2024-08-02T18:29:02.375 INFO:root:teuthology version: 0.0.1.dev379+g53ce146 2024-08-02T18:29:02.401 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-02T18:29:02.491 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803 branch: squid-release description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} email: yweinste@redhat.com first_in_suite: false job_id: '7832803' kernel: client: sha1: distro kdb: 1 sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules - exec: mon.a: - ceph mgr module enable snap_schedule name: yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid-release ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 3 session_timeout: 300 standby_replay: true conf: client: client dirsize rbytes: false client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: ms die on skipped message: false mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: cephsqlite lock renewal timeout: 900000 debug cephsqlite: 20 debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 mon warn on pool no app: false osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 osd shutdown pgref assert: true osd_max_omap_entries_per_request: 10000 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - MON_DOWN - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - Degraded data redundancy - slow metadata IO - SLOW_OPS - slow request sha1: 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea subvols: create: 2 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs ceph-fuse: client.0: mount_subvol_num: 0 check-counter: counters: mds: - mds.exported - mds.imported - mds.root_rsnaps - mds_server.req_mksnap_latency.avgcount - mds_server.req_rmsnap_latency.avgcount install: ceph: flavor: default sha1: 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea kclient: client.0: mount_subvol_num: 1 mntopts: - ms_mode=secure - nowsync rbytes: false syntax: v1 selinux: allowlist: - scontext=system_u:system_r:logrotate_t:s0 - scontext=system_u:system_r:getty_t:s0 - scontext=system_u:system_r:getty_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: squid-release sha1: 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea owner: scheduled_yuriw@teuthology priority: 99 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - mgr.x - mds.a - mds.d - mds.g - mds.j - osd.0 - osd.3 - osd.6 - osd.9 - client.0 - - mon.b - mgr.y - mds.b - mds.e - mds.h - mds.k - osd.1 - osd.4 - osd.7 - osd.10 - - mon.c - mgr.z - mds.c - mds.f - mds.i - mds.l - osd.2 - osd.5 - osd.8 - osd.11 seed: 4941 sha1: 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: squid-release suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi103.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfJBrcsHaqSOao5qMsp7w8fitB4JehlHfWFFXb9SsuVUbq2ZB8F9IQ5nhnG5w7T9SPemhf6lkOfIzTvuQLjZGs= smithi121.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8/6LBw7w59z52M5+gU1C95QwYVH0DVgjuErVcvXAGg5D+e+GvEgvg2I+04+X/IonZGw+xBIE97neE7Z1YkfvU= smithi151.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF9wxRTQLa1aR1BKnDQKG6by5WqIDcj7reqsmUw/11C8Pr2XSH2WfKgzyMMhx6l86kaP0SSFqDtQc1Ls63GWGSU= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - cephadm: roleless: false - cephadm.shell: mon.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: mon.a: - ceph fs dump - ceph osd dump - fs.ready: timeout: 300 - sequential: - mgrmodules - kclient: null - exec: mon.a: - ceph fs set cephfs balance_automate true - check-counter: {} - fwd_scrub: scrub_timeout: 900 sleep_between_iterations: 1 - exec: mon.a: - ceph config set mgr mgr/snap_schedule/log_level debug - ceph config set mgr mgr/snap_schedule/allow_m_granularity true - ceph config set mgr mgr/snap_schedule/dump_on_update true - ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m - ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - date +%s > START_TIME - full_sequential_finally: - exec: mon.a: - date +%s > END_TIME - START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi - ceph fs snap-schedule status --fs=cephfs --path=/ - ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true - background_exec: mon.a: - while sleep 13; do ceph tell mds.cephfs:0 flush journal; done - quiescer: null - workunit: clients: all: - fs/norstats teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return yaml.ktype == 'upstream' end - local function is_kdistro() return yaml.ktype == 'distro' end - local function is_fuse() return false end - local function syntax_version() return yaml.overrides.kclient.syntax end teuthology_branch: main teuthology_sha1: 53ce1462e129f6eb4071986336534c740fdebd31 timestamp: 2024-08-02_15:32:26 tube: smithi user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.4074525 2024-08-02T18:29:02.491 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa; will attempt to use it 2024-08-02T18:29:02.492 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa/tasks 2024-08-02T18:29:02.492 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-08-02T18:29:02.493 INFO:teuthology.task.internal:Checking packages... 2024-08-02T18:29:02.513 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea' 2024-08-02T18:29:02.513 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-08-02T18:29:02.513 INFO:teuthology.packaging:ref: None 2024-08-02T18:29:02.514 INFO:teuthology.packaging:tag: None 2024-08-02T18:29:02.514 INFO:teuthology.packaging:branch: squid-release 2024-08-02T18:29:02.514 INFO:teuthology.packaging:sha1: 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:29:02.514 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid-release 2024-08-02T18:29:02.662 INFO:teuthology.task.internal:Found packages for ceph version 19.1.0-1260.g26c3fb8e 2024-08-02T18:29:02.663 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-08-02T18:29:02.670 INFO:teuthology.task.internal:no buildpackages task found 2024-08-02T18:29:02.670 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-08-02T18:29:02.680 INFO:teuthology.task.internal:Saving configuration 2024-08-02T18:29:02.701 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-08-02T18:29:02.708 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-08-02T18:29:02.729 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi103.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-02 18:22:59.298244', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLfJBrcsHaqSOao5qMsp7w8fitB4JehlHfWFFXb9SsuVUbq2ZB8F9IQ5nhnG5w7T9SPemhf6lkOfIzTvuQLjZGs='} 2024-08-02T18:29:02.752 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi121.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-02 18:22:59.299534', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBN8/6LBw7w59z52M5+gU1C95QwYVH0DVgjuErVcvXAGg5D+e+GvEgvg2I+04+X/IonZGw+xBIE97neE7Z1YkfvU='} 2024-08-02T18:29:02.769 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi151.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-08-02 18:22:59.300809', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBF9wxRTQLa1aR1BKnDQKG6by5WqIDcj7reqsmUw/11C8Pr2XSH2WfKgzyMMhx6l86kaP0SSFqDtQc1Ls63GWGSU='} 2024-08-02T18:29:02.769 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-08-02T18:29:02.774 INFO:teuthology.task.internal:roles: ubuntu@smithi103.front.sepia.ceph.com - ['mon.a', 'mgr.x', 'mds.a', 'mds.d', 'mds.g', 'mds.j', 'osd.0', 'osd.3', 'osd.6', 'osd.9', 'client.0'] 2024-08-02T18:29:02.775 INFO:teuthology.task.internal:roles: ubuntu@smithi121.front.sepia.ceph.com - ['mon.b', 'mgr.y', 'mds.b', 'mds.e', 'mds.h', 'mds.k', 'osd.1', 'osd.4', 'osd.7', 'osd.10'] 2024-08-02T18:29:02.775 INFO:teuthology.task.internal:roles: ubuntu@smithi151.front.sepia.ceph.com - ['mon.c', 'mgr.z', 'mds.c', 'mds.f', 'mds.i', 'mds.l', 'osd.2', 'osd.5', 'osd.8', 'osd.11'] 2024-08-02T18:29:02.775 INFO:teuthology.run_tasks:Running task console_log... 2024-08-02T18:29:02.994 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fc859ae3ac0>, signals=[15]) 2024-08-02T18:29:02.995 INFO:teuthology.run_tasks:Running task internal.connect... 2024-08-02T18:29:02.999 INFO:teuthology.task.internal:Opening connections... 2024-08-02T18:29:03.000 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:29:03.001 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:29:03.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi121.front.sepia.ceph.com 2024-08-02T18:29:03.077 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:29:03.158 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi151.front.sepia.ceph.com 2024-08-02T18:29:03.159 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:29:03.234 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-08-02T18:29:03.240 DEBUG:teuthology.orchestra.run.smithi103:> uname -m 2024-08-02T18:29:03.258 INFO:teuthology.orchestra.run.smithi103.stdout:x86_64 2024-08-02T18:29:03.259 DEBUG:teuthology.orchestra.run.smithi103:> cat /etc/os-release 2024-08-02T18:29:03.316 INFO:teuthology.orchestra.run.smithi103.stdout:NAME="CentOS Stream" 2024-08-02T18:29:03.316 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION="9" 2024-08-02T18:29:03.316 INFO:teuthology.orchestra.run.smithi103.stdout:ID="centos" 2024-08-02T18:29:03.316 INFO:teuthology.orchestra.run.smithi103.stdout:ID_LIKE="rhel fedora" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:VERSION_ID="9" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:PLATFORM_ID="platform:el9" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:ANSI_COLOR="0;31" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:LOGO="fedora-logo-icon" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:HOME_URL="https://centos.org/" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-02T18:29:03.317 INFO:teuthology.orchestra.run.smithi103.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-02T18:29:03.318 INFO:teuthology.lock.ops:Updating smithi103.front.sepia.ceph.com on lock server 2024-08-02T18:29:03.340 DEBUG:teuthology.orchestra.run.smithi121:> uname -m 2024-08-02T18:29:03.358 INFO:teuthology.orchestra.run.smithi121.stdout:x86_64 2024-08-02T18:29:03.358 DEBUG:teuthology.orchestra.run.smithi121:> cat /etc/os-release 2024-08-02T18:29:03.415 INFO:teuthology.orchestra.run.smithi121.stdout:NAME="CentOS Stream" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION="9" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:ID="centos" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:ID_LIKE="rhel fedora" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:VERSION_ID="9" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:PLATFORM_ID="platform:el9" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:ANSI_COLOR="0;31" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:LOGO="fedora-logo-icon" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:HOME_URL="https://centos.org/" 2024-08-02T18:29:03.416 INFO:teuthology.orchestra.run.smithi121.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-02T18:29:03.417 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-02T18:29:03.417 INFO:teuthology.orchestra.run.smithi121.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-02T18:29:03.417 INFO:teuthology.lock.ops:Updating smithi121.front.sepia.ceph.com on lock server 2024-08-02T18:29:03.440 DEBUG:teuthology.orchestra.run.smithi151:> uname -m 2024-08-02T18:29:03.458 INFO:teuthology.orchestra.run.smithi151.stdout:x86_64 2024-08-02T18:29:03.458 DEBUG:teuthology.orchestra.run.smithi151:> cat /etc/os-release 2024-08-02T18:29:03.515 INFO:teuthology.orchestra.run.smithi151.stdout:NAME="CentOS Stream" 2024-08-02T18:29:03.515 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION="9" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:ID="centos" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:ID_LIKE="rhel fedora" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:VERSION_ID="9" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:PLATFORM_ID="platform:el9" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:PRETTY_NAME="CentOS Stream 9" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:ANSI_COLOR="0;31" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:LOGO="fedora-logo-icon" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:HOME_URL="https://centos.org/" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-08-02T18:29:03.516 INFO:teuthology.orchestra.run.smithi151.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-08-02T18:29:03.517 INFO:teuthology.lock.ops:Updating smithi151.front.sepia.ceph.com on lock server 2024-08-02T18:29:03.540 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-08-02T18:29:03.551 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-08-02T18:29:03.556 INFO:teuthology.task.internal:Checking for old test directory... 2024-08-02T18:29:03.556 DEBUG:teuthology.orchestra.run.smithi103:> test '!' -e /home/ubuntu/cephtest 2024-08-02T18:29:03.559 DEBUG:teuthology.orchestra.run.smithi121:> test '!' -e /home/ubuntu/cephtest 2024-08-02T18:29:03.561 DEBUG:teuthology.orchestra.run.smithi151:> test '!' -e /home/ubuntu/cephtest 2024-08-02T18:29:03.577 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-08-02T18:29:03.583 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-08-02T18:29:03.583 DEBUG:teuthology.orchestra.run.smithi103:> test -z $(ls -A /var/lib/ceph) 2024-08-02T18:29:03.616 DEBUG:teuthology.orchestra.run.smithi121:> test -z $(ls -A /var/lib/ceph) 2024-08-02T18:29:03.619 DEBUG:teuthology.orchestra.run.smithi151:> test -z $(ls -A /var/lib/ceph) 2024-08-02T18:29:03.725 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-08-02T18:29:03.799 INFO:teuthology.run_tasks:Running task kernel... 2024-08-02T18:29:03.815 INFO:teuthology.task.kernel:normalize config orig: {'client': {'sha1': 'distro'}, 'kdb': 1, 'sha1': 'distro'} 2024-08-02T18:29:03.815 INFO:teuthology.task.kernel:normalize config final: {'client.0': {'sha1': 'distro'}} 2024-08-02T18:29:03.815 INFO:teuthology.task.kernel:config {'client.0': {'sha1': 'distro'}}, timeout 300 2024-08-02T18:29:03.815 DEBUG:teuthology.orchestra.run.smithi103:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-02T18:29:03.832 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T18:29:03.833 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-08-02T18:29:03.890 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-437.el9.x86_64 2024-08-02T18:29:03.890 INFO:teuthology.task.kernel:Running kernel on smithi103: 5.14.0-437.el9.x86_64 2024-08-02T18:29:03.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum install -y kernel 2024-08-02T18:29:08.261 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 3.1 MB/s | 8.2 MB 00:02 2024-08-02T18:29:17.453 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 2.5 MB/s | 20 MB 00:08 2024-08-02T18:29:22.962 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.6 MB 00:01 2024-08-02T18:29:24.829 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 35 kB/s | 18 kB 00:00 2024-08-02T18:29:25.683 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 31 MB/s | 22 MB 00:00 2024-08-02T18:29:31.030 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 30 kB/s | 1.7 kB 00:00 2024-08-02T18:29:33.037 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-08-02T18:29:33.037 INFO:teuthology.orchestra.run.smithi103.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-08-02T18:29:33.136 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-08-02T18:29:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-02T18:29:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: Package Architecture Version Repository Size 2024-08-02T18:29:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-02T18:29:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-08-02T18:29:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: kernel x86_64 5.14.0-480.el9 baseos 1.5 M 2024-08-02T18:29:33.146 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-08-02T18:29:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core x86_64 5.14.0-480.el9 baseos 17 M 2024-08-02T18:29:33.146 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules x86_64 5.14.0-480.el9 baseos 36 M 2024-08-02T18:29:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core x86_64 5.14.0-480.el9 baseos 30 M 2024-08-02T18:29:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:29:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-08-02T18:29:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:================================================================================ 2024-08-02T18:29:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:Install 4 Packages 2024-08-02T18:29:33.147 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:29:33.147 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 84 M 2024-08-02T18:29:33.148 INFO:teuthology.orchestra.run.smithi103.stdout:Installed size: 126 M 2024-08-02T18:29:33.148 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-08-02T18:29:33.507 INFO:teuthology.orchestra.run.smithi103.stdout:(1/4): kernel-5.14.0-480.el9.x86_64.rpm 6.4 MB/s | 1.5 MB 00:00 2024-08-02T18:29:33.782 INFO:teuthology.orchestra.run.smithi103.stdout:(2/4): kernel-core-5.14.0-480.el9.x86_64.rpm 33 MB/s | 17 MB 00:00 2024-08-02T18:29:34.241 INFO:teuthology.orchestra.run.smithi103.stdout:(3/4): kernel-modules-5.14.0-480.el9.x86_64.rpm 37 MB/s | 36 MB 00:00 2024-08-02T18:29:34.525 INFO:teuthology.orchestra.run.smithi103.stdout:(4/4): kernel-modules-core-5.14.0-480.el9.x86_6 29 MB/s | 30 MB 00:01 2024-08-02T18:29:34.525 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-08-02T18:29:34.525 INFO:teuthology.orchestra.run.smithi103.stdout:Total 61 MB/s | 84 MB 00:01 2024-08-02T18:29:35.255 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-08-02T18:29:35.596 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-08-02T18:29:35.596 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-08-02T18:29:36.584 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-08-02T18:29:36.585 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-08-02T18:29:39.007 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-08-02T18:29:39.665 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-core-5.14.0-480.el9.x86_64 1/4 2024-08-02T18:29:39.760 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-02T18:29:42.417 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-02T18:29:42.567 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-02T18:29:47.391 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-02T18:29:47.526 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : kernel-5.14.0-480.el9.x86_64 4/4 2024-08-02T18:29:52.391 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-08-02T18:30:22.184 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-core-5.14.0-480.el9.x86_64 4/4 2024-08-02T18:30:22.224 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-modules-5.14.0-480.el9.x86_64 4/4 2024-08-02T18:30:22.545 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: kernel-5.14.0-480.el9.x86_64 4/4 2024-08-02T18:30:22.546 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-5.14.0-480.el9.x86_64 1/4 2024-08-02T18:30:22.546 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-core-5.14.0-480.el9.x86_64 2/4 2024-08-02T18:30:22.546 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-5.14.0-480.el9.x86_64 3/4 2024-08-02T18:30:23.352 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : kernel-modules-core-5.14.0-480.el9.x86_64 4/4 2024-08-02T18:30:23.352 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:30:23.352 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-08-02T18:30:23.352 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-5.14.0-480.el9.x86_64 2024-08-02T18:30:23.352 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-core-5.14.0-480.el9.x86_64 2024-08-02T18:30:23.352 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-5.14.0-480.el9.x86_64 2024-08-02T18:30:23.352 INFO:teuthology.orchestra.run.smithi103.stdout: kernel-modules-core-5.14.0-480.el9.x86_64 2024-08-02T18:30:23.353 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:30:23.353 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-08-02T18:30:23.762 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-08-02T18:30:23.854 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-02T18:30:23.854 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-02T18:30:23.854 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-480.el9.x86_64 2024-08-02T18:30:23.854 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-08-02T18:30:23.854 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-08-02T18:30:23.855 INFO:teuthology.task.kernel:Installing distro kernel on client.0... 2024-08-02T18:30:23.855 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi103.front.sepia.ceph.com, path=None, version=distro) 2024-08-02T18:30:23.855 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q kernel | sort -rV | head -n 1 2024-08-02T18:30:23.913 INFO:teuthology.orchestra.run.smithi103.stdout:kernel-5.14.0-480.el9.x86_64 2024-08-02T18:30:23.913 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-480.el9.x86_64 2024-08-02T18:30:23.913 DEBUG:teuthology.orchestra.run.smithi103:> sudo rpm -qi grub2-tools 2024-08-02T18:30:23.947 INFO:teuthology.orchestra.run.smithi103.stdout:Name : grub2-tools 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Epoch : 1 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Version : 2.06 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Release : 68.el9 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Architecture: x86_64 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Group : Unspecified 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Size : 8264254 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:License : GPLv3+ 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-08-02T18:30:23.948 INFO:teuthology.orchestra.run.smithi103.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:Packager : builder@centos.org 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:Vendor : CentOS 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:URL : http://www.gnu.org/software/grub/ 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:Summary : Support tools for GRUB. 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:Description : 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:customizable bootloader with modular architecture. It supports a rich 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:variety of kernel formats, file systems, computer architectures and 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:hardware devices. 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:30:23.949 INFO:teuthology.orchestra.run.smithi103.stdout:This subpackage provides tools for support of all platforms. 2024-08-02T18:30:23.950 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-08-02T18:30:23.950 INFO:teuthology.task.kernel:Updating grub on smithi103 to boot 5.14.0-480.el9.x86_64 2024-08-02T18:30:23.951 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-08-02T18:30:24.578 INFO:teuthology.orchestra.run.smithi103.stderr:Generating grub configuration file ... 2024-08-02T18:30:25.977 INFO:teuthology.orchestra.run.smithi103.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-08-02T18:30:26.000 INFO:teuthology.orchestra.run.smithi103.stderr:done 2024-08-02T18:30:26.002 DEBUG:teuthology.orchestra.run.smithi103:> mktemp 2024-08-02T18:30:26.022 INFO:teuthology.orchestra.run.smithi103.stdout:/tmp/tmp.5pqfId9jJh 2024-08-02T18:30:26.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.5pqfId9jJh 2024-08-02T18:30:26.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0666 /tmp/tmp.5pqfId9jJh 2024-08-02T18:30:26.240 DEBUG:teuthology.orchestra.remote:smithi103:/tmp/tmp.5pqfId9jJh is 6KB 2024-08-02T18:30:26.288 DEBUG:teuthology.orchestra.run.smithi103:> rm -fr /tmp/tmp.5pqfId9jJh 2024-08-02T18:30:26.302 DEBUG:teuthology.orchestra.run.smithi103:> sudo /bin/ls /boot/loader/entries || true 2024-08-02T18:30:26.363 INFO:teuthology.orchestra.run.smithi103.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-08-02T18:30:26.363 INFO:teuthology.orchestra.run.smithi103.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-08-02T18:30:26.363 INFO:teuthology.orchestra.run.smithi103.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-08-02T18:30:26.363 INFO:teuthology.orchestra.run.smithi103.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64.conf 2024-08-02T18:30:26.365 DEBUG:teuthology.orchestra.run.smithi103:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-480.el9.x86_64 2024-08-02T18:30:26.502 DEBUG:teuthology.orchestra.run.smithi103:> sudo shutdown -r now 2024-08-02T18:30:56.505 INFO:teuthology.task.kernel:Checking client client.0 for new kernel version... 2024-08-02T18:30:56.506 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-08-02T18:30:56.507 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:31:31.039 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-08-02T18:31:40.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-08-02T18:31:40.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:31:43.106 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.103 2024-08-02T18:31:55.107 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-08-02T18:31:55.108 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:32:26.940 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-08-02T18:32:27.366 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-08-02T18:32:27.366 INFO:teuthology.task.kernel:Checking kernel version of client.0, want "5.14.0-480.el9.x86_64"... 2024-08-02T18:32:27.367 DEBUG:teuthology.orchestra.run.smithi103:> uname -r 2024-08-02T18:32:27.382 INFO:teuthology.orchestra.run.smithi103.stdout:5.14.0-480.el9.x86_64 2024-08-02T18:32:27.382 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-480.el9.x86_64 vs 5.14.0-480.el9.x86_64 2024-08-02T18:32:27.382 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-08-02T18:32:27.382 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-08-02T18:32:28.384 DEBUG:teuthology.parallel:result is None 2024-08-02T18:32:28.384 INFO:teuthology.run_tasks:Running task internal.base... 2024-08-02T18:32:28.392 INFO:teuthology.task.internal:Creating test directory... 2024-08-02T18:32:28.392 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-02T18:32:28.394 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-02T18:32:28.397 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-08-02T18:32:28.415 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-08-02T18:32:28.421 INFO:teuthology.run_tasks:Running task internal.archive... 2024-08-02T18:32:28.432 INFO:teuthology.task.internal:Creating archive directory... 2024-08-02T18:32:28.432 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-02T18:32:28.447 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-02T18:32:28.455 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-08-02T18:32:28.574 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-08-02T18:32:28.589 INFO:teuthology.task.internal:Enabling coredump saving... 2024-08-02T18:32:28.589 DEBUG:teuthology.orchestra.run.smithi121:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-02T18:32:28.605 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T18:32:28.606 DEBUG:teuthology.orchestra.run.smithi151:> test -f /run/.containerenv -o -f /.dockerenv 2024-08-02T18:32:28.622 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T18:32:28.622 DEBUG:teuthology.orchestra.run.smithi103:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-02T18:32:28.625 DEBUG:teuthology.orchestra.run.smithi121:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-02T18:32:28.649 DEBUG:teuthology.orchestra.run.smithi151:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-08-02T18:32:28.679 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-02T18:32:28.694 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-02T18:32:28.696 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-02T18:32:28.719 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-02T18:32:28.720 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-02T18:32:28.739 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-08-02T18:32:28.741 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-08-02T18:32:28.748 INFO:teuthology.task.internal:Configuring sudo... 2024-08-02T18:32:28.749 DEBUG:teuthology.orchestra.run.smithi103:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-02T18:32:28.751 DEBUG:teuthology.orchestra.run.smithi121:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-02T18:32:28.753 DEBUG:teuthology.orchestra.run.smithi151:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-08-02T18:32:28.780 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-08-02T18:32:28.790 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-08-02T18:32:28.790 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-02T18:32:28.812 DEBUG:teuthology.orchestra.run.smithi121:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-02T18:32:28.819 DEBUG:teuthology.orchestra.run.smithi151:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-08-02T18:32:28.837 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-02T18:32:28.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-02T18:32:28.955 DEBUG:teuthology.orchestra.run.smithi103:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-02T18:32:29.035 DEBUG:teuthology.orchestra.run.smithi103:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-02T18:32:29.072 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:32:29.072 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-02T18:32:29.135 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-02T18:32:29.179 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-02T18:32:29.228 DEBUG:teuthology.orchestra.run.smithi121:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-02T18:32:29.310 DEBUG:teuthology.orchestra.run.smithi121:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-02T18:32:29.353 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:32:29.353 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-02T18:32:29.419 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-02T18:32:29.464 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-08-02T18:32:29.515 DEBUG:teuthology.orchestra.run.smithi151:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-02T18:32:29.600 DEBUG:teuthology.orchestra.run.smithi151:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-08-02T18:32:29.640 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:32:29.641 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-08-02T18:32:29.706 DEBUG:teuthology.orchestra.run.smithi103:> sudo service rsyslog restart 2024-08-02T18:32:29.709 DEBUG:teuthology.orchestra.run.smithi121:> sudo service rsyslog restart 2024-08-02T18:32:29.711 DEBUG:teuthology.orchestra.run.smithi151:> sudo service rsyslog restart 2024-08-02T18:32:29.743 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-02T18:32:29.745 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-02T18:32:29.796 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-02T18:32:30.230 INFO:teuthology.run_tasks:Running task internal.timer... 2024-08-02T18:32:30.243 INFO:teuthology.task.internal:Starting timer... 2024-08-02T18:32:30.244 INFO:teuthology.run_tasks:Running task pcp... 2024-08-02T18:32:30.256 INFO:teuthology.run_tasks:Running task selinux... 2024-08-02T18:32:30.267 DEBUG:teuthology.task:Applying overrides for task selinux: {'allowlist': ['scontext=system_u:system_r:logrotate_t:s0', 'scontext=system_u:system_r:getty_t:s0', 'scontext=system_u:system_r:getty_t:s0']} 2024-08-02T18:32:30.267 DEBUG:teuthology.orchestra.run.smithi103:> sudo service auditd rotate 2024-08-02T18:32:30.349 INFO:teuthology.orchestra.run.smithi103.stdout:Rotating logs: 2024-08-02T18:32:30.351 DEBUG:teuthology.orchestra.run.smithi121:> sudo service auditd rotate 2024-08-02T18:32:30.422 INFO:teuthology.orchestra.run.smithi121.stdout:Rotating logs: 2024-08-02T18:32:30.424 DEBUG:teuthology.orchestra.run.smithi151:> sudo service auditd rotate 2024-08-02T18:32:30.486 INFO:teuthology.orchestra.run.smithi151.stdout:Rotating logs: 2024-08-02T18:32:30.488 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-08-02T18:32:30.488 DEBUG:teuthology.orchestra.run.smithi103:> /usr/sbin/getenforce 2024-08-02T18:32:30.510 INFO:teuthology.orchestra.run.smithi103.stdout:Permissive 2024-08-02T18:32:30.510 DEBUG:teuthology.orchestra.run.smithi121:> /usr/sbin/getenforce 2024-08-02T18:32:30.534 INFO:teuthology.orchestra.run.smithi121.stdout:Permissive 2024-08-02T18:32:30.535 DEBUG:teuthology.orchestra.run.smithi151:> /usr/sbin/getenforce 2024-08-02T18:32:30.558 INFO:teuthology.orchestra.run.smithi151.stdout:Permissive 2024-08-02T18:32:30.559 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi103.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi121.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi151.front.sepia.ceph.com': 'permissive'} 2024-08-02T18:32:30.559 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-02T18:32:30.585 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T18:32:30.586 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-02T18:32:30.612 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T18:32:30.612 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-02T18:32:30.637 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T18:32:30.638 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-08-02T18:32:30.638 DEBUG:teuthology.orchestra.run.smithi103:> sudo /usr/sbin/setenforce permissive 2024-08-02T18:32:30.664 DEBUG:teuthology.orchestra.run.smithi121:> sudo /usr/sbin/setenforce permissive 2024-08-02T18:32:30.692 DEBUG:teuthology.orchestra.run.smithi151:> sudo /usr/sbin/setenforce permissive 2024-08-02T18:32:30.727 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-08-02T18:32:30.738 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-08-02T18:32:30.750 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-08-02T18:32:30.751 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi103.front.sepia.ceph.com,smithi121.front.sepia.ceph.com,smithi151.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-08-02T18:37:25.356 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi103.front.sepia.ceph.com'), Remote(name='ubuntu@smithi121.front.sepia.ceph.com'), Remote(name='ubuntu@smithi151.front.sepia.ceph.com')] 2024-08-02T18:37:25.358 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-08-02T18:37:25.359 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi103.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:37:25.436 DEBUG:teuthology.orchestra.run.smithi103:> true 2024-08-02T18:37:25.518 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi103.front.sepia.ceph.com' 2024-08-02T18:37:25.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-02T18:37:25.519 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi121.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:37:25.594 DEBUG:teuthology.orchestra.run.smithi121:> true 2024-08-02T18:37:25.669 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi121.front.sepia.ceph.com' 2024-08-02T18:37:25.670 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-08-02T18:37:25.670 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi151.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-08-02T18:37:25.746 DEBUG:teuthology.orchestra.run.smithi151:> true 2024-08-02T18:37:25.840 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi151.front.sepia.ceph.com' 2024-08-02T18:37:25.841 INFO:teuthology.run_tasks:Running task clock... 2024-08-02T18:37:25.852 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-08-02T18:37:25.852 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-02T18:37:25.852 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-02T18:37:25.855 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-02T18:37:25.855 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-02T18:37:25.857 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-08-02T18:37:25.857 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-02T18:37:25.883 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-02T18:37:25.883 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-02T18:37:25.897 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-02T18:37:25.899 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-02T18:37:25.913 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-08-02T18:37:25.919 INFO:teuthology.orchestra.run.smithi121.stderr:sudo: ntpd: command not found 2024-08-02T18:37:25.923 INFO:teuthology.orchestra.run.smithi103.stderr:sudo: ntpd: command not found 2024-08-02T18:37:25.928 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-08-02T18:37:25.929 INFO:teuthology.orchestra.run.smithi121.stdout:506 Cannot talk to daemon 2024-08-02T18:37:25.935 INFO:teuthology.orchestra.run.smithi103.stdout:506 Cannot talk to daemon 2024-08-02T18:37:25.942 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-02T18:37:25.949 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-02T18:37:25.952 INFO:teuthology.orchestra.run.smithi151.stderr:sudo: ntpd: command not found 2024-08-02T18:37:25.955 INFO:teuthology.orchestra.run.smithi121.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-02T18:37:25.963 INFO:teuthology.orchestra.run.smithi103.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-02T18:37:25.964 INFO:teuthology.orchestra.run.smithi151.stdout:506 Cannot talk to daemon 2024-08-02T18:37:25.978 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-08-02T18:37:25.992 INFO:teuthology.orchestra.run.smithi151.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-08-02T18:37:26.008 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-08-02T18:37:26.011 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-02T18:37:26.011 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-08-02T18:37:26.011 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.011 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.012 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.012 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.020 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-08-02T18:37:26.026 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-02T18:37:26.027 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-08-02T18:37:26.027 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.027 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.027 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.027 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.045 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-08-02T18:37:26.048 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-02T18:37:26.048 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-08-02T18:37:26.048 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.048 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.048 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.048 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T18:37:26.049 INFO:teuthology.run_tasks:Running task install... 2024-08-02T18:37:26.058 DEBUG:teuthology.task.install:project ceph 2024-08-02T18:37:26.058 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea'}} 2024-08-02T18:37:26.058 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea'} 2024-08-02T18:37:26.059 INFO:teuthology.task.install:Using flavor: default 2024-08-02T18:37:26.064 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-08-02T18:37:26.064 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-08-02T18:37:26.064 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea', 'tag': None, 'wait_for_package': False} 2024-08-02T18:37:26.065 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:37:26.067 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea', 'tag': None, 'wait_for_package': False} 2024-08-02T18:37:26.067 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:37:26.068 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea', 'tag': None, 'wait_for_package': False} 2024-08-02T18:37:26.068 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:37:26.215 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/ 2024-08-02T18:37:26.215 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1260.g26c3fb8e 2024-08-02T18:37:26.219 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/ 2024-08-02T18:37:26.219 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1260.g26c3fb8e 2024-08-02T18:37:26.229 INFO:teuthology.task.install.rpm:Pulling from https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/ 2024-08-02T18:37:26.230 INFO:teuthology.task.install.rpm:Package version is 19.1.0-1260.g26c3fb8e 2024-08-02T18:37:26.326 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-02T18:37:26.327 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:37:26.327 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-02T18:37:26.331 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-02T18:37:26.332 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:37:26.332 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-02T18:37:26.337 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-08-02T18:37:26.337 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:37:26.337 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-08-02T18:37:26.353 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-02T18:37:26.354 DEBUG:teuthology.orchestra.run.smithi103:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-02T18:37:26.356 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-02T18:37:26.356 DEBUG:teuthology.orchestra.run.smithi151:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-02T18:37:26.362 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2024-08-02T18:37:26.362 DEBUG:teuthology.orchestra.run.smithi121:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-08-02T18:37:26.421 DEBUG:teuthology.orchestra.run.smithi103:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-02T18:37:26.423 DEBUG:teuthology.orchestra.run.smithi151:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-02T18:37:26.425 DEBUG:teuthology.orchestra.run.smithi121:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-08-02T18:37:26.496 DEBUG:teuthology.orchestra.run.smithi151:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-02T18:37:26.497 DEBUG:teuthology.orchestra.run.smithi103:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-02T18:37:26.498 DEBUG:teuthology.orchestra.run.smithi121:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-08-02T18:37:26.559 INFO:teuthology.orchestra.run.smithi151.stdout:check_obsoletes = 1 2024-08-02T18:37:26.560 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum clean all 2024-08-02T18:37:26.561 INFO:teuthology.orchestra.run.smithi103.stdout:check_obsoletes = 1 2024-08-02T18:37:26.561 INFO:teuthology.orchestra.run.smithi121.stdout:check_obsoletes = 1 2024-08-02T18:37:26.562 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum clean all 2024-08-02T18:37:26.563 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum clean all 2024-08-02T18:37:26.783 INFO:teuthology.orchestra.run.smithi121.stdout:45 files removed 2024-08-02T18:37:26.786 INFO:teuthology.orchestra.run.smithi151.stdout:45 files removed 2024-08-02T18:37:26.799 INFO:teuthology.orchestra.run.smithi103.stdout:45 files removed 2024-08-02T18:37:26.809 DEBUG:teuthology.orchestra.run.smithi121:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-02T18:37:26.813 DEBUG:teuthology.orchestra.run.smithi151:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-02T18:37:26.829 DEBUG:teuthology.orchestra.run.smithi103:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2024-08-02T18:37:27.389 INFO:teuthology.orchestra.run.smithi121.stdout:ceph packages for x86_64 262 kB/s | 84 kB 00:00 2024-08-02T18:37:27.400 INFO:teuthology.orchestra.run.smithi151.stdout:ceph packages for x86_64 257 kB/s | 84 kB 00:00 2024-08-02T18:37:27.410 INFO:teuthology.orchestra.run.smithi103.stdout:ceph packages for x86_64 276 kB/s | 84 kB 00:00 2024-08-02T18:37:27.717 INFO:teuthology.orchestra.run.smithi151.stdout:ceph noarch packages 42 kB/s | 12 kB 00:00 2024-08-02T18:37:27.722 INFO:teuthology.orchestra.run.smithi121.stdout:ceph noarch packages 40 kB/s | 12 kB 00:00 2024-08-02T18:37:27.743 INFO:teuthology.orchestra.run.smithi103.stdout:ceph noarch packages 41 kB/s | 12 kB 00:00 2024-08-02T18:37:28.048 INFO:teuthology.orchestra.run.smithi121.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-08-02T18:37:28.050 INFO:teuthology.orchestra.run.smithi151.stdout:ceph source packages 6.3 kB/s | 1.9 kB 00:00 2024-08-02T18:37:28.078 INFO:teuthology.orchestra.run.smithi103.stdout:ceph source packages 6.5 kB/s | 1.9 kB 00:00 2024-08-02T18:37:29.516 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - BaseOS 5.9 MB/s | 8.2 MB 00:01 2024-08-02T18:37:29.826 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.2 MB 00:01 2024-08-02T18:37:30.631 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - BaseOS 3.2 MB/s | 8.2 MB 00:02 2024-08-02T18:37:32.810 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - AppStream 11 MB/s | 20 MB 00:01 2024-08-02T18:37:32.915 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - AppStream 8.6 MB/s | 20 MB 00:02 2024-08-02T18:37:35.582 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - AppStream 5.2 MB/s | 20 MB 00:03 2024-08-02T18:37:37.377 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - CRB 12 MB/s | 6.6 MB 00:00 2024-08-02T18:37:37.500 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 6.6 MB 00:00 2024-08-02T18:37:38.894 INFO:teuthology.orchestra.run.smithi151.stdout:CentOS Stream 9 - Extras packages 57 kB/s | 18 kB 00:00 2024-08-02T18:37:39.309 INFO:teuthology.orchestra.run.smithi103.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 18 kB 00:00 2024-08-02T18:37:40.032 INFO:teuthology.orchestra.run.smithi151.stdout:Extra Packages for Enterprise Linux 22 MB/s | 22 MB 00:01 2024-08-02T18:37:40.530 INFO:teuthology.orchestra.run.smithi103.stdout:Extra Packages for Enterprise Linux 20 MB/s | 22 MB 00:01 2024-08-02T18:37:41.965 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - CRB 2.5 MB/s | 6.6 MB 00:02 2024-08-02T18:37:43.674 INFO:teuthology.orchestra.run.smithi121.stdout:CentOS Stream 9 - Extras packages 37 kB/s | 18 kB 00:00 2024-08-02T18:37:44.503 INFO:teuthology.orchestra.run.smithi121.stdout:Extra Packages for Enterprise Linux 32 MB/s | 22 MB 00:00 2024-08-02T18:37:45.371 INFO:teuthology.orchestra.run.smithi151.stdout:lab-extras 39 kB/s | 1.7 kB 00:00 2024-08-02T18:37:45.861 INFO:teuthology.orchestra.run.smithi103.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-08-02T18:37:47.639 INFO:teuthology.orchestra.run.smithi151.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-02T18:37:47.640 INFO:teuthology.orchestra.run.smithi151.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-02T18:37:47.651 INFO:teuthology.orchestra.run.smithi151.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-02T18:37:47.651 INFO:teuthology.orchestra.run.smithi151.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-02T18:37:47.652 INFO:teuthology.orchestra.run.smithi151.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-02T18:37:47.653 INFO:teuthology.orchestra.run.smithi151.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-02T18:37:47.655 INFO:teuthology.orchestra.run.smithi151.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-02T18:37:47.657 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-02T18:37:47.658 INFO:teuthology.orchestra.run.smithi151.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-02T18:37:47.721 INFO:teuthology.orchestra.run.smithi151.stdout:Dependencies resolved. 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: Package Arch Version Repository Size 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout:Installing: 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: ceph x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 6.6 k 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 5.4 M 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 897 k 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 145 k 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 1.5 M 2024-08-02T18:37:47.739 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 146 k 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 3.6 M 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 7.4 M 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 49 k 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 11 M 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 49 M 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 274 k 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 765 k 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 224 k 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 27 k 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 18 k 2024-08-02T18:37:47.740 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 32 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 751 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 127 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-02T18:37:47.741 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 188 k 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 372 k 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 349 k 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 116 k 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 85 k 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.1 M 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 170 k 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrading: 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-02T18:37:47.742 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: librados2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.4 M 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.2 M 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout:Installing dependencies: 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-02T18:37:47.743 INFO:teuthology.orchestra.run.smithi151.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 21 M 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 32 k 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 2.4 M 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 249 k 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 4.7 M 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 17 M 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 16 k 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 25 k 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-02T18:37:47.744 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 164 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-02T18:37:47.745 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 507 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 5.4 M 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-02T18:37:47.746 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 45 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 136 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-02T18:37:47.747 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-02T18:37:47.748 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-02T18:37:47.749 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-02T18:37:47.750 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-02T18:37:47.751 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout:Installing weak dependencies: 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction Summary 2024-08-02T18:37:47.752 INFO:teuthology.orchestra.run.smithi151.stdout:======================================================================================= 2024-08-02T18:37:47.753 INFO:teuthology.orchestra.run.smithi151.stdout:Install 148 Packages 2024-08-02T18:37:47.753 INFO:teuthology.orchestra.run.smithi151.stdout:Upgrade 12 Packages 2024-08-02T18:37:47.753 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:37:47.753 INFO:teuthology.orchestra.run.smithi151.stdout:Total download size: 228 M 2024-08-02T18:37:47.753 INFO:teuthology.orchestra.run.smithi151.stdout:Downloading Packages: 2024-08-02T18:37:48.204 INFO:teuthology.orchestra.run.smithi103.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-02T18:37:48.205 INFO:teuthology.orchestra.run.smithi103.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-02T18:37:48.217 INFO:teuthology.orchestra.run.smithi103.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-02T18:37:48.217 INFO:teuthology.orchestra.run.smithi103.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-02T18:37:48.218 INFO:teuthology.orchestra.run.smithi103.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-02T18:37:48.219 INFO:teuthology.orchestra.run.smithi103.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-02T18:37:48.221 INFO:teuthology.orchestra.run.smithi103.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-02T18:37:48.223 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-02T18:37:48.224 INFO:teuthology.orchestra.run.smithi103.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-02T18:37:48.288 INFO:teuthology.orchestra.run.smithi103.stdout:Dependencies resolved. 2024-08-02T18:37:48.318 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-08-02T18:37:48.318 INFO:teuthology.orchestra.run.smithi103.stdout: Package Arch Version Repository Size 2024-08-02T18:37:48.318 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout:Installing: 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 6.6 k 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 5.4 M 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 897 k 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 145 k 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 1.5 M 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 146 k 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 3.6 M 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 7.4 M 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 49 k 2024-08-02T18:37:48.319 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 11 M 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 49 M 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 274 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 765 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 224 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 27 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 18 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 32 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 751 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 127 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-02T18:37:48.320 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 188 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 372 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 349 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 116 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 85 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.1 M 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 170 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-02T18:37:48.321 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrading: 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: librados2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.4 M 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.2 M 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-02T18:37:48.322 INFO:teuthology.orchestra.run.smithi103.stdout:Installing dependencies: 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 21 M 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 32 k 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 2.4 M 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 249 k 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 4.7 M 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 17 M 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 16 k 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 25 k 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-02T18:37:48.323 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 164 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 507 k 2024-08-02T18:37:48.324 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 5.4 M 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-02T18:37:48.325 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 45 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 136 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-02T18:37:48.326 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-02T18:37:48.327 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-02T18:37:48.328 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-02T18:37:48.329 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-02T18:37:48.330 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout:Installing weak dependencies: 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction Summary 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout:======================================================================================= 2024-08-02T18:37:48.331 INFO:teuthology.orchestra.run.smithi103.stdout:Install 148 Packages 2024-08-02T18:37:48.332 INFO:teuthology.orchestra.run.smithi103.stdout:Upgrade 12 Packages 2024-08-02T18:37:48.332 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:37:48.332 INFO:teuthology.orchestra.run.smithi103.stdout:Total download size: 228 M 2024-08-02T18:37:48.332 INFO:teuthology.orchestra.run.smithi103.stdout:Downloading Packages: 2024-08-02T18:37:48.343 INFO:teuthology.orchestra.run.smithi151.stdout:(1/160): ceph-19.1.0-1260.g26c3fb8e.el9.x86_64. 40 kB/s | 6.6 kB 00:00 2024-08-02T18:37:48.547 INFO:teuthology.orchestra.run.smithi151.stdout:(2/160): ceph-fuse-19.1.0-1260.g26c3fb8e.el9.x8 4.2 MB/s | 897 kB 00:00 2024-08-02T18:37:48.648 INFO:teuthology.orchestra.run.smithi151.stdout:(3/160): ceph-base-19.1.0-1260.g26c3fb8e.el9.x8 11 MB/s | 5.4 MB 00:00 2024-08-02T18:37:48.673 INFO:teuthology.orchestra.run.smithi151.stdout:(4/160): ceph-immutable-object-cache-19.1.0-126 1.1 MB/s | 145 kB 00:00 2024-08-02T18:37:48.782 INFO:teuthology.orchestra.run.smithi151.stdout:(5/160): ceph-mds-19.1.0-1260.g26c3fb8e.el9.x86 18 MB/s | 2.4 MB 00:00 2024-08-02T18:37:48.840 INFO:teuthology.orchestra.run.smithi151.stdout:(6/160): ceph-mgr-19.1.0-1260.g26c3fb8e.el9.x86 9.1 MB/s | 1.5 MB 00:00 2024-08-02T18:37:48.990 INFO:teuthology.orchestra.run.smithi151.stdout:(7/160): ceph-mon-19.1.0-1260.g26c3fb8e.el9.x86 23 MB/s | 4.7 MB 00:00 2024-08-02T18:37:49.012 INFO:teuthology.orchestra.run.smithi103.stdout:(1/160): ceph-19.1.0-1260.g26c3fb8e.el9.x86_64. 30 kB/s | 6.6 kB 00:00 2024-08-02T18:37:49.491 INFO:teuthology.orchestra.run.smithi151.stdout:(8/160): ceph-radosgw-19.1.0-1260.g26c3fb8e.el9 21 MB/s | 11 MB 00:00 2024-08-02T18:37:49.541 INFO:teuthology.orchestra.run.smithi151.stdout:(9/160): ceph-selinux-19.1.0-1260.g26c3fb8e.el9 505 kB/s | 25 kB 00:00 2024-08-02T18:37:49.596 INFO:teuthology.orchestra.run.smithi103.stdout:(2/160): ceph-fuse-19.1.0-1260.g26c3fb8e.el9.x8 1.5 MB/s | 897 kB 00:00 2024-08-02T18:37:49.663 INFO:teuthology.orchestra.run.smithi103.stdout:(3/160): ceph-immutable-object-cache-19.1.0-126 2.1 MB/s | 145 kB 00:00 2024-08-02T18:37:49.741 INFO:teuthology.orchestra.run.smithi151.stdout:(10/160): ceph-common-19.1.0-1260.g26c3fb8e.el9 14 MB/s | 21 MB 00:01 2024-08-02T18:37:49.800 INFO:teuthology.orchestra.run.smithi151.stdout:(11/160): cephfs-mirror-19.1.0-1260.g26c3fb8e.e 3.8 MB/s | 224 kB 00:00 2024-08-02T18:37:49.850 INFO:teuthology.orchestra.run.smithi151.stdout:(12/160): cephfs-shell-19.1.0-1260.g26c3fb8e.el 540 kB/s | 27 kB 00:00 2024-08-02T18:37:49.892 INFO:teuthology.orchestra.run.smithi121.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2024-08-02T18:37:49.900 INFO:teuthology.orchestra.run.smithi151.stdout:(13/160): libcephfs-devel-19.1.0-1260.g26c3fb8e 636 kB/s | 32 kB 00:00 2024-08-02T18:37:49.984 INFO:teuthology.orchestra.run.smithi151.stdout:(14/160): libcephfs2-19.1.0-1260.g26c3fb8e.el9. 8.8 MB/s | 751 kB 00:00 2024-08-02T18:37:50.051 INFO:teuthology.orchestra.run.smithi151.stdout:(15/160): libcephsqlite-19.1.0-1260.g26c3fb8e.e 2.4 MB/s | 164 kB 00:00 2024-08-02T18:37:50.109 INFO:teuthology.orchestra.run.smithi151.stdout:(16/160): librados-devel-19.1.0-1260.g26c3fb8e. 2.1 MB/s | 127 kB 00:00 2024-08-02T18:37:50.171 INFO:teuthology.orchestra.run.smithi103.stdout:(4/160): ceph-mds-19.1.0-1260.g26c3fb8e.el9.x86 4.7 MB/s | 2.4 MB 00:00 2024-08-02T18:37:50.176 INFO:teuthology.orchestra.run.smithi151.stdout:(17/160): libradosstriper1-19.1.0-1260.g26c3fb8 7.4 MB/s | 507 kB 00:00 2024-08-02T18:37:50.436 INFO:teuthology.orchestra.run.smithi151.stdout:(18/160): ceph-osd-19.1.0-1260.g26c3fb8e.el9.x8 11 MB/s | 17 MB 00:01 2024-08-02T18:37:50.472 INFO:teuthology.orchestra.run.smithi103.stdout:(5/160): ceph-mgr-19.1.0-1260.g26c3fb8e.el9.x86 5.1 MB/s | 1.5 MB 00:00 2024-08-02T18:37:50.485 INFO:teuthology.orchestra.run.smithi151.stdout:(19/160): python3-ceph-argparse-19.1.0-1260.g26 910 kB/s | 45 kB 00:00 2024-08-02T18:37:50.561 INFO:teuthology.orchestra.run.smithi151.stdout:(20/160): librgw2-19.1.0-1260.g26c3fb8e.el9.x86 14 MB/s | 5.4 MB 00:00 2024-08-02T18:37:50.564 INFO:teuthology.orchestra.run.smithi103.stdout:(6/160): ceph-base-19.1.0-1260.g26c3fb8e.el9.x8 3.1 MB/s | 5.4 MB 00:01 2024-08-02T18:37:50.587 INFO:teuthology.orchestra.run.smithi151.stdout:(21/160): python3-ceph-common-19.1.0-1260.g26c3 1.3 MB/s | 136 kB 00:00 2024-08-02T18:37:50.611 INFO:teuthology.orchestra.run.smithi151.stdout:(22/160): python3-cephfs-19.1.0-1260.g26c3fb8e. 3.7 MB/s | 188 kB 00:00 2024-08-02T18:37:50.662 INFO:teuthology.orchestra.run.smithi151.stdout:(23/160): python3-rados-19.1.0-1260.g26c3fb8e.e 4.8 MB/s | 372 kB 00:00 2024-08-02T18:37:50.695 INFO:teuthology.orchestra.run.smithi151.stdout:(24/160): python3-rbd-19.1.0-1260.g26c3fb8e.el9 4.1 MB/s | 349 kB 00:00 2024-08-02T18:37:50.729 INFO:teuthology.orchestra.run.smithi151.stdout:(25/160): python3-rgw-19.1.0-1260.g26c3fb8e.el9 1.7 MB/s | 116 kB 00:00 2024-08-02T18:37:50.754 INFO:teuthology.orchestra.run.smithi151.stdout:(26/160): rbd-fuse-19.1.0-1260.g26c3fb8e.el9.x8 1.4 MB/s | 85 kB 00:00 2024-08-02T18:37:50.838 INFO:teuthology.orchestra.run.smithi151.stdout:(27/160): rbd-nbd-19.1.0-1260.g26c3fb8e.el9.x86 2.0 MB/s | 170 kB 00:00 2024-08-02T18:37:50.913 INFO:teuthology.orchestra.run.smithi151.stdout:(28/160): ceph-grafana-dashboards-19.1.0-1260.g 425 kB/s | 32 kB 00:00 2024-08-02T18:37:50.981 INFO:teuthology.orchestra.run.smithi103.stdout:(7/160): ceph-mon-19.1.0-1260.g26c3fb8e.el9.x86 9.2 MB/s | 4.7 MB 00:00 2024-08-02T18:37:50.988 INFO:teuthology.orchestra.run.smithi151.stdout:(29/160): ceph-mgr-cephadm-19.1.0-1260.g26c3fb8 1.9 MB/s | 146 kB 00:00 2024-08-02T18:37:51.180 INFO:teuthology.orchestra.run.smithi151.stdout:(30/160): rbd-mirror-19.1.0-1260.g26c3fb8e.el9. 6.9 MB/s | 3.1 MB 00:00 2024-08-02T18:37:51.272 INFO:teuthology.orchestra.run.smithi151.stdout:(31/160): ceph-mgr-dashboard-19.1.0-1260.g26c3f 13 MB/s | 3.6 MB 00:00 2024-08-02T18:37:51.356 INFO:teuthology.orchestra.run.smithi151.stdout:(32/160): ceph-mgr-modules-core-19.1.0-1260.g26 2.9 MB/s | 249 kB 00:00 2024-08-02T18:37:51.431 INFO:teuthology.orchestra.run.smithi151.stdout:(33/160): ceph-mgr-rook-19.1.0-1260.g26c3fb8e.e 657 kB/s | 49 kB 00:00 2024-08-02T18:37:51.506 INFO:teuthology.orchestra.run.smithi151.stdout:(34/160): ceph-prometheus-alerts-19.1.0-1260.g2 220 kB/s | 16 kB 00:00 2024-08-02T18:37:51.590 INFO:teuthology.orchestra.run.smithi151.stdout:(35/160): ceph-volume-19.1.0-1260.g26c3fb8e.el9 3.2 MB/s | 274 kB 00:00 2024-08-02T18:37:51.682 INFO:teuthology.orchestra.run.smithi151.stdout:(36/160): cephadm-19.1.0-1260.g26c3fb8e.el9.noa 8.1 MB/s | 765 kB 00:00 2024-08-02T18:37:51.741 INFO:teuthology.orchestra.run.smithi151.stdout:(37/160): cephfs-top-19.1.0-1260.g26c3fb8e.el9. 314 kB/s | 18 kB 00:00 2024-08-02T18:37:51.789 INFO:teuthology.orchestra.run.smithi103.stdout:(8/160): ceph-common-19.1.0-1260.g26c3fb8e.el9. 7.1 MB/s | 21 MB 00:02 2024-08-02T18:37:51.891 INFO:teuthology.orchestra.run.smithi151.stdout:(38/160): fuse-2.9.9-16.el9.x86_64.rpm 533 kB/s | 80 kB 00:00 2024-08-02T18:37:51.915 INFO:teuthology.orchestra.run.smithi103.stdout:(9/160): ceph-radosgw-19.1.0-1260.g26c3fb8e.el9 11 MB/s | 11 MB 00:00 2024-08-02T18:37:51.940 INFO:teuthology.orchestra.run.smithi103.stdout:(10/160): ceph-selinux-19.1.0-1260.g26c3fb8e.el 167 kB/s | 25 kB 00:00 2024-08-02T18:37:51.991 INFO:teuthology.orchestra.run.smithi151.stdout:(39/160): ceph-mgr-diskprediction-local-19.1.0- 9.1 MB/s | 7.4 MB 00:00 2024-08-02T18:37:52.015 INFO:teuthology.orchestra.run.smithi103.stdout:(11/160): cephfs-mirror-19.1.0-1260.g26c3fb8e.e 2.9 MB/s | 224 kB 00:00 2024-08-02T18:37:52.082 INFO:teuthology.orchestra.run.smithi103.stdout:(12/160): cephfs-shell-19.1.0-1260.g26c3fb8e.el 405 kB/s | 27 kB 00:00 2024-08-02T18:37:52.117 INFO:teuthology.orchestra.run.smithi151.stdout:(40/160): libgfortran-11.4.1-3.el9.x86_64.rpm 3.5 MB/s | 803 kB 00:00 2024-08-02T18:37:52.149 INFO:teuthology.orchestra.run.smithi103.stdout:(13/160): libcephfs-devel-19.1.0-1260.g26c3fb8e 475 kB/s | 32 kB 00:00 2024-08-02T18:37:52.159 INFO:teuthology.orchestra.run.smithi121.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-02T18:37:52.160 INFO:teuthology.orchestra.run.smithi121.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2024-08-02T18:37:52.171 INFO:teuthology.orchestra.run.smithi121.stdout:Package NetworkManager-1:1.47.4-1.el9.x86_64 is already installed. 2024-08-02T18:37:52.172 INFO:teuthology.orchestra.run.smithi121.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2024-08-02T18:37:52.172 INFO:teuthology.orchestra.run.smithi121.stdout:Package util-linux-2.37.4-18.el9.x86_64 is already installed. 2024-08-02T18:37:52.173 INFO:teuthology.orchestra.run.smithi121.stdout:Package libacl-devel-2.3.1-4.el9.x86_64 is already installed. 2024-08-02T18:37:52.175 INFO:teuthology.orchestra.run.smithi151.stdout:(41/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 4.3 MB/s | 253 kB 00:00 2024-08-02T18:37:52.175 INFO:teuthology.orchestra.run.smithi121.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2024-08-02T18:37:52.177 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsdump-3.1.12-4.el9.x86_64 is already installed. 2024-08-02T18:37:52.178 INFO:teuthology.orchestra.run.smithi121.stdout:Package xfsprogs-6.3.0-1.el9.x86_64 is already installed. 2024-08-02T18:37:52.234 INFO:teuthology.orchestra.run.smithi151.stdout:(42/160): libquadmath-11.4.1-3.el9.x86_64.rpm 806 kB/s | 195 kB 00:00 2024-08-02T18:37:52.241 INFO:teuthology.orchestra.run.smithi121.stdout:Dependencies resolved. 2024-08-02T18:37:52.256 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-02T18:37:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: Package Arch Version Repository Size 2024-08-02T18:37:52.256 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-02T18:37:52.256 INFO:teuthology.orchestra.run.smithi121.stdout:Installing: 2024-08-02T18:37:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: bison x86_64 3.7.4-5.el9 appstream 943 k 2024-08-02T18:37:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: ceph x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 6.6 k 2024-08-02T18:37:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 5.4 M 2024-08-02T18:37:52.256 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 897 k 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 145 k 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 1.5 M 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 146 k 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 3.6 M 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 7.4 M 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 49 k 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 11 M 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 49 M 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 274 k 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 765 k 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 224 k 2024-08-02T18:37:52.257 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 27 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 18 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel x86_64 0.191-4.el9 appstream 22 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: flex x86_64 2.6.4-9.el9 appstream 313 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel x86_64 0.3.111-13.el9 appstream 11 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 32 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 751 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 127 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: libtool x86_64 2.4.6-46.el9 appstream 581 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel x86_64 2.37.4-18.el9 appstream 25 k 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel x86_64 1:3.2.2-2.el9 appstream 4.4 M 2024-08-02T18:37:52.258 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql x86_64 13.14-1.el9 appstream 1.6 M 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib x86_64 13.14-1.el9 appstream 911 k 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server x86_64 13.14-1.el9 appstream 5.8 M 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 188 k 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 372 k 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 349 k 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 116 k 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 85 k 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.1 M 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 170 k 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel x86_64 6.4.0-3.el9 appstream 96 k 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrading: 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager x86_64 1:1.48.2-2.el9 baseos 2.3 M 2024-08-02T18:37:52.259 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm x86_64 1:1.48.2-2.el9 baseos 1.8 M 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team x86_64 1:1.48.2-2.el9 baseos 41 k 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui x86_64 1:1.48.2-2.el9 baseos 247 k 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-debuginfod-client x86_64 0.191-4.el9 baseos 37 k 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf x86_64 0.191-4.el9 baseos 207 k 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libs x86_64 0.191-4.el9 baseos 260 k 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: librados2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.4 M 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 3.2 M 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: openssl x86_64 1:3.2.2-2.el9 baseos 1.4 M 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs x86_64 1:3.2.2-2.el9 baseos 2.4 M 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs x86_64 6.4.0-3.el9 baseos 1.1 M 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout:Installing dependencies: 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-08-02T18:37:52.260 INFO:teuthology.orchestra.run.smithi121.stdout: automake noarch 1.16.2-8.el9 appstream 689 k 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 21 M 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 32 k 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 2.4 M 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 249 k 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 4.7 M 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 17 M 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts noarch 2:19.1.0-1260.g26c3fb8e.el9 ceph-noarch 16 k 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 25 k 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-08-02T18:37:52.261 INFO:teuthology.orchestra.run.smithi121.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 164 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran x86_64 11.4.1-3.el9 baseos 803 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath x86_64 11.4.1-3.el9 baseos 195 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 507 k 2024-08-02T18:37:52.262 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2 x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 5.4 M 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel x86_64 1.5.1-2.el9 appstream 47 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: openblas x86_64 0.3.21-2.el9 appstream 35 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp x86_64 0.3.21-2.el9 appstream 4.7 M 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs x86_64 13.14-1.el9 appstream 133 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-08-02T18:37:52.263 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs noarch 20.3.0-7.el9 appstream 87 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 45 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common x86_64 2:19.1.0-1260.g26c3fb8e.el9 ceph 136 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama noarch 0.4.6-3.el9 appstream 61 k 2024-08-02T18:37:52.264 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel x86_64 3.9.18-3.el9 appstream 244 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth noarch 1:2.32.0-1.el9 epel 216 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-08-02T18:37:52.265 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-08-02T18:37:52.266 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-08-02T18:37:52.267 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth noarch 0.2.5-8.el9 appstream 44 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2024-08-02T18:37:52.268 INFO:teuthology.orchestra.run.smithi121.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: uuid x86_64 1.6.2-55.el9 appstream 58 k 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel x86_64 1.2.11-41.el9 appstream 45 k 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout:Installing weak dependencies: 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction Summary 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout:======================================================================================= 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout:Install 148 Packages 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout:Upgrade 12 Packages 2024-08-02T18:37:52.269 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:37:52.270 INFO:teuthology.orchestra.run.smithi121.stdout:Total download size: 228 M 2024-08-02T18:37:52.270 INFO:teuthology.orchestra.run.smithi121.stdout:Downloading Packages: 2024-08-02T18:37:52.274 INFO:teuthology.orchestra.run.smithi103.stdout:(14/160): libcephfs2-19.1.0-1260.g26c3fb8e.el9. 5.9 MB/s | 751 kB 00:00 2024-08-02T18:37:52.309 INFO:teuthology.orchestra.run.smithi151.stdout:(43/160): python3-cryptography-36.0.1-4.el9.x86 9.2 MB/s | 1.2 MB 00:00 2024-08-02T18:37:52.334 INFO:teuthology.orchestra.run.smithi151.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 1.0 MB/s | 106 kB 00:00 2024-08-02T18:37:52.349 INFO:teuthology.orchestra.run.smithi103.stdout:(15/160): libcephsqlite-19.1.0-1260.g26c3fb8e.e 2.1 MB/s | 164 kB 00:00 2024-08-02T18:37:52.359 INFO:teuthology.orchestra.run.smithi151.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-02T18:37:52.393 INFO:teuthology.orchestra.run.smithi151.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 2.1 MB/s | 125 kB 00:00 2024-08-02T18:37:52.419 INFO:teuthology.orchestra.run.smithi151.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-02T18:37:52.425 INFO:teuthology.orchestra.run.smithi103.stdout:(16/160): librados-devel-19.1.0-1260.g26c3fb8e. 1.7 MB/s | 127 kB 00:00 2024-08-02T18:37:52.517 INFO:teuthology.orchestra.run.smithi103.stdout:(17/160): libradosstriper1-19.1.0-1260.g26c3fb8 5.4 MB/s | 507 kB 00:00 2024-08-02T18:37:52.784 INFO:teuthology.orchestra.run.smithi103.stdout:(18/160): ceph-osd-19.1.0-1260.g26c3fb8e.el9.x8 7.6 MB/s | 17 MB 00:02 2024-08-02T18:37:52.834 INFO:teuthology.orchestra.run.smithi103.stdout:(19/160): python3-ceph-argparse-19.1.0-1260.g26 907 kB/s | 45 kB 00:00 2024-08-02T18:37:52.835 INFO:teuthology.orchestra.run.smithi121.stdout:(1/160): ceph-19.1.0-1260.g26c3fb8e.el9.x86_64. 36 kB/s | 6.6 kB 00:00 2024-08-02T18:37:52.918 INFO:teuthology.orchestra.run.smithi103.stdout:(20/160): python3-ceph-common-19.1.0-1260.g26c3 1.6 MB/s | 136 kB 00:00 2024-08-02T18:37:53.011 INFO:teuthology.orchestra.run.smithi151.stdout:(48/160): ceph-test-19.1.0-1260.g26c3fb8e.el9.x 14 MB/s | 49 MB 00:03 2024-08-02T18:37:53.035 INFO:teuthology.orchestra.run.smithi103.stdout:(21/160): librgw2-19.1.0-1260.g26c3fb8e.el9.x86 10 MB/s | 5.4 MB 00:00 2024-08-02T18:37:53.053 INFO:teuthology.orchestra.run.smithi151.stdout:(49/160): automake-1.16.2-8.el9.noarch.rpm 1.0 MB/s | 689 kB 00:00 2024-08-02T18:37:53.060 INFO:teuthology.orchestra.run.smithi103.stdout:(22/160): python3-cephfs-19.1.0-1260.g26c3fb8e. 1.3 MB/s | 188 kB 00:00 2024-08-02T18:37:53.094 INFO:teuthology.orchestra.run.smithi103.stdout:(23/160): python3-rados-19.1.0-1260.g26c3fb8e.e 6.2 MB/s | 372 kB 00:00 2024-08-02T18:37:53.094 INFO:teuthology.orchestra.run.smithi151.stdout:(50/160): bison-3.7.4-5.el9.x86_64.rpm 1.4 MB/s | 943 kB 00:00 2024-08-02T18:37:53.119 INFO:teuthology.orchestra.run.smithi103.stdout:(24/160): python3-rbd-19.1.0-1260.g26c3fb8e.el9 5.8 MB/s | 349 kB 00:00 2024-08-02T18:37:53.119 INFO:teuthology.orchestra.run.smithi151.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 325 kB/s | 22 kB 00:00 2024-08-02T18:37:53.144 INFO:teuthology.orchestra.run.smithi103.stdout:(25/160): python3-rgw-19.1.0-1260.g26c3fb8e.el9 2.3 MB/s | 116 kB 00:00 2024-08-02T18:37:53.162 INFO:teuthology.orchestra.run.smithi151.stdout:(52/160): flex-2.6.4-9.el9.x86_64.rpm 4.6 MB/s | 313 kB 00:00 2024-08-02T18:37:53.170 INFO:teuthology.orchestra.run.smithi103.stdout:(26/160): rbd-fuse-19.1.0-1260.g26c3fb8e.el9.x8 1.7 MB/s | 85 kB 00:00 2024-08-02T18:37:53.185 INFO:teuthology.orchestra.run.smithi121.stdout:(2/160): ceph-fuse-19.1.0-1260.g26c3fb8e.el9.x8 2.5 MB/s | 897 kB 00:00 2024-08-02T18:37:53.186 INFO:teuthology.orchestra.run.smithi151.stdout:(53/160): boost-program-options-1.75.0-8.el9.x8 609 kB/s | 107 kB 00:00 2024-08-02T18:37:53.212 INFO:teuthology.orchestra.run.smithi103.stdout:(27/160): rbd-nbd-19.1.0-1260.g26c3fb8e.el9.x86 4.0 MB/s | 170 kB 00:00 2024-08-02T18:37:53.212 INFO:teuthology.orchestra.run.smithi151.stdout:(54/160): flexiblas-3.0.4-8.el9.x86_64.rpm 355 kB/s | 33 kB 00:00 2024-08-02T18:37:53.237 INFO:teuthology.orchestra.run.smithi151.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-08-02T18:37:53.262 INFO:teuthology.orchestra.run.smithi151.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 222 kB/s | 11 kB 00:00 2024-08-02T18:37:53.288 INFO:teuthology.orchestra.run.smithi151.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.1 MB/s | 160 kB 00:00 2024-08-02T18:37:53.295 INFO:teuthology.orchestra.run.smithi103.stdout:(28/160): ceph-grafana-dashboards-19.1.0-1260.g 382 kB/s | 32 kB 00:00 2024-08-02T18:37:53.313 INFO:teuthology.orchestra.run.smithi151.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 902 kB/s | 45 kB 00:00 2024-08-02T18:37:53.318 INFO:teuthology.orchestra.run.smithi121.stdout:(3/160): ceph-immutable-object-cache-19.1.0-126 1.1 MB/s | 145 kB 00:00 2024-08-02T18:37:53.379 INFO:teuthology.orchestra.run.smithi103.stdout:(29/160): ceph-mgr-cephadm-19.1.0-1260.g26c3fb8 1.7 MB/s | 146 kB 00:00 2024-08-02T18:37:53.380 INFO:teuthology.orchestra.run.smithi151.stdout:(59/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 14 MB/s | 3.0 MB 00:00 2024-08-02T18:37:53.405 INFO:teuthology.orchestra.run.smithi151.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 5.5 MB/s | 662 kB 00:00 2024-08-02T18:37:53.430 INFO:teuthology.orchestra.run.smithi151.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 509 kB/s | 25 kB 00:00 2024-08-02T18:37:53.438 INFO:teuthology.orchestra.run.smithi103.stdout:(30/160): rbd-mirror-19.1.0-1260.g26c3fb8e.el9. 11 MB/s | 3.1 MB 00:00 2024-08-02T18:37:53.456 INFO:teuthology.orchestra.run.smithi151.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-08-02T18:37:53.481 INFO:teuthology.orchestra.run.smithi151.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 5.7 MB/s | 292 kB 00:00 2024-08-02T18:37:53.506 INFO:teuthology.orchestra.run.smithi151.stdout:(64/160): libtool-2.4.6-46.el9.x86_64.rpm 2.9 MB/s | 581 kB 00:00 2024-08-02T18:37:53.532 INFO:teuthology.orchestra.run.smithi151.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 704 kB/s | 35 kB 00:00 2024-08-02T18:37:53.557 INFO:teuthology.orchestra.run.smithi151.stdout:(66/160): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-08-02T18:37:53.640 INFO:teuthology.orchestra.run.smithi151.stdout:(67/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-08-02T18:37:53.683 INFO:teuthology.orchestra.run.smithi151.stdout:(68/160): postgresql-13.14-1.el9.x86_64.rpm 13 MB/s | 1.6 MB 00:00 2024-08-02T18:37:53.710 INFO:teuthology.orchestra.run.smithi121.stdout:(4/160): ceph-mds-19.1.0-1260.g26c3fb8e.el9.x86 6.1 MB/s | 2.4 MB 00:00 2024-08-02T18:37:53.724 INFO:teuthology.orchestra.run.smithi151.stdout:(69/160): postgresql-contrib-13.14-1.el9.x86_64 11 MB/s | 911 kB 00:00 2024-08-02T18:37:53.791 INFO:teuthology.orchestra.run.smithi151.stdout:(70/160): openblas-openmp-0.3.21-2.el9.x86_64.r 17 MB/s | 4.7 MB 00:00 2024-08-02T18:37:53.816 INFO:teuthology.orchestra.run.smithi151.stdout:(71/160): postgresql-private-libs-13.14-1.el9.x 998 kB/s | 133 kB 00:00 2024-08-02T18:37:53.850 INFO:teuthology.orchestra.run.smithi151.stdout:(72/160): protobuf-3.14.0-13.el9.x86_64.rpm 17 MB/s | 1.0 MB 00:00 2024-08-02T18:37:53.876 INFO:teuthology.orchestra.run.smithi151.stdout:(73/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 87 kB 00:00 2024-08-02T18:37:53.894 INFO:teuthology.orchestra.run.smithi121.stdout:(5/160): ceph-base-19.1.0-1260.g26c3fb8e.el9.x8 4.3 MB/s | 5.4 MB 00:01 2024-08-02T18:37:53.905 INFO:teuthology.orchestra.run.smithi103.stdout:(31/160): ceph-test-19.1.0-1260.g26c3fb8e.el9.x 24 MB/s | 49 MB 00:01 2024-08-02T18:37:53.917 INFO:teuthology.orchestra.run.smithi151.stdout:(74/160): python3-colorama-0.4.6-3.el9.noarch.r 1.4 MB/s | 61 kB 00:00 2024-08-02T18:37:53.936 INFO:teuthology.orchestra.run.smithi121.stdout:(6/160): ceph-mgr-19.1.0-1260.g26c3fb8e.el9.x86 6.7 MB/s | 1.5 MB 00:00 2024-08-02T18:37:53.980 INFO:teuthology.orchestra.run.smithi103.stdout:(32/160): ceph-mgr-dashboard-19.1.0-1260.g26c3f 5.9 MB/s | 3.6 MB 00:00 2024-08-02T18:37:53.993 INFO:teuthology.orchestra.run.smithi151.stdout:(75/160): postgresql-server-13.14-1.el9.x86_64. 22 MB/s | 5.8 MB 00:00 2024-08-02T18:37:54.005 INFO:teuthology.orchestra.run.smithi103.stdout:(33/160): ceph-mgr-modules-core-19.1.0-1260.g26 2.4 MB/s | 249 kB 00:00 2024-08-02T18:37:54.018 INFO:teuthology.orchestra.run.smithi151.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 2.4 MB/s | 244 kB 00:00 2024-08-02T18:37:54.063 INFO:teuthology.orchestra.run.smithi151.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 3.5 MB/s | 248 kB 00:00 2024-08-02T18:37:54.064 INFO:teuthology.orchestra.run.smithi103.stdout:(34/160): ceph-mgr-rook-19.1.0-1260.g26c3fb8e.e 592 kB/s | 49 kB 00:00 2024-08-02T18:37:54.089 INFO:teuthology.orchestra.run.smithi103.stdout:(35/160): ceph-prometheus-alerts-19.1.0-1260.g2 197 kB/s | 16 kB 00:00 2024-08-02T18:37:54.094 INFO:teuthology.orchestra.run.smithi151.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 340 kB/s | 26 kB 00:00 2024-08-02T18:37:54.119 INFO:teuthology.orchestra.run.smithi151.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 345 kB/s | 19 kB 00:00 2024-08-02T18:37:54.123 INFO:teuthology.orchestra.run.smithi103.stdout:(36/160): ceph-volume-19.1.0-1260.g26c3fb8e.el9 4.6 MB/s | 274 kB 00:00 2024-08-02T18:37:54.144 INFO:teuthology.orchestra.run.smithi151.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-08-02T18:37:54.169 INFO:teuthology.orchestra.run.smithi151.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 693 kB/s | 35 kB 00:00 2024-08-02T18:37:54.190 INFO:teuthology.orchestra.run.smithi103.stdout:(37/160): cephfs-top-19.1.0-1260.g26c3fb8e.el9. 274 kB/s | 18 kB 00:00 2024-08-02T18:37:54.215 INFO:teuthology.orchestra.run.smithi103.stdout:(38/160): cephadm-19.1.0-1260.g26c3fb8e.el9.noa 6.0 MB/s | 765 kB 00:00 2024-08-02T18:37:54.245 INFO:teuthology.orchestra.run.smithi151.stdout:(82/160): python3-babel-2.9.1-2.el9.noarch.rpm 15 MB/s | 6.0 MB 00:00 2024-08-02T18:37:54.270 INFO:teuthology.orchestra.run.smithi151.stdout:(83/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 2.4 MB/s | 250 kB 00:00 2024-08-02T18:37:54.295 INFO:teuthology.orchestra.run.smithi151.stdout:(84/160): python3-oauthlib-3.1.1-5.el9.noarch.r 4.3 MB/s | 222 kB 00:00 2024-08-02T18:37:54.312 INFO:teuthology.orchestra.run.smithi151.stdout:(85/160): python3-packaging-20.9-5.el9.noarch.r 1.8 MB/s | 77 kB 00:00 2024-08-02T18:37:54.315 INFO:teuthology.orchestra.run.smithi103.stdout:(39/160): ceph-mgr-diskprediction-local-19.1.0- 8.4 MB/s | 7.4 MB 00:00 2024-08-02T18:37:54.336 INFO:teuthology.orchestra.run.smithi121.stdout:(7/160): ceph-mon-19.1.0-1260.g26c3fb8e.el9.x86 11 MB/s | 4.7 MB 00:00 2024-08-02T18:37:54.337 INFO:teuthology.orchestra.run.smithi151.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 1.0 MB/s | 42 kB 00:00 2024-08-02T18:37:54.363 INFO:teuthology.orchestra.run.smithi151.stdout:(87/160): python3-protobuf-3.14.0-13.el9.noarch 5.3 MB/s | 269 kB 00:00 2024-08-02T18:37:54.388 INFO:teuthology.orchestra.run.smithi151.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 3.1 MB/s | 159 kB 00:00 2024-08-02T18:37:54.413 INFO:teuthology.orchestra.run.smithi151.stdout:(89/160): python3-pyasn1-modules-0.4.8-6.el9.no 5.4 MB/s | 279 kB 00:00 2024-08-02T18:37:54.439 INFO:teuthology.orchestra.run.smithi151.stdout:(90/160): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-08-02T18:37:54.449 INFO:teuthology.orchestra.run.smithi103.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 308 kB/s | 80 kB 00:00 2024-08-02T18:37:54.464 INFO:teuthology.orchestra.run.smithi151.stdout:(91/160): python3-requests-oauthlib-1.3.0-12.el 1.0 MB/s | 54 kB 00:00 2024-08-02T18:37:54.506 INFO:teuthology.orchestra.run.smithi151.stdout:(92/160): python3-toml-0.10.2-6.el9.noarch.rpm 1.0 MB/s | 42 kB 00:00 2024-08-02T18:37:54.516 INFO:teuthology.orchestra.run.smithi103.stdout:(41/160): libquadmath-11.4.1-3.el9.x86_64.rpm 976 kB/s | 195 kB 00:00 2024-08-02T18:37:54.550 INFO:teuthology.orchestra.run.smithi103.stdout:(42/160): libgfortran-11.4.1-3.el9.x86_64.rpm 2.3 MB/s | 803 kB 00:00 2024-08-02T18:37:54.573 INFO:teuthology.orchestra.run.smithi151.stdout:(93/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-02T18:37:54.598 INFO:teuthology.orchestra.run.smithi151.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 482 kB/s | 44 kB 00:00 2024-08-02T18:37:54.617 INFO:teuthology.orchestra.run.smithi103.stdout:(43/160): python3-ply-3.11-14.el9.noarch.rpm 1.6 MB/s | 106 kB 00:00 2024-08-02T18:37:54.623 INFO:teuthology.orchestra.run.smithi151.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-08-02T18:37:54.642 INFO:teuthology.orchestra.run.smithi103.stdout:(44/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.3 MB/s | 253 kB 00:00 2024-08-02T18:37:54.649 INFO:teuthology.orchestra.run.smithi151.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 716 kB/s | 36 kB 00:00 2024-08-02T18:37:54.667 INFO:teuthology.orchestra.run.smithi103.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-02T18:37:54.674 INFO:teuthology.orchestra.run.smithi151.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 949 kB/s | 47 kB 00:00 2024-08-02T18:37:54.692 INFO:teuthology.orchestra.run.smithi103.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-02T18:37:54.699 INFO:teuthology.orchestra.run.smithi151.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 5.9 MB/s | 304 kB 00:00 2024-08-02T18:37:54.724 INFO:teuthology.orchestra.run.smithi151.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 1.1 MB/s | 58 kB 00:00 2024-08-02T18:37:54.726 INFO:teuthology.orchestra.run.smithi103.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 3.6 MB/s | 215 kB 00:00 2024-08-02T18:37:54.750 INFO:teuthology.orchestra.run.smithi151.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-02T18:37:54.760 INFO:teuthology.orchestra.run.smithi103.stdout:(48/160): python3-cryptography-36.0.1-4.el9.x86 5.0 MB/s | 1.2 MB 00:00 2024-08-02T18:37:54.775 INFO:teuthology.orchestra.run.smithi151.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.2 MB/s | 64 kB 00:00 2024-08-02T18:37:54.801 INFO:teuthology.orchestra.run.smithi151.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 895 kB/s | 45 kB 00:00 2024-08-02T18:37:54.952 INFO:teuthology.orchestra.run.smithi103.stdout:(49/160): automake-1.16.2-8.el9.noarch.rpm 2.6 MB/s | 689 kB 00:00 2024-08-02T18:37:54.977 INFO:teuthology.orchestra.run.smithi103.stdout:(50/160): boost-program-options-1.75.0-8.el9.x8 493 kB/s | 107 kB 00:00 2024-08-02T18:37:55.003 INFO:teuthology.orchestra.run.smithi103.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 431 kB/s | 22 kB 00:00 2024-08-02T18:37:55.011 INFO:teuthology.orchestra.run.smithi121.stdout:(8/160): ceph-radosgw-19.1.0-1260.g26c3fb8e.el9 16 MB/s | 11 MB 00:00 2024-08-02T18:37:55.017 INFO:teuthology.orchestra.run.smithi151.stdout:(103/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 28 MB/s | 16 MB 00:00 2024-08-02T18:37:55.053 INFO:teuthology.orchestra.run.smithi103.stdout:(52/160): flexiblas-3.0.4-8.el9.x86_64.rpm 655 kB/s | 33 kB 00:00 2024-08-02T18:37:55.084 INFO:teuthology.orchestra.run.smithi151.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-08-02T18:37:55.110 INFO:teuthology.orchestra.run.smithi151.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-02T18:37:55.135 INFO:teuthology.orchestra.run.smithi151.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 783 kB/s | 19 kB 00:00 2024-08-02T18:37:55.136 INFO:teuthology.orchestra.run.smithi103.stdout:(53/160): bison-3.7.4-5.el9.x86_64.rpm 2.2 MB/s | 943 kB 00:00 2024-08-02T18:37:55.162 INFO:teuthology.orchestra.run.smithi103.stdout:(54/160): flex-2.6.4-9.el9.x86_64.rpm 1.7 MB/s | 313 kB 00:00 2024-08-02T18:37:55.187 INFO:teuthology.orchestra.run.smithi103.stdout:(55/160): flexiblas-openblas-openmp-3.0.4-8.el9 362 kB/s | 18 kB 00:00 2024-08-02T18:37:55.212 INFO:teuthology.orchestra.run.smithi121.stdout:(9/160): ceph-common-19.1.0-1260.g26c3fb8e.el9. 8.3 MB/s | 21 MB 00:02 2024-08-02T18:37:55.221 INFO:teuthology.orchestra.run.smithi103.stdout:(56/160): libaio-devel-0.3.111-13.el9.x86_64.rp 189 kB/s | 11 kB 00:00 2024-08-02T18:37:55.229 INFO:teuthology.orchestra.run.smithi121.stdout:(10/160): ceph-selinux-19.1.0-1260.g26c3fb8e.el 116 kB/s | 25 kB 00:00 2024-08-02T18:37:55.243 INFO:teuthology.orchestra.run.smithi151.stdout:(107/160): libarrow-9.0.0-11.el9.x86_64.rpm 41 MB/s | 4.4 MB 00:00 2024-08-02T18:37:55.246 INFO:teuthology.orchestra.run.smithi103.stdout:(57/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.7 MB/s | 160 kB 00:00 2024-08-02T18:37:55.280 INFO:teuthology.orchestra.run.smithi103.stdout:(58/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 773 kB/s | 45 kB 00:00 2024-08-02T18:37:55.327 INFO:teuthology.orchestra.run.smithi151.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 794 kB/s | 26 kB 00:00 2024-08-02T18:37:55.352 INFO:teuthology.orchestra.run.smithi151.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-02T18:37:55.364 INFO:teuthology.orchestra.run.smithi103.stdout:(59/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 9.6 MB/s | 3.0 MB 00:00 2024-08-02T18:37:55.377 INFO:teuthology.orchestra.run.smithi151.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-02T18:37:55.396 INFO:teuthology.orchestra.run.smithi121.stdout:(11/160): ceph-osd-19.1.0-1260.g26c3fb8e.el9.x8 12 MB/s | 17 MB 00:01 2024-08-02T18:37:55.403 INFO:teuthology.orchestra.run.smithi151.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 6.1 MB/s | 151 kB 00:00 2024-08-02T18:37:55.421 INFO:teuthology.orchestra.run.smithi121.stdout:(12/160): cephfs-mirror-19.1.0-1260.g26c3fb8e.e 1.1 MB/s | 224 kB 00:00 2024-08-02T18:37:55.422 INFO:teuthology.orchestra.run.smithi103.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 3.7 MB/s | 662 kB 00:00 2024-08-02T18:37:55.445 INFO:teuthology.orchestra.run.smithi151.stdout:(112/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 20 MB/s | 839 kB 00:00 2024-08-02T18:37:55.446 INFO:teuthology.orchestra.run.smithi121.stdout:(13/160): cephfs-shell-19.1.0-1260.g26c3fb8e.el 542 kB/s | 27 kB 00:00 2024-08-02T18:37:55.447 INFO:teuthology.orchestra.run.smithi103.stdout:(61/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 305 kB/s | 25 kB 00:00 2024-08-02T18:37:55.471 INFO:teuthology.orchestra.run.smithi121.stdout:(14/160): libcephfs-devel-19.1.0-1260.g26c3fb8e 630 kB/s | 32 kB 00:00 2024-08-02T18:37:55.472 INFO:teuthology.orchestra.run.smithi103.stdout:(62/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 947 kB/s | 47 kB 00:00 2024-08-02T18:37:55.478 INFO:teuthology.orchestra.run.smithi151.stdout:(113/160): python3-asyncssh-2.13.2-5.el9.noarch 16 MB/s | 548 kB 00:00 2024-08-02T18:37:55.503 INFO:teuthology.orchestra.run.smithi151.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.7 MB/s | 43 kB 00:00 2024-08-02T18:37:55.506 INFO:teuthology.orchestra.run.smithi103.stdout:(63/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-08-02T18:37:55.522 INFO:teuthology.orchestra.run.smithi121.stdout:(15/160): libcephfs2-19.1.0-1260.g26c3fb8e.el9. 9.7 MB/s | 751 kB 00:00 2024-08-02T18:37:55.529 INFO:teuthology.orchestra.run.smithi151.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-02T18:37:55.540 INFO:teuthology.orchestra.run.smithi103.stdout:(64/160): libtool-2.4.6-46.el9.x86_64.rpm 2.2 MB/s | 581 kB 00:00 2024-08-02T18:37:55.547 INFO:teuthology.orchestra.run.smithi121.stdout:(16/160): libcephsqlite-19.1.0-1260.g26c3fb8e.e 2.1 MB/s | 164 kB 00:00 2024-08-02T18:37:55.554 INFO:teuthology.orchestra.run.smithi151.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 562 kB/s | 14 kB 00:00 2024-08-02T18:37:55.565 INFO:teuthology.orchestra.run.smithi103.stdout:(65/160): openblas-0.3.21-2.el9.x86_64.rpm 602 kB/s | 35 kB 00:00 2024-08-02T18:37:55.579 INFO:teuthology.orchestra.run.smithi151.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 6.7 MB/s | 172 kB 00:00 2024-08-02T18:37:55.580 INFO:teuthology.orchestra.run.smithi121.stdout:(17/160): librados-devel-19.1.0-1260.g26c3fb8e. 2.1 MB/s | 127 kB 00:00 2024-08-02T18:37:55.591 INFO:teuthology.orchestra.run.smithi103.stdout:(66/160): lua-5.4.4-4.el9.x86_64.rpm 1.6 MB/s | 188 kB 00:00 2024-08-02T18:37:55.613 INFO:teuthology.orchestra.run.smithi151.stdout:(118/160): python3-cherrypy-18.6.1-2.el9.noarch 11 MB/s | 358 kB 00:00 2024-08-02T18:37:55.623 INFO:teuthology.orchestra.run.smithi121.stdout:(18/160): libradosstriper1-19.1.0-1260.g26c3fb8 6.6 MB/s | 507 kB 00:00 2024-08-02T18:37:55.630 INFO:teuthology.orchestra.run.smithi151.stdout:(119/160): lua-devel-5.4.4-4.el9.x86_64.rpm 26 kB/s | 22 kB 00:00 2024-08-02T18:37:55.689 INFO:teuthology.orchestra.run.smithi151.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 4.0 MB/s | 303 kB 00:00 2024-08-02T18:37:55.698 INFO:teuthology.orchestra.run.smithi121.stdout:(19/160): python3-ceph-argparse-19.1.0-1260.g26 604 kB/s | 45 kB 00:00 2024-08-02T18:37:55.730 INFO:teuthology.orchestra.run.smithi151.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 2.1 MB/s | 216 kB 00:00 2024-08-02T18:37:55.773 INFO:teuthology.orchestra.run.smithi121.stdout:(20/160): python3-ceph-common-19.1.0-1260.g26c3 1.8 MB/s | 136 kB 00:00 2024-08-02T18:37:55.781 INFO:teuthology.orchestra.run.smithi151.stdout:(122/160): python3-grpcio-1.46.7-10.el9.x86_64. 23 MB/s | 2.0 MB 00:00 2024-08-02T18:37:55.806 INFO:teuthology.orchestra.run.smithi151.stdout:(123/160): python3-grpcio-tools-1.46.7-10.el9.x 1.9 MB/s | 144 kB 00:00 2024-08-02T18:37:55.823 INFO:teuthology.orchestra.run.smithi151.stdout:(124/160): python3-jaraco-8.2.1-3.el9.noarch.rp 257 kB/s | 11 kB 00:00 2024-08-02T18:37:55.848 INFO:teuthology.orchestra.run.smithi151.stdout:(125/160): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-08-02T18:37:55.848 INFO:teuthology.orchestra.run.smithi121.stdout:(21/160): python3-cephfs-19.1.0-1260.g26c3fb8e. 2.5 MB/s | 188 kB 00:00 2024-08-02T18:37:55.866 INFO:teuthology.orchestra.run.smithi103.stdout:(67/160): postgresql-13.14-1.el9.x86_64.rpm 5.8 MB/s | 1.6 MB 00:00 2024-08-02T18:37:55.873 INFO:teuthology.orchestra.run.smithi151.stdout:(126/160): python3-jaraco-collections-3.0.0-8.e 462 kB/s | 23 kB 00:00 2024-08-02T18:37:55.900 INFO:teuthology.orchestra.run.smithi151.stdout:(127/160): python3-jaraco-functools-3.5.0-2.el9 386 kB/s | 19 kB 00:00 2024-08-02T18:37:55.924 INFO:teuthology.orchestra.run.smithi151.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 391 kB/s | 20 kB 00:00 2024-08-02T18:37:55.925 INFO:teuthology.orchestra.run.smithi121.stdout:(22/160): librgw2-19.1.0-1260.g26c3fb8e.el9.x86 16 MB/s | 5.4 MB 00:00 2024-08-02T18:37:55.942 INFO:teuthology.orchestra.run.smithi103.stdout:(68/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 12 MB/s | 4.4 MB 00:00 2024-08-02T18:37:55.949 INFO:teuthology.orchestra.run.smithi151.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-02T18:37:55.949 INFO:teuthology.orchestra.run.smithi121.stdout:(23/160): python3-rados-19.1.0-1260.g26c3fb8e.e 3.6 MB/s | 372 kB 00:00 2024-08-02T18:37:55.974 INFO:teuthology.orchestra.run.smithi151.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-02T18:37:55.975 INFO:teuthology.orchestra.run.smithi121.stdout:(24/160): python3-rbd-19.1.0-1260.g26c3fb8e.el9 6.8 MB/s | 349 kB 00:00 2024-08-02T18:37:56.000 INFO:teuthology.orchestra.run.smithi103.stdout:(69/160): postgresql-private-libs-13.14-1.el9.x 2.2 MB/s | 133 kB 00:00 2024-08-02T18:37:56.000 INFO:teuthology.orchestra.run.smithi151.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-02T18:37:56.001 INFO:teuthology.orchestra.run.smithi121.stdout:(25/160): python3-rgw-19.1.0-1260.g26c3fb8e.el9 2.3 MB/s | 116 kB 00:00 2024-08-02T18:37:56.025 INFO:teuthology.orchestra.run.smithi121.stdout:(26/160): rbd-fuse-19.1.0-1260.g26c3fb8e.el9.x8 1.7 MB/s | 85 kB 00:00 2024-08-02T18:37:56.033 INFO:teuthology.orchestra.run.smithi151.stdout:(132/160): python3-kubernetes-26.1.0-2.el9.noar 7.6 MB/s | 1.0 MB 00:00 2024-08-02T18:37:56.059 INFO:teuthology.orchestra.run.smithi151.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 660 kB/s | 16 kB 00:00 2024-08-02T18:37:56.067 INFO:teuthology.orchestra.run.smithi103.stdout:(70/160): postgresql-contrib-13.14-1.el9.x86_64 4.4 MB/s | 911 kB 00:00 2024-08-02T18:37:56.084 INFO:teuthology.orchestra.run.smithi121.stdout:(27/160): rbd-nbd-19.1.0-1260.g26c3fb8e.el9.x86 2.9 MB/s | 170 kB 00:00 2024-08-02T18:37:56.101 INFO:teuthology.orchestra.run.smithi151.stdout:(134/160): protobuf-compiler-3.14.0-13.el9.x86_ 664 kB/s | 863 kB 00:01 2024-08-02T18:37:56.126 INFO:teuthology.orchestra.run.smithi151.stdout:(135/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 1.3 MB/s | 90 kB 00:00 2024-08-02T18:37:56.167 INFO:teuthology.orchestra.run.smithi121.stdout:(28/160): rbd-mirror-19.1.0-1260.g26c3fb8e.el9. 19 MB/s | 3.1 MB 00:00 2024-08-02T18:37:56.176 INFO:teuthology.orchestra.run.smithi151.stdout:(136/160): python3-pecan-1.4.2-3.el9.noarch.rpm 1.5 MB/s | 272 kB 00:00 2024-08-02T18:37:56.193 INFO:teuthology.orchestra.run.smithi121.stdout:(29/160): ceph-grafana-dashboards-19.1.0-1260.g 294 kB/s | 32 kB 00:00 2024-08-02T18:37:56.201 INFO:teuthology.orchestra.run.smithi151.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 618 kB/s | 31 kB 00:00 2024-08-02T18:37:56.218 INFO:teuthology.orchestra.run.smithi121.stdout:(30/160): ceph-mgr-cephadm-19.1.0-1260.g26c3fb8 2.9 MB/s | 146 kB 00:00 2024-08-02T18:37:56.225 INFO:teuthology.orchestra.run.smithi103.stdout:(71/160): protobuf-3.14.0-13.el9.x86_64.rpm 6.4 MB/s | 1.0 MB 00:00 2024-08-02T18:37:56.235 INFO:teuthology.orchestra.run.smithi151.stdout:(138/160): python3-pyperclip-1.8.2-2.el9.noarch 211 kB/s | 28 kB 00:00 2024-08-02T18:37:56.261 INFO:teuthology.orchestra.run.smithi151.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-08-02T18:37:56.286 INFO:teuthology.orchestra.run.smithi151.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-08-02T18:37:56.292 INFO:teuthology.orchestra.run.smithi103.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 1.3 MB/s | 87 kB 00:00 2024-08-02T18:37:56.311 INFO:teuthology.orchestra.run.smithi151.stdout:(141/160): python3-routes-2.5.1-5.el9.noarch.rp 1.4 MB/s | 188 kB 00:00 2024-08-02T18:37:56.336 INFO:teuthology.orchestra.run.smithi151.stdout:(142/160): python3-typing-extensions-4.12.2-2.e 989 kB/s | 74 kB 00:00 2024-08-02T18:37:56.361 INFO:teuthology.orchestra.run.smithi151.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-02T18:37:56.387 INFO:teuthology.orchestra.run.smithi151.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-02T18:37:56.392 INFO:teuthology.orchestra.run.smithi103.stdout:(73/160): openblas-openmp-0.3.21-2.el9.x86_64.r 5.6 MB/s | 4.7 MB 00:00 2024-08-02T18:37:56.412 INFO:teuthology.orchestra.run.smithi151.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 399 kB/s | 20 kB 00:00 2024-08-02T18:37:56.437 INFO:teuthology.orchestra.run.smithi151.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 7.5 MB/s | 192 kB 00:00 2024-08-02T18:37:56.462 INFO:teuthology.orchestra.run.smithi151.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-02T18:37:56.468 INFO:teuthology.orchestra.run.smithi103.stdout:(74/160): postgresql-server-13.14-1.el9.x86_64. 12 MB/s | 5.8 MB 00:00 2024-08-02T18:37:56.493 INFO:teuthology.orchestra.run.smithi103.stdout:(75/160): python3-colorama-0.4.6-3.el9.noarch.r 611 kB/s | 61 kB 00:00 2024-08-02T18:37:56.513 INFO:teuthology.orchestra.run.smithi151.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-02T18:37:56.527 INFO:teuthology.orchestra.run.smithi103.stdout:(76/160): python3-devel-3.9.18-3.el9.x86_64.rpm 4.1 MB/s | 244 kB 00:00 2024-08-02T18:37:56.552 INFO:teuthology.orchestra.run.smithi103.stdout:(77/160): python3-jinja2-2.11.3-6.el9.noarch.rp 4.1 MB/s | 248 kB 00:00 2024-08-02T18:37:56.577 INFO:teuthology.orchestra.run.smithi103.stdout:(78/160): python3-jsonpatch-1.21-16.el9.noarch. 512 kB/s | 26 kB 00:00 2024-08-02T18:37:56.594 INFO:teuthology.orchestra.run.smithi103.stdout:(79/160): python3-jsonpointer-2.0-4.el9.noarch. 456 kB/s | 19 kB 00:00 2024-08-02T18:37:56.636 INFO:teuthology.orchestra.run.smithi103.stdout:(80/160): python3-mako-1.1.4-6.el9.noarch.rpm 2.9 MB/s | 172 kB 00:00 2024-08-02T18:37:56.662 INFO:teuthology.orchestra.run.smithi103.stdout:(81/160): python3-markupsafe-1.1.1-12.el9.x86_6 517 kB/s | 35 kB 00:00 2024-08-02T18:37:56.676 INFO:teuthology.orchestra.run.smithi121.stdout:(31/160): ceph-mgr-diskprediction-local-19.1.0- 16 MB/s | 7.4 MB 00:00 2024-08-02T18:37:56.720 INFO:teuthology.orchestra.run.smithi103.stdout:(82/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 4.2 MB/s | 250 kB 00:00 2024-08-02T18:37:56.735 INFO:teuthology.orchestra.run.smithi121.stdout:(32/160): ceph-mgr-dashboard-19.1.0-1260.g26c3f 6.6 MB/s | 3.6 MB 00:00 2024-08-02T18:37:56.760 INFO:teuthology.orchestra.run.smithi121.stdout:(33/160): ceph-mgr-modules-core-19.1.0-1260.g26 2.9 MB/s | 249 kB 00:00 2024-08-02T18:37:56.786 INFO:teuthology.orchestra.run.smithi121.stdout:(34/160): ceph-mgr-rook-19.1.0-1260.g26c3fb8e.e 978 kB/s | 49 kB 00:00 2024-08-02T18:37:56.796 INFO:teuthology.orchestra.run.smithi103.stdout:(83/160): python3-oauthlib-3.1.1-5.el9.noarch.r 2.9 MB/s | 222 kB 00:00 2024-08-02T18:37:56.811 INFO:teuthology.orchestra.run.smithi121.stdout:(35/160): ceph-prometheus-alerts-19.1.0-1260.g2 327 kB/s | 16 kB 00:00 2024-08-02T18:37:56.836 INFO:teuthology.orchestra.run.smithi121.stdout:(36/160): ceph-volume-19.1.0-1260.g26c3fb8e.el9 5.3 MB/s | 274 kB 00:00 2024-08-02T18:37:56.846 INFO:teuthology.orchestra.run.smithi151.stdout:(149/160): NetworkManager-1.48.2-2.el9.x86_64.r 6.9 MB/s | 2.3 MB 00:00 2024-08-02T18:37:56.863 INFO:teuthology.orchestra.run.smithi103.stdout:(84/160): python3-packaging-20.9-5.el9.noarch.r 1.1 MB/s | 77 kB 00:00 2024-08-02T18:37:56.878 INFO:teuthology.orchestra.run.smithi121.stdout:(37/160): cephadm-19.1.0-1260.g26c3fb8e.el9.noa 11 MB/s | 765 kB 00:00 2024-08-02T18:37:56.896 INFO:teuthology.orchestra.run.smithi151.stdout:(150/160): librbd1-19.1.0-1260.g26c3fb8e.el9.x8 7.3 MB/s | 3.2 MB 00:00 2024-08-02T18:37:56.904 INFO:teuthology.orchestra.run.smithi121.stdout:(38/160): cephfs-top-19.1.0-1260.g26c3fb8e.el9. 272 kB/s | 18 kB 00:00 2024-08-02T18:37:56.955 INFO:teuthology.orchestra.run.smithi151.stdout:(151/160): librados2-19.1.0-1260.g26c3fb8e.el9. 6.6 MB/s | 3.4 MB 00:00 2024-08-02T18:37:56.972 INFO:teuthology.orchestra.run.smithi103.stdout:(85/160): python3-babel-2.9.1-2.el9.noarch.rpm 8.8 MB/s | 6.0 MB 00:00 2024-08-02T18:37:56.997 INFO:teuthology.orchestra.run.smithi103.stdout:(86/160): python3-prettytable-0.7.2-27.el9.noar 317 kB/s | 42 kB 00:00 2024-08-02T18:37:57.022 INFO:teuthology.orchestra.run.smithi151.stdout:(152/160): NetworkManager-libnm-1.48.2-2.el9.x8 10 MB/s | 1.8 MB 00:00 2024-08-02T18:37:57.047 INFO:teuthology.orchestra.run.smithi151.stdout:(153/160): NetworkManager-team-1.48.2-2.el9.x86 271 kB/s | 41 kB 00:00 2024-08-02T18:37:57.064 INFO:teuthology.orchestra.run.smithi103.stdout:(87/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 12 MB/s | 5.1 MB 00:00 2024-08-02T18:37:57.073 INFO:teuthology.orchestra.run.smithi151.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 731 kB/s | 37 kB 00:00 2024-08-02T18:37:57.089 INFO:teuthology.orchestra.run.smithi103.stdout:(88/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 159 kB 00:00 2024-08-02T18:37:57.114 INFO:teuthology.orchestra.run.smithi103.stdout:(89/160): python3-protobuf-3.14.0-13.el9.noarch 1.8 MB/s | 269 kB 00:00 2024-08-02T18:37:57.140 INFO:teuthology.orchestra.run.smithi151.stdout:(155/160): elfutils-libs-0.191-4.el9.x86_64.rpm 3.8 MB/s | 260 kB 00:00 2024-08-02T18:37:57.140 INFO:teuthology.orchestra.run.smithi103.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 3.6 MB/s | 279 kB 00:00 2024-08-02T18:37:57.165 INFO:teuthology.orchestra.run.smithi103.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 675 kB/s | 51 kB 00:00 2024-08-02T18:37:57.166 INFO:teuthology.orchestra.run.smithi151.stdout:(156/160): NetworkManager-tui-1.48.2-2.el9.x86_ 1.2 MB/s | 247 kB 00:00 2024-08-02T18:37:57.190 INFO:teuthology.orchestra.run.smithi151.stdout:(157/160): elfutils-libelf-0.191-4.el9.x86_64.r 1.4 MB/s | 207 kB 00:00 2024-08-02T18:37:57.191 INFO:teuthology.orchestra.run.smithi103.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 710 kB/s | 54 kB 00:00 2024-08-02T18:37:57.224 INFO:teuthology.orchestra.run.smithi103.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 712 kB/s | 42 kB 00:00 2024-08-02T18:37:57.249 INFO:teuthology.orchestra.run.smithi103.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 754 kB/s | 44 kB 00:00 2024-08-02T18:37:57.265 INFO:teuthology.orchestra.run.smithi151.stdout:(158/160): openssl-3.2.2-2.el9.x86_64.rpm 11 MB/s | 1.4 MB 00:00 2024-08-02T18:37:57.283 INFO:teuthology.orchestra.run.smithi103.stdout:(95/160): qatlib-24.02.0-1.el9.x86_64.rpm 3.7 MB/s | 221 kB 00:00 2024-08-02T18:37:57.308 INFO:teuthology.orchestra.run.smithi103.stdout:(96/160): qatlib-service-24.02.0-1.el9.x86_64.r 612 kB/s | 36 kB 00:00 2024-08-02T18:37:57.342 INFO:teuthology.orchestra.run.smithi103.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 808 kB/s | 47 kB 00:00 2024-08-02T18:37:57.375 INFO:teuthology.orchestra.run.smithi103.stdout:(98/160): socat-1.7.4.1-6.el9.x86_64.rpm 4.4 MB/s | 304 kB 00:00 2024-08-02T18:37:57.409 INFO:teuthology.orchestra.run.smithi151.stdout:(159/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 10 MB/s | 2.4 MB 00:00 2024-08-02T18:37:57.409 INFO:teuthology.orchestra.run.smithi103.stdout:(99/160): uuid-1.6.2-55.el9.x86_64.rpm 984 kB/s | 58 kB 00:00 2024-08-02T18:37:57.426 INFO:teuthology.orchestra.run.smithi103.stdout:(100/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 1.9 MB/s | 96 kB 00:00 2024-08-02T18:37:57.449 INFO:teuthology.orchestra.run.smithi151.stdout:(160/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 4.2 MB/s | 1.1 MB 00:00 2024-08-02T18:37:57.455 INFO:teuthology.orchestra.run.smithi151.stdout:-------------------------------------------------------------------------------- 2024-08-02T18:37:57.456 INFO:teuthology.orchestra.run.smithi151.stdout:Total 23 MB/s | 228 MB 00:09 2024-08-02T18:37:57.460 INFO:teuthology.orchestra.run.smithi103.stdout:(101/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.1 MB/s | 64 kB 00:00 2024-08-02T18:37:57.485 INFO:teuthology.orchestra.run.smithi103.stdout:(102/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 765 kB/s | 45 kB 00:00 2024-08-02T18:37:57.519 INFO:teuthology.orchestra.run.smithi103.stdout:(103/160): lua-devel-5.4.4-4.el9.x86_64.rpm 379 kB/s | 22 kB 00:00 2024-08-02T18:37:57.538 INFO:teuthology.orchestra.run.smithi121.stdout:(39/160): ceph-test-19.1.0-1260.g26c3fb8e.el9.x 21 MB/s | 49 MB 00:02 2024-08-02T18:37:57.563 INFO:teuthology.orchestra.run.smithi121.stdout:(40/160): fuse-2.9.9-16.el9.x86_64.rpm 117 kB/s | 80 kB 00:00 2024-08-02T18:37:57.594 INFO:teuthology.orchestra.run.smithi103.stdout:(104/160): protobuf-compiler-3.14.0-13.el9.x86_ 7.8 MB/s | 863 kB 00:00 2024-08-02T18:37:57.653 INFO:teuthology.orchestra.run.smithi103.stdout:(105/160): abseil-cpp-20211102.0-3.el9.x86_64.r 4.0 MB/s | 548 kB 00:00 2024-08-02T18:37:57.671 INFO:teuthology.orchestra.run.smithi121.stdout:(41/160): python3-cffi-1.14.5-5.el9.x86_64.rpm 2.3 MB/s | 253 kB 00:00 2024-08-02T18:37:57.678 INFO:teuthology.orchestra.run.smithi103.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 859 kB/s | 19 kB 00:00 2024-08-02T18:37:57.696 INFO:teuthology.orchestra.run.smithi121.stdout:(42/160): libquadmath-11.4.1-3.el9.x86_64.rpm 1.2 MB/s | 195 kB 00:00 2024-08-02T18:37:57.712 INFO:teuthology.orchestra.run.smithi103.stdout:(107/160): gperftools-libs-2.9.1-2.el9.x86_64.r 2.6 MB/s | 309 kB 00:00 2024-08-02T18:37:57.722 INFO:teuthology.orchestra.run.smithi121.stdout:(43/160): libgfortran-11.4.1-3.el9.x86_64.rpm 982 kB/s | 803 kB 00:00 2024-08-02T18:37:57.737 INFO:teuthology.orchestra.run.smithi103.stdout:(108/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 1.0 MB/s | 26 kB 00:00 2024-08-02T18:37:57.747 INFO:teuthology.orchestra.run.smithi121.stdout:(44/160): python3-ply-3.11-14.el9.noarch.rpm 2.1 MB/s | 106 kB 00:00 2024-08-02T18:37:57.762 INFO:teuthology.orchestra.run.smithi103.stdout:(109/160): liboath-2.6.7-2.el9.x86_64.rpm 1.9 MB/s | 49 kB 00:00 2024-08-02T18:37:57.772 INFO:teuthology.orchestra.run.smithi121.stdout:(45/160): python3-pycparser-2.20-6.el9.noarch.r 2.6 MB/s | 135 kB 00:00 2024-08-02T18:37:57.798 INFO:teuthology.orchestra.run.smithi121.stdout:(46/160): python3-requests-2.25.1-8.el9.noarch. 2.4 MB/s | 125 kB 00:00 2024-08-02T18:37:57.813 INFO:teuthology.orchestra.run.smithi103.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-08-02T18:37:57.823 INFO:teuthology.orchestra.run.smithi121.stdout:(47/160): python3-urllib3-1.26.5-6.el9.noarch.r 4.2 MB/s | 215 kB 00:00 2024-08-02T18:37:57.838 INFO:teuthology.orchestra.run.smithi103.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 5.9 MB/s | 151 kB 00:00 2024-08-02T18:37:57.957 INFO:teuthology.orchestra.run.smithi121.stdout:(48/160): python3-cryptography-36.0.1-4.el9.x86 4.3 MB/s | 1.2 MB 00:00 2024-08-02T18:37:58.030 INFO:teuthology.orchestra.run.smithi103.stdout:(112/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-08-02T18:37:58.089 INFO:teuthology.orchestra.run.smithi103.stdout:(113/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 3.3 MB/s | 839 kB 00:00 2024-08-02T18:37:58.114 INFO:teuthology.orchestra.run.smithi103.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.9 MB/s | 43 kB 00:00 2024-08-02T18:37:58.131 INFO:teuthology.orchestra.run.smithi103.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.9 MB/s | 32 kB 00:00 2024-08-02T18:37:58.150 INFO:teuthology.orchestra.run.smithi103.stdout:(116/160): python3-certifi-2023.05.07-4.el9.noa 851 kB/s | 14 kB 00:00 2024-08-02T18:37:58.182 INFO:teuthology.orchestra.run.smithi103.stdout:(117/160): python3-cheroot-8.6.0-4.el9.noarch.r 5.0 MB/s | 172 kB 00:00 2024-08-02T18:37:58.207 INFO:teuthology.orchestra.run.smithi103.stdout:(118/160): python3-asyncssh-2.13.2-5.el9.noarch 3.0 MB/s | 548 kB 00:00 2024-08-02T18:37:58.232 INFO:teuthology.orchestra.run.smithi103.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-02T18:37:58.258 INFO:teuthology.orchestra.run.smithi103.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-08-02T18:37:58.283 INFO:teuthology.orchestra.run.smithi103.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 4.2 MB/s | 216 kB 00:00 2024-08-02T18:37:58.308 INFO:teuthology.orchestra.run.smithi103.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-02T18:37:58.334 INFO:teuthology.orchestra.run.smithi103.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 428 kB/s | 11 kB 00:00 2024-08-02T18:37:58.359 INFO:teuthology.orchestra.run.smithi103.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 707 kB/s | 18 kB 00:00 2024-08-02T18:37:58.384 INFO:teuthology.orchestra.run.smithi103.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 932 kB/s | 23 kB 00:00 2024-08-02T18:37:58.410 INFO:teuthology.orchestra.run.smithi103.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 775 kB/s | 19 kB 00:00 2024-08-02T18:37:58.485 INFO:teuthology.orchestra.run.smithi103.stdout:(127/160): libarrow-9.0.0-11.el9.x86_64.rpm 5.5 MB/s | 4.4 MB 00:00 2024-08-02T18:37:58.490 INFO:teuthology.orchestra.run.smithi121.stdout:(49/160): boost-program-options-1.75.0-8.el9.x8 200 kB/s | 107 kB 00:00 2024-08-02T18:37:58.510 INFO:teuthology.orchestra.run.smithi103.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2024-08-02T18:37:58.524 INFO:teuthology.orchestra.run.smithi121.stdout:(50/160): automake-1.16.2-8.el9.noarch.rpm 949 kB/s | 689 kB 00:00 2024-08-02T18:37:58.535 INFO:teuthology.orchestra.run.smithi103.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 1.8 MB/s | 46 kB 00:00 2024-08-02T18:37:58.561 INFO:teuthology.orchestra.run.smithi103.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-02T18:37:58.587 INFO:teuthology.orchestra.run.smithi103.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.2 MB/s | 58 kB 00:00 2024-08-02T18:37:58.590 INFO:teuthology.orchestra.run.smithi121.stdout:(51/160): elfutils-libelf-devel-0.191-4.el9.x86 218 kB/s | 22 kB 00:00 2024-08-02T18:37:58.620 INFO:teuthology.orchestra.run.smithi103.stdout:(132/160): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-02T18:37:58.624 INFO:teuthology.orchestra.run.smithi121.stdout:(52/160): bison-3.7.4-5.el9.x86_64.rpm 1.1 MB/s | 943 kB 00:00 2024-08-02T18:37:58.645 INFO:teuthology.orchestra.run.smithi103.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 658 kB/s | 16 kB 00:00 2024-08-02T18:37:58.649 INFO:teuthology.orchestra.run.smithi121.stdout:(53/160): flex-2.6.4-9.el9.x86_64.rpm 2.4 MB/s | 313 kB 00:00 2024-08-02T18:37:58.679 INFO:teuthology.orchestra.run.smithi103.stdout:(134/160): python3-kubernetes-26.1.0-2.el9.noar 5.3 MB/s | 1.0 MB 00:00 2024-08-02T18:37:58.692 INFO:teuthology.orchestra.run.smithi121.stdout:(54/160): flexiblas-3.0.4-8.el9.x86_64.rpm 326 kB/s | 33 kB 00:00 2024-08-02T18:37:58.717 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction check 2024-08-02T18:37:58.721 INFO:teuthology.orchestra.run.smithi103.stdout:(135/160): python3-grpcio-1.46.7-10.el9.x86_64. 4.4 MB/s | 2.0 MB 00:00 2024-08-02T18:37:58.747 INFO:teuthology.orchestra.run.smithi103.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 419 kB/s | 28 kB 00:00 2024-08-02T18:37:58.763 INFO:teuthology.orchestra.run.smithi103.stdout:(137/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 763 kB/s | 90 kB 00:00 2024-08-02T18:37:58.789 INFO:teuthology.orchestra.run.smithi103.stdout:(138/160): python3-repoze-lru-0.7-16.el9.noarch 457 kB/s | 31 kB 00:00 2024-08-02T18:37:58.814 INFO:teuthology.orchestra.run.smithi103.stdout:(139/160): python3-rsa-4.9-2.el9.noarch.rpm 1.1 MB/s | 59 kB 00:00 2024-08-02T18:37:58.839 INFO:teuthology.orchestra.run.smithi103.stdout:(140/160): python3-tempora-5.0.0-2.el9.noarch.r 710 kB/s | 36 kB 00:00 2024-08-02T18:37:58.865 INFO:teuthology.orchestra.run.smithi103.stdout:(141/160): python3-typing-extensions-4.12.2-2.e 1.4 MB/s | 74 kB 00:00 2024-08-02T18:37:58.890 INFO:teuthology.orchestra.run.smithi103.stdout:(142/160): python3-routes-2.5.1-5.el9.noarch.rp 1.3 MB/s | 188 kB 00:00 2024-08-02T18:37:58.909 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction check succeeded. 2024-08-02T18:37:58.910 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction test 2024-08-02T18:37:58.916 INFO:teuthology.orchestra.run.smithi103.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 1.7 MB/s | 90 kB 00:00 2024-08-02T18:37:58.925 INFO:teuthology.orchestra.run.smithi121.stdout:(55/160): flexiblas-netlib-3.0.4-8.el9.x86_64.r 10 MB/s | 3.0 MB 00:00 2024-08-02T18:37:58.940 INFO:teuthology.orchestra.run.smithi103.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.2 MB/s | 230 kB 00:00 2024-08-02T18:37:58.950 INFO:teuthology.orchestra.run.smithi121.stdout:(56/160): flexiblas-openblas-openmp-3.0.4-8.el9 61 kB/s | 18 kB 00:00 2024-08-02T18:37:58.966 INFO:teuthology.orchestra.run.smithi103.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 397 kB/s | 20 kB 00:00 2024-08-02T18:37:58.975 INFO:teuthology.orchestra.run.smithi121.stdout:(57/160): libaio-devel-0.3.111-13.el9.x86_64.rp 39 kB/s | 11 kB 00:00 2024-08-02T18:37:58.991 INFO:teuthology.orchestra.run.smithi103.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.7 MB/s | 192 kB 00:00 2024-08-02T18:37:59.025 INFO:teuthology.orchestra.run.smithi103.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.1 MB/s | 427 kB 00:00 2024-08-02T18:37:59.026 INFO:teuthology.orchestra.run.smithi121.stdout:(58/160): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.6 MB/s | 160 kB 00:00 2024-08-02T18:37:59.067 INFO:teuthology.orchestra.run.smithi103.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-02T18:37:59.076 INFO:teuthology.orchestra.run.smithi121.stdout:(59/160): librabbitmq-0.11.0-7.el9.x86_64.rpm 452 kB/s | 45 kB 00:00 2024-08-02T18:37:59.101 INFO:teuthology.orchestra.run.smithi121.stdout:(60/160): librdkafka-1.6.1-102.el9.x86_64.rpm 5.2 MB/s | 662 kB 00:00 2024-08-02T18:37:59.135 INFO:teuthology.orchestra.run.smithi121.stdout:(61/160): libtool-2.4.6-46.el9.x86_64.rpm 5.2 MB/s | 581 kB 00:00 2024-08-02T18:37:59.177 INFO:teuthology.orchestra.run.smithi121.stdout:(62/160): libuuid-devel-2.37.4-18.el9.x86_64.rp 256 kB/s | 25 kB 00:00 2024-08-02T18:37:59.202 INFO:teuthology.orchestra.run.smithi121.stdout:(63/160): libzstd-devel-1.5.1-2.el9.x86_64.rpm 471 kB/s | 47 kB 00:00 2024-08-02T18:37:59.236 INFO:teuthology.orchestra.run.smithi121.stdout:(64/160): lttng-ust-2.12.0-6.el9.x86_64.rpm 2.8 MB/s | 292 kB 00:00 2024-08-02T18:37:59.267 INFO:teuthology.orchestra.run.smithi103.stdout:(149/160): librados2-19.1.0-1260.g26c3fb8e.el9. 12 MB/s | 3.4 MB 00:00 2024-08-02T18:37:59.278 INFO:teuthology.orchestra.run.smithi121.stdout:(65/160): lua-5.4.4-4.el9.x86_64.rpm 1.8 MB/s | 188 kB 00:00 2024-08-02T18:37:59.303 INFO:teuthology.orchestra.run.smithi121.stdout:(66/160): openblas-0.3.21-2.el9.x86_64.rpm 350 kB/s | 35 kB 00:00 2024-08-02T18:37:59.417 INFO:teuthology.orchestra.run.smithi103.stdout:(150/160): librbd1-19.1.0-1260.g26c3fb8e.el9.x8 8.0 MB/s | 3.2 MB 00:00 2024-08-02T18:37:59.479 INFO:teuthology.orchestra.run.smithi121.stdout:(67/160): openblas-openmp-0.3.21-2.el9.x86_64.r 20 MB/s | 4.7 MB 00:00 2024-08-02T18:37:59.568 INFO:teuthology.orchestra.run.smithi103.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 271 kB/s | 41 kB 00:00 2024-08-02T18:37:59.629 INFO:teuthology.orchestra.run.smithi121.stdout:(68/160): openssl-devel-3.2.2-2.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-08-02T18:37:59.671 INFO:teuthology.orchestra.run.smithi121.stdout:(69/160): postgresql-13.14-1.el9.x86_64.rpm 4.3 MB/s | 1.6 MB 00:00 2024-08-02T18:37:59.676 INFO:teuthology.orchestra.run.smithi103.stdout:(152/160): NetworkManager-libnm-1.48.2-2.el9.x8 4.4 MB/s | 1.8 MB 00:00 2024-08-02T18:37:59.701 INFO:teuthology.orchestra.run.smithi103.stdout:(153/160): NetworkManager-tui-1.48.2-2.el9.x86_ 1.8 MB/s | 247 kB 00:00 2024-08-02T18:37:59.704 INFO:teuthology.orchestra.run.smithi121.stdout:(70/160): postgresql-contrib-13.14-1.el9.x86_64 4.0 MB/s | 911 kB 00:00 2024-08-02T18:37:59.727 INFO:teuthology.orchestra.run.smithi103.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 732 kB/s | 37 kB 00:00 2024-08-02T18:37:59.729 INFO:teuthology.orchestra.run.smithi121.stdout:(71/160): postgresql-private-libs-13.14-1.el9.x 1.3 MB/s | 133 kB 00:00 2024-08-02T18:37:59.760 INFO:teuthology.orchestra.run.smithi103.stdout:(155/160): elfutils-libelf-0.191-4.el9.x86_64.r 3.4 MB/s | 207 kB 00:00 2024-08-02T18:37:59.894 INFO:teuthology.orchestra.run.smithi103.stdout:(156/160): NetworkManager-1.48.2-2.el9.x86_64.r 2.8 MB/s | 2.3 MB 00:00 2024-08-02T18:37:59.914 INFO:teuthology.orchestra.run.smithi121.stdout:(72/160): python3-attrs-20.3.0-7.el9.noarch.rpm 477 kB/s | 87 kB 00:00 2024-08-02T18:37:59.919 INFO:teuthology.orchestra.run.smithi103.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 1.3 MB/s | 260 kB 00:00 2024-08-02T18:37:59.953 INFO:teuthology.orchestra.run.smithi103.stdout:(158/160): openssl-3.2.2-2.el9.x86_64.rpm 7.0 MB/s | 1.4 MB 00:00 2024-08-02T18:37:59.988 INFO:teuthology.orchestra.run.smithi121.stdout:(73/160): postgresql-server-13.14-1.el9.x86_64. 20 MB/s | 5.8 MB 00:00 2024-08-02T18:38:00.022 INFO:teuthology.orchestra.run.smithi121.stdout:(74/160): protobuf-3.14.0-13.el9.x86_64.rpm 3.2 MB/s | 1.0 MB 00:00 2024-08-02T18:38:00.189 INFO:teuthology.orchestra.run.smithi121.stdout:(75/160): python3-babel-2.9.1-2.el9.noarch.rpm 22 MB/s | 6.0 MB 00:00 2024-08-02T18:38:00.206 INFO:teuthology.orchestra.run.smithi121.stdout:(76/160): python3-colorama-0.4.6-3.el9.noarch.r 337 kB/s | 61 kB 00:00 2024-08-02T18:38:00.231 INFO:teuthology.orchestra.run.smithi121.stdout:(77/160): python3-devel-3.9.18-3.el9.x86_64.rpm 1.2 MB/s | 244 kB 00:00 2024-08-02T18:38:00.289 INFO:teuthology.orchestra.run.smithi121.stdout:(78/160): python3-jinja2-2.11.3-6.el9.noarch.rp 2.4 MB/s | 248 kB 00:00 2024-08-02T18:38:00.331 INFO:teuthology.orchestra.run.smithi121.stdout:(79/160): python3-jsonpatch-1.21-16.el9.noarch. 256 kB/s | 26 kB 00:00 2024-08-02T18:38:00.382 INFO:teuthology.orchestra.run.smithi121.stdout:(80/160): python3-jsonpointer-2.0-4.el9.noarch. 127 kB/s | 19 kB 00:00 2024-08-02T18:38:00.407 INFO:teuthology.orchestra.run.smithi121.stdout:(81/160): python3-mako-1.1.4-6.el9.noarch.rpm 1.4 MB/s | 172 kB 00:00 2024-08-02T18:38:00.432 INFO:teuthology.orchestra.run.smithi121.stdout:(82/160): python3-markupsafe-1.1.1-12.el9.x86_6 346 kB/s | 35 kB 00:00 2024-08-02T18:38:00.489 INFO:teuthology.orchestra.run.smithi103.stdout:(159/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 1.9 MB/s | 1.1 MB 00:00 2024-08-02T18:38:00.641 INFO:teuthology.orchestra.run.smithi121.stdout:(83/160): python3-numpy-1.20.1-5.el9.x86_64.rpm 20 MB/s | 5.1 MB 00:00 2024-08-02T18:38:00.666 INFO:teuthology.orchestra.run.smithi121.stdout:(84/160): python3-numpy-f2py-1.20.1-5.el9.x86_6 968 kB/s | 250 kB 00:00 2024-08-02T18:38:00.691 INFO:teuthology.orchestra.run.smithi121.stdout:(85/160): python3-oauthlib-3.1.1-5.el9.noarch.r 858 kB/s | 222 kB 00:00 2024-08-02T18:38:00.736 INFO:teuthology.orchestra.run.smithi151.stdout:Transaction test succeeded. 2024-08-02T18:38:00.737 INFO:teuthology.orchestra.run.smithi151.stdout:Running transaction 2024-08-02T18:38:00.741 INFO:teuthology.orchestra.run.smithi121.stdout:(86/160): python3-packaging-20.9-5.el9.noarch.r 774 kB/s | 77 kB 00:00 2024-08-02T18:38:00.792 INFO:teuthology.orchestra.run.smithi121.stdout:(87/160): python3-prettytable-0.7.2-27.el9.noar 422 kB/s | 42 kB 00:00 2024-08-02T18:38:00.795 INFO:teuthology.orchestra.run.smithi103.stdout:(160/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 2.7 MB/s | 2.4 MB 00:00 2024-08-02T18:38:00.801 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-08-02T18:38:00.801 INFO:teuthology.orchestra.run.smithi103.stdout:Total 18 MB/s | 228 MB 00:12 2024-08-02T18:38:00.818 INFO:teuthology.orchestra.run.smithi121.stdout:(88/160): python3-protobuf-3.14.0-13.el9.noarch 2.1 MB/s | 269 kB 00:00 2024-08-02T18:38:00.843 INFO:teuthology.orchestra.run.smithi121.stdout:(89/160): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.5 MB/s | 159 kB 00:00 2024-08-02T18:38:00.909 INFO:teuthology.orchestra.run.smithi121.stdout:(90/160): python3-pyasn1-modules-0.4.8-6.el9.no 2.3 MB/s | 279 kB 00:00 2024-08-02T18:38:00.935 INFO:teuthology.orchestra.run.smithi121.stdout:(91/160): python3-pytz-2021.1-5.el9.noarch.rpm 435 kB/s | 51 kB 00:00 2024-08-02T18:38:00.961 INFO:teuthology.orchestra.run.smithi121.stdout:(92/160): python3-requests-oauthlib-1.3.0-12.el 456 kB/s | 54 kB 00:00 2024-08-02T18:38:01.102 INFO:teuthology.orchestra.run.smithi121.stdout:(93/160): python3-toml-0.10.2-6.el9.noarch.rpm 249 kB/s | 42 kB 00:00 2024-08-02T18:38:01.127 INFO:teuthology.orchestra.run.smithi121.stdout:(94/160): python3-wcwidth-0.2.5-8.el9.noarch.rp 264 kB/s | 44 kB 00:00 2024-08-02T18:38:01.294 INFO:teuthology.orchestra.run.smithi121.stdout:(95/160): qatlib-service-24.02.0-1.el9.x86_64.r 218 kB/s | 36 kB 00:00 2024-08-02T18:38:01.395 INFO:teuthology.orchestra.run.smithi121.stdout:(96/160): qatlib-24.02.0-1.el9.x86_64.rpm 755 kB/s | 221 kB 00:00 2024-08-02T18:38:01.453 INFO:teuthology.orchestra.run.smithi121.stdout:(97/160): qatzip-libs-1.2.0-1.el9.x86_64.rpm 303 kB/s | 47 kB 00:00 2024-08-02T18:38:01.612 INFO:teuthology.orchestra.run.smithi121.stdout:(98/160): python3-scipy-1.6.2-8.el9.x86_64.rpm 23 MB/s | 16 MB 00:00 2024-08-02T18:38:01.637 INFO:teuthology.orchestra.run.smithi121.stdout:(99/160): socat-1.7.4.1-6.el9.x86_64.rpm 1.2 MB/s | 304 kB 00:00 2024-08-02T18:38:01.662 INFO:teuthology.orchestra.run.smithi121.stdout:(100/160): uuid-1.6.2-55.el9.x86_64.rpm 278 kB/s | 58 kB 00:00 2024-08-02T18:38:01.721 INFO:teuthology.orchestra.run.smithi121.stdout:(101/160): xfsprogs-devel-6.4.0-3.el9.x86_64.rp 887 kB/s | 96 kB 00:00 2024-08-02T18:38:01.763 INFO:teuthology.orchestra.run.smithi121.stdout:(102/160): xmlstarlet-1.6.1-20.el9.x86_64.rpm 635 kB/s | 64 kB 00:00 2024-08-02T18:38:01.788 INFO:teuthology.orchestra.run.smithi121.stdout:(103/160): zlib-devel-1.2.11-41.el9.x86_64.rpm 357 kB/s | 45 kB 00:00 2024-08-02T18:38:01.855 INFO:teuthology.orchestra.run.smithi121.stdout:(104/160): abseil-cpp-20211102.0-3.el9.x86_64.r 8.1 MB/s | 548 kB 00:00 2024-08-02T18:38:01.880 INFO:teuthology.orchestra.run.smithi121.stdout:(105/160): gperftools-libs-2.9.1-2.el9.x86_64.r 12 MB/s | 309 kB 00:00 2024-08-02T18:38:01.906 INFO:teuthology.orchestra.run.smithi121.stdout:(106/160): grpc-data-1.46.7-10.el9.noarch.rpm 775 kB/s | 19 kB 00:00 2024-08-02T18:38:02.006 INFO:teuthology.orchestra.run.smithi121.stdout:(107/160): libarrow-9.0.0-11.el9.x86_64.rpm 44 MB/s | 4.4 MB 00:00 2024-08-02T18:38:02.031 INFO:teuthology.orchestra.run.smithi121.stdout:(108/160): lua-devel-5.4.4-4.el9.x86_64.rpm 72 kB/s | 22 kB 00:00 2024-08-02T18:38:02.052 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction check 2024-08-02T18:38:02.057 INFO:teuthology.orchestra.run.smithi121.stdout:(109/160): libarrow-doc-9.0.0-11.el9.noarch.rpm 517 kB/s | 26 kB 00:00 2024-08-02T18:38:02.107 INFO:teuthology.orchestra.run.smithi121.stdout:(110/160): libunwind-1.6.2-1.el9.x86_64.rpm 2.7 MB/s | 67 kB 00:00 2024-08-02T18:38:02.140 INFO:teuthology.orchestra.run.smithi121.stdout:(111/160): luarocks-3.9.2-5.el9.noarch.rpm 4.8 MB/s | 151 kB 00:00 2024-08-02T18:38:02.166 INFO:teuthology.orchestra.run.smithi121.stdout:(112/160): liboath-2.6.7-2.el9.x86_64.rpm 362 kB/s | 49 kB 00:00 2024-08-02T18:38:02.256 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction check succeeded. 2024-08-02T18:38:02.256 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction test 2024-08-02T18:38:02.287 INFO:teuthology.orchestra.run.smithi121.stdout:(113/160): parquet-libs-9.0.0-11.el9.x86_64.rpm 5.6 MB/s | 839 kB 00:00 2024-08-02T18:38:02.316 INFO:teuthology.orchestra.run.smithi121.stdout:(114/160): python3-bcrypt-3.2.2-1.el9.x86_64.rp 1.5 MB/s | 43 kB 00:00 2024-08-02T18:38:02.342 INFO:teuthology.orchestra.run.smithi121.stdout:(115/160): python3-cachetools-4.2.4-1.el9.noarc 1.3 MB/s | 32 kB 00:00 2024-08-02T18:38:02.367 INFO:teuthology.orchestra.run.smithi121.stdout:(116/160): python3-asyncssh-2.13.2-5.el9.noarch 2.7 MB/s | 548 kB 00:00 2024-08-02T18:38:02.392 INFO:teuthology.orchestra.run.smithi121.stdout:(117/160): python3-certifi-2023.05.07-4.el9.noa 281 kB/s | 14 kB 00:00 2024-08-02T18:38:02.417 INFO:teuthology.orchestra.run.smithi121.stdout:(118/160): python3-cheroot-8.6.0-4.el9.noarch.r 3.3 MB/s | 172 kB 00:00 2024-08-02T18:38:02.443 INFO:teuthology.orchestra.run.smithi121.stdout:(119/160): python3-cherrypy-18.6.1-2.el9.noarch 7.0 MB/s | 358 kB 00:00 2024-08-02T18:38:02.468 INFO:teuthology.orchestra.run.smithi121.stdout:(120/160): python3-cmd2-2.4.2-2.el9.noarch.rpm 5.9 MB/s | 303 kB 00:00 2024-08-02T18:38:02.502 INFO:teuthology.orchestra.run.smithi121.stdout:(121/160): python3-google-auth-2.32.0-1.el9.noa 3.6 MB/s | 216 kB 00:00 2024-08-02T18:38:02.527 INFO:teuthology.orchestra.run.smithi121.stdout:(122/160): python3-grpcio-tools-1.46.7-10.el9.x 5.7 MB/s | 144 kB 00:00 2024-08-02T18:38:02.553 INFO:teuthology.orchestra.run.smithi121.stdout:(123/160): python3-jaraco-8.2.1-3.el9.noarch.rp 426 kB/s | 11 kB 00:00 2024-08-02T18:38:02.578 INFO:teuthology.orchestra.run.smithi121.stdout:(124/160): python3-jaraco-classes-3.2.1-5.el9.n 708 kB/s | 18 kB 00:00 2024-08-02T18:38:02.603 INFO:teuthology.orchestra.run.smithi121.stdout:(125/160): python3-jaraco-collections-3.0.0-8.e 934 kB/s | 23 kB 00:00 2024-08-02T18:38:02.628 INFO:teuthology.orchestra.run.smithi121.stdout:(126/160): python3-jaraco-functools-3.5.0-2.el9 778 kB/s | 19 kB 00:00 2024-08-02T18:38:02.654 INFO:teuthology.orchestra.run.smithi121.stdout:(127/160): protobuf-compiler-3.14.0-13.el9.x86_ 969 kB/s | 863 kB 00:00 2024-08-02T18:38:02.704 INFO:teuthology.orchestra.run.smithi121.stdout:(128/160): python3-jaraco-text-3.2.0-6.el9.noar 261 kB/s | 20 kB 00:00 2024-08-02T18:38:02.729 INFO:teuthology.orchestra.run.smithi121.stdout:(129/160): python3-logutils-0.3.5-21.el9.noarch 2.0 MB/s | 46 kB 00:00 2024-08-02T18:38:02.754 INFO:teuthology.orchestra.run.smithi121.stdout:(130/160): python3-more-itertools-8.12.0-2.el9. 3.1 MB/s | 79 kB 00:00 2024-08-02T18:38:02.780 INFO:teuthology.orchestra.run.smithi121.stdout:(131/160): python3-natsort-7.1.1-5.el9.noarch.r 2.3 MB/s | 58 kB 00:00 2024-08-02T18:38:02.813 INFO:teuthology.orchestra.run.smithi121.stdout:(132/160): python3-pecan-1.4.2-3.el9.noarch.rpm 8.0 MB/s | 272 kB 00:00 2024-08-02T18:38:02.839 INFO:teuthology.orchestra.run.smithi121.stdout:(133/160): python3-portend-3.1.0-2.el9.noarch.r 655 kB/s | 16 kB 00:00 2024-08-02T18:38:02.864 INFO:teuthology.orchestra.run.smithi121.stdout:(134/160): python3-pyOpenSSL-21.0.0-1.el9.noarc 3.5 MB/s | 90 kB 00:00 2024-08-02T18:38:02.914 INFO:teuthology.orchestra.run.smithi121.stdout:(135/160): python3-grpcio-1.46.7-10.el9.x86_64. 4.6 MB/s | 2.0 MB 00:00 2024-08-02T18:38:02.940 INFO:teuthology.orchestra.run.smithi121.stdout:(136/160): python3-pyperclip-1.8.2-2.el9.noarch 375 kB/s | 28 kB 00:00 2024-08-02T18:38:02.965 INFO:teuthology.orchestra.run.smithi121.stdout:(137/160): python3-repoze-lru-0.7-16.el9.noarch 610 kB/s | 31 kB 00:00 2024-08-02T18:38:02.990 INFO:teuthology.orchestra.run.smithi121.stdout:(138/160): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-08-02T18:38:03.024 INFO:teuthology.orchestra.run.smithi121.stdout:(139/160): python3-kubernetes-26.1.0-2.el9.noar 2.8 MB/s | 1.0 MB 00:00 2024-08-02T18:38:03.049 INFO:teuthology.orchestra.run.smithi121.stdout:(140/160): python3-routes-2.5.1-5.el9.noarch.rp 1.7 MB/s | 188 kB 00:00 2024-08-02T18:38:03.074 INFO:teuthology.orchestra.run.smithi121.stdout:(141/160): python3-tempora-5.0.0-2.el9.noarch.r 426 kB/s | 36 kB 00:00 2024-08-02T18:38:03.100 INFO:teuthology.orchestra.run.smithi121.stdout:(142/160): python3-typing-extensions-4.12.2-2.e 985 kB/s | 74 kB 00:00 2024-08-02T18:38:03.117 INFO:teuthology.orchestra.run.smithi121.stdout:(143/160): python3-websocket-client-1.2.3-2.el9 2.1 MB/s | 90 kB 00:00 2024-08-02T18:38:03.142 INFO:teuthology.orchestra.run.smithi121.stdout:(144/160): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2024-08-02T18:38:03.176 INFO:teuthology.orchestra.run.smithi121.stdout:(145/160): python3-zc-lockfile-2.0-10.el9.noarc 341 kB/s | 20 kB 00:00 2024-08-02T18:38:03.201 INFO:teuthology.orchestra.run.smithi121.stdout:(146/160): re2-20211101-3.el9.x86_64.rpm 3.2 MB/s | 192 kB 00:00 2024-08-02T18:38:03.291 INFO:teuthology.orchestra.run.smithi121.stdout:(147/160): python3-werkzeug-2.0.3-3.el9.1.noarc 3.3 MB/s | 427 kB 00:00 2024-08-02T18:38:03.292 INFO:teuthology.orchestra.run.smithi121.stdout:(148/160): thrift-0.15.0-2.el9.x86_64.rpm 16 MB/s | 1.6 MB 00:00 2024-08-02T18:38:03.444 INFO:teuthology.orchestra.run.smithi121.stdout:(149/160): librados2-19.1.0-1260.g26c3fb8e.el9. 14 MB/s | 3.4 MB 00:00 2024-08-02T18:38:03.644 INFO:teuthology.orchestra.run.smithi121.stdout:(150/160): librbd1-19.1.0-1260.g26c3fb8e.el9.x8 7.6 MB/s | 3.2 MB 00:00 2024-08-02T18:38:03.744 INFO:teuthology.orchestra.run.smithi121.stdout:(151/160): NetworkManager-team-1.48.2-2.el9.x86 408 kB/s | 41 kB 00:00 2024-08-02T18:38:03.828 INFO:teuthology.orchestra.run.smithi121.stdout:(152/160): NetworkManager-libnm-1.48.2-2.el9.x8 4.7 MB/s | 1.8 MB 00:00 2024-08-02T18:38:03.869 INFO:teuthology.orchestra.run.smithi121.stdout:(153/160): NetworkManager-1.48.2-2.el9.x86_64.r 4.1 MB/s | 2.3 MB 00:00 2024-08-02T18:38:03.886 INFO:teuthology.orchestra.run.smithi121.stdout:(154/160): elfutils-debuginfod-client-0.191-4.e 628 kB/s | 37 kB 00:00 2024-08-02T18:38:03.912 INFO:teuthology.orchestra.run.smithi121.stdout:(155/160): NetworkManager-tui-1.48.2-2.el9.x86_ 1.4 MB/s | 247 kB 00:00 2024-08-02T18:38:03.937 INFO:teuthology.orchestra.run.smithi121.stdout:(156/160): elfutils-libelf-0.191-4.el9.x86_64.r 3.0 MB/s | 207 kB 00:00 2024-08-02T18:38:03.988 INFO:teuthology.orchestra.run.smithi121.stdout:(157/160): elfutils-libs-0.191-4.el9.x86_64.rpm 2.5 MB/s | 260 kB 00:00 2024-08-02T18:38:04.029 INFO:teuthology.orchestra.run.smithi121.stdout:(158/160): openssl-3.2.2-2.el9.x86_64.rpm 12 MB/s | 1.4 MB 00:00 2024-08-02T18:38:04.071 INFO:teuthology.orchestra.run.smithi121.stdout:(159/160): xfsprogs-6.4.0-3.el9.x86_64.rpm 13 MB/s | 1.1 MB 00:00 2024-08-02T18:38:04.163 INFO:teuthology.orchestra.run.smithi121.stdout:(160/160): openssl-libs-3.2.2-2.el9.x86_64.rpm 11 MB/s | 2.4 MB 00:00 2024-08-02T18:38:04.170 INFO:teuthology.orchestra.run.smithi121.stdout:-------------------------------------------------------------------------------- 2024-08-02T18:38:04.170 INFO:teuthology.orchestra.run.smithi121.stdout:Total 19 MB/s | 228 MB 00:11 2024-08-02T18:38:04.413 INFO:teuthology.orchestra.run.smithi103.stdout:Transaction test succeeded. 2024-08-02T18:38:04.419 INFO:teuthology.orchestra.run.smithi103.stdout:Running transaction 2024-08-02T18:38:05.365 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction check 2024-08-02T18:38:05.558 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction check succeeded. 2024-08-02T18:38:05.558 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction test 2024-08-02T18:38:07.143 INFO:teuthology.orchestra.run.smithi151.stdout: Preparing : 1/1 2024-08-02T18:38:07.236 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-08-02T18:38:07.275 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-08-02T18:38:07.388 INFO:teuthology.orchestra.run.smithi121.stdout:Transaction test succeeded. 2024-08-02T18:38:07.389 INFO:teuthology.orchestra.run.smithi121.stdout:Running transaction 2024-08-02T18:38:07.412 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-08-02T18:38:07.529 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-08-02T18:38:07.554 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-08-02T18:38:07.597 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-08-02T18:38:07.935 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-08-02T18:38:08.055 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:38:08.169 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:38:08.198 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:38:08.293 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:38:08.319 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 10/172 2024-08-02T18:38:08.354 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-08-02T18:38:08.554 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-08-02T18:38:08.609 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-08-02T18:38:08.637 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:38:08.740 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:38:08.763 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 15/172 2024-08-02T18:38:08.810 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 15/172 2024-08-02T18:38:08.831 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-08-02T18:38:08.854 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-08-02T18:38:09.005 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-08-02T18:38:09.101 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-08-02T18:38:09.283 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-08-02T18:38:09.480 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-08-02T18:38:09.531 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-08-02T18:38:09.624 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:09.707 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:09.913 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:10.025 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-08-02T18:38:10.118 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-08-02T18:38:10.155 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-08-02T18:38:10.189 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-08-02T18:38:10.255 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-08-02T18:38:10.299 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-08-02T18:38:10.331 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-packaging-20.9-5.el9.noarch 27/172 2024-08-02T18:38:10.375 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/172 2024-08-02T18:38:10.406 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/172 2024-08-02T18:38:10.434 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/172 2024-08-02T18:38:10.504 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/172 2024-08-02T18:38:10.557 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 32/172 2024-08-02T18:38:10.587 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/172 2024-08-02T18:38:10.622 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/172 2024-08-02T18:38:10.699 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/172 2024-08-02T18:38:10.733 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9. 36/172 2024-08-02T18:38:10.779 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el 37/172 2024-08-02T18:38:10.806 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_6 38/172 2024-08-02T18:38:10.855 INFO:teuthology.orchestra.run.smithi103.stdout: Preparing : 1/1 2024-08-02T18:38:10.876 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/172 2024-08-02T18:38:10.921 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : luarocks-3.9.2-5.el9.noarch 40/172 2024-08-02T18:38:10.944 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-08-02T18:38:10.990 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-08-02T18:38:10.995 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/172 2024-08-02T18:38:11.051 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-08-02T18:38:11.085 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-08-02T18:38:11.111 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-08-02T18:38:11.127 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/172 2024-08-02T18:38:11.157 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-08-02T18:38:11.180 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/172 2024-08-02T18:38:11.500 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-08-02T18:38:11.612 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:38:11.708 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/172 2024-08-02T18:38:11.736 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:38:11.763 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:38:11.792 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/172 2024-08-02T18:38:11.822 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 46/172 2024-08-02T18:38:11.859 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:38:11.866 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 47/172 2024-08-02T18:38:11.885 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 10/172 2024-08-02T18:38:11.924 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 48/172 2024-08-02T18:38:11.929 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-08-02T18:38:11.961 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_6 49/172 2024-08-02T18:38:12.003 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/172 2024-08-02T18:38:12.110 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-08-02T18:38:12.153 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 51/172 2024-08-02T18:38:12.165 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-08-02T18:38:12.194 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:38:12.206 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 52/172 2024-08-02T18:38:12.261 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/172 2024-08-02T18:38:12.298 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:38:12.328 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 15/172 2024-08-02T18:38:12.333 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-08-02T18:38:12.365 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-08-02T18:38:12.391 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 15/172 2024-08-02T18:38:12.401 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 56/172 2024-08-02T18:38:12.412 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-08-02T18:38:12.436 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-08-02T18:38:12.449 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-08-02T18:38:12.551 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-08-02T18:38:12.581 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-08-02T18:38:12.636 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-08-02T18:38:12.684 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-08-02T18:38:12.687 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-08-02T18:38:12.822 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-08-02T18:38:12.863 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-08-02T18:38:12.904 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-08-02T18:38:12.938 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-08-02T18:38:13.003 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-08-02T18:38:13.045 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-08-02T18:38:13.062 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-08-02T18:38:13.085 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-08-02T18:38:13.111 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-08-02T18:38:13.122 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-08-02T18:38:13.136 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-08-02T18:38:13.209 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-08-02T18:38:13.230 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:13.332 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:13.337 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-08-02T18:38:13.385 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-08-02T18:38:13.413 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-08-02T18:38:13.447 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-08-02T18:38:13.486 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-08-02T18:38:13.518 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-08-02T18:38:13.547 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-08-02T18:38:13.549 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:13.582 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-08-02T18:38:13.615 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-08-02T18:38:13.648 INFO:teuthology.orchestra.run.smithi121.stdout: Preparing : 1/1 2024-08-02T18:38:13.657 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-08-02T18:38:13.661 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-08-02T18:38:13.691 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-08-02T18:38:13.716 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-libs-1:3.2.2-2.el9.x86_64 1/172 2024-08-02T18:38:13.754 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 2/172 2024-08-02T18:38:13.759 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-08-02T18:38:13.786 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-08-02T18:38:13.796 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-08-02T18:38:13.808 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 3/172 2024-08-02T18:38:13.830 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-08-02T18:38:13.831 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-08-02T18:38:13.842 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : thrift-0.15.0-2.el9.x86_64 4/172 2024-08-02T18:38:13.861 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-08-02T18:38:13.876 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/172 2024-08-02T18:38:13.896 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-08-02T18:38:13.919 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/172 2024-08-02T18:38:13.949 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-08-02T18:38:13.965 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-08-02T18:38:13.981 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-packaging-20.9-5.el9.noarch 27/172 2024-08-02T18:38:14.012 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-02T18:38:14.025 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/172 2024-08-02T18:38:14.057 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/172 2024-08-02T18:38:14.085 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/172 2024-08-02T18:38:14.153 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/172 2024-08-02T18:38:14.206 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 32/172 2024-08-02T18:38:14.246 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/172 2024-08-02T18:38:14.247 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/172 2024-08-02T18:38:14.298 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/172 2024-08-02T18:38:14.352 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:38:14.373 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/172 2024-08-02T18:38:14.409 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9. 36/172 2024-08-02T18:38:14.454 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el 37/172 2024-08-02T18:38:14.475 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:38:14.480 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_6 38/172 2024-08-02T18:38:14.503 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:38:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/172 2024-08-02T18:38:14.595 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : luarocks-3.9.2-5.el9.noarch 40/172 2024-08-02T18:38:14.598 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:38:14.624 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 10/172 2024-08-02T18:38:14.657 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-private-libs-13.14-1.el9.x86_64 11/172 2024-08-02T18:38:14.670 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/172 2024-08-02T18:38:14.738 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-08-02T18:38:14.792 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-08-02T18:38:14.809 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/172 2024-08-02T18:38:14.826 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-08-02T18:38:14.847 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-libelf-0.191-4.el9.x86_64 12/172 2024-08-02T18:38:14.865 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/172 2024-08-02T18:38:14.916 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-13.14-1.el9.x86_64 13/172 2024-08-02T18:38:14.925 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-08-02T18:38:14.944 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:38:14.972 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-08-02T18:38:15.017 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-08-02T18:38:15.048 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:38:15.070 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 15/172 2024-08-02T18:38:15.109 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-08-02T18:38:15.132 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 15/172 2024-08-02T18:38:15.153 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-08-02T18:38:15.155 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-08-02T18:38:15.173 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 16/172 2024-08-02T18:38:15.332 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-08-02T18:38:15.359 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-08-02T18:38:15.362 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 17/172 2024-08-02T18:38:15.380 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/172 2024-08-02T18:38:15.437 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-08-02T18:38:15.469 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 17/172 2024-08-02T18:38:15.476 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/172 2024-08-02T18:38:15.506 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 46/172 2024-08-02T18:38:15.542 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 47/172 2024-08-02T18:38:15.592 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 48/172 2024-08-02T18:38:15.629 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_6 49/172 2024-08-02T18:38:15.661 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : xfsprogs-6.4.0-3.el9.x86_64 18/172 2024-08-02T18:38:15.671 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/172 2024-08-02T18:38:15.816 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-08-02T18:38:15.823 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 51/172 2024-08-02T18:38:15.856 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 19/172 2024-08-02T18:38:15.874 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 52/172 2024-08-02T18:38:15.928 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/172 2024-08-02T18:38:15.978 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:16.003 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-08-02T18:38:16.033 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-08-02T18:38:16.058 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:16.069 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 56/172 2024-08-02T18:38:16.088 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-08-02T18:38:16.116 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-08-02T18:38:16.151 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-08-02T18:38:16.195 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-08-02T18:38:16.207 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-08-02T18:38:16.237 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-08-02T18:38:16.269 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.48.2-2.el9.x86_64 20/172 2024-08-02T18:38:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-08-02T18:38:16.384 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : re2-1:20211101-3.el9.x86_64 21/172 2024-08-02T18:38:16.484 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 22/172 2024-08-02T18:38:16.531 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 23/172 2024-08-02T18:38:16.566 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : liboath-2.6.7-2.el9.x86_64 24/172 2024-08-02T18:38:16.623 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-08-02T18:38:16.631 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/172 2024-08-02T18:38:16.676 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/172 2024-08-02T18:38:16.690 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-08-02T18:38:16.716 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-packaging-20.9-5.el9.noarch 27/172 2024-08-02T18:38:16.761 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 28/172 2024-08-02T18:38:16.789 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-08-02T18:38:16.792 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 29/172 2024-08-02T18:38:16.821 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-5.4.4-4.el9.x86_64 30/172 2024-08-02T18:38:16.822 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-08-02T18:38:16.863 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-08-02T18:38:16.891 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 31/172 2024-08-02T18:38:16.896 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-08-02T18:38:16.920 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-08-02T18:38:16.953 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 32/172 2024-08-02T18:38:16.983 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 33/172 2024-08-02T18:38:17.003 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-08-02T18:38:17.026 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libquadmath-11.4.1-3.el9.x86_64 34/172 2024-08-02T18:38:17.102 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libgfortran-11.4.1-3.el9.x86_64 35/172 2024-08-02T18:38:17.137 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9. 36/172 2024-08-02T18:38:17.138 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-08-02T18:38:17.183 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el 37/172 2024-08-02T18:38:17.186 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-08-02T18:38:17.201 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_6 38/172 2024-08-02T18:38:17.214 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-08-02T18:38:17.257 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-08-02T18:38:17.269 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 39/172 2024-08-02T18:38:17.296 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-08-02T18:38:17.315 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : luarocks-3.9.2-5.el9.noarch 40/172 2024-08-02T18:38:17.328 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-08-02T18:38:17.357 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-08-02T18:38:17.383 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-08-02T18:38:17.389 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 41/172 2024-08-02T18:38:17.417 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-08-02T18:38:17.435 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-08-02T18:38:17.458 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-08-02T18:38:17.493 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-08-02T18:38:17.503 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-08-02T18:38:17.522 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 42/172 2024-08-02T18:38:17.531 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-08-02T18:38:17.564 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-08-02T18:38:17.576 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 43/172 2024-08-02T18:38:17.578 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-08-02T18:38:17.624 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-08-02T18:38:17.654 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-08-02T18:38:17.757 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-08-02T18:38:17.805 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-02T18:38:17.950 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-08-02T18:38:17.986 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 104/172 2024-08-02T18:38:18.080 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 104/172 2024-08-02T18:38:18.116 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rsa-4.9-2.el9.noarch 44/172 2024-08-02T18:38:18.130 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 105/172 2024-08-02T18:38:18.169 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-08-02T18:38:18.197 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 45/172 2024-08-02T18:38:18.226 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 46/172 2024-08-02T18:38:18.262 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 47/172 2024-08-02T18:38:18.303 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-libs-0.191-4.el9.x86_64 48/172 2024-08-02T18:38:18.341 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_6 49/172 2024-08-02T18:38:18.382 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 50/172 2024-08-02T18:38:18.527 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-08-02T18:38:18.538 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 51/172 2024-08-02T18:38:18.569 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-08-02T18:38:18.602 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : openssl-1:3.2.2-2.el9.x86_64 52/172 2024-08-02T18:38:18.603 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-08-02T18:38:18.646 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-08-02T18:38:18.657 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 53/172 2024-08-02T18:38:18.672 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 108/172 2024-08-02T18:38:18.700 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-08-02T18:38:18.729 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 54/172 2024-08-02T18:38:18.744 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 108/172 2024-08-02T18:38:18.761 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 55/172 2024-08-02T18:38:18.774 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 109/172 2024-08-02T18:38:18.774 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-08-02T18:38:18.797 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 56/172 2024-08-02T18:38:18.820 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-08-02T18:38:18.844 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 57/172 2024-08-02T18:38:18.880 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 58/172 2024-08-02T18:38:18.917 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-08-02T18:38:18.923 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 59/172 2024-08-02T18:38:18.955 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-08-02T18:38:18.965 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 60/172 2024-08-02T18:38:19.100 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 61/172 2024-08-02T18:38:19.133 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-08-02T18:38:19.162 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-08-02T18:38:19.240 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-08-02T18:38:19.360 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 62/172 2024-08-02T18:38:19.401 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 63/172 2024-08-02T18:38:19.501 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 64/172 2024-08-02T18:38:19.534 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-google-auth-1:2.32.0-1.el9.noarch 65/172 2024-08-02T18:38:19.574 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 66/172 2024-08-02T18:38:19.599 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 67/172 2024-08-02T18:38:19.624 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 68/172 2024-08-02T18:38:19.690 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 69/172 2024-08-02T18:38:19.818 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 70/172 2024-08-02T18:38:19.856 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 71/172 2024-08-02T18:38:19.880 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-08-02T18:38:19.884 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : zlib-devel-1.2.11-41.el9.x86_64 72/172 2024-08-02T18:38:19.919 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 73/172 2024-08-02T18:38:19.957 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : uuid-1.6.2-55.el9.x86_64 74/172 2024-08-02T18:38:19.989 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 75/172 2024-08-02T18:38:19.993 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-08-02T18:38:20.019 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 76/172 2024-08-02T18:38:20.054 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 77/172 2024-08-02T18:38:20.087 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 78/172 2024-08-02T18:38:20.129 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 79/172 2024-08-02T18:38:20.163 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 80/172 2024-08-02T18:38:20.249 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 81/172 2024-08-02T18:38:20.293 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 82/172 2024-08-02T18:38:20.324 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 83/172 2024-08-02T18:38:20.427 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 84/172 2024-08-02T18:38:20.475 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-02T18:38:21.079 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:21.114 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:21.195 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 86/172 2024-08-02T18:38:21.231 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-08-02T18:38:21.250 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 87/172 2024-08-02T18:38:21.281 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 88/172 2024-08-02T18:38:21.324 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-08-02T18:38:21.351 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-08-02T18:38:21.379 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 89/172 2024-08-02T18:38:21.385 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-08-02T18:38:21.427 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-devel-3.9.18-3.el9.x86_64 90/172 2024-08-02T18:38:21.472 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-colorama-0.4.6-3.el9.noarch 91/172 2024-08-02T18:38:21.559 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 92/172 2024-08-02T18:38:21.592 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 93/172 2024-08-02T18:38:21.660 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:21.693 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-08-02T18:38:21.702 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 111/172 2024-08-02T18:38:21.740 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 104/172 2024-08-02T18:38:21.760 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-0.3.21-2.el9.x86_64 94/172 2024-08-02T18:38:21.790 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 95/172 2024-08-02T18:38:21.803 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 111/172 2024-08-02T18:38:21.803 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-02T18:38:21.804 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-02T18:38:21.804 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:21.837 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 112/172 2024-08-02T18:38:21.851 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 104/172 2024-08-02T18:38:21.867 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 96/172 2024-08-02T18:38:21.878 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 105/172 2024-08-02T18:38:21.922 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-08-02T18:38:22.395 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-08-02T18:38:22.426 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 108/172 2024-08-02T18:38:22.498 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 108/172 2024-08-02T18:38:22.507 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 97/172 2024-08-02T18:38:22.528 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 109/172 2024-08-02T18:38:22.628 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 98/172 2024-08-02T18:38:23.839 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 99/172 2024-08-02T18:38:23.919 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 100/172 2024-08-02T18:38:23.946 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 101/172 2024-08-02T18:38:23.979 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libuuid-devel-2.37.4-18.el9.x86_64 102/172 2024-08-02T18:38:24.288 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 103/172 2024-08-02T18:38:24.326 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 104/172 2024-08-02T18:38:24.429 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 104/172 2024-08-02T18:38:24.456 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 105/172 2024-08-02T18:38:24.500 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 106/172 2024-08-02T18:38:24.738 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:24.774 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:24.978 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 107/172 2024-08-02T18:38:25.013 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 108/172 2024-08-02T18:38:25.084 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 108/172 2024-08-02T18:38:25.114 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 109/172 2024-08-02T18:38:25.490 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:25.528 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 111/172 2024-08-02T18:38:25.621 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 111/172 2024-08-02T18:38:25.621 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-02T18:38:25.621 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-02T18:38:25.621 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:25.654 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 112/172 2024-08-02T18:38:27.372 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:27.406 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:27.950 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 110/172 2024-08-02T18:38:27.985 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 111/172 2024-08-02T18:38:28.059 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 111/172 2024-08-02T18:38:28.060 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-08-02T18:38:28.060 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-08-02T18:38:28.060 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:28.095 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 112/172 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 112/172 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /sys 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /proc 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /mnt 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /var/tmp 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /home 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /root 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout:skipping the directory /tmp 2024-08-02T18:38:33.609 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:33.781 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 113/172 2024-08-02T18:38:33.797 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 113/172 2024-08-02T18:38:33.798 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:33.798 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-02T18:38:33.798 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:35.285 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 114/172 2024-08-02T18:38:35.310 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 114/172 2024-08-02T18:38:35.311 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:35.311 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-02T18:38:35.311 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-02T18:38:35.311 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-02T18:38:35.311 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:35.560 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 115/172 2024-08-02T18:38:35.583 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 115/172 2024-08-02T18:38:35.583 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:35.583 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-02T18:38:35.583 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-02T18:38:35.584 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-02T18:38:35.584 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:36.020 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 116/172 2024-08-02T18:38:36.043 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 116/172 2024-08-02T18:38:36.043 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:36.043 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-02T18:38:36.043 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-02T18:38:36.043 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-02T18:38:36.043 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:36.150 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-08-02T18:38:36.208 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-08-02T18:38:36.263 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-08-02T18:38:36.449 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-08-02T18:38:36.505 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-08-02T18:38:36.583 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-08-02T18:38:36.673 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-08-02T18:38:36.821 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-08-02T18:38:36.856 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-08-02T18:38:36.888 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-08-02T18:38:36.916 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-08-02T18:38:37.240 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 112/172 2024-08-02T18:38:37.241 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /sys 2024-08-02T18:38:37.241 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /proc 2024-08-02T18:38:37.241 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /mnt 2024-08-02T18:38:37.241 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /var/tmp 2024-08-02T18:38:37.241 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /home 2024-08-02T18:38:37.241 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /root 2024-08-02T18:38:37.241 INFO:teuthology.orchestra.run.smithi103.stdout:skipping the directory /tmp 2024-08-02T18:38:37.241 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:37.378 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 128/172 2024-08-02T18:38:37.407 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 128/172 2024-08-02T18:38:37.430 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 113/172 2024-08-02T18:38:37.439 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.e 129/172 2024-08-02T18:38:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 113/172 2024-08-02T18:38:37.446 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:37.446 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-02T18:38:37.446 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:37.502 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e. 130/172 2024-08-02T18:38:37.531 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 131/172 2024-08-02T18:38:38.573 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 131/172 2024-08-02T18:38:38.617 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 132/172 2024-08-02T18:38:38.925 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 114/172 2024-08-02T18:38:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 114/172 2024-08-02T18:38:38.952 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:38.952 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-02T18:38:38.952 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-02T18:38:38.952 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-02T18:38:38.952 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:39.176 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 115/172 2024-08-02T18:38:39.199 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 115/172 2024-08-02T18:38:39.200 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:39.200 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-02T18:38:39.200 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-02T18:38:39.200 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-02T18:38:39.200 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:39.578 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 132/172 2024-08-02T18:38:39.601 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 133/172 2024-08-02T18:38:39.636 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 116/172 2024-08-02T18:38:39.659 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 116/172 2024-08-02T18:38:39.659 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:39.659 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-02T18:38:39.659 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-02T18:38:39.659 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-02T18:38:39.659 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:39.659 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 112/172 2024-08-02T18:38:39.660 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /sys 2024-08-02T18:38:39.660 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /proc 2024-08-02T18:38:39.660 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /mnt 2024-08-02T18:38:39.660 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /var/tmp 2024-08-02T18:38:39.660 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /home 2024-08-02T18:38:39.660 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /root 2024-08-02T18:38:39.660 INFO:teuthology.orchestra.run.smithi121.stdout:skipping the directory /tmp 2024-08-02T18:38:39.660 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:39.703 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 133/172 2024-08-02T18:38:39.757 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-08-02T18:38:39.813 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-08-02T18:38:39.835 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 113/172 2024-08-02T18:38:39.851 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 113/172 2024-08-02T18:38:39.851 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:39.851 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-08-02T18:38:39.851 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:39.862 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el 134/172 2024-08-02T18:38:39.874 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-08-02T18:38:39.895 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 135/172 2024-08-02T18:38:39.918 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 135/172 2024-08-02T18:38:39.918 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:39.919 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-02T18:38:39.919 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-02T18:38:39.919 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-02T18:38:39.919 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:39.963 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 136/172 2024-08-02T18:38:39.975 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 136/172 2024-08-02T18:38:40.052 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-08-02T18:38:40.074 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 137/172 2024-08-02T18:38:40.094 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-08-02T18:38:40.128 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 138/172 2024-08-02T18:38:40.171 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-08-02T18:38:40.268 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-08-02T18:38:40.398 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-08-02T18:38:40.436 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-08-02T18:38:40.468 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-08-02T18:38:40.496 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-08-02T18:38:40.892 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 128/172 2024-08-02T18:38:40.921 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 128/172 2024-08-02T18:38:40.952 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.e 129/172 2024-08-02T18:38:41.014 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e. 130/172 2024-08-02T18:38:41.037 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-08-02T18:38:41.043 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 131/172 2024-08-02T18:38:41.066 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 140/172 2024-08-02T18:38:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 140/172 2024-08-02T18:38:41.089 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:41.089 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-02T18:38:41.089 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-02T18:38:41.089 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-02T18:38:41.089 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:41.133 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 141/172 2024-08-02T18:38:41.155 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 141/172 2024-08-02T18:38:41.155 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:41.156 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-02T18:38:41.156 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:41.200 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 142/172 2024-08-02T18:38:41.224 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 142/172 2024-08-02T18:38:41.224 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:41.224 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-02T18:38:41.224 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-02T18:38:41.224 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-02T18:38:41.224 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:41.324 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 114/172 2024-08-02T18:38:41.347 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 114/172 2024-08-02T18:38:41.347 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:41.347 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-08-02T18:38:41.347 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-02T18:38:41.347 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-08-02T18:38:41.347 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:41.526 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 143/172 2024-08-02T18:38:41.549 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 143/172 2024-08-02T18:38:41.549 INFO:teuthology.orchestra.run.smithi151.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:41.549 INFO:teuthology.orchestra.run.smithi151.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-02T18:38:41.549 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-02T18:38:41.549 INFO:teuthology.orchestra.run.smithi151.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-02T18:38:41.550 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:41.572 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 115/172 2024-08-02T18:38:41.594 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 115/172 2024-08-02T18:38:41.594 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:41.594 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-08-02T18:38:41.594 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-02T18:38:41.594 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-08-02T18:38:41.594 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:42.024 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 116/172 2024-08-02T18:38:42.045 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 116/172 2024-08-02T18:38:42.045 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:42.045 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-08-02T18:38:42.045 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-02T18:38:42.045 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-08-02T18:38:42.045 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:42.078 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 131/172 2024-08-02T18:38:42.129 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 132/172 2024-08-02T18:38:42.144 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : automake-1.16.2-8.el9.noarch 117/172 2024-08-02T18:38:42.201 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-ply-3.11-14.el9.noarch 118/172 2024-08-02T18:38:42.256 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 119/172 2024-08-02T18:38:42.440 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 120/172 2024-08-02T18:38:42.498 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 121/172 2024-08-02T18:38:42.567 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 122/172 2024-08-02T18:38:42.656 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 123/172 2024-08-02T18:38:42.802 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 124/172 2024-08-02T18:38:42.848 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 125/172 2024-08-02T18:38:42.880 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 126/172 2024-08-02T18:38:42.908 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : fuse-2.9.9-16.el9.x86_64 127/172 2024-08-02T18:38:43.085 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 132/172 2024-08-02T18:38:43.113 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 133/172 2024-08-02T18:38:43.215 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 133/172 2024-08-02T18:38:43.369 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 128/172 2024-08-02T18:38:43.375 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el 134/172 2024-08-02T18:38:43.399 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 128/172 2024-08-02T18:38:43.406 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 135/172 2024-08-02T18:38:43.430 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.e 129/172 2024-08-02T18:38:43.430 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 135/172 2024-08-02T18:38:43.431 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:43.431 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-02T18:38:43.431 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-02T18:38:43.431 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-02T18:38:43.431 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:43.482 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 136/172 2024-08-02T18:38:43.492 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e. 130/172 2024-08-02T18:38:43.494 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 136/172 2024-08-02T18:38:43.522 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 131/172 2024-08-02T18:38:43.592 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 137/172 2024-08-02T18:38:43.646 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 138/172 2024-08-02T18:38:44.558 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 131/172 2024-08-02T18:38:44.569 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-08-02T18:38:44.598 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 132/172 2024-08-02T18:38:44.602 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 140/172 2024-08-02T18:38:44.625 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 140/172 2024-08-02T18:38:44.625 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:44.626 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-02T18:38:44.626 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-02T18:38:44.626 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-02T18:38:44.626 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:44.669 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 141/172 2024-08-02T18:38:44.691 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 141/172 2024-08-02T18:38:44.692 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:44.692 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-02T18:38:44.692 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:44.737 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 142/172 2024-08-02T18:38:44.759 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 142/172 2024-08-02T18:38:44.759 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:44.760 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-02T18:38:44.760 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-02T18:38:44.760 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-02T18:38:44.760 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:45.062 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 143/172 2024-08-02T18:38:45.085 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 143/172 2024-08-02T18:38:45.085 INFO:teuthology.orchestra.run.smithi103.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:45.085 INFO:teuthology.orchestra.run.smithi103.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-02T18:38:45.085 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-02T18:38:45.086 INFO:teuthology.orchestra.run.smithi103.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-02T18:38:45.086 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:38:45.558 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 132/172 2024-08-02T18:38:45.590 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 133/172 2024-08-02T18:38:45.691 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 133/172 2024-08-02T18:38:45.860 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el 134/172 2024-08-02T18:38:45.893 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 135/172 2024-08-02T18:38:45.916 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 135/172 2024-08-02T18:38:45.916 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:45.916 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-08-02T18:38:45.916 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-02T18:38:45.916 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-08-02T18:38:45.916 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:45.960 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 136/172 2024-08-02T18:38:45.971 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 136/172 2024-08-02T18:38:46.070 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 137/172 2024-08-02T18:38:46.106 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 144/172 2024-08-02T18:38:46.116 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 138/172 2024-08-02T18:38:46.147 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 145/172 2024-08-02T18:38:46.230 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 146/172 2024-08-02T18:38:46.263 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-08-02T18:38:46.290 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-08-02T18:38:46.475 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 149/172 2024-08-02T18:38:46.517 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-08-02T18:38:46.550 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_ 151/172 2024-08-02T18:38:46.598 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-08-02T18:38:46.628 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-08-02T18:38:46.675 INFO:teuthology.orchestra.run.smithi151.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-08-02T18:38:47.030 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libtool-2.4.6-46.el9.x86_64 139/172 2024-08-02T18:38:47.054 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 140/172 2024-08-02T18:38:47.077 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 140/172 2024-08-02T18:38:47.077 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:47.077 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-08-02T18:38:47.077 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-02T18:38:47.077 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-08-02T18:38:47.077 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:47.121 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 141/172 2024-08-02T18:38:47.143 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 141/172 2024-08-02T18:38:47.143 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:47.144 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-08-02T18:38:47.144 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:47.189 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 142/172 2024-08-02T18:38:47.210 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 142/172 2024-08-02T18:38:47.210 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:47.211 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2024-08-02T18:38:47.211 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-02T18:38:47.211 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2024-08-02T18:38:47.211 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:47.288 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:47.334 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:47.354 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:47.514 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 143/172 2024-08-02T18:38:47.536 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 143/172 2024-08-02T18:38:47.537 INFO:teuthology.orchestra.run.smithi121.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-08-02T18:38:47.537 INFO:teuthology.orchestra.run.smithi121.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-08-02T18:38:47.537 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-02T18:38:47.537 INFO:teuthology.orchestra.run.smithi121.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-08-02T18:38:47.537 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:38:48.189 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 156/172 2024-08-02T18:38:48.292 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-08-02T18:38:48.341 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-08-02T18:38:48.432 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-08-02T18:38:48.480 INFO:teuthology.orchestra.run.smithi151.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-08-02T18:38:48.505 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-08-02T18:38:48.530 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-08-02T18:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-08-02T18:38:48.557 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-08-02T18:38:48.642 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-08-02T18:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-08-02T18:38:48.676 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-08-02T18:38:48.761 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-08-02T18:38:48.786 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-08-02T18:38:48.791 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:48.792 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:48.971 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:48.972 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-08-02T18:38:49.048 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-08-02T18:38:49.081 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-08-02T18:38:49.107 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-08-02T18:38:49.171 INFO:teuthology.orchestra.run.smithi151.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:38:49.616 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 144/172 2024-08-02T18:38:49.657 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 145/172 2024-08-02T18:38:49.698 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 146/172 2024-08-02T18:38:49.731 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-08-02T18:38:49.758 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-08-02T18:38:49.968 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 149/172 2024-08-02T18:38:50.013 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-08-02T18:38:50.045 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_ 151/172 2024-08-02T18:38:50.086 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-08-02T18:38:50.115 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-08-02T18:38:50.162 INFO:teuthology.orchestra.run.smithi103.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-08-02T18:38:50.720 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:50.761 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:50.781 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:51.612 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 156/172 2024-08-02T18:38:51.691 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-08-02T18:38:51.733 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-08-02T18:38:51.824 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-08-02T18:38:51.853 INFO:teuthology.orchestra.run.smithi103.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-08-02T18:38:51.878 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-08-02T18:38:51.904 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-08-02T18:38:51.931 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-08-02T18:38:51.931 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-08-02T18:38:51.998 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-08-02T18:38:52.031 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-08-02T18:38:52.031 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-08-02T18:38:52.051 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 144/172 2024-08-02T18:38:52.092 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 145/172 2024-08-02T18:38:52.124 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-08-02T18:38:52.133 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 146/172 2024-08-02T18:38:52.149 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-08-02T18:38:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:52.155 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:52.165 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : xfsprogs-devel-6.4.0-3.el9.x86_64 147/172 2024-08-02T18:38:52.193 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : elfutils-libelf-devel-0.191-4.el9.x86_64 148/172 2024-08-02T18:38:52.335 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:52.335 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-08-02T18:38:52.375 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 149/172 2024-08-02T18:38:52.419 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-08-02T18:38:52.422 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-contrib-13.14-1.el9.x86_64 150/172 2024-08-02T18:38:52.452 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-08-02T18:38:52.463 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_ 151/172 2024-08-02T18:38:52.478 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-08-02T18:38:52.503 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : elfutils-debuginfod-client-0.191-4.el9.x86_64 152/172 2024-08-02T18:38:52.533 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-team-1:1.48.2-2.el9.x86_64 153/172 2024-08-02T18:38:52.552 INFO:teuthology.orchestra.run.smithi103.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:38:52.571 INFO:teuthology.orchestra.run.smithi121.stdout: Upgrading : NetworkManager-tui-1:1.48.2-2.el9.x86_64 154/172 2024-08-02T18:38:53.140 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:53.183 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:53.203 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: postgresql-server-13.14-1.el9.x86_64 155/172 2024-08-02T18:38:54.047 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 156/172 2024-08-02T18:38:54.152 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : openssl-devel-1:3.2.2-2.el9.x86_64 157/172 2024-08-02T18:38:54.192 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 158/172 2024-08-02T18:38:54.274 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : flex-2.6.4-9.el9.x86_64 159/172 2024-08-02T18:38:54.322 INFO:teuthology.orchestra.run.smithi121.stdout: Installing : bison-3.7.4-5.el9.x86_64 160/172 2024-08-02T18:38:54.347 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-tui-1:1.47.4-1.el9.x86_64 161/172 2024-08-02T18:38:54.372 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-08-02T18:38:54.398 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-libs-0.190-2.el9.x86_64 163/172 2024-08-02T18:38:54.399 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-08-02T18:38:54.475 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 164/172 2024-08-02T18:38:54.500 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-1:3.0.7-27.el9.x86_64 165/172 2024-08-02T18:38:54.500 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 166/172 2024-08-02T18:38:54.585 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 166/172 2024-08-02T18:38:54.610 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-team-1:1.47.4-1.el9.x86_64 167/172 2024-08-02T18:38:54.614 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:54.615 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:54.795 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-1:1.47.4-1.el9.x86_64 168/172 2024-08-02T18:38:54.796 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-08-02T18:38:54.880 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: NetworkManager-libnm-1:1.47.4-1.el9.x86_64 169/172 2024-08-02T18:38:54.905 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-08-02T18:38:54.930 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : elfutils-libelf-0.190-2.el9.x86_64 171/172 2024-08-02T18:38:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:38:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 1/172 2024-08-02T18:38:54.947 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 3/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 4/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 5/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 6/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 7/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 10/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 11/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 12/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 13/172 2024-08-02T18:38:54.948 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:38:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_ 15/172 2024-08-02T18:38:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 16/172 2024-08-02T18:38:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 17/172 2024-08-02T18:38:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_6 18/172 2024-08-02T18:38:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 19/172 2024-08-02T18:38:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 20/172 2024-08-02T18:38:54.949 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el 21/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9. 22/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_6 23/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 24/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 25/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 26/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 27/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 28/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 29/172 2024-08-02T18:38:54.950 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e. 30/172 2024-08-02T18:38:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 31/172 2024-08-02T18:38:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 32/172 2024-08-02T18:38:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 33/172 2024-08-02T18:38:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el 34/172 2024-08-02T18:38:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 35/172 2024-08-02T18:38:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.e 36/172 2024-08-02T18:38:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 37/172 2024-08-02T18:38:54.964 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 38/172 2024-08-02T18:38:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 39/172 2024-08-02T18:38:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-08-02T18:38:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-08-02T18:38:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-08-02T18:38:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-08-02T18:38:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-08-02T18:38:54.965 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-08-02T18:38:54.966 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-08-02T18:38:54.967 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-08-02T18:38:54.968 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-08-02T18:38:54.969 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-08-02T18:38:54.970 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-08-02T18:38:54.971 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-08-02T18:38:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-08-02T18:38:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-08-02T18:38:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-08-02T18:38:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-08-02T18:38:54.972 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-08-02T18:38:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-08-02T18:38:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-08-02T18:38:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-08-02T18:38:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-08-02T18:38:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-08-02T18:38:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-08-02T18:38:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-08-02T18:38:54.973 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-08-02T18:38:54.974 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 149/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 151/172 2024-08-02T18:38:54.975 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-08-02T18:38:54.976 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-08-02T18:38:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-08-02T18:38:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-08-02T18:38:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-08-02T18:38:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-08-02T18:38:54.977 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-08-02T18:38:54.994 INFO:teuthology.orchestra.run.smithi121.stdout: Cleanup : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:38:57.851 INFO:teuthology.orchestra.run.smithi151.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout:Upgraded: 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-02T18:38:57.852 INFO:teuthology.orchestra.run.smithi151.stdout: librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout:Installed: 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: automake-1.16.2-8.el9.noarch 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: bison-3.7.4-5.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.853 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-immutable-object-cache-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.854 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: flex-2.6.4-9.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-02T18:38:57.855 INFO:teuthology.orchestra.run.smithi151.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-02T18:38:57.856 INFO:teuthology.orchestra.run.smithi151.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: lua-5.4.4-4.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-02T18:38:57.857 INFO:teuthology.orchestra.run.smithi151.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-13.14-1.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-02T18:38:57.858 INFO:teuthology.orchestra.run.smithi151.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-02T18:38:57.859 INFO:teuthology.orchestra.run.smithi151.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-02T18:38:57.860 INFO:teuthology.orchestra.run.smithi151.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-02T18:38:57.861 INFO:teuthology.orchestra.run.smithi151.stdout: python3-ply-3.11-14.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-02T18:38:57.862 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-02T18:38:57.863 INFO:teuthology.orchestra.run.smithi151.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: re2-1:20211101-3.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-02T18:38:57.864 INFO:teuthology.orchestra.run.smithi151.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-02T18:38:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-02T18:38:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-02T18:38:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-02T18:38:57.865 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:38:57.865 INFO:teuthology.orchestra.run.smithi151.stdout:Complete! 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 1/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 3/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 4/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 5/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 6/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 7/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:38:58.177 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 10/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 11/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 12/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 13/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_ 15/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 16/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 17/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_6 18/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 19/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 20/172 2024-08-02T18:38:58.178 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el 21/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9. 22/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_6 23/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 24/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 25/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 26/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 27/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 28/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 29/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e. 30/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 31/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 32/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 33/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el 34/172 2024-08-02T18:38:58.179 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 35/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.e 36/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 37/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 38/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 39/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-08-02T18:38:58.180 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-08-02T18:38:58.181 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-08-02T18:38:58.182 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-08-02T18:38:58.183 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-08-02T18:38:58.184 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-08-02T18:38:58.185 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-08-02T18:38:58.186 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-08-02T18:38:58.187 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 149/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 151/172 2024-08-02T18:38:58.188 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-08-02T18:38:58.189 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-08-02T18:38:58.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-08-02T18:38:58.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-08-02T18:38:58.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-08-02T18:38:58.190 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-08-02T18:38:58.287 DEBUG:teuthology.parallel:result is None 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Running scriptlet: xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 1/172 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2/172 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 3/172 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 4/172 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-immutable-object-cache-2:19.1.0-1260.g26c3f 5/172 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 6/172 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 7/172 2024-08-02T18:39:00.555 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 8/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 9/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 10/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 11/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 12/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 13/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 14/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_ 15/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 16/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 17/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_6 18/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86 19/172 2024-08-02T18:39:00.556 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 20/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el 21/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9. 22/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_6 23/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 24/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 25/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 26/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 27/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 28/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 29/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e. 30/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noa 31/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.n 32/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c 33/172 2024-08-02T18:39:00.557 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el 34/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 35/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.e 36/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 37/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 38/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 39/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 40/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libgfortran-11.4.1-3.el9.x86_64 41/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libquadmath-11.4.1-3.el9.x86_64 42/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 43/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 44/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-ply-3.11-14.el9.noarch 45/172 2024-08-02T18:39:00.558 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 46/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 47/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 48/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : automake-1.16.2-8.el9.noarch 49/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : bison-3.7.4-5.el9.x86_64 50/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 51/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-devel-0.191-4.el9.x86_64 52/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flex-2.6.4-9.el9.x86_64 53/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 54/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 55/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 56/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 57/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 58/172 2024-08-02T18:39:00.559 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 59/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 60/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libtool-2.4.6-46.el9.x86_64 61/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libuuid-devel-2.37.4-18.el9.x86_64 62/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 63/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 64/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-5.4.4-4.el9.x86_64 65/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 66/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 67/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-devel-1:3.2.2-2.el9.x86_64 68/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-13.14-1.el9.x86_64 69/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-contrib-13.14-1.el9.x86_64 70/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-private-libs-13.14-1.el9.x86_64 71/172 2024-08-02T18:39:00.560 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : postgresql-server-13.14-1.el9.x86_64 72/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 73/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 74/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 75/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-colorama-0.4.6-3.el9.noarch 76/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-devel-3.9.18-3.el9.x86_64 77/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 78/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 79/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 80/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 81/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 82/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 83/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 84/172 2024-08-02T18:39:00.561 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 85/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 86/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 87/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 88/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 89/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 90/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 91/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 92/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 93/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 94/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 95/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 96/172 2024-08-02T18:39:00.562 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 97/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 98/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 99/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 100/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-devel-6.4.0-3.el9.x86_64 101/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 102/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : zlib-devel-1.2.11-41.el9.x86_64 103/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 104/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 105/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 106/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 107/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 108/172 2024-08-02T18:39:00.563 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 109/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 110/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 111/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 112/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 113/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 114/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 115/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 116/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 117/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 118/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 119/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 120/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 121/172 2024-08-02T18:39:00.564 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-google-auth-1:2.32.0-1.el9.noarch 122/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 123/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 124/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 125/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 126/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 127/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 128/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 129/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 130/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 131/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 132/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 133/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 134/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 135/172 2024-08-02T18:39:00.565 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 136/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 137/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 138/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 139/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 140/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 141/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 142/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 143/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 144/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 145/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 146/172 2024-08-02T18:39:00.566 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : re2-1:20211101-3.el9.x86_64 147/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 148/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 149/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 150/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 151/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 152/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.48.2-2.el9.x86_64 153/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-1:1.47.4-1.el9.x86_64 154/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.48.2-2.el9.x86_64 155/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-libnm-1:1.47.4-1.el9.x86_64 156/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.48.2-2.el9.x86_64 157/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-team-1:1.47.4-1.el9.x86_64 158/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.48.2-2.el9.x86_64 159/172 2024-08-02T18:39:00.567 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : NetworkManager-tui-1:1.47.4-1.el9.x86_64 160/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-debuginfod-client-0.191-4.el9.x86_64 161/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-debuginfod-client-0.190-2.el9.x86_64 162/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-0.191-4.el9.x86_64 163/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libelf-0.190-2.el9.x86_64 164/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libs-0.191-4.el9.x86_64 165/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : elfutils-libs-0.190-2.el9.x86_64 166/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.2.2-2.el9.x86_64 167/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-1:3.0.7-27.el9.x86_64 168/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.2.2-2.el9.x86_64 169/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : openssl-libs-1:3.0.7-27.el9.x86_64 170/172 2024-08-02T18:39:00.568 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-6.4.0-3.el9.x86_64 171/172 2024-08-02T18:39:00.923 INFO:teuthology.orchestra.run.smithi103.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout:Upgraded: 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-02T18:39:00.924 INFO:teuthology.orchestra.run.smithi103.stdout: librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout:Installed: 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: automake-1.16.2-8.el9.noarch 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: bison-3.7.4-5.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.925 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-immutable-object-cache-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.926 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: flex-2.6.4-9.el9.x86_64 2024-08-02T18:39:00.927 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-02T18:39:00.928 INFO:teuthology.orchestra.run.smithi103.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-02T18:39:00.929 INFO:teuthology.orchestra.run.smithi103.stdout: lua-5.4.4-4.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-13.14-1.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-02T18:39:00.930 INFO:teuthology.orchestra.run.smithi103.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-02T18:39:00.931 INFO:teuthology.orchestra.run.smithi103.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-02T18:39:00.932 INFO:teuthology.orchestra.run.smithi103.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-ply-3.11-14.el9.noarch 2024-08-02T18:39:00.933 INFO:teuthology.orchestra.run.smithi103.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-02T18:39:00.934 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-02T18:39:00.935 INFO:teuthology.orchestra.run.smithi103.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: re2-1:20211101-3.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-02T18:39:00.936 INFO:teuthology.orchestra.run.smithi103.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-02T18:39:00.937 INFO:teuthology.orchestra.run.smithi103.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-02T18:39:00.937 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:39:00.937 INFO:teuthology.orchestra.run.smithi103.stdout:Complete! 2024-08-02T18:39:01.358 DEBUG:teuthology.parallel:result is None 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: Verifying : xfsprogs-6.3.0-1.el9.x86_64 172/172 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout:Upgraded: 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-1:1.48.2-2.el9.x86_64 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-libnm-1:1.48.2-2.el9.x86_64 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-team-1:1.48.2-2.el9.x86_64 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: NetworkManager-tui-1:1.48.2-2.el9.x86_64 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-debuginfod-client-0.191-4.el9.x86_64 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-0.191-4.el9.x86_64 2024-08-02T18:39:03.370 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libs-0.191-4.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: librados2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: librbd1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-1:3.2.2-2.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-libs-1:3.2.2-2.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-6.4.0-3.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout:Installed: 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: automake-1.16.2-8.el9.noarch 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: bison-3.7.4-5.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-base-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.371 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-grafana-dashboards-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-immutable-object-cache-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mds-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-dashboard-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-diskprediction-local-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-modules-core-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mgr-rook-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-mon-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.372 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-osd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-prometheus-alerts-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-radosgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-selinux-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-test-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: ceph-volume-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: cephadm-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-shell-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: cephfs-top-2:19.1.0-1260.g26c3fb8e.el9.noarch 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: elfutils-libelf-devel-0.191-4.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: flex-2.6.4-9.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-08-02T18:39:03.373 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: fuse-2.9.9-16.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: grpc-data-1.46.7-10.el9.noarch 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: libaio-devel-0.3.111-13.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-9.0.0-11.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: libcephfs2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: libcephsqlite-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: libgfortran-11.4.1-3.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: liboath-2.6.7-2.el9.x86_64 2024-08-02T18:39:03.374 INFO:teuthology.orchestra.run.smithi121.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: libquadmath-11.4.1-3.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: librados-devel-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: libradosstriper1-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: librgw2-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: libtool-2.4.6-46.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: libunwind-1.6.2-1.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: libuuid-devel-2.37.4-18.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-08-02T18:39:03.375 INFO:teuthology.orchestra.run.smithi121.stdout: lua-5.4.4-4.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: luarocks-3.9.2-5.el9.noarch 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-0.3.21-2.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: openssl-devel-1:3.2.2-2.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-13.14-1.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-contrib-13.14-1.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-private-libs-13.14-1.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: postgresql-server-13.14-1.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-3.14.0-13.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-08-02T18:39:03.376 INFO:teuthology.orchestra.run.smithi121.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-attrs-20.3.0-7.el9.noarch 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-babel-2.9.1-2.el9.noarch 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-argparse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ceph-common-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cephfs-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cmd2-2.4.2-2.el9.noarch 2024-08-02T18:39:03.377 INFO:teuthology.orchestra.run.smithi121.stdout: python3-colorama-0.4.6-3.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-devel-3.9.18-3.el9.x86_64 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-google-auth-1:2.32.0-1.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-08-02T18:39:03.378 INFO:teuthology.orchestra.run.smithi121.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-mako-1.1.4-6.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-packaging-20.9-5.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-ply-3.11-14.el9.noarch 2024-08-02T18:39:03.379 INFO:teuthology.orchestra.run.smithi121.stdout: python3-portend-3.1.0-2.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pycparser-2.20-6.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-pytz-2021.1-5.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rados-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-2.25.1-8.el9.noarch 2024-08-02T18:39:03.380 INFO:teuthology.orchestra.run.smithi121.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rgw-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-routes-2.5.1-5.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-rsa-4.9-2.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-toml-0.10.2-6.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-webob-1.8.7-6.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-08-02T18:39:03.381 INFO:teuthology.orchestra.run.smithi121.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-24.02.0-1.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-fuse-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-mirror-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: rbd-nbd-2:19.1.0-1260.g26c3fb8e.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: re2-1:20211101-3.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: socat-1.7.4.1-6.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: thrift-0.15.0-2.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: uuid-1.6.2-55.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: xfsprogs-devel-6.4.0-3.el9.x86_64 2024-08-02T18:39:03.382 INFO:teuthology.orchestra.run.smithi121.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-08-02T18:39:03.383 INFO:teuthology.orchestra.run.smithi121.stdout: zlib-devel-1.2.11-41.el9.x86_64 2024-08-02T18:39:03.383 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:39:03.383 INFO:teuthology.orchestra.run.smithi121.stdout:Complete! 2024-08-02T18:39:03.782 DEBUG:teuthology.parallel:result is None 2024-08-02T18:39:03.783 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:39:03.922 DEBUG:teuthology.orchestra.run.smithi103:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-02T18:39:03.948 INFO:teuthology.orchestra.run.smithi103.stdout:19.1.0-1260.g26c3fb8e.el9 2024-08-02T18:39:03.949 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1260.g26c3fb8e.el9 2024-08-02T18:39:03.949 INFO:teuthology.task.install:The correct ceph version 19.1.0-1260.g26c3fb8e is installed. 2024-08-02T18:39:03.951 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:39:04.090 DEBUG:teuthology.orchestra.run.smithi121:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-02T18:39:04.112 INFO:teuthology.orchestra.run.smithi121.stdout:19.1.0-1260.g26c3fb8e.el9 2024-08-02T18:39:04.112 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1260.g26c3fb8e.el9 2024-08-02T18:39:04.112 INFO:teuthology.task.install:The correct ceph version 19.1.0-1260.g26c3fb8e is installed. 2024-08-02T18:39:04.114 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:39:04.254 DEBUG:teuthology.orchestra.run.smithi151:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-08-02T18:39:04.279 INFO:teuthology.orchestra.run.smithi151.stdout:19.1.0-1260.g26c3fb8e.el9 2024-08-02T18:39:04.279 INFO:teuthology.packaging:The installed version of ceph is 19.1.0-1260.g26c3fb8e.el9 2024-08-02T18:39:04.280 INFO:teuthology.task.install:The correct ceph version 19.1.0-1260.g26c3fb8e is installed. 2024-08-02T18:39:04.281 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-08-02T18:39:04.282 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:39:04.282 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-02T18:39:04.314 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:39:04.315 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-02T18:39:04.342 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:39:04.342 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-08-02T18:39:04.373 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-08-02T18:39:04.373 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:39:04.373 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/daemon-helper 2024-08-02T18:39:04.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-02T18:39:04.474 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:39:04.474 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/daemon-helper 2024-08-02T18:39:04.499 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-02T18:39:04.565 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:39:04.565 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/daemon-helper 2024-08-02T18:39:04.593 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-08-02T18:39:04.661 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-08-02T18:39:04.661 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:39:04.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-02T18:39:04.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-02T18:39:04.760 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:39:04.760 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-02T18:39:04.785 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-02T18:39:04.849 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:39:04.849 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/adjust-ulimits 2024-08-02T18:39:04.877 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-08-02T18:39:04.945 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-08-02T18:39:04.946 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:39:04.946 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/usr/bin/stdin-killer 2024-08-02T18:39:04.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-02T18:39:05.045 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:39:05.045 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/usr/bin/stdin-killer 2024-08-02T18:39:05.070 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-02T18:39:05.134 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:39:05.134 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/usr/bin/stdin-killer 2024-08-02T18:39:05.162 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-08-02T18:39:05.231 INFO:teuthology.run_tasks:Running task cephadm... 2024-08-02T18:39:05.376 INFO:tasks.cephadm:Config: {'roleless': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True}, 'conf': {'client': {'client dirsize rbytes': False, 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'ms die on skipped message': False}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'cephsqlite lock renewal timeout': 900000, 'debug cephsqlite': 20, 'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120, 'mon warn on pool no app': False}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180, 'osd shutdown pgref assert': True, 'osd_max_omap_entries_per_request': 10000}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'MON_DOWN', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'Degraded data redundancy', 'slow metadata IO', 'SLOW_OPS', 'slow request'], 'sha1': '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea', 'subvols': {'create': 2}} 2024-08-02T18:39:05.377 INFO:tasks.cephadm:Cluster image is quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:39:05.377 INFO:tasks.cephadm:Cluster fsid is 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:39:05.377 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-08-02T18:39:05.377 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.103', 'mon.b': '172.21.15.121', 'mon.c': '172.21.15.151'} 2024-08-02T18:39:05.378 INFO:tasks.cephadm:First mon is mon.a on smithi103 2024-08-02T18:39:05.378 INFO:tasks.cephadm:First mgr is x 2024-08-02T18:39:05.378 INFO:tasks.cephadm:Normalizing hostnames... 2024-08-02T18:39:05.378 DEBUG:teuthology.orchestra.run.smithi103:> sudo hostname $(hostname -s) 2024-08-02T18:39:05.409 DEBUG:teuthology.orchestra.run.smithi121:> sudo hostname $(hostname -s) 2024-08-02T18:39:05.433 DEBUG:teuthology.orchestra.run.smithi151:> sudo hostname $(hostname -s) 2024-08-02T18:39:05.461 INFO:tasks.cephadm:Downloading "compiled" cephadm from cachra 2024-08-02T18:39:05.461 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:39:05.599 INFO:tasks.cephadm:builder_project result: [{'status': 'ready', 'sha1': '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea', 'extra': {'build_url': 'https://jenkins.ceph.com/job/ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic/81786/', 'root_build_cause': 'SCMTRIGGER', 'version': '19.1.0-1260-g26c3fb8e', 'node_name': '172.21.5.40+adami10', 'job_name': 'ceph-dev-new-build/ARCH=x86_64,AVAILABLE_ARCH=x86_64,AVAILABLE_DIST=centos9,DIST=centos9,MACHINE_SIZE=gigantic', 'package_manager_version': '19.1.0-1260.g26c3fb8e'}, 'url': 'https://4.chacra.ceph.com/r/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/', 'distro_codename': None, 'modified': '2024-08-01 22:01:07.411737', 'distro_version': '9', 'project': 'ceph', 'flavor': 'default', 'ref': 'squid-release', 'chacra_url': 'https://4.chacra.ceph.com/repos/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/flavors/default/', 'archs': ['x86_64', 'source'], 'distro': 'centos'}] 2024-08-02T18:39:05.739 INFO:tasks.util.chacra:got chacra host 4.chacra.ceph.com, ref squid-release, sha1 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea from https://shaman.ceph.com/api/search/?project=ceph&distros=centos%2F9%2Fx86_64&flavor=default&sha1=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:39:05.741 INFO:tasks.cephadm:Discovered cachra url: https://4.chacra.ceph.com/binaries/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/x86_64/flavors/default/cephadm 2024-08-02T18:39:05.741 INFO:tasks.cephadm:Downloading cephadm from url: https://4.chacra.ceph.com/binaries/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/x86_64/flavors/default/cephadm 2024-08-02T18:39:05.742 DEBUG:teuthology.orchestra.run.smithi103:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:06.287 INFO:teuthology.orchestra.run.smithi103.stdout:-rw-r--r--. 1 ubuntu ubuntu 784604 Aug 2 18:39 /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:06.287 DEBUG:teuthology.orchestra.run.smithi121:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:06.827 INFO:teuthology.orchestra.run.smithi121.stdout:-rw-r--r--. 1 ubuntu ubuntu 784604 Aug 2 18:39 /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:06.827 DEBUG:teuthology.orchestra.run.smithi151:> curl --silent -L https://4.chacra.ceph.com/binaries/ceph/squid-release/26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/centos/9/x86_64/flavors/default/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:07.357 INFO:teuthology.orchestra.run.smithi151.stdout:-rw-r--r--. 1 ubuntu ubuntu 784604 Aug 2 18:39 /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:07.357 DEBUG:teuthology.orchestra.run.smithi103:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:07.377 DEBUG:teuthology.orchestra.run.smithi121:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:07.396 DEBUG:teuthology.orchestra.run.smithi151:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-08-02T18:39:07.441 INFO:tasks.cephadm:Pulling image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea on all hosts... 2024-08-02T18:39:07.441 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea pull 2024-08-02T18:39:07.443 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea pull 2024-08-02T18:39:07.446 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea pull 2024-08-02T18:39:08.251 INFO:teuthology.orchestra.run.smithi121.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea... 2024-08-02T18:39:08.303 INFO:teuthology.orchestra.run.smithi103.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea... 2024-08-02T18:39:08.370 INFO:teuthology.orchestra.run.smithi151.stderr:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea... 2024-08-02T18:39:41.360 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-08-02T18:39:41.361 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_version": "ceph version 19.1.0-1260-g26c3fb8e (26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea) squid (rc)", 2024-08-02T18:39:41.361 INFO:teuthology.orchestra.run.smithi151.stdout: "image_id": "564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208", 2024-08-02T18:39:41.361 INFO:teuthology.orchestra.run.smithi151.stdout: "repo_digests": [ 2024-08-02T18:39:41.361 INFO:teuthology.orchestra.run.smithi151.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6" 2024-08-02T18:39:41.361 INFO:teuthology.orchestra.run.smithi151.stdout: ] 2024-08-02T18:39:41.361 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-08-02T18:39:48.588 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:39:48.588 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.0-1260-g26c3fb8e (26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea) squid (rc)", 2024-08-02T18:39:48.588 INFO:teuthology.orchestra.run.smithi103.stdout: "image_id": "564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208", 2024-08-02T18:39:48.588 INFO:teuthology.orchestra.run.smithi103.stdout: "repo_digests": [ 2024-08-02T18:39:48.588 INFO:teuthology.orchestra.run.smithi103.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6" 2024-08-02T18:39:48.588 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:39:48.588 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:39:59.314 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-02T18:39:59.314 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_version": "ceph version 19.1.0-1260-g26c3fb8e (26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea) squid (rc)", 2024-08-02T18:39:59.315 INFO:teuthology.orchestra.run.smithi121.stdout: "image_id": "564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208", 2024-08-02T18:39:59.315 INFO:teuthology.orchestra.run.smithi121.stdout: "repo_digests": [ 2024-08-02T18:39:59.315 INFO:teuthology.orchestra.run.smithi121.stdout: "quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6" 2024-08-02T18:39:59.315 INFO:teuthology.orchestra.run.smithi121.stdout: ] 2024-08-02T18:39:59.315 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-02T18:39:59.341 DEBUG:teuthology.orchestra.run.smithi103:> sudo mkdir -p /etc/ceph 2024-08-02T18:39:59.375 DEBUG:teuthology.orchestra.run.smithi121:> sudo mkdir -p /etc/ceph 2024-08-02T18:39:59.401 DEBUG:teuthology.orchestra.run.smithi151:> sudo mkdir -p /etc/ceph 2024-08-02T18:39:59.434 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 777 /etc/ceph 2024-08-02T18:39:59.463 DEBUG:teuthology.orchestra.run.smithi121:> sudo chmod 777 /etc/ceph 2024-08-02T18:39:59.487 DEBUG:teuthology.orchestra.run.smithi151:> sudo chmod 777 /etc/ceph 2024-08-02T18:39:59.516 INFO:tasks.cephadm:Writing seed config... 2024-08-02T18:39:59.517 INFO:tasks.cephadm: override: [client] client dirsize rbytes = False 2024-08-02T18:39:59.517 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-08-02T18:39:59.517 INFO:tasks.cephadm: override: [client] debug client = 20 2024-08-02T18:39:59.517 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-08-02T18:39:59.517 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-08-02T18:39:59.517 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-08-02T18:39:59.517 INFO:tasks.cephadm: override: [global] ms die on skipped message = False 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] mds bal fragment size max = 10000 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] mds bal merge size = 5 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] mds bal split bits = 3 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] mds bal split size = 100 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-08-02T18:39:59.518 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mgr] cephsqlite lock renewal timeout = 900000 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mgr] debug cephsqlite = 20 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mgr] debug client = 20 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mon] mon down mkfs grace = 300 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [mon] mon warn on pool no app = False 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-08-02T18:39:59.519 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] debug bluefs = 20 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] debug bluestore = 20 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] debug rocksdb = 10 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] osd shutdown pgref assert = True 2024-08-02T18:39:59.520 INFO:tasks.cephadm: override: [osd] osd_max_omap_entries_per_request = 10000 2024-08-02T18:39:59.521 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:39:59.521 DEBUG:teuthology.orchestra.run.smithi103:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-08-02T18:39:59.540 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 7ef68402-50fe-11ef-bcca-c7b262605968 ms die on skipped message = False [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = True bdev debug aio = true osd sloppy crc = true bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 20 debug bluestore = 20 debug ms = 1 debug osd = 20 debug rocksdb = 10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 osd_max_omap_entries_per_request = 10000 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false cephsqlite lock renewal timeout = 900000 debug cephsqlite = 20 debug client = 20 debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon down mkfs grace = 300 mon op complaint time = 120 mon warn on pool no app = False [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client dirsize rbytes = False client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds bal fragment size max = 10000 mds bal merge size = 5 mds bal split bits = 3 mds bal split size = 100 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-08-02T18:39:59.540 DEBUG:teuthology.orchestra.run.smithi103:mon.a> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.a.service 2024-08-02T18:39:59.586 DEBUG:teuthology.orchestra.run.smithi103:mgr.x> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.x.service 2024-08-02T18:39:59.630 INFO:tasks.cephadm:Bootstrapping... 2024-08-02T18:39:59.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea -v bootstrap --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id x --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.103 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-08-02T18:39:59.849 INFO:teuthology.orchestra.run.smithi103.stdout:-------------------------------------------------------------------------------- 2024-08-02T18:39:59.849 INFO:teuthology.orchestra.run.smithi103.stdout:cephadm ['--image', 'quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea', '-v', 'bootstrap', '--fsid', '7ef68402-50fe-11ef-bcca-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'x', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.103', '--skip-admin-label'] 2024-08-02T18:39:59.849 INFO:teuthology.orchestra.run.smithi103.stderr:Specifying an fsid for your cluster offers no advantages and may increase the likelihood of fsid conflicts. 2024-08-02T18:39:59.849 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying podman|docker is present... 2024-08-02T18:39:59.875 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.1.2 2024-08-02T18:39:59.875 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying lvm2 is present... 2024-08-02T18:39:59.875 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying time synchronization is in place... 2024-08-02T18:39:59.882 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-02T18:39:59.882 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-02T18:39:59.889 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-02T18:39:59.889 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-08-02T18:39:59.896 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout enabled 2024-08-02T18:39:59.902 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout active 2024-08-02T18:39:59.902 INFO:teuthology.orchestra.run.smithi103.stdout:Unit chronyd.service is enabled and running 2024-08-02T18:39:59.903 INFO:teuthology.orchestra.run.smithi103.stdout:Repeating the final host check... 2024-08-02T18:39:59.927 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 5.1.2 2024-08-02T18:39:59.927 INFO:teuthology.orchestra.run.smithi103.stdout:podman (/bin/podman) version 5.1.2 is present 2024-08-02T18:39:59.927 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl is present 2024-08-02T18:39:59.927 INFO:teuthology.orchestra.run.smithi103.stdout:lvcreate is present 2024-08-02T18:39:59.933 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled chrony.service 2024-08-02T18:39:59.934 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to get unit file state for chrony.service: No such file or directory 2024-08-02T18:39:59.940 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active chrony.service 2024-08-02T18:39:59.940 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-08-02T18:39:59.946 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout enabled 2024-08-02T18:39:59.953 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout active 2024-08-02T18:39:59.953 INFO:teuthology.orchestra.run.smithi103.stdout:Unit chronyd.service is enabled and running 2024-08-02T18:39:59.953 INFO:teuthology.orchestra.run.smithi103.stdout:Host looks OK 2024-08-02T18:39:59.953 INFO:teuthology.orchestra.run.smithi103.stdout:Cluster fsid: 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:39:59.953 INFO:teuthology.orchestra.run.smithi103.stdout:Acquiring lock 140716256876672 on /run/cephadm/7ef68402-50fe-11ef-bcca-c7b262605968.lock 2024-08-02T18:39:59.953 INFO:teuthology.orchestra.run.smithi103.stdout:Lock 140716256876672 acquired on /run/cephadm/7ef68402-50fe-11ef-bcca-c7b262605968.lock 2024-08-02T18:39:59.954 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying IP 172.21.15.103 port 3300 ... 2024-08-02T18:39:59.954 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying IP 172.21.15.103 port 6789 ... 2024-08-02T18:39:59.954 INFO:teuthology.orchestra.run.smithi103.stdout:Base mon IP(s) is [172.21.15.103:3300, 172.21.15.103:6789], mon addrv is [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-08-02T18:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.103 metric 100 2024-08-02T18:39:59.957 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.103 metric 100 2024-08-02T18:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout ::1 dev lo proto kernel metric 256 pref medium 2024-08-02T18:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-08-02T18:39:59.960 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1789sec hoplimit 64 pref medium 2024-08-02T18:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-08-02T18:39:59.962 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout inet6 ::1/128 scope host 2024-08-02T18:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-02T18:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-08-02T18:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-08-02T18:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout:/sbin/ip: stdout valid_lft forever preferred_lft forever 2024-08-02T18:39:59.963 INFO:teuthology.orchestra.run.smithi103.stdout:Mon IP `172.21.15.103` is in CIDR network `172.21.0.0/20` 2024-08-02T18:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout:Mon IP `172.21.15.103` is in CIDR network `172.21.0.0/20` 2024-08-02T18:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-08-02T18:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-08-02T18:39:59.964 INFO:teuthology.orchestra.run.smithi103.stdout:Pulling container image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea... 2024-08-02T18:40:03.629 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stdout 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 2024-08-02T18:40:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Trying to pull quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea... 2024-08-02T18:40:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Getting image source signatures 2024-08-02T18:40:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying blob sha256:251e09273f2ec31de181954d061e48f87f3421518b30a5bbf1722961df606297 2024-08-02T18:40:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying blob sha256:e8b54c863393b7a8216a71737771b73b16a8e43ec7acf927c7faa175c255e551 2024-08-02T18:40:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Copying config sha256:564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 2024-08-02T18:40:03.630 INFO:teuthology.orchestra.run.smithi103.stdout:/bin/podman: stderr Writing manifest to image destination 2024-08-02T18:40:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:ceph: stdout ceph version 19.1.0-1260-g26c3fb8e (26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea) squid (rc) 2024-08-02T18:40:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:Ceph version: ceph version 19.1.0-1260-g26c3fb8e (26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea) squid (rc) 2024-08-02T18:40:12.447 INFO:teuthology.orchestra.run.smithi103.stdout:Extracting ceph user uid/gid from container image... 2024-08-02T18:40:13.444 INFO:teuthology.orchestra.run.smithi103.stdout:stat: stdout 167 167 2024-08-02T18:40:13.444 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial keys... 2024-08-02T18:40:14.317 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQANKK1m1ovSLRAAxmM5VPXGctmuYyb+OIovVw== 2024-08-02T18:40:15.250 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQAOKK1mYaO9JhAAci/5VmiQny76DDx6Xay8yQ== 2024-08-02T18:40:16.239 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph-authtool: stdout AQAPKK1mHRFAIhAALYxm8aa6DvF7IqMC5/RmMw== 2024-08-02T18:40:16.240 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial monmap... 2024-08-02T18:40:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-02T18:40:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout setting min_mon_release = quincy 2024-08-02T18:40:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: set fsid to 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: stdout /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-02T18:40:17.212 INFO:teuthology.orchestra.run.smithi103.stdout:monmaptool for a [v2:172.21.15.103:3300,v1:172.21.15.103:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-08-02T18:40:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:setting min_mon_release = quincy 2024-08-02T18:40:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: set fsid to 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-08-02T18:40:17.213 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:40:17.213 INFO:teuthology.orchestra.run.smithi103.stdout:Creating mon... 2024-08-02T18:40:19.106 INFO:teuthology.orchestra.run.smithi103.stdout:create mon.a on 2024-08-02T18:40:19.323 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Removed "/etc/systemd/system/multi-user.target.wants/ceph.target". 2024-08-02T18:40:19.467 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-08-02T18:40:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/multi-user.target.wants/ceph-7ef68402-50fe-11ef-bcca-c7b262605968.target → /etc/systemd/system/ceph-7ef68402-50fe-11ef-bcca-c7b262605968.target. 2024-08-02T18:40:19.647 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph.target.wants/ceph-7ef68402-50fe-11ef-bcca-c7b262605968.target → /etc/systemd/system/ceph-7ef68402-50fe-11ef-bcca-c7b262605968.target. 2024-08-02T18:40:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.a 2024-08-02T18:40:19.885 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.a.service: Unit ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.a.service not loaded. 2024-08-02T18:40:20.045 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7ef68402-50fe-11ef-bcca-c7b262605968.target.wants/ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.a.service → /etc/systemd/system/ceph-7ef68402-50fe-11ef-bcca-c7b262605968@.service. 2024-08-02T18:40:20.103 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 systemd[1]: Starting Ceph mon.a for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:40:20.375 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 podman[32369]: 2024-08-02 18:40:20.264306031 +0000 UTC m=+0.091186243 container create fb0eb2ded5ab60612a81bd987089a7a2921787e9143dbf9c5f666f6696db0189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T18:40:20.375 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 podman[32369]: 2024-08-02 18:40:20.190410371 +0000 UTC m=+0.017290554 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:40:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-02T18:40:20.556 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-08-02T18:40:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-02T18:40:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-08-02T18:40:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-08-02T18:40:20.563 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to enable service . firewalld.service is not available 2024-08-02T18:40:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mon to start... 2024-08-02T18:40:20.564 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mon... 2024-08-02T18:40:20.768 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 podman[32369]: 2024-08-02 18:40:20.474780485 +0000 UTC m=+0.301660658 container init fb0eb2ded5ab60612a81bd987089a7a2921787e9143dbf9c5f666f6696db0189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-08-02T18:40:20.768 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 podman[32369]: 2024-08-02 18:40:20.478013973 +0000 UTC m=+0.304894144 container start fb0eb2ded5ab60612a81bd987089a7a2921787e9143dbf9c5f666f6696db0189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-02T18:40:20.768 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 ceph-mon[32388]: mkfs 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:20.768 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 ceph-mon[32388]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-02T18:40:20.768 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 bash[32369]: fb0eb2ded5ab60612a81bd987089a7a2921787e9143dbf9c5f666f6696db0189 2024-08-02T18:40:20.768 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:20 smithi103 systemd[1]: Started Ceph mon.a for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:40:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout cluster: 2024-08-02T18:40:21.524 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout id: 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout health: HEALTH_OK 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout services: 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon: 1 daemons, quorum a (age 0.515206s) 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr: no daemons active 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd: 0 osds: 0 up, 0 in 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout data: 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout pools: 0 pools, 0 pgs 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout objects: 0 objects, 0 B 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout usage: 0 B used, 0 B / 0 B avail 2024-08-02T18:40:21.525 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout pgs: 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.962+0000 7fd3576d5640 1 Processor -- start 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.962+0000 7fd3576d5640 1 -- start start 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.963+0000 7fd3576d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35010a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.963+0000 7fd3576d5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd350075580 con 0x7fd350107e90 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.963+0000 7fd355471640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35010a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.963+0000 7fd355471640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35010a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44062/0 (socket says 172.21.15.103:44062) 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.963+0000 7fd355471640 1 -- 172.21.15.103:0/2244261190 learned_addr learned my addr 172.21.15.103:0/2244261190 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:21.526 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.963+0000 7fd355471640 1 -- 172.21.15.103:0/2244261190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35010a7c0 con 0x7fd350107e90 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.965+0000 7fd355471640 1 --2- 172.21.15.103:0/2244261190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35010a280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd340009e80 tx=0x7fd34002a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=570aa0f9197352db server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.965+0000 7fd34ffff640 1 -- 172.21.15.103:0/2244261190 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340036070 con 0x7fd350107e90 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.965+0000 7fd34ffff640 1 -- 172.21.15.103:0/2244261190 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd340031400 con 0x7fd350107e90 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.965+0000 7fd34ffff640 1 -- 172.21.15.103:0/2244261190 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340031700 con 0x7fd350107e90 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.966+0000 7fd3576d5640 1 -- 172.21.15.103:0/2244261190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 msgr2=0x7fd35010a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.966+0000 7fd3576d5640 1 --2- 172.21.15.103:0/2244261190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35010a280 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fd340009e80 tx=0x7fd34002a7a0 comp rx=0 tx=0).stop 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.966+0000 7fd3576d5640 1 -- 172.21.15.103:0/2244261190 shutdown_connections 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.966+0000 7fd3576d5640 1 --2- 172.21.15.103:0/2244261190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35010a280 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.966+0000 7fd3576d5640 1 -- 172.21.15.103:0/2244261190 >> 172.21.15.103:0/2244261190 conn(0x7fd350101b10 msgr2=0x7fd350103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.966+0000 7fd3576d5640 1 -- 172.21.15.103:0/2244261190 shutdown_connections 2024-08-02T18:40:21.527 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.966+0000 7fd3576d5640 1 -- 172.21.15.103:0/2244261190 wait complete. 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd3576d5640 1 Processor -- start 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd3576d5640 1 -- start start 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd3576d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35019ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd3576d5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd35010ad00 con 0x7fd350107e90 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd355471640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35019ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd355471640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35019ac00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44072/0 (socket says 172.21.15.103:44072) 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd355471640 1 -- 172.21.15.103:0/2203590416 learned_addr learned my addr 172.21.15.103:0/2203590416 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd355471640 1 -- 172.21.15.103:0/2203590416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd35019b140 con 0x7fd350107e90 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.967+0000 7fd355471640 1 --2- 172.21.15.103:0/2203590416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35019ac00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd340034040 tx=0x7fd340004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.968+0000 7fd34e7fc640 1 -- 172.21.15.103:0/2203590416 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340041070 con 0x7fd350107e90 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.968+0000 7fd34e7fc640 1 -- 172.21.15.103:0/2203590416 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd34003c650 con 0x7fd350107e90 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.968+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd35019b3d0 con 0x7fd350107e90 2024-08-02T18:40:21.528 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.968+0000 7fd34e7fc640 1 -- 172.21.15.103:0/2203590416 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd340036040 con 0x7fd350107e90 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.968+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd35019e0c0 con 0x7fd350107e90 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.968+0000 7fd34e7fc640 1 -- 172.21.15.103:0/2203590416 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd340044070 con 0x7fd350107e90 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.968+0000 7fd34e7fc640 1 -- 172.21.15.103:0/2203590416 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd340046c10 con 0x7fd350107e90 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.969+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd3501082f0 con 0x7fd350107e90 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:20.971+0000 7fd34e7fc640 1 -- 172.21.15.103:0/2203590416 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fd34003c950 con 0x7fd350107e90 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.029+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status"} v 0) -- 0x7fd35002d730 con 0x7fd350107e90 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.030+0000 7fd34e7fc640 1 -- 172.21.15.103:0/2203590416 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) ==== 54+0+317 (secure 0 0 0) 0x7fd34003cb30 con 0x7fd350107e90 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.030+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 msgr2=0x7fd35019ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.030+0000 7fd3576d5640 1 --2- 172.21.15.103:0/2203590416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35019ac00 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fd340034040 tx=0x7fd340004a40 comp rx=0 tx=0).stop 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.030+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 shutdown_connections 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.030+0000 7fd3576d5640 1 --2- 172.21.15.103:0/2203590416 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd350107e90 0x7fd35019ac00 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:21.529 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.030+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 >> 172.21.15.103:0/2203590416 conn(0x7fd350101b10 msgr2=0x7fd350102c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.030+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 shutdown_connections 2024-08-02T18:40:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.030+0000 7fd3576d5640 1 -- 172.21.15.103:0/2203590416 wait complete. 2024-08-02T18:40:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:mon is available 2024-08-02T18:40:21.530 INFO:teuthology.orchestra.run.smithi103.stdout:Assimilating anything we can from ceph.conf... 2024-08-02T18:40:21.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-02T18:40:21.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: monmap epoch 1 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: last_changed 2024-08-02T18:40:16.551678+0000 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: min_mon_release 19 (squid) 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: election_strategy: 1 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: fsmap 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: osdmap e1: 0 total, 0 up, 0 in 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: mgrmap e1: no daemons active 2024-08-02T18:40:21.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:21 smithi103 ceph-mon[32388]: from='client.? 172.21.15.103:0/2203590416' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-08-02T18:40:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:22 smithi103 ceph-mon[32388]: from='client.? 172.21.15.103:0/3025268198' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-02T18:40:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:22 smithi103 ceph-mon[32388]: from='client.? 172.21.15.103:0/3025268198' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-08-02T18:40:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [global] 2024-08-02T18:40:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout fsid = 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-08-02T18:40:22.614 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [osd] 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-02T18:40:22.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.943+0000 7f61d563d640 1 Processor -- start 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.943+0000 7f61d563d640 1 -- start start 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.943+0000 7f61d563d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d010a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.943+0000 7f61d563d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f61d007be30 con 0x7f61d0107ed0 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.943+0000 7f61ceffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d010a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.943+0000 7f61ceffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d010a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44088/0 (socket says 172.21.15.103:44088) 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.943+0000 7f61ceffd640 1 -- 172.21.15.103:0/4083367004 learned_addr learned my addr 172.21.15.103:0/4083367004 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.944+0000 7f61ceffd640 1 -- 172.21.15.103:0/4083367004 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d010a800 con 0x7f61d0107ed0 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.944+0000 7f61ceffd640 1 --2- 172.21.15.103:0/4083367004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d010a2c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009820 tx=0x7f61c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d3242db08f7a81 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61ce7fc640 1 -- 172.21.15.103:0/4083367004 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c0037070 con 0x7f61d0107ed0 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61ce7fc640 1 -- 172.21.15.103:0/4083367004 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c0032440 con 0x7f61d0107ed0 2024-08-02T18:40:22.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61ce7fc640 1 -- 172.21.15.103:0/4083367004 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c0032740 con 0x7f61d0107ed0 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61d563d640 1 -- 172.21.15.103:0/4083367004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 msgr2=0x7f61d010a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61d563d640 1 --2- 172.21.15.103:0/4083367004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d010a2c0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7f61c0009820 tx=0x7f61c002a270 comp rx=0 tx=0).stop 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61d563d640 1 -- 172.21.15.103:0/4083367004 shutdown_connections 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61d563d640 1 --2- 172.21.15.103:0/4083367004 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d010a2c0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61d563d640 1 -- 172.21.15.103:0/4083367004 >> 172.21.15.103:0/4083367004 conn(0x7f61d0101b50 msgr2=0x7f61d0103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61d563d640 1 -- 172.21.15.103:0/4083367004 shutdown_connections 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.945+0000 7f61d563d640 1 -- 172.21.15.103:0/4083367004 wait complete. 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.946+0000 7f61d563d640 1 Processor -- start 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.946+0000 7f61d563d640 1 -- start start 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.946+0000 7f61d563d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d019abc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.946+0000 7f61d563d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f61d010ac80 con 0x7f61d0107ed0 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.946+0000 7f61ceffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d019abc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.946+0000 7f61ceffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d019abc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44100/0 (socket says 172.21.15.103:44100) 2024-08-02T18:40:22.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.946+0000 7f61ceffd640 1 -- 172.21.15.103:0/3025268198 learned_addr learned my addr 172.21.15.103:0/3025268198 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.946+0000 7f61ceffd640 1 -- 172.21.15.103:0/3025268198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f61d019b100 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.947+0000 7f61ceffd640 1 --2- 172.21.15.103:0/3025268198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d019abc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f61c00090b0 tx=0x7f61c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.947+0000 7f61ccff9640 1 -- 172.21.15.103:0/3025268198 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c0041070 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.947+0000 7f61ccff9640 1 -- 172.21.15.103:0/3025268198 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61c003c7a0 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.947+0000 7f61ccff9640 1 -- 172.21.15.103:0/3025268198 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61c0037040 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.947+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f61d019b390 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.947+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f61d019e080 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.947+0000 7f61ccff9640 1 -- 172.21.15.103:0/3025268198 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f61c0044070 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.947+0000 7f61ccff9640 1 -- 172.21.15.103:0/3025268198 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f61c003d3f0 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.948+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f61d0108330 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:21.950+0000 7f61ccff9640 1 -- 172.21.15.103:0/3025268198 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f61c0046450 con 0x7f61d0107ed0 2024-08-02T18:40:22.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.006+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f61d002d730 con 0x7f61d0107ed0 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.009+0000 7f61ccff9640 1 -- 172.21.15.103:0/3025268198 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) ==== 70+0+431 (secure 0 0 0) 0x7f61c0046630 con 0x7f61d0107ed0 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.010+0000 7f61ccff9640 1 -- 172.21.15.103:0/3025268198 <== mon.0 v2:172.21.15.103:3300/0 8 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f61c0056070 con 0x7f61d0107ed0 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.011+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 msgr2=0x7f61d019abc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.011+0000 7f61d563d640 1 --2- 172.21.15.103:0/3025268198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d019abc0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 crypto rx=0x7f61c00090b0 tx=0x7f61c00046c0 comp rx=0 tx=0).stop 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.011+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 shutdown_connections 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.011+0000 7f61d563d640 1 --2- 172.21.15.103:0/3025268198 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f61d0107ed0 0x7f61d019abc0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.011+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 >> 172.21.15.103:0/3025268198 conn(0x7f61d0101b50 msgr2=0x7f61d0102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.011+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 shutdown_connections 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:22.011+0000 7f61d563d640 1 -- 172.21.15.103:0/3025268198 wait complete. 2024-08-02T18:40:22.619 INFO:teuthology.orchestra.run.smithi103.stdout:Generating new minimal ceph.conf... 2024-08-02T18:40:23.620 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:23 smithi103 ceph-mon[32388]: from='client.? 172.21.15.103:0/1599185281' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:40:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.009+0000 7fd0c8360640 1 Processor -- start 2024-08-02T18:40:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.009+0000 7fd0c8360640 1 -- start start 2024-08-02T18:40:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.009+0000 7fd0c8360640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c010a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.009+0000 7fd0c8360640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c00754e0 con 0x7fd0c0107f30 2024-08-02T18:40:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.010+0000 7fd0c60fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c010a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.010+0000 7fd0c60fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c010a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44102/0 (socket says 172.21.15.103:44102) 2024-08-02T18:40:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.010+0000 7fd0c60fc640 1 -- 172.21.15.103:0/3750641823 learned_addr learned my addr 172.21.15.103:0/3750641823 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:23.627 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.010+0000 7fd0c60fc640 1 -- 172.21.15.103:0/3750641823 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c010a860 con 0x7fd0c0107f30 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c60fc640 1 --2- 172.21.15.103:0/3750641823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c010a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009820 tx=0x7fd0bc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3125516a4d9e0e0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c50fa640 1 -- 172.21.15.103:0/3750641823 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc037070 con 0x7fd0c0107f30 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c50fa640 1 -- 172.21.15.103:0/3750641823 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd0bc032920 con 0x7fd0c0107f30 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c50fa640 1 -- 172.21.15.103:0/3750641823 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc030950 con 0x7fd0c0107f30 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c8360640 1 -- 172.21.15.103:0/3750641823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 msgr2=0x7fd0c010a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c8360640 1 --2- 172.21.15.103:0/3750641823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c010a320 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc009820 tx=0x7fd0bc02a270 comp rx=0 tx=0).stop 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c8360640 1 -- 172.21.15.103:0/3750641823 shutdown_connections 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c8360640 1 --2- 172.21.15.103:0/3750641823 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c010a320 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.011+0000 7fd0c8360640 1 -- 172.21.15.103:0/3750641823 >> 172.21.15.103:0/3750641823 conn(0x7fd0c0101b10 msgr2=0x7fd0c0103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c8360640 1 -- 172.21.15.103:0/3750641823 shutdown_connections 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c8360640 1 -- 172.21.15.103:0/3750641823 wait complete. 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c8360640 1 Processor -- start 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c8360640 1 -- start start 2024-08-02T18:40:23.628 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c8360640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c8360640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c010b8a0 con 0x7fd0c0107f30 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c60fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c60fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44116/0 (socket says 172.21.15.103:44116) 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.012+0000 7fd0c60fc640 1 -- 172.21.15.103:0/1599185281 learned_addr learned my addr 172.21.15.103:0/1599185281 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0c60fc640 1 -- 172.21.15.103:0/1599185281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c019dc10 con 0x7fd0c0107f30 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0c60fc640 1 --2- 172.21.15.103:0/1599185281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c019d6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc031000 tx=0x7fd0bc032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0b77fe640 1 -- 172.21.15.103:0/1599185281 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc042070 con 0x7fd0c0107f30 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0b77fe640 1 -- 172.21.15.103:0/1599185281 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd0bc0325f0 con 0x7fd0c0107f30 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0b77fe640 1 -- 172.21.15.103:0/1599185281 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd0bc037040 con 0x7fd0c0107f30 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c019dea0 con 0x7fd0c0107f30 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c01a0b90 con 0x7fd0c0107f30 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0b77fe640 1 -- 172.21.15.103:0/1599185281 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd0bc045070 con 0x7fd0c0107f30 2024-08-02T18:40:23.629 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.013+0000 7fd0b77fe640 1 -- 172.21.15.103:0/1599185281 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd0bc0466f0 con 0x7fd0c0107f30 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.014+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c0108390 con 0x7fd0c0107f30 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.016+0000 7fd0b77fe640 1 -- 172.21.15.103:0/1599185281 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fd0bc04c030 con 0x7fd0c0107f30 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.073+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7fd0c01a0d60 con 0x7fd0c0107f30 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.073+0000 7fd0b77fe640 1 -- 172.21.15.103:0/1599185281 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) ==== 76+0+177 (secure 0 0 0) 0x7fd0bc047cf0 con 0x7fd0c0107f30 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.074+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 msgr2=0x7fd0c019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.074+0000 7fd0c8360640 1 --2- 172.21.15.103:0/1599185281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c019d6d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd0bc031000 tx=0x7fd0bc032e40 comp rx=0 tx=0).stop 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.074+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 shutdown_connections 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.074+0000 7fd0c8360640 1 --2- 172.21.15.103:0/1599185281 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0107f30 0x7fd0c019d6d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.074+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 >> 172.21.15.103:0/1599185281 conn(0x7fd0c0101b10 msgr2=0x7fd0c01026d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.074+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 shutdown_connections 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:23.074+0000 7fd0c8360640 1 -- 172.21.15.103:0/1599185281 wait complete. 2024-08-02T18:40:23.630 INFO:teuthology.orchestra.run.smithi103.stdout:Restarting the monitor... 2024-08-02T18:40:24.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:23 smithi103 systemd[1]: Stopping Ceph mon.a for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:40:24.458 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:24 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32384]: 2024-08-02T18:40:24.090+0000 7f00c164a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T18:40:24.458 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:24 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32384]: 2024-08-02T18:40:24.090+0000 7f00c164a640 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-08-02T18:40:24.458 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:24 smithi103 podman[32629]: 2024-08-02 18:40:24.213439486 +0000 UTC m=+0.424814785 container died fb0eb2ded5ab60612a81bd987089a7a2921787e9143dbf9c5f666f6696db0189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-02T18:40:24.774 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:24 smithi103 podman[32629]: 2024-08-02 18:40:24.556173553 +0000 UTC m=+0.767548860 container cleanup fb0eb2ded5ab60612a81bd987089a7a2921787e9143dbf9c5f666f6696db0189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T18:40:24.774 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:24 smithi103 bash[32629]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a 2024-08-02T18:40:25.027 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:24 smithi103 podman[32641]: 2024-08-02 18:40:24.773884163 +0000 UTC m=+0.562478766 container remove fb0eb2ded5ab60612a81bd987089a7a2921787e9143dbf9c5f666f6696db0189 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8) 2024-08-02T18:40:25.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 systemd[1]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.a.service: Deactivated successfully. 2024-08-02T18:40:25.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 systemd[1]: Stopped Ceph mon.a for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:40:25.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 systemd[1]: Starting Ceph mon.a for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:40:25.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 podman[32734]: 2024-08-02 18:40:25.241408447 +0000 UTC m=+0.113792693 container create 966880a17b7ef183c4591605a15ce81cae8ca90c6c21aee8618511f388d83b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True) 2024-08-02T18:40:25.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 podman[32734]: 2024-08-02 18:40:25.144483962 +0000 UTC m=+0.016868213 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:40:25.582 INFO:teuthology.orchestra.run.smithi103.stdout:Setting public_network to 172.21.0.0/20 in mon config section 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 podman[32734]: 2024-08-02 18:40:25.493710063 +0000 UTC m=+0.366094308 container init 966880a17b7ef183c4591605a15ce81cae8ca90c6c21aee8618511f388d83b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 podman[32734]: 2024-08-02 18:40:25.496923854 +0000 UTC m=+0.369308100 container start 966880a17b7ef183c4591605a15ce81cae8ca90c6c21aee8618511f388d83b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: set uid:gid to 167:167 (ceph:ceph) 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: ceph version 19.1.0-1260-g26c3fb8e (26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea) squid (rc), process ceph-mon, pid 2 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: pidfile_write: ignore empty --pid-file 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: load: jerasure load: lrc 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: RocksDB version: 7.9.2 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Git sha 0 2024-08-02T18:40:25.696 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Compile date 2024-08-01 20:56:42 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: DB SUMMARY 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: DB Session ID: NDESY0THDTEGETXSG5DE 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: CURRENT file: CURRENT 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: IDENTITY file: IDENTITY 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: MANIFEST file: MANIFEST-000010 size: 179 Bytes 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000009.log size: 105240 ; 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.error_if_exists: 0 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.create_if_missing: 0 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.paranoid_checks: 1 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-02T18:40:25.697 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-02T18:40:25.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-02T18:40:25.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.env: 0x5621643017a0 2024-08-02T18:40:25.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.fs: PosixFileSystem 2024-08-02T18:40:25.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.info_log: 0x5621661b1500 2024-08-02T18:40:25.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_file_opening_threads: 16 2024-08-02T18:40:25.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.statistics: (nil) 2024-08-02T18:40:25.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.use_fsync: 0 2024-08-02T18:40:25.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_log_file_size: 0 2024-08-02T18:40:25.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-02T18:40:25.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-02T18:40:25.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.keep_log_file_num: 1000 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.recycle_log_file_num: 0 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.allow_fallocate: 1 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.allow_mmap_reads: 0 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.allow_mmap_writes: 0 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.use_direct_reads: 0 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.create_missing_column_families: 0 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.db_log_dir: 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.wal_dir: 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-02T18:40:25.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.advise_random_on_open: 1 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.db_write_buffer_size: 0 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.write_buffer_manager: 0x5621661c0dc0 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.rate_limiter: (nil) 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.wal_recovery_mode: 2 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.enable_thread_tracking: 0 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.enable_pipelined_write: 0 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.unordered_write: 0 2024-08-02T18:40:25.701 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.row_cache: None 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.wal_filter: None 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.allow_ingest_behind: 0 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.two_write_queues: 0 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.manual_wal_flush: 0 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.wal_compression: 0 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.atomic_flush: 0 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-02T18:40:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.log_readahead_size: 0 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.best_efforts_recovery: 0 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.allow_data_in_errors: 0 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.db_host_id: __hostname__ 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_background_jobs: 2 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_background_compactions: -1 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_subcompactions: 1 2024-08-02T18:40:25.703 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_total_wal_size: 0 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_open_files: -1 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bytes_per_sync: 0 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_readahead_size: 0 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_background_flushes: -1 2024-08-02T18:40:25.704 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Compression algorithms supported: 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: kZSTD supported: 0 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: kXpressCompression supported: 0 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: kBZip2Compression supported: 0 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: kLZ4Compression supported: 1 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: kZlibCompression supported: 1 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: kLZ4HCCompression supported: 1 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: kSnappyCompression supported: 1 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-02T18:40:25.705 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.merge_operator: 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_filter: None 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_filter_factory: None 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.sst_partitioner_factory: None 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x5621661b1120) 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout: cache_index_and_filter_blocks: 1 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout: pin_top_level_index_and_filter: 1 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_type: 0 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout: data_block_index_type: 0 2024-08-02T18:40:25.706 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_shortening: 1 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: checksum: 4 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: no_block_cache: 0 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache: 0x5621661a5090 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_name: BinnedLRUCache 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_options: 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: capacity : 536870912 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: num_shard_bits : 4 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: strict_capacity_limit : 0 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: high_pri_pool_ratio: 0.000 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_cache_compressed: (nil) 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: persistent_cache: (nil) 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_size: 4096 2024-08-02T18:40:25.707 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_size_deviation: 10 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_restart_interval: 16 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: index_block_restart_interval: 1 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: metadata_block_size: 4096 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: partition_filters: 0 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: use_delta_encoding: 1 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: filter_policy: bloomfilter 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: whole_key_filtering: 1 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: verify_compression: 0 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: read_amp_bytes_per_bit: 0 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: format_version: 5 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: enable_index_compression: 1 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: block_align: 0 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: max_auto_readahead_size: 262144 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: prepopulate_block_cache: 0 2024-08-02T18:40:25.708 INFO:journalctl@ceph.mon.a.smithi103.stdout: initial_auto_readahead_size: 8192 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout: num_file_reads_for_auto_readahead: 2 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.write_buffer_size: 33554432 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_write_buffer_number: 2 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression: NoCompression 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression: Disabled 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.prefix_extractor: nullptr 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.num_levels: 7 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-02T18:40:25.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.level: 32767 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.strategy: 0 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-02T18:40:25.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.enabled: false 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.target_file_size_base: 67108864 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-02T18:40:25.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.arena_block_size: 1048576 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.disable_auto_compactions: 0 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-02T18:40:25.712 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.inplace_update_support: 0 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-02T18:40:25.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.bloom_locality: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.max_successive_merges: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.paranoid_file_checks: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.force_consistency_checks: 1 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.report_bg_io_stats: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.ttl: 2592000 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.enable_blob_files: false 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.min_blob_size: 0 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.blob_file_size: 268435456 2024-08-02T18:40:25.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.blob_file_starting_level: 0 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000010 succeeded,manifest_file_number is 10, next_file_number is 12, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 5 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 5 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 1c729ce1-fcf9-4112-8c45-b29c3c53d516 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722624025523864, "job": 1, "event": "recovery_started", "wal_files": [9]} 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #9 mode 2 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722624025525300, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 13, "file_size": 100314, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 8, "largest_seqno": 328, "table_properties": {"data_size": 98199, "index_size": 307, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 773, "raw_key_size": 14286, "raw_average_key_size": 49, "raw_value_size": 90469, "raw_average_value_size": 315, "num_data_blocks": 12, "num_entries": 287, "num_filter_entries": 287, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1722624025, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "1c729ce1-fcf9-4112-8c45-b29c3c53d516", "db_session_id": "NDESY0THDTEGETXSG5DE", "orig_file_number": 13, "seqno_to_time_mapping": "N/A"}} 2024-08-02T18:40:25.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722624025525433, "job": 1, "event": "recovery_finished"} 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/version_set.cc:5047] Creating manifest 15 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000009.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x5621661d2e00 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: DB pointer 0x5621662cc000 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** DB Stats ** 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-02T18:40:25.716 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** Compaction Stats [default] ** 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: L0 2/0 99.82 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: Sum 2/0 99.82 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 111.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** Compaction Stats [default] ** 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-02T18:40:25.717 INFO:journalctl@ceph.mon.a.smithi103.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 111.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: Cumulative compaction: 0.00 GB write, 21.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: Interval compaction: 0.00 GB write, 21.67 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-02T18:40:25.718 INFO:journalctl@ceph.mon.a.smithi103.stdout: Block cache BinnedLRUCache@0x5621661a5090#2 capacity: 512.00 MB usage: 1.52 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: Block cache entry stats(count,size,portion): FilterBlock(2,1.02 KB,0.000193715%) IndexBlock(2,0.50 KB,9.53674e-05%) Misc(1,0.00 KB,0%) 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: starting mon.a rank 0 at public addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] at bind addrs [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a@-1(???) e1 preinit fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a@-1(???).mds e1 new map 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a@-1(???).mds e1 print_map 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: e1 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: btime 2024-08-02T18:40:20:516071+0000 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: legacy client fscid: -1 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: 2024-08-02T18:40:25.719 INFO:journalctl@ceph.mon.a.smithi103.stdout: No filesystems configured 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 bash[32734]: 966880a17b7ef183c4591605a15ce81cae8ca90c6c21aee8618511f388d83b38 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 systemd[1]: Started Ceph mon.a for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mon.a is new leader, mons a in quorum (ranks 0) 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: monmap epoch 1 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: last_changed 2024-08-02T18:40:16.551678+0000 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: min_mon_release 19 (squid) 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: election_strategy: 1 2024-08-02T18:40:25.720 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:40:25.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: fsmap 2024-08-02T18:40:25.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: osdmap e1: 0 total, 0 up, 0 in 2024-08-02T18:40:25.721 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:25 smithi103 ceph-mon[32753]: mgrmap e1: no daemons active 2024-08-02T18:40:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.052+0000 7f7cf84df640 1 Processor -- start 2024-08-02T18:40:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.053+0000 7f7cf84df640 1 -- start start 2024-08-02T18:40:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.053+0000 7f7cf84df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf0106740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.053+0000 7f7cf84df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf0106d10 con 0x7f7cf0106340 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.053+0000 7f7cf627b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf0106740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.053+0000 7f7cf627b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf0106740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44126/0 (socket says 172.21.15.103:44126) 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.053+0000 7f7cf627b640 1 -- 172.21.15.103:0/3718761139 learned_addr learned my addr 172.21.15.103:0/3718761139 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.054+0000 7f7cf627b640 1 -- 172.21.15.103:0/3718761139 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf01074f0 con 0x7f7cf0106340 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.055+0000 7f7cf627b640 1 --2- 172.21.15.103:0/3718761139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf0106740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009820 tx=0x7f7cec02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e67f8b8be5553ca server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf5279640 1 -- 172.21.15.103:0/3718761139 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cec037070 con 0x7f7cf0106340 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf5279640 1 -- 172.21.15.103:0/3718761139 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7cec032920 con 0x7f7cf0106340 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf5279640 1 -- 172.21.15.103:0/3718761139 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cec030950 con 0x7f7cf0106340 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf84df640 1 -- 172.21.15.103:0/3718761139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 msgr2=0x7f7cf0106740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf84df640 1 --2- 172.21.15.103:0/3718761139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf0106740 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009820 tx=0x7f7cec02a270 comp rx=0 tx=0).stop 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf84df640 1 -- 172.21.15.103:0/3718761139 shutdown_connections 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf84df640 1 --2- 172.21.15.103:0/3718761139 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf0106740 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf84df640 1 -- 172.21.15.103:0/3718761139 >> 172.21.15.103:0/3718761139 conn(0x7f7cf0101b50 msgr2=0x7f7cf0103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf84df640 1 -- 172.21.15.103:0/3718761139 shutdown_connections 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.056+0000 7f7cf84df640 1 -- 172.21.15.103:0/3718761139 wait complete. 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.057+0000 7f7cf84df640 1 Processor -- start 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.057+0000 7f7cf84df640 1 -- start start 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.057+0000 7f7cf84df640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf007ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.057+0000 7f7cf84df640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7cf010a8a0 con 0x7f7cf0106340 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.057+0000 7f7cf627b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf007ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.057+0000 7f7cf627b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf007ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44132/0 (socket says 172.21.15.103:44132) 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.057+0000 7f7cf627b640 1 -- 172.21.15.103:0/1193187380 learned_addr learned my addr 172.21.15.103:0/1193187380 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.057+0000 7f7cf627b640 1 -- 172.21.15.103:0/1193187380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7cf019e220 con 0x7f7cf0106340 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.058+0000 7f7cf627b640 1 --2- 172.21.15.103:0/1193187380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf007ba60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009940 tx=0x7f7cec032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.058+0000 7f7ce77fe640 1 -- 172.21.15.103:0/1193187380 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cec042070 con 0x7f7cf0106340 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.058+0000 7f7ce77fe640 1 -- 172.21.15.103:0/1193187380 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f7cec0325f0 con 0x7f7cf0106340 2024-08-02T18:40:26.617 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.058+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7cf019e3f0 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.058+0000 7f7ce77fe640 1 -- 172.21.15.103:0/1193187380 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7cec037040 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.058+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7cf019e790 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.058+0000 7f7ce77fe640 1 -- 172.21.15.103:0/1193187380 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7cec045070 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.058+0000 7f7ce77fe640 1 -- 172.21.15.103:0/1193187380 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f7cec047bd0 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.059+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7cf01067c0 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.061+0000 7f7ce77fe640 1 -- 172.21.15.103:0/1193187380 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f7cec03c840 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.117+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) -- 0x7f7cf019eab0 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.119+0000 7f7ce77fe640 1 -- 172.21.15.103:0/1193187380 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) ==== 124+0+0 (secure 0 0 0) 0x7f7cec03ca20 con 0x7f7cf0106340 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.120+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 msgr2=0x7f7cf007ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:26.618 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.120+0000 7f7cf84df640 1 --2- 172.21.15.103:0/1193187380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf007ba60 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7f7cec009940 tx=0x7f7cec032e40 comp rx=0 tx=0).stop 2024-08-02T18:40:26.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.120+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 shutdown_connections 2024-08-02T18:40:26.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.120+0000 7f7cf84df640 1 --2- 172.21.15.103:0/1193187380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7cf0106340 0x7f7cf007ba60 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:26.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.120+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 >> 172.21.15.103:0/1193187380 conn(0x7f7cf0101b50 msgr2=0x7f7cf0102770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:26.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.120+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 shutdown_connections 2024-08-02T18:40:26.619 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:26.120+0000 7f7cf84df640 1 -- 172.21.15.103:0/1193187380 wait complete. 2024-08-02T18:40:26.619 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote config to /etc/ceph/ceph.conf 2024-08-02T18:40:26.642 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-08-02T18:40:26.642 INFO:teuthology.orchestra.run.smithi103.stdout:Creating mgr... 2024-08-02T18:40:26.642 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:9283 ... 2024-08-02T18:40:26.643 INFO:teuthology.orchestra.run.smithi103.stdout:Verifying port 0.0.0.0:8765 ... 2024-08-02T18:40:26.873 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl reset-failed ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.x 2024-08-02T18:40:26.873 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Failed to reset failed state of unit ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.x.service: Unit ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.x.service not loaded. 2024-08-02T18:40:27.025 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stderr Created symlink /etc/systemd/system/ceph-7ef68402-50fe-11ef-bcca-c7b262605968.target.wants/ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.x.service → /etc/systemd/system/ceph-7ef68402-50fe-11ef-bcca-c7b262605968@.service. 2024-08-02T18:40:27.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:27 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1193187380' entity='client.admin' 2024-08-02T18:40:27.325 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:27 smithi103 podman[32966]: 2024-08-02 18:40:27.160663643 +0000 UTC m=+0.017040831 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:40:27.570 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-02T18:40:27.570 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-08-02T18:40:27.578 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-02T18:40:27.578 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-08-02T18:40:27.578 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-08-02T18:40:27.578 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to enable service . firewalld.service is not available 2024-08-02T18:40:27.587 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-02T18:40:27.587 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-08-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-08-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-08-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to open ports <[9283, 8765]>. firewalld.service is not available 2024-08-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr to start... 2024-08-02T18:40:27.595 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr... 2024-08-02T18:40:27.610 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:27 smithi103 podman[32966]: 2024-08-02 18:40:27.48020254 +0000 UTC m=+0.336579726 container init ffcd03abcab0639a8afdbe9a965a65a3dc937254d027456f8615aff1b071961f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8) 2024-08-02T18:40:27.611 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:27 smithi103 podman[32966]: 2024-08-02 18:40:27.483047771 +0000 UTC m=+0.339424942 container start ffcd03abcab0639a8afdbe9a965a65a3dc937254d027456f8615aff1b071961f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux ) 2024-08-02T18:40:27.611 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:27 smithi103 bash[32966]: ffcd03abcab0639a8afdbe9a965a65a3dc937254d027456f8615aff1b071961f 2024-08-02T18:40:27.611 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:27 smithi103 systemd[1]: Started Ceph mgr.x for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:40:27.925 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:27 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:27.609+0000 7ff1e083a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-02T18:40:27.925 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:27 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:27.758+0000 7ff1e083a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:40:27.925 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:27 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:27.828+0000 7ff1e083a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-02T18:40:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:28 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1901338144' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-02T18:40:28.326 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:28 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:28.083+0000 7ff1e083a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-02T18:40:28.326 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:28 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:28.146+0000 7ff1e083a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-02T18:40:28.698 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:28.711 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-08-02T18:40:28.711 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:28.712 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 2, 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-02T18:40:28.713 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-02T18:40:28.714 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-08-02T18:40:20:516071+0000", 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-02T18:40:28.715 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-08-02T18:40:20.516741+0000", 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.001+0000 7fd6dc869640 1 Processor -- start 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.001+0000 7fd6dc869640 1 -- start start 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.001+0000 7fd6dc869640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d810a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:28.716 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.001+0000 7fd6dc869640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d80754c0 con 0x7fd6d8107f50 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.002+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d810a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.002+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d810a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44166/0 (socket says 172.21.15.103:44166) 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.002+0000 7fd6d659c640 1 -- 172.21.15.103:0/2662905610 learned_addr learned my addr 172.21.15.103:0/2662905610 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.002+0000 7fd6d659c640 1 -- 172.21.15.103:0/2662905610 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d810a880 con 0x7fd6d8107f50 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.003+0000 7fd6d659c640 1 --2- 172.21.15.103:0/2662905610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d810a340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009820 tx=0x7fd6c802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d317134dd3989fa server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.003+0000 7fd6d5d9b640 1 -- 172.21.15.103:0/2662905610 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6c8037070 con 0x7fd6d8107f50 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.003+0000 7fd6d5d9b640 1 -- 172.21.15.103:0/2662905610 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd6c8032920 con 0x7fd6d8107f50 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.003+0000 7fd6d5d9b640 1 -- 172.21.15.103:0/2662905610 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6c8030950 con 0x7fd6d8107f50 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.004+0000 7fd6dc869640 1 -- 172.21.15.103:0/2662905610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 msgr2=0x7fd6d810a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.004+0000 7fd6dc869640 1 --2- 172.21.15.103:0/2662905610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d810a340 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0x7fd6c8009820 tx=0x7fd6c802a270 comp rx=0 tx=0).stop 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.004+0000 7fd6dc869640 1 -- 172.21.15.103:0/2662905610 shutdown_connections 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.004+0000 7fd6dc869640 1 --2- 172.21.15.103:0/2662905610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d810a340 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:28.717 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.004+0000 7fd6dc869640 1 -- 172.21.15.103:0/2662905610 >> 172.21.15.103:0/2662905610 conn(0x7fd6d8101b10 msgr2=0x7fd6d8103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.004+0000 7fd6dc869640 1 -- 172.21.15.103:0/2662905610 shutdown_connections 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.004+0000 7fd6dc869640 1 -- 172.21.15.103:0/2662905610 wait complete. 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.004+0000 7fd6dc869640 1 Processor -- start 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6dc869640 1 -- start start 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6dc869640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d81077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6dc869640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd6d810b8c0 con 0x7fd6d8107f50 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d81077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d81077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44176/0 (socket says 172.21.15.103:44176) 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6d659c640 1 -- 172.21.15.103:0/1901338144 learned_addr learned my addr 172.21.15.103:0/1901338144 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6d659c640 1 -- 172.21.15.103:0/1901338144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6d8107d10 con 0x7fd6d8107f50 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6d659c640 1 --2- 172.21.15.103:0/1901338144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d81077d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80097f0 tx=0x7fd6c8032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6cf7fe640 1 -- 172.21.15.103:0/1901338144 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6c8037040 con 0x7fd6d8107f50 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6cf7fe640 1 -- 172.21.15.103:0/1901338144 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fd6c8040070 con 0x7fd6d8107f50 2024-08-02T18:40:28.718 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd6d8105f00 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6cf7fe640 1 -- 172.21.15.103:0/1901338144 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6c803a6d0 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.005+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6d8106440 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.006+0000 7fd6cf7fe640 1 -- 172.21.15.103:0/1901338144 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd6c803a870 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.006+0000 7fd6cf7fe640 1 -- 172.21.15.103:0/1901338144 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fd6c8045b40 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.006+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd6d81083b0 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.009+0000 7fd6cf7fe640 1 -- 172.21.15.103:0/1901338144 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7fd6c803ad40 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.069+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7fd6d8106740 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.070+0000 7fd6cf7fe640 1 -- 172.21.15.103:0/1901338144 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7fd6c803bb00 con 0x7fd6d8107f50 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.071+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 msgr2=0x7fd6d81077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.071+0000 7fd6dc869640 1 --2- 172.21.15.103:0/1901338144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d81077d0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7fd6c80097f0 tx=0x7fd6c8032d00 comp rx=0 tx=0).stop 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.071+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 shutdown_connections 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.071+0000 7fd6dc869640 1 --2- 172.21.15.103:0/1901338144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd6d8107f50 0x7fd6d81077d0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:28.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.071+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 >> 172.21.15.103:0/1901338144 conn(0x7fd6d8101b10 msgr2=0x7fd6d8102700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:28.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.071+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 shutdown_connections 2024-08-02T18:40:28.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:28.071+0000 7fd6dc869640 1 -- 172.21.15.103:0/1901338144 wait complete. 2024-08-02T18:40:28.720 INFO:teuthology.orchestra.run.smithi103.stdout:mgr not available, waiting (1/15)... 2024-08-02T18:40:29.472 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:29.089+0000 7ff1e083a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-02T18:40:29.472 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:29.201+0000 7ff1e083a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-02T18:40:29.473 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:29.257+0000 7ff1e083a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-02T18:40:29.473 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:29.471+0000 7ff1e083a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-02T18:40:29.739 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:29.531+0000 7ff1e083a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-02T18:40:29.739 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:29.596+0000 7ff1e083a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-02T18:40:29.739 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:29.737+0000 7ff1e083a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:40:30.468 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:30.155+0000 7ff1e083a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-02T18:40:30.468 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:30.466+0000 7ff1e083a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-02T18:40:30.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:30.532+0000 7ff1e083a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-02T18:40:30.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:30.677+0000 7ff1e083a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-02T18:40:31.090 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:31.001+0000 7ff1e083a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-02T18:40:31.090 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:31.064+0000 7ff1e083a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-02T18:40:31.421 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:31 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/237843941' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-02T18:40:31.422 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:31.263+0000 7ff1e083a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-02T18:40:31.422 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:31.420+0000 7ff1e083a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-02T18:40:31.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:31.484+0000 7ff1e083a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-02T18:40:31.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:31.567+0000 7ff1e083a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-02T18:40:31.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:31.625+0000 7ff1e083a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-02T18:40:31.974 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 5, 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:31.975 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:31.976 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-08-02T18:40:20:516071+0000", 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-02T18:40:31.977 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": false, 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-02T18:40:31.978 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-08-02T18:40:20.516741+0000", 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.108+0000 7f1c2023c640 1 Processor -- start 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.108+0000 7f1c2023c640 1 -- start start 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.108+0000 7f1c2023c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1810a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.108+0000 7f1c2023c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1807be80 con 0x7f1c18107e90 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.108+0000 7f1c1dfd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1810a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.108+0000 7f1c1dfd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1810a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36456/0 (socket says 172.21.15.103:36456) 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.108+0000 7f1c1dfd8640 1 -- 172.21.15.103:0/2517758463 learned_addr learned my addr 172.21.15.103:0/2517758463 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:31.979 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.109+0000 7f1c1dfd8640 1 -- 172.21.15.103:0/2517758463 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1810a7c0 con 0x7f1c18107e90 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.109+0000 7f1c1dfd8640 1 --2- 172.21.15.103:0/2517758463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1810a280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009820 tx=0x7f1c1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9aba7e9628dc13a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.110+0000 7f1c1cfd6640 1 -- 172.21.15.103:0/2517758463 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c14037070 con 0x7f1c18107e90 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.110+0000 7f1c1cfd6640 1 -- 172.21.15.103:0/2517758463 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1c14032920 con 0x7f1c18107e90 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.110+0000 7f1c1cfd6640 1 -- 172.21.15.103:0/2517758463 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c14030950 con 0x7f1c18107e90 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.110+0000 7f1c2023c640 1 -- 172.21.15.103:0/2517758463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 msgr2=0x7f1c1810a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.110+0000 7f1c2023c640 1 --2- 172.21.15.103:0/2517758463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1810a280 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f1c14009820 tx=0x7f1c1402a270 comp rx=0 tx=0).stop 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.110+0000 7f1c2023c640 1 -- 172.21.15.103:0/2517758463 shutdown_connections 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.110+0000 7f1c2023c640 1 --2- 172.21.15.103:0/2517758463 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1810a280 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.110+0000 7f1c2023c640 1 -- 172.21.15.103:0/2517758463 >> 172.21.15.103:0/2517758463 conn(0x7f1c18101af0 msgr2=0x7f1c18103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.111+0000 7f1c2023c640 1 -- 172.21.15.103:0/2517758463 shutdown_connections 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.111+0000 7f1c2023c640 1 -- 172.21.15.103:0/2517758463 wait complete. 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.111+0000 7f1c2023c640 1 Processor -- start 2024-08-02T18:40:31.980 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.111+0000 7f1c2023c640 1 -- start start 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.111+0000 7f1c2023c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1819b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.111+0000 7f1c2023c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c1810b860 con 0x7f1c18107e90 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.111+0000 7f1c1dfd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1819b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c1dfd8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1819b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36468/0 (socket says 172.21.15.103:36468) 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c1dfd8640 1 -- 172.21.15.103:0/237843941 learned_addr learned my addr 172.21.15.103:0/237843941 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c1dfd8640 1 -- 172.21.15.103:0/237843941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c1819b9d0 con 0x7f1c18107e90 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c1dfd8640 1 --2- 172.21.15.103:0/237843941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1819b490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1c140097f0 tx=0x7f1c14032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c0effd640 1 -- 172.21.15.103:0/237843941 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c14037040 con 0x7f1c18107e90 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c0effd640 1 -- 172.21.15.103:0/237843941 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1c14040070 con 0x7f1c18107e90 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c1819bc60 con 0x7f1c18107e90 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c0effd640 1 -- 172.21.15.103:0/237843941 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1c1403a6d0 con 0x7f1c18107e90 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.112+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c1819e950 con 0x7f1c18107e90 2024-08-02T18:40:31.981 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.113+0000 7f1c0effd640 1 -- 172.21.15.103:0/237843941 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1c1403a870 con 0x7f1c18107e90 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.113+0000 7f1c0effd640 1 -- 172.21.15.103:0/237843941 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f1c14045b90 con 0x7f1c18107e90 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.113+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1c181082f0 con 0x7f1c18107e90 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.115+0000 7f1c0effd640 1 -- 172.21.15.103:0/237843941 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73482 (secure 0 0 0) 0x7f1c1403acf0 con 0x7f1c18107e90 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.176+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f1c1819eec0 con 0x7f1c18107e90 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.176+0000 7f1c0effd640 1 -- 172.21.15.103:0/237843941 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1291 (secure 0 0 0) 0x7f1c1403bb00 con 0x7f1c18107e90 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.177+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 msgr2=0x7f1c1819b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.177+0000 7f1c2023c640 1 --2- 172.21.15.103:0/237843941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1819b490 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f1c140097f0 tx=0x7f1c14032d00 comp rx=0 tx=0).stop 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.177+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 shutdown_connections 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.177+0000 7f1c2023c640 1 --2- 172.21.15.103:0/237843941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c18107e90 0x7f1c1819b490 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.177+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 >> 172.21.15.103:0/237843941 conn(0x7f1c18101af0 msgr2=0x7f1c18102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.177+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 shutdown_connections 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:31.178+0000 7f1c2023c640 1 -- 172.21.15.103:0/237843941 wait complete. 2024-08-02T18:40:31.982 INFO:teuthology.orchestra.run.smithi103.stdout:mgr not available, waiting (2/15)... 2024-08-02T18:40:32.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:32.159+0000 7ff1e083a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-02T18:40:32.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:32.314+0000 7ff1e083a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: Activating manager daemon x 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: mgrmap e2: x(active, starting, since 0.00302578s) 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: Manager daemon x is now available 2024-08-02T18:40:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-02T18:40:32.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-02T18:40:32.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' 2024-08-02T18:40:32.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' 2024-08-02T18:40:32.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:32 smithi103 ceph-mon[32753]: from='mgr.14100 172.21.15.103:0/3751632740' entity='mgr.x' 2024-08-02T18:40:34.346 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:34 smithi103 ceph-mon[32753]: mgrmap e3: x(active, since 1.006s) 2024-08-02T18:40:35.113 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:35.113 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-08-02T18:40:35.113 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "health": { 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "status": "HEALTH_OK", 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "checks": {}, 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mutes": [] 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "election_epoch": 5, 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum": [ 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 0 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_names": [ 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "a" 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:35.114 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "quorum_age": 9, 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "monmap": { 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "min_mon_release_name": "squid", 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_mons": 1 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osdmap": { 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_osds": 0, 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_up_osds": 0, 2024-08-02T18:40:35.115 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_up_since": 0, 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_in_osds": 0, 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "osd_in_since": 0, 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_remapped_pgs": 0 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgmap": { 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "pgs_by_state": [], 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pgs": 0, 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_pools": 0, 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_objects": 0, 2024-08-02T18:40:35.126 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "data_bytes": 0, 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_used": 0, 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_avail": 0, 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "bytes_total": 0 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "fsmap": { 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "btime": "2024-08-02T18:40:20:516071+0000", 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "by_rank": [], 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "up:standby": 0 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap": { 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standbys": 0, 2024-08-02T18:40:35.127 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modules": [ 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "iostat", 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "nfs", 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "restful" 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ], 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "servicemap": { 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 1, 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "modified": "2024-08-02T18:40:20.516741+0000", 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "services": {} 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout }, 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "progress_events": {} 2024-08-02T18:40:35.128 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.351+0000 7f5e0be9f640 1 Processor -- start 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.352+0000 7f5e0be9f640 1 -- start start 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.352+0000 7f5e0be9f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0410a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.352+0000 7f5e0be9f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5e04075580 con 0x7f5e04107e90 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.352+0000 7f5e09c3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0410a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.352+0000 7f5e09c3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0410a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36516/0 (socket says 172.21.15.103:36516) 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.352+0000 7f5e09c3b640 1 -- 172.21.15.103:0/2832126754 learned_addr learned my addr 172.21.15.103:0/2832126754 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.352+0000 7f5e09c3b640 1 -- 172.21.15.103:0/2832126754 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0410a7c0 con 0x7f5e04107e90 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.353+0000 7f5e09c3b640 1 --2- 172.21.15.103:0/2832126754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0410a280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009e80 tx=0x7f5df402a7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5496775572909c94 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.353+0000 7f5e08c39640 1 -- 172.21.15.103:0/2832126754 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5df4036070 con 0x7f5e04107e90 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.353+0000 7f5e08c39640 1 -- 172.21.15.103:0/2832126754 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5df40318e0 con 0x7f5e04107e90 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.353+0000 7f5e08c39640 1 -- 172.21.15.103:0/2832126754 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5df4007b00 con 0x7f5e04107e90 2024-08-02T18:40:35.129 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2832126754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 msgr2=0x7f5e0410a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:35.130 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 --2- 172.21.15.103:0/2832126754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0410a280 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5df4009e80 tx=0x7f5df402a7a0 comp rx=0 tx=0).stop 2024-08-02T18:40:35.130 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2832126754 shutdown_connections 2024-08-02T18:40:35.130 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 --2- 172.21.15.103:0/2832126754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0410a280 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:35.130 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2832126754 >> 172.21.15.103:0/2832126754 conn(0x7f5e04101b10 msgr2=0x7f5e04103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:35.130 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2832126754 shutdown_connections 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2832126754 wait complete. 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 Processor -- start 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.354+0000 7f5e0be9f640 1 -- start start 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e0be9f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0419b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e0be9f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5e0410b8c0 con 0x7f5e04107e90 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e09c3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0419b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e09c3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0419b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36524/0 (socket says 172.21.15.103:36524) 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e09c3b640 1 -- 172.21.15.103:0/2548048718 learned_addr learned my addr 172.21.15.103:0/2548048718 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:35.131 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e09c3b640 1 -- 172.21.15.103:0/2548048718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e0419ba10 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e09c3b640 1 --2- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0419b4d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5df40076d0 tx=0x7f5df40316a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e02ffd640 1 -- 172.21.15.103:0/2548048718 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5df4041020 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e02ffd640 1 -- 172.21.15.103:0/2548048718 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f5df4007e50 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e0419bca0 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e02ffd640 1 -- 172.21.15.103:0/2548048718 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5df4036040 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.355+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e0419e990 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.356+0000 7f5e02ffd640 1 -- 172.21.15.103:0/2548048718 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f5df4044020 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.356+0000 7f5e02ffd640 1 --2- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f5dec038f20 0x7f5dec03b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.356+0000 7f5e02ffd640 1 -- 172.21.15.103:0/2548048718 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f5df406ce60 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.357+0000 7f5e0943a640 1 --2- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f5dec038f20 0x7f5dec03b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.357+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e041082f0 con 0x7f5e04107e90 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.357+0000 7f5e0943a640 1 --2- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f5dec038f20 0x7f5dec03b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5df80098c0 tx=0x7f5df8006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:35.132 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.362+0000 7f5e02ffd640 1 -- 172.21.15.103:0/2548048718 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5df404b020 con 0x7f5e04107e90 2024-08-02T18:40:35.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.591+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) -- 0x7f5e0419eed0 con 0x7f5e04107e90 2024-08-02T18:40:35.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.592+0000 7f5e02ffd640 1 -- 172.21.15.103:0/2548048718 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) ==== 79+0+1290 (secure 0 0 0) 0x7f5df4045570 con 0x7f5e04107e90 2024-08-02T18:40:35.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f5dec038f20 msgr2=0x7f5dec03b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:35.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 --2- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f5dec038f20 0x7f5dec03b3e0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 crypto rx=0x7f5df80098c0 tx=0x7f5df8006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:35.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 msgr2=0x7f5e0419b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:35.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 --2- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0419b4d0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5df40076d0 tx=0x7f5df40316a0 comp rx=0 tx=0).stop 2024-08-02T18:40:35.133 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 shutdown_connections 2024-08-02T18:40:35.134 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 --2- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f5dec038f20 0x7f5dec03b3e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:35.134 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 --2- 172.21.15.103:0/2548048718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e04107e90 0x7f5e0419b4d0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:35.134 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 >> 172.21.15.103:0/2548048718 conn(0x7f5e04101b10 msgr2=0x7f5e04102780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:35.134 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 shutdown_connections 2024-08-02T18:40:35.134 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:34.594+0000 7f5e0be9f640 1 -- 172.21.15.103:0/2548048718 wait complete. 2024-08-02T18:40:35.134 INFO:teuthology.orchestra.run.smithi103.stdout:mgr is available 2024-08-02T18:40:35.428 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:35 smithi103 ceph-mon[32753]: mgrmap e4: x(active, since 2s) 2024-08-02T18:40:35.428 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:35 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2548048718' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [global] 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout fsid = 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_host = [v2:172.21.15.103:3300,v1:172.21.15.103:6789] 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_pg_remap = true 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_allow_primary_affinity = true 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_warn_on_no_sortbitwise = false 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_crush_chooseleaf_type = 0 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:36.199 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [mgr] 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mgr/telemetry/nag = false 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout [osd] 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_backfillfull_ratio = 0.85 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_full_ratio = 0.9 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout mon_osd_nearfull_ratio = 0.8 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_map_max_advance = 10 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout osd_sloppy_crc = true 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.503+0000 7f312d18d640 1 Processor -- start 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.503+0000 7f312d18d640 1 -- start start 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.503+0000 7f312d18d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f3128107850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.503+0000 7f312d18d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3128107e20 con 0x7f3128107450 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.503+0000 7f3126d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f3128107850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:36.200 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.503+0000 7f3126d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f3128107850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36540/0 (socket says 172.21.15.103:36540) 2024-08-02T18:40:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.503+0000 7f3126d9d640 1 -- 172.21.15.103:0/326255968 learned_addr learned my addr 172.21.15.103:0/326255968 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.503+0000 7f3126d9d640 1 -- 172.21.15.103:0/326255968 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3128108600 con 0x7f3128107450 2024-08-02T18:40:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.504+0000 7f3126d9d640 1 --2- 172.21.15.103:0/326255968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f3128107850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3118009820 tx=0x7f311802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c647220536fbc051 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.504+0000 7f3125d9b640 1 -- 172.21.15.103:0/326255968 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3118037070 con 0x7f3128107450 2024-08-02T18:40:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.504+0000 7f3125d9b640 1 -- 172.21.15.103:0/326255968 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3118032920 con 0x7f3128107450 2024-08-02T18:40:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.504+0000 7f3125d9b640 1 -- 172.21.15.103:0/326255968 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3118030950 con 0x7f3128107450 2024-08-02T18:40:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.505+0000 7f312d18d640 1 -- 172.21.15.103:0/326255968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 msgr2=0x7f3128107850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:36.201 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.505+0000 7f312d18d640 1 --2- 172.21.15.103:0/326255968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f3128107850 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f3118009820 tx=0x7f311802a270 comp rx=0 tx=0).stop 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.505+0000 7f312d18d640 1 -- 172.21.15.103:0/326255968 shutdown_connections 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.505+0000 7f312d18d640 1 --2- 172.21.15.103:0/326255968 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f3128107850 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.505+0000 7f312d18d640 1 -- 172.21.15.103:0/326255968 >> 172.21.15.103:0/326255968 conn(0x7f3128102c40 msgr2=0x7f3128105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.505+0000 7f312d18d640 1 -- 172.21.15.103:0/326255968 shutdown_connections 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.505+0000 7f312d18d640 1 -- 172.21.15.103:0/326255968 wait complete. 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.505+0000 7f312d18d640 1 Processor -- start 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f312d18d640 1 -- start start 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f312d18d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f312819b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f312d18d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f312810b9b0 con 0x7f3128107450 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f3126d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f312819b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f3126d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f312819b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36542/0 (socket says 172.21.15.103:36542) 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f3126d9d640 1 -- 172.21.15.103:0/515864099 learned_addr learned my addr 172.21.15.103:0/515864099 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f3126d9d640 1 -- 172.21.15.103:0/515864099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f312819ba20 con 0x7f3128107450 2024-08-02T18:40:36.202 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f3126d9d640 1 --2- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f312819b4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f31180097f0 tx=0x7f3118032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.506+0000 7f310ffff640 1 -- 172.21.15.103:0/515864099 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3118037040 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.507+0000 7f310ffff640 1 -- 172.21.15.103:0/515864099 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f3118040070 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.507+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f312819bcb0 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.507+0000 7f310ffff640 1 -- 172.21.15.103:0/515864099 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f311803a610 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.507+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f312819e9a0 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.507+0000 7f310ffff640 1 -- 172.21.15.103:0/515864099 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7f311803a890 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.507+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31281078d0 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.507+0000 7f310ffff640 1 --2- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f3110038f20 0x7f311003b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.508+0000 7f310ffff640 1 -- 172.21.15.103:0/515864099 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f311806c080 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.508+0000 7f312659c640 1 --2- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f3110038f20 0x7f311003b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.508+0000 7f312659c640 1 --2- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f3110038f20 0x7f311003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f311c0098c0 tx=0x7f311c006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.512+0000 7f310ffff640 1 -- 172.21.15.103:0/515864099 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3118041270 con 0x7f3128107450 2024-08-02T18:40:36.203 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.679+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) -- 0x7f31281a01a0 con 0x7f3128107450 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.680+0000 7f310ffff640 1 -- 172.21.15.103:0/515864099 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) ==== 70+0+431 (secure 0 0 0) 0x7f311806bde0 con 0x7f3128107450 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.682+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f3110038f20 msgr2=0x7f311003b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.682+0000 7f312d18d640 1 --2- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f3110038f20 0x7f311003b3e0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f311c0098c0 tx=0x7f311c006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.682+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 msgr2=0x7f312819b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.682+0000 7f312d18d640 1 --2- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f312819b4e0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f31180097f0 tx=0x7f3118032d00 comp rx=0 tx=0).stop 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.683+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 shutdown_connections 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.683+0000 7f312d18d640 1 --2- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f3110038f20 0x7f311003b3e0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.683+0000 7f312d18d640 1 --2- 172.21.15.103:0/515864099 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3128107450 0x7f312819b4e0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.683+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 >> 172.21.15.103:0/515864099 conn(0x7f3128102c40 msgr2=0x7f31281038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.683+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 shutdown_connections 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:35.683+0000 7f312d18d640 1 -- 172.21.15.103:0/515864099 wait complete. 2024-08-02T18:40:36.204 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling cephadm module... 2024-08-02T18:40:36.451 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:36 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/515864099' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-08-02T18:40:37.628 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:37 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3345618334' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-08-02T18:40:37.628 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ignoring --setuser ceph since I am not root 2024-08-02T18:40:37.629 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ignoring --setgroup ceph since I am not root 2024-08-02T18:40:37.629 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:37.479+0000 7fc385b3a040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-02T18:40:37.629 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:37.627+0000 7fc385b3a040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:40:37.896 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:37.695+0000 7fc385b3a040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-02T18:40:37.904 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.613+0000 7fb1a85ab640 1 Processor -- start 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.613+0000 7fb1a85ab640 1 -- start start 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.614+0000 7fb1a85ab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a0107850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.614+0000 7fb1a85ab640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a0107e20 con 0x7fb1a0107450 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.614+0000 7fb1a6347640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a0107850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.614+0000 7fb1a6347640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a0107850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36554/0 (socket says 172.21.15.103:36554) 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.614+0000 7fb1a6347640 1 -- 172.21.15.103:0/193002938 learned_addr learned my addr 172.21.15.103:0/193002938 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.614+0000 7fb1a6347640 1 -- 172.21.15.103:0/193002938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a0108600 con 0x7fb1a0107450 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.615+0000 7fb1a6347640 1 --2- 172.21.15.103:0/193002938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a0107850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009820 tx=0x7fb19c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acb69171597ffb server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.615+0000 7fb1a5345640 1 -- 172.21.15.103:0/193002938 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c037070 con 0x7fb1a0107450 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.615+0000 7fb1a5345640 1 -- 172.21.15.103:0/193002938 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb19c032920 con 0x7fb1a0107450 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.615+0000 7fb1a5345640 1 -- 172.21.15.103:0/193002938 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c030950 con 0x7fb1a0107450 2024-08-02T18:40:37.905 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 -- 172.21.15.103:0/193002938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 msgr2=0x7fb1a0107850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 --2- 172.21.15.103:0/193002938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a0107850 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009820 tx=0x7fb19c02a270 comp rx=0 tx=0).stop 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 -- 172.21.15.103:0/193002938 shutdown_connections 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 --2- 172.21.15.103:0/193002938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a0107850 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 -- 172.21.15.103:0/193002938 >> 172.21.15.103:0/193002938 conn(0x7fb1a0102c40 msgr2=0x7fb1a0105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 -- 172.21.15.103:0/193002938 shutdown_connections 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 -- 172.21.15.103:0/193002938 wait complete. 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 Processor -- start 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 -- start start 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a019b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.616+0000 7fb1a85ab640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb1a010b9b0 con 0x7fb1a0107450 2024-08-02T18:40:37.906 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1a6347640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a019b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1a6347640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a019b4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36568/0 (socket says 172.21.15.103:36568) 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1a6347640 1 -- 172.21.15.103:0/3345618334 learned_addr learned my addr 172.21.15.103:0/3345618334 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1a6347640 1 -- 172.21.15.103:0/3345618334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb1a019ba20 con 0x7fb1a0107450 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1a6347640 1 --2- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a019b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009940 tx=0x7fb19c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1977fe640 1 -- 172.21.15.103:0/3345618334 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c042070 con 0x7fb1a0107450 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1977fe640 1 -- 172.21.15.103:0/3345618334 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb19c0325f0 con 0x7fb1a0107450 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb1a019bcb0 con 0x7fb1a0107450 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1977fe640 1 -- 172.21.15.103:0/3345618334 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb19c037040 con 0x7fb1a0107450 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.617+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1a019e9a0 con 0x7fb1a0107450 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.618+0000 7fb1977fe640 1 -- 172.21.15.103:0/3345618334 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 4) ==== 46276+0+0 (secure 0 0 0) 0x7fb19c045070 con 0x7fb1a0107450 2024-08-02T18:40:37.907 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.618+0000 7fb1977fe640 1 --2- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb18c038f70 0x7fb18c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.618+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb1a01078d0 con 0x7fb1a0107450 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.618+0000 7fb1977fe640 1 -- 172.21.15.103:0/3345618334 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb19c06bf00 con 0x7fb1a0107450 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.618+0000 7fb1a5b46640 1 --2- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb18c038f70 0x7fb18c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.619+0000 7fb1a5b46640 1 --2- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb18c038f70 0x7fb18c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1900098c0 tx=0x7fb190006db0 comp rx=0 tx=0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.623+0000 7fb1977fe640 1 -- 172.21.15.103:0/3345618334 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb19c04b170 con 0x7fb1a0107450 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:36.834+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) -- 0x7fb1a019eb70 con 0x7fb1a0107450 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.330+0000 7fb1977fe640 1 -- 172.21.15.103:0/3345618334 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) ==== 86+0+0 (secure 0 0 0) 0x7fb1a019eb70 con 0x7fb1a0107450 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.332+0000 7fb1977fe640 1 -- 172.21.15.103:0/3345618334 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fb19c03cb10 con 0x7fb1a0107450 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb18c038f70 msgr2=0x7fb18c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:37.908 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 --2- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb18c038f70 0x7fb18c03b430 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fb1900098c0 tx=0x7fb190006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 msgr2=0x7fb1a019b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 --2- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a019b4e0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7fb19c009940 tx=0x7fb19c032e40 comp rx=0 tx=0).stop 2024-08-02T18:40:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 shutdown_connections 2024-08-02T18:40:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 --2- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb18c038f70 0x7fb18c03b430 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 --2- 172.21.15.103:0/3345618334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1a0107450 0x7fb1a019b4e0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 >> 172.21.15.103:0/3345618334 conn(0x7fb1a0102c40 msgr2=0x7fb1a01038a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.333+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 shutdown_connections 2024-08-02T18:40:37.909 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:37.334+0000 7fb1a85ab640 1 -- 172.21.15.103:0/3345618334 wait complete. 2024-08-02T18:40:38.232 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:37.943+0000 7fc385b3a040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-02T18:40:38.233 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:38.003+0000 7fc385b3a040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-02T18:40:38.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:38 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3345618334' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-08-02T18:40:38.517 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:38 smithi103 ceph-mon[32753]: mgrmap e5: x(active, since 5s) 2024-08-02T18:40:39.136 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:38.965+0000 7fc385b3a040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-02T18:40:39.136 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:39.083+0000 7fc385b3a040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-02T18:40:39.145 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-08-02T18:40:39.145 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 5, 2024-08-02T18:40:39.145 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-02T18:40:39.145 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-02T18:40:39.145 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-02T18:40:39.145 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-08-02T18:40:39.145 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.309+0000 7f0cbd878640 1 Processor -- start 2024-08-02T18:40:39.145 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.309+0000 7f0cbd878640 1 -- start start 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.309+0000 7f0cbd878640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb810a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.309+0000 7f0cbd878640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb8075520 con 0x7f0cb8107ef0 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.309+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb810a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.310+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb810a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36588/0 (socket says 172.21.15.103:36588) 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.310+0000 7f0cb6ffd640 1 -- 172.21.15.103:0/3469273992 learned_addr learned my addr 172.21.15.103:0/3469273992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.310+0000 7f0cb6ffd640 1 -- 172.21.15.103:0/3469273992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb810a820 con 0x7f0cb8107ef0 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.310+0000 7f0cb6ffd640 1 --2- 172.21.15.103:0/3469273992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb810a2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009820 tx=0x7f0ca802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8571dac8d5e02be1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cb5ffb640 1 -- 172.21.15.103:0/3469273992 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca8037070 con 0x7f0cb8107ef0 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cb5ffb640 1 -- 172.21.15.103:0/3469273992 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0ca8032920 con 0x7f0cb8107ef0 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cb5ffb640 1 -- 172.21.15.103:0/3469273992 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca8030950 con 0x7f0cb8107ef0 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cbd878640 1 -- 172.21.15.103:0/3469273992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 msgr2=0x7f0cb810a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:39.146 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cbd878640 1 --2- 172.21.15.103:0/3469273992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb810a2e0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8009820 tx=0x7f0ca802a270 comp rx=0 tx=0).stop 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cbd878640 1 -- 172.21.15.103:0/3469273992 shutdown_connections 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cbd878640 1 --2- 172.21.15.103:0/3469273992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb810a2e0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cbd878640 1 -- 172.21.15.103:0/3469273992 >> 172.21.15.103:0/3469273992 conn(0x7f0cb8101b10 msgr2=0x7f0cb8103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cbd878640 1 -- 172.21.15.103:0/3469273992 shutdown_connections 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.311+0000 7f0cbd878640 1 -- 172.21.15.103:0/3469273992 wait complete. 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.312+0000 7f0cbd878640 1 Processor -- start 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.312+0000 7f0cbd878640 1 -- start start 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.312+0000 7f0cbd878640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb819b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.312+0000 7f0cbd878640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0cb810b8c0 con 0x7f0cb8107ef0 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.312+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb819b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.312+0000 7f0cb6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb819b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:36592/0 (socket says 172.21.15.103:36592) 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.313+0000 7f0cb6ffd640 1 -- 172.21.15.103:0/2617292673 learned_addr learned my addr 172.21.15.103:0/2617292673 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.313+0000 7f0cb6ffd640 1 -- 172.21.15.103:0/2617292673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0cb819ba10 con 0x7f0cb8107ef0 2024-08-02T18:40:39.147 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.313+0000 7f0cb6ffd640 1 --2- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb819b4d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8031000 tx=0x7f0ca8032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.313+0000 7f0cbc876640 1 -- 172.21.15.103:0/2617292673 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca8042070 con 0x7f0cb8107ef0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.313+0000 7f0cbc876640 1 -- 172.21.15.103:0/2617292673 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f0ca80325f0 con 0x7f0cb8107ef0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.313+0000 7f0cbc876640 1 -- 172.21.15.103:0/2617292673 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0ca8037040 con 0x7f0cb8107ef0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.313+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0cb819bca0 con 0x7f0cb8107ef0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.313+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0cb819e990 con 0x7f0cb8107ef0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.314+0000 7f0cbc876640 1 -- 172.21.15.103:0/2617292673 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7f0ca8045070 con 0x7f0cb8107ef0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.314+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0cb8108350 con 0x7f0cb8107ef0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.314+0000 7f0cbc876640 1 --2- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f0ca4038fc0 0x7f0ca403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.314+0000 7f0cbc876640 1 -- 172.21.15.103:0/2617292673 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0ca806bff0 con 0x7f0cb8107ef0 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.314+0000 7f0cb67fc640 1 -- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f0ca4038fc0 msgr2=0x7f0ca403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2382390785 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.315+0000 7f0cb67fc640 1 --2- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f0ca4038fc0 0x7f0ca403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:40:39.148 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.319+0000 7f0cbc876640 1 -- 172.21.15.103:0/2617292673 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0ca8042210 con 0x7f0cb8107ef0 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.516+0000 7f0cb67fc640 1 -- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f0ca4038fc0 msgr2=0x7f0ca403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2382390785 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.516+0000 7f0cb67fc640 1 --2- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f0ca4038fc0 0x7f0ca403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.534+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f0cb819eb60 con 0x7f0cb8107ef0 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.534+0000 7f0cbc876640 1 -- 172.21.15.103:0/2617292673 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) ==== 56+0+88 (secure 0 0 0) 0x7f0ca803a780 con 0x7f0cb8107ef0 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f0ca4038fc0 msgr2=0x7f0ca403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 --2- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f0ca4038fc0 0x7f0ca403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 msgr2=0x7f0cb819b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 --2- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb819b4d0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7f0ca8031000 tx=0x7f0ca8032e40 comp rx=0 tx=0).stop 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 shutdown_connections 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 --2- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7f0ca4038fc0 0x7f0ca403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 --2- 172.21.15.103:0/2617292673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0cb8107ef0 0x7f0cb819b4d0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 >> 172.21.15.103:0/2617292673 conn(0x7f0cb8101b10 msgr2=0x7f0cb8102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.536+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 shutdown_connections 2024-08-02T18:40:39.149 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:38.537+0000 7f0cbd878640 1 -- 172.21.15.103:0/2617292673 wait complete. 2024-08-02T18:40:39.150 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for the mgr to restart... 2024-08-02T18:40:39.150 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr epoch 5... 2024-08-02T18:40:39.427 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:39 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2617292673' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-02T18:40:39.428 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:39.141+0000 7fc385b3a040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-02T18:40:39.428 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:39.364+0000 7fc385b3a040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-02T18:40:39.428 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:39.426+0000 7fc385b3a040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-02T18:40:39.749 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:39.494+0000 7fc385b3a040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-02T18:40:39.749 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:39.645+0000 7fc385b3a040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:40:40.325 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:40.059+0000 7fc385b3a040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-02T18:40:40.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:40.372+0000 7fc385b3a040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-02T18:40:40.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:40.438+0000 7fc385b3a040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-02T18:40:40.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:40.584+0000 7fc385b3a040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-02T18:40:41.281 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:40.894+0000 7fc385b3a040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-02T18:40:41.281 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:40.954+0000 7fc385b3a040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-02T18:40:41.282 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:41.136+0000 7fc385b3a040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-02T18:40:41.282 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:41.280+0000 7fc385b3a040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-02T18:40:41.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:41.343+0000 7fc385b3a040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-02T18:40:41.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:41.424+0000 7fc385b3a040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-02T18:40:41.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:41.482+0000 7fc385b3a040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-02T18:40:42.325 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:42.013+0000 7fc385b3a040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-02T18:40:42.325 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:42.168+0000 7fc385b3a040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: Active manager daemon x restarted 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: Activating manager daemon x 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: osdmap e2: 0 total, 0 up, 0 in 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: mgrmap e6: x(active, starting, since 0.00310283s) 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: Manager daemon x is now available 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:40:42.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:40:42.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-02T18:40:42.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:42 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-02T18:40:43.501 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-mon[32753]: Found migration_current of "None". Setting to last migration. 2024-08-02T18:40:43.501 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:43.501 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:43.501 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-mon[32753]: mgrmap e7: x(active, since 1.00548s) 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:43.412+0000 7fc2f2858640 -1 log_channel(cephadm) log [ERR] : [02/Aug/2024:18:40:43] ENGINE Error in HTTPServer.serve 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: Traceback (most recent call last): 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._connections.run(self.expiration_interval) 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._run(expiration_interval) 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: new_conn = self._from_server_socket(self.server.socket) 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: s = self.context.wrap_socket( 2024-08-02T18:40:43.502 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-02T18:40:43.503 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: return self.sslsocket_class._create( 2024-08-02T18:40:43.503 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-02T18:40:43.503 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self.do_handshake() 2024-08-02T18:40:43.503 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-02T18:40:43.503 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._sslobj.do_handshake() 2024-08-02T18:40:43.503 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-02T18:40:43.503 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:40:43.785 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-08-02T18:40:43.821 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 7, 2024-08-02T18:40:43.821 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.542+0000 7fb52e167640 1 Processor -- start 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.542+0000 7fb52e167640 1 -- start start 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.542+0000 7fb52e167640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb52810a340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.542+0000 7fb52e167640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb52807bdf0 con 0x7fb528107f50 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.542+0000 7fb5277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb52810a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.542+0000 7fb5277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb52810a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57338/0 (socket says 172.21.15.103:57338) 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.542+0000 7fb5277fe640 1 -- 172.21.15.103:0/2603160083 learned_addr learned my addr 172.21.15.103:0/2603160083 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.542+0000 7fb5277fe640 1 -- 172.21.15.103:0/2603160083 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb52810a880 con 0x7fb528107f50 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.543+0000 7fb5277fe640 1 --2- 172.21.15.103:0/2603160083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb52810a340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb518009820 tx=0x7fb51802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5327c8d5e546ebc1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:43.822 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.543+0000 7fb5267fc640 1 -- 172.21.15.103:0/2603160083 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb518037070 con 0x7fb528107f50 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.543+0000 7fb5267fc640 1 -- 172.21.15.103:0/2603160083 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb518032920 con 0x7fb528107f50 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.543+0000 7fb5267fc640 1 -- 172.21.15.103:0/2603160083 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb518030950 con 0x7fb528107f50 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.544+0000 7fb52e167640 1 -- 172.21.15.103:0/2603160083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 msgr2=0x7fb52810a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.544+0000 7fb52e167640 1 --2- 172.21.15.103:0/2603160083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb52810a340 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fb518009820 tx=0x7fb51802a270 comp rx=0 tx=0).stop 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.544+0000 7fb52e167640 1 -- 172.21.15.103:0/2603160083 shutdown_connections 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.544+0000 7fb52e167640 1 --2- 172.21.15.103:0/2603160083 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb52810a340 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.544+0000 7fb52e167640 1 -- 172.21.15.103:0/2603160083 >> 172.21.15.103:0/2603160083 conn(0x7fb528101bb0 msgr2=0x7fb528103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.544+0000 7fb52e167640 1 -- 172.21.15.103:0/2603160083 shutdown_connections 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.544+0000 7fb52e167640 1 -- 172.21.15.103:0/2603160083 wait complete. 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.545+0000 7fb52e167640 1 Processor -- start 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.545+0000 7fb52e167640 1 -- start start 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.545+0000 7fb52e167640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb5281077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:43.823 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.545+0000 7fb52e167640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb52810b860 con 0x7fb528107f50 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.545+0000 7fb5277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb5281077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.545+0000 7fb5277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb5281077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57342/0 (socket says 172.21.15.103:57342) 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.545+0000 7fb5277fe640 1 -- 172.21.15.103:0/498586591 learned_addr learned my addr 172.21.15.103:0/498586591 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.546+0000 7fb5277fe640 1 -- 172.21.15.103:0/498586591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb528107d10 con 0x7fb528107f50 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.546+0000 7fb5277fe640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb5281077d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb518031000 tx=0x7fb518032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.546+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb518042070 con 0x7fb528107f50 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.546+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb5180325f0 con 0x7fb528107f50 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.546+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb518037040 con 0x7fb528107f50 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.546+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb528105f00 con 0x7fb528107f50 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.546+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb528106440 con 0x7fb528107f50 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.547+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 5) ==== 46287+0+0 (secure 0 0 0) 0x7fb518045070 con 0x7fb528107f50 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.547+0000 7fb524ff9640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 0x7fb51003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:43.824 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.547+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 --> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb51003bb40 con 0x7fb510038f70 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.547+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fb51806bfc0 con 0x7fb528107f50 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.547+0000 7fb526ffd640 1 -- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 msgr2=0x7fb51003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2382390785 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.547+0000 7fb526ffd640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 0x7fb51003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.748+0000 7fb526ffd640 1 -- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 msgr2=0x7fb51003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2382390785 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:39.748+0000 7fb526ffd640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 0x7fb51003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:40.149+0000 7fb526ffd640 1 -- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 msgr2=0x7fb51003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2382390785 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:40.149+0000 7fb526ffd640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 0x7fb51003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:40.950+0000 7fb526ffd640 1 -- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 msgr2=0x7fb51003b430 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2382390785 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:40.950+0000 7fb526ffd640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 0x7fb51003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:42.171+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mgrmap(e 6) ==== 46054+0+0 (secure 0 0 0) 0x7fb51806ab40 con 0x7fb528107f50 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:42.172+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 msgr2=0x7fb51003b430 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:42.172+0000 7fb524ff9640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 0x7fb51003b430 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:43.825 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.173+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fb51803c840 con 0x7fb528107f50 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.173+0000 7fb524ff9640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb51003c8a0 0x7fb51003ec90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.173+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7fb518008e50 con 0x7fb51003c8a0 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.173+0000 7fb526ffd640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb51003c8a0 0x7fb51003ec90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.174+0000 7fb526ffd640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb51003c8a0 0x7fb51003ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb51c003980 tx=0x7fb51c006e10 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.174+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mgr.14118 v2:172.21.15.103:6800/2532430315 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7fb518008e50 con 0x7fb51003c8a0 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.181+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7fb5281083b0 con 0x7fb51003c8a0 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.181+0000 7fb524ff9640 1 -- 172.21.15.103:0/498586591 <== mgr.14118 v2:172.21.15.103:6800/2532430315 2 ==== command_reply(tid 1: 0 ) ==== 8+0+51 (secure 0 0 0) 0x7fb5281083b0 con 0x7fb51003c8a0 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb51003c8a0 msgr2=0x7fb51003ec90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb51003c8a0 0x7fb51003ec90 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 crypto rx=0x7fb51c003980 tx=0x7fb51c006e10 comp rx=0 tx=0).stop 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 msgr2=0x7fb5281077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb5281077d0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7fb518031000 tx=0x7fb518032e40 comp rx=0 tx=0).stop 2024-08-02T18:40:43.826 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 shutdown_connections 2024-08-02T18:40:43.827 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb51003c8a0 0x7fb51003ec90 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:43.827 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:6800/2382390785,v1:172.21.15.103:6801/2382390785] conn(0x7fb510038f70 0x7fb51003b430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:43.827 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 --2- 172.21.15.103:0/498586591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb528107f50 0x7fb5281077d0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:43.827 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 >> 172.21.15.103:0/498586591 conn(0x7fb528101bb0 msgr2=0x7fb5281027b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:43.827 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 shutdown_connections 2024-08-02T18:40:43.827 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:43.182+0000 7fb52e167640 1 -- 172.21.15.103:0/498586591 wait complete. 2024-08-02T18:40:43.827 INFO:teuthology.orchestra.run.smithi103.stdout:mgr epoch 5 is available 2024-08-02T18:40:43.827 INFO:teuthology.orchestra.run.smithi103.stdout:Setting orchestrator backend to cephadm... 2024-08-02T18:40:44.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:44 smithi103 ceph-mon[32753]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-08-02T18:40:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:44 smithi103 ceph-mon[32753]: from='client.14122 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-08-02T18:40:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:44 smithi103 ceph-mon[32753]: [02/Aug/2024:18:40:43] ENGINE Bus STARTING 2024-08-02T18:40:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:44 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:40:44.864 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.131+0000 7fbf5122c640 1 Processor -- start 2024-08-02T18:40:44.864 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.131+0000 7fbf5122c640 1 -- start start 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.131+0000 7fbf5122c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c10a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.131+0000 7fbf5122c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c075580 con 0x7fbf4c107e90 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.132+0000 7fbf4ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c10a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.132+0000 7fbf4ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c10a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57414/0 (socket says 172.21.15.103:57414) 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.132+0000 7fbf4ad9d640 1 -- 172.21.15.103:0/3287429938 learned_addr learned my addr 172.21.15.103:0/3287429938 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.132+0000 7fbf4ad9d640 1 -- 172.21.15.103:0/3287429938 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c10a7c0 con 0x7fbf4c107e90 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf4ad9d640 1 --2- 172.21.15.103:0/3287429938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c10a280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009820 tx=0x7fbf3c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34785519be55a0a3 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf49d9b640 1 -- 172.21.15.103:0/3287429938 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c037070 con 0x7fbf4c107e90 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf49d9b640 1 -- 172.21.15.103:0/3287429938 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fbf3c032920 con 0x7fbf4c107e90 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf49d9b640 1 -- 172.21.15.103:0/3287429938 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c030950 con 0x7fbf4c107e90 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf5122c640 1 -- 172.21.15.103:0/3287429938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 msgr2=0x7fbf4c10a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:44.865 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf5122c640 1 --2- 172.21.15.103:0/3287429938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c10a280 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c009820 tx=0x7fbf3c02a270 comp rx=0 tx=0).stop 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf5122c640 1 -- 172.21.15.103:0/3287429938 shutdown_connections 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf5122c640 1 --2- 172.21.15.103:0/3287429938 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c10a280 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf5122c640 1 -- 172.21.15.103:0/3287429938 >> 172.21.15.103:0/3287429938 conn(0x7fbf4c101b10 msgr2=0x7fbf4c103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf5122c640 1 -- 172.21.15.103:0/3287429938 shutdown_connections 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.133+0000 7fbf5122c640 1 -- 172.21.15.103:0/3287429938 wait complete. 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.134+0000 7fbf5122c640 1 Processor -- start 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.134+0000 7fbf5122c640 1 -- start start 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.134+0000 7fbf5122c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c19b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.134+0000 7fbf5122c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbf4c10b8c0 con 0x7fbf4c107e90 2024-08-02T18:40:44.866 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf4ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c19b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf4ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c19b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57426/0 (socket says 172.21.15.103:57426) 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf4ad9d640 1 -- 172.21.15.103:0/347910123 learned_addr learned my addr 172.21.15.103:0/347910123 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf4ad9d640 1 -- 172.21.15.103:0/347910123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbf4c19ba10 con 0x7fbf4c107e90 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf4ad9d640 1 --2- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c19b4d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0097f0 tx=0x7fbf3c032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf33fff640 1 -- 172.21.15.103:0/347910123 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c037040 con 0x7fbf4c107e90 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbf4c19bca0 con 0x7fbf4c107e90 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf33fff640 1 -- 172.21.15.103:0/347910123 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fbf3c040070 con 0x7fbf4c107e90 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf33fff640 1 -- 172.21.15.103:0/347910123 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbf3c03a6d0 con 0x7fbf4c107e90 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.135+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbf4c19e990 con 0x7fbf4c107e90 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.136+0000 7fbf33fff640 1 -- 172.21.15.103:0/347910123 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 7) ==== 46181+0+0 (secure 0 0 0) 0x7fbf3c03a8c0 con 0x7fbf4c107e90 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.136+0000 7fbf33fff640 1 --2- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fbf34038e60 0x7fbf3403b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.136+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbf4c1082f0 con 0x7fbf4c107e90 2024-08-02T18:40:44.867 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.136+0000 7fbf33fff640 1 -- 172.21.15.103:0/347910123 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fbf3c06c490 con 0x7fbf4c107e90 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.137+0000 7fbf4a59c640 1 --2- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fbf34038e60 0x7fbf3403b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.137+0000 7fbf4a59c640 1 --2- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fbf34038e60 0x7fbf3403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbf400098c0 tx=0x7fbf40006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.141+0000 7fbf33fff640 1 -- 172.21.15.103:0/347910123 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbf3c044c70 con 0x7fbf4c107e90 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.227+0000 7fbf33fff640 1 -- 172.21.15.103:0/347910123 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fbf3c045980 con 0x7fbf4c107e90 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.324+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) -- 0x7fbf4c102e50 con 0x7fbf34038e60 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.332+0000 7fbf33fff640 1 -- 172.21.15.103:0/347910123 <== mgr.14118 v2:172.21.15.103:6800/2532430315 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fbf4c102e50 con 0x7fbf34038e60 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fbf34038e60 msgr2=0x7fbf3403b320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 --2- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fbf34038e60 0x7fbf3403b320 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7fbf400098c0 tx=0x7fbf40006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 msgr2=0x7fbf4c19b4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 --2- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c19b4d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fbf3c0097f0 tx=0x7fbf3c032d00 comp rx=0 tx=0).stop 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 shutdown_connections 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 --2- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fbf34038e60 0x7fbf3403b320 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 --2- 172.21.15.103:0/347910123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbf4c107e90 0x7fbf4c19b4d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 >> 172.21.15.103:0/347910123 conn(0x7fbf4c101b10 msgr2=0x7fbf4c102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:44.869 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 shutdown_connections 2024-08-02T18:40:44.869 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:44.335+0000 7fbf5122c640 1 -- 172.21.15.103:0/347910123 wait complete. 2024-08-02T18:40:45.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:40:43] ENGINE Serving on https://172.21.15.103:7150 2024-08-02T18:40:45.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:40:43] ENGINE Error in HTTPServer.serve 2024-08-02T18:40:45.575 INFO:journalctl@ceph.mon.a.smithi103.stdout: Traceback (most recent call last): 2024-08-02T18:40:45.575 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._run(expiration_interval) 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: s = self.context.wrap_socket( 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: return self.sslsocket_class._create( 2024-08-02T18:40:45.576 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout: self.do_handshake() 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._sslobj.do_handshake() 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:40:43] ENGINE Serving on http://172.21.15.103:8765 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:40:43] ENGINE Bus STARTED 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:45 smithi103 ceph-mon[32753]: mgrmap e8: x(active, since 2s) 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:45 smithi103 ceph-mon[32753]: from='client.14130 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:45 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:45.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:45 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:40:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout value unchanged 2024-08-02T18:40:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.255+0000 7fde587f7640 1 Processor -- start 2024-08-02T18:40:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.255+0000 7fde587f7640 1 -- start start 2024-08-02T18:40:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.255+0000 7fde587f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde50106760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.255+0000 7fde587f7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde50106d30 con 0x7fde50106360 2024-08-02T18:40:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.255+0000 7fde56593640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde50106760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.255+0000 7fde56593640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde50106760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57430/0 (socket says 172.21.15.103:57430) 2024-08-02T18:40:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.255+0000 7fde56593640 1 -- 172.21.15.103:0/4121737634 learned_addr learned my addr 172.21.15.103:0/4121737634 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.256+0000 7fde56593640 1 -- 172.21.15.103:0/4121737634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde50107510 con 0x7fde50106360 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.256+0000 7fde56593640 1 --2- 172.21.15.103:0/4121737634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde50106760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009820 tx=0x7fde4c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba1ae2808db006bb server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.256+0000 7fde55591640 1 -- 172.21.15.103:0/4121737634 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4c037070 con 0x7fde50106360 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.256+0000 7fde55591640 1 -- 172.21.15.103:0/4121737634 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fde4c032920 con 0x7fde50106360 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.256+0000 7fde55591640 1 -- 172.21.15.103:0/4121737634 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4c030950 con 0x7fde50106360 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.257+0000 7fde587f7640 1 -- 172.21.15.103:0/4121737634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 msgr2=0x7fde50106760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.257+0000 7fde587f7640 1 --2- 172.21.15.103:0/4121737634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde50106760 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009820 tx=0x7fde4c02a270 comp rx=0 tx=0).stop 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.257+0000 7fde587f7640 1 -- 172.21.15.103:0/4121737634 shutdown_connections 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.257+0000 7fde587f7640 1 --2- 172.21.15.103:0/4121737634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde50106760 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.257+0000 7fde587f7640 1 -- 172.21.15.103:0/4121737634 >> 172.21.15.103:0/4121737634 conn(0x7fde50101bb0 msgr2=0x7fde50103fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.257+0000 7fde587f7640 1 -- 172.21.15.103:0/4121737634 shutdown_connections 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.257+0000 7fde587f7640 1 -- 172.21.15.103:0/4121737634 wait complete. 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.258+0000 7fde587f7640 1 Processor -- start 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.258+0000 7fde587f7640 1 -- start start 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.258+0000 7fde587f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde5019b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.258+0000 7fde587f7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fde5010a8c0 con 0x7fde50106360 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.258+0000 7fde56593640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde5019b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.258+0000 7fde56593640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde5019b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57440/0 (socket says 172.21.15.103:57440) 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.258+0000 7fde56593640 1 -- 172.21.15.103:0/2881520933 learned_addr learned my addr 172.21.15.103:0/2881520933 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.258+0000 7fde56593640 1 -- 172.21.15.103:0/2881520933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fde5019ba80 con 0x7fde50106360 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.259+0000 7fde56593640 1 --2- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde5019b540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009940 tx=0x7fde4c032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:46.033 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.259+0000 7fde477fe640 1 -- 172.21.15.103:0/2881520933 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4c042070 con 0x7fde50106360 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.259+0000 7fde477fe640 1 -- 172.21.15.103:0/2881520933 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fde4c0325f0 con 0x7fde50106360 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.259+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fde5019bd10 con 0x7fde50106360 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.259+0000 7fde477fe640 1 -- 172.21.15.103:0/2881520933 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fde4c037040 con 0x7fde50106360 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.259+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fde5019ea00 con 0x7fde50106360 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.260+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fde501067e0 con 0x7fde50106360 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.260+0000 7fde477fe640 1 -- 172.21.15.103:0/2881520933 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fde4c045070 con 0x7fde50106360 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.260+0000 7fde477fe640 1 --2- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fde3c038fc0 0x7fde3c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.260+0000 7fde477fe640 1 -- 172.21.15.103:0/2881520933 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fde4c06bfd0 con 0x7fde50106360 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.260+0000 7fde55d92640 1 --2- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fde3c038fc0 0x7fde3c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.261+0000 7fde55d92640 1 --2- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fde3c038fc0 0x7fde3c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde400098c0 tx=0x7fde40006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:46.034 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.265+0000 7fde477fe640 1 -- 172.21.15.103:0/2881520933 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fde4c03cab0 con 0x7fde50106360 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.430+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) -- 0x7fde5002d880 con 0x7fde3c038fc0 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.431+0000 7fde477fe640 1 -- 172.21.15.103:0/2881520933 <== mgr.14118 v2:172.21.15.103:6800/2532430315 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+16 (secure 0 0 0) 0x7fde5002d880 con 0x7fde3c038fc0 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fde3c038fc0 msgr2=0x7fde3c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 --2- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fde3c038fc0 0x7fde3c03b480 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fde400098c0 tx=0x7fde40006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 msgr2=0x7fde5019b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 --2- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde5019b540 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fde4c009940 tx=0x7fde4c032e40 comp rx=0 tx=0).stop 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 shutdown_connections 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 --2- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fde3c038fc0 0x7fde3c03b480 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 --2- 172.21.15.103:0/2881520933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fde50106360 0x7fde5019b540 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 >> 172.21.15.103:0/2881520933 conn(0x7fde50101bb0 msgr2=0x7fde50102b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 shutdown_connections 2024-08-02T18:40:46.035 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:45.433+0000 7fde587f7640 1 -- 172.21.15.103:0/2881520933 wait complete. 2024-08-02T18:40:46.036 INFO:teuthology.orchestra.run.smithi103.stdout:Generating ssh key... 2024-08-02T18:40:46.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-mon[32753]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:40:46.986 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: Generating public/private rsa key pair. 2024-08-02T18:40:46.986 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: Your identification has been saved in /tmp/tmp8wkbsry_/key 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: Your public key has been saved in /tmp/tmp8wkbsry_/key.pub 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: The key fingerprint is: 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: SHA256:XLd9AMpAx93gJ6tT3I4aFdjacumUjTUtMJJ1TcRKRHk ceph-7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: The key's randomart image is: 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: +---[RSA 3072]----+ 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | .o.o+*=+*o| 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | +o*.=+.E| 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | = *.*o.| 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | . . = #.+ | 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | S o & + .| 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | O o . | 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | + o . | 2024-08-02T18:40:46.987 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | + | 2024-08-02T18:40:46.988 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: | . | 2024-08-02T18:40:46.988 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:40:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: +----[SHA256]-----+ 2024-08-02T18:40:47.260 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.391+0000 7ff3b9da4640 1 Processor -- start 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.391+0000 7ff3b9da4640 1 -- start start 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.391+0000 7ff3b9da4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b4106720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.391+0000 7ff3b9da4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b4106cf0 con 0x7ff3b4106320 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.391+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b4106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.391+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b4106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57448/0 (socket says 172.21.15.103:57448) 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.391+0000 7ff3b37fe640 1 -- 172.21.15.103:0/1582756127 learned_addr learned my addr 172.21.15.103:0/1582756127 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.392+0000 7ff3b37fe640 1 -- 172.21.15.103:0/1582756127 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b4107520 con 0x7ff3b4106320 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.392+0000 7ff3b37fe640 1 --2- 172.21.15.103:0/1582756127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b4106720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009820 tx=0x7ff3a402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39f011101820dd5a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b27fc640 1 -- 172.21.15.103:0/1582756127 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3a4037070 con 0x7ff3b4106320 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b27fc640 1 -- 172.21.15.103:0/1582756127 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff3a4032920 con 0x7ff3b4106320 2024-08-02T18:40:47.261 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b27fc640 1 -- 172.21.15.103:0/1582756127 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3a4030950 con 0x7ff3b4106320 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b9da4640 1 -- 172.21.15.103:0/1582756127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 msgr2=0x7ff3b4106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b9da4640 1 --2- 172.21.15.103:0/1582756127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b4106720 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7ff3a4009820 tx=0x7ff3a402a270 comp rx=0 tx=0).stop 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b9da4640 1 -- 172.21.15.103:0/1582756127 shutdown_connections 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b9da4640 1 --2- 172.21.15.103:0/1582756127 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b4106720 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b9da4640 1 -- 172.21.15.103:0/1582756127 >> 172.21.15.103:0/1582756127 conn(0x7ff3b4101b10 msgr2=0x7ff3b4103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b9da4640 1 -- 172.21.15.103:0/1582756127 shutdown_connections 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.393+0000 7ff3b9da4640 1 -- 172.21.15.103:0/1582756127 wait complete. 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.394+0000 7ff3b9da4640 1 Processor -- start 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.394+0000 7ff3b9da4640 1 -- start start 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.394+0000 7ff3b9da4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b419b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.394+0000 7ff3b9da4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff3b410a8d0 con 0x7ff3b4106320 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.394+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b419b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:47.262 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.394+0000 7ff3b37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b419b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57450/0 (socket says 172.21.15.103:57450) 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.394+0000 7ff3b37fe640 1 -- 172.21.15.103:0/3908920905 learned_addr learned my addr 172.21.15.103:0/3908920905 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.395+0000 7ff3b37fe640 1 -- 172.21.15.103:0/3908920905 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3b419ba40 con 0x7ff3b4106320 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.395+0000 7ff3b37fe640 1 --2- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b419b500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40097f0 tx=0x7ff3a4032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.395+0000 7ff3b0ff9640 1 -- 172.21.15.103:0/3908920905 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3a4037040 con 0x7ff3b4106320 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.395+0000 7ff3b0ff9640 1 -- 172.21.15.103:0/3908920905 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7ff3a4040070 con 0x7ff3b4106320 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.395+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3b419bcd0 con 0x7ff3b4106320 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.395+0000 7ff3b0ff9640 1 -- 172.21.15.103:0/3908920905 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3a403a610 con 0x7ff3b4106320 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.395+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3b419e9c0 con 0x7ff3b4106320 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.396+0000 7ff3b0ff9640 1 -- 172.21.15.103:0/3908920905 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7ff3a403a840 con 0x7ff3b4106320 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.396+0000 7ff3b0ff9640 1 --2- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ff39c038fc0 0x7ff39c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.396+0000 7ff3b0ff9640 1 -- 172.21.15.103:0/3908920905 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ff3a406c510 con 0x7ff3b4106320 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.396+0000 7ff3b2ffd640 1 --2- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ff39c038fc0 0x7ff39c03b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:47.263 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.396+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3b41067a0 con 0x7ff3b4106320 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.396+0000 7ff3b2ffd640 1 --2- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ff39c038fc0 0x7ff39c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80098c0 tx=0x7ff3a8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.401+0000 7ff3b0ff9640 1 -- 172.21.15.103:0/3908920905 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff3a4044c70 con 0x7ff3b4106320 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.574+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) -- 0x7ff3b4103b60 con 0x7ff39c038fc0 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.709+0000 7ff3b0ff9640 1 -- 172.21.15.103:0/3908920905 <== mgr.14118 v2:172.21.15.103:6800/2532430315 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff3b4103b60 con 0x7ff39c038fc0 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.711+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ff39c038fc0 msgr2=0x7ff39c03b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.711+0000 7ff3b9da4640 1 --2- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ff39c038fc0 0x7ff39c03b480 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ff3a80098c0 tx=0x7ff3a8006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.711+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 msgr2=0x7ff3b419b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.711+0000 7ff3b9da4640 1 --2- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b419b500 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7ff3a40097f0 tx=0x7ff3a4032d00 comp rx=0 tx=0).stop 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.711+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 shutdown_connections 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.711+0000 7ff3b9da4640 1 --2- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ff39c038fc0 0x7ff39c03b480 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.711+0000 7ff3b9da4640 1 --2- 172.21.15.103:0/3908920905 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3b4106320 0x7ff3b419b500 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.711+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 >> 172.21.15.103:0/3908920905 conn(0x7ff3b4101b10 msgr2=0x7ff3b4074fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.712+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 shutdown_connections 2024-08-02T18:40:47.264 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:46.712+0000 7ff3b9da4640 1 -- 172.21.15.103:0/3908920905 wait complete. 2024-08-02T18:40:47.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:47 smithi103 ceph-mon[32753]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:40:47.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:47 smithi103 ceph-mon[32753]: Generating ssh key... 2024-08-02T18:40:47.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:47 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:47.777 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:47 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:48.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEFan6TC4g43dArgDB5iEunY6XREWqZpRhlDXoOFcZPKKwqDHb/jMf4GGfHneptXOJBBeDFyBjYSLsyRLOUjmO1hZ9odI7HCTvKvF+3fnVP5uanl0CPjutNUYL7Nck42+eu+myxQgW0nY1S74zSWP3iV2HlSRnynNiFRzIlzKejEsiGD1IGCcw8EZqUZSrtdVmh7r27YmWOZqH+qAhRoefFiA3dkVtSZLJPDuDWuHizuW6PNGDhpN5DiUVHK3e4KKYaWod1RvnvN0ghlUeSrT3U29yD6xc5c2CQ36cBxqBVjXXMuqPM1q2yvqeQVoFnLIiYJMGv6UP8YKu/+rTpQnGM4IRVYKhoke3BtDvN4fj33fCe2t+FQ/iatmV+JtuXJ9EKxa72Nn4TlyjnxJIaCSgyAePgOs4HnvSpBfTmdxu3Nrtths55iRq6txJ87IiJWH6DOSPdoRiYWJudW/YrlDDuHinNKgEynCrL0d3CPE098vBEnCv2mxbZogAPn5fjts= ceph-7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:40:48.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.598+0000 7f118190a640 1 Processor -- start 2024-08-02T18:40:48.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.598+0000 7f118190a640 1 -- start start 2024-08-02T18:40:48.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.598+0000 7f118190a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c106770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:48.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.598+0000 7f118190a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f117c106d40 con 0x7f117c106370 2024-08-02T18:40:48.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.598+0000 7f117affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c106770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:48.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.598+0000 7f117affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c106770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57456/0 (socket says 172.21.15.103:57456) 2024-08-02T18:40:48.360 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.599+0000 7f117affd640 1 -- 172.21.15.103:0/1507923143 learned_addr learned my addr 172.21.15.103:0/1507923143 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.599+0000 7f117affd640 1 -- 172.21.15.103:0/1507923143 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c107570 con 0x7f117c106370 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.599+0000 7f117affd640 1 --2- 172.21.15.103:0/1507923143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c106770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f116c009820 tx=0x7f116c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920402444254169f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f117a7fc640 1 -- 172.21.15.103:0/1507923143 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f116c037070 con 0x7f117c106370 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f117a7fc640 1 -- 172.21.15.103:0/1507923143 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f116c032920 con 0x7f117c106370 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f117a7fc640 1 -- 172.21.15.103:0/1507923143 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f116c030950 con 0x7f117c106370 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f118190a640 1 -- 172.21.15.103:0/1507923143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 msgr2=0x7f117c106770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f118190a640 1 --2- 172.21.15.103:0/1507923143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c106770 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f116c009820 tx=0x7f116c02a270 comp rx=0 tx=0).stop 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f118190a640 1 -- 172.21.15.103:0/1507923143 shutdown_connections 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f118190a640 1 --2- 172.21.15.103:0/1507923143 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c106770 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f118190a640 1 -- 172.21.15.103:0/1507923143 >> 172.21.15.103:0/1507923143 conn(0x7f117c101ba0 msgr2=0x7f117c103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f118190a640 1 -- 172.21.15.103:0/1507923143 shutdown_connections 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.600+0000 7f118190a640 1 -- 172.21.15.103:0/1507923143 wait complete. 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.601+0000 7f118190a640 1 Processor -- start 2024-08-02T18:40:48.361 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.601+0000 7f118190a640 1 -- start start 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.601+0000 7f118190a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c191570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.601+0000 7f118190a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f117c10a920 con 0x7f117c106370 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.601+0000 7f117affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c191570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.601+0000 7f117affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c191570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57464/0 (socket says 172.21.15.103:57464) 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.601+0000 7f117affd640 1 -- 172.21.15.103:0/3245737426 learned_addr learned my addr 172.21.15.103:0/3245737426 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.601+0000 7f117affd640 1 -- 172.21.15.103:0/3245737426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f117c191ab0 con 0x7f117c106370 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.602+0000 7f117affd640 1 --2- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c191570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f116c0097f0 tx=0x7f116c032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.602+0000 7f1180908640 1 -- 172.21.15.103:0/3245737426 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f116c037040 con 0x7f117c106370 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.602+0000 7f1180908640 1 -- 172.21.15.103:0/3245737426 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f116c040070 con 0x7f117c106370 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.602+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f117c18fca0 con 0x7f117c106370 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.602+0000 7f1180908640 1 -- 172.21.15.103:0/3245737426 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f116c03a610 con 0x7f117c106370 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.602+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f117c1901e0 con 0x7f117c106370 2024-08-02T18:40:48.362 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.603+0000 7f1180908640 1 -- 172.21.15.103:0/3245737426 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f116c03a840 con 0x7f117c106370 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.603+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f117c10aaa0 con 0x7f117c106370 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.603+0000 7f1180908640 1 --2- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1168038fc0 0x7f116803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.603+0000 7f1180908640 1 -- 172.21.15.103:0/3245737426 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f116c06c530 con 0x7f117c106370 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.603+0000 7f1173fff640 1 --2- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1168038fc0 0x7f116803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.603+0000 7f1173fff640 1 --2- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1168038fc0 0x7f116803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f11640098c0 tx=0x7f1164006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.608+0000 7f1180908640 1 -- 172.21.15.103:0/3245737426 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f116c0313a0 con 0x7f117c106370 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.775+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) -- 0x7f117c190a70 con 0x7f1168038fc0 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.776+0000 7f1180908640 1 -- 172.21.15.103:0/3245737426 <== mgr.14118 v2:172.21.15.103:6800/2532430315 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+595 (secure 0 0 0) 0x7f117c190a70 con 0x7f1168038fc0 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1168038fc0 msgr2=0x7f116803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 --2- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1168038fc0 0x7f116803b480 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f11640098c0 tx=0x7f1164006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 msgr2=0x7f117c191570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 --2- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c191570 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f116c0097f0 tx=0x7f116c032d00 comp rx=0 tx=0).stop 2024-08-02T18:40:48.363 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 shutdown_connections 2024-08-02T18:40:48.364 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 --2- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1168038fc0 0x7f116803b480 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:48.364 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 --2- 172.21.15.103:0/3245737426 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f117c106370 0x7f117c191570 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:48.364 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 >> 172.21.15.103:0/3245737426 conn(0x7f117c101ba0 msgr2=0x7f117c1027e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:48.364 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 shutdown_connections 2024-08-02T18:40:48.364 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:47.778+0000 7f118190a640 1 -- 172.21.15.103:0/3245737426 wait complete. 2024-08-02T18:40:48.364 INFO:teuthology.orchestra.run.smithi103.stdout:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-08-02T18:40:48.364 INFO:teuthology.orchestra.run.smithi103.stdout:Adding key to root@localhost authorized_keys... 2024-08-02T18:40:48.364 INFO:teuthology.orchestra.run.smithi103.stdout:Adding host smithi103... 2024-08-02T18:40:48.930 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:48 smithi103 ceph-mon[32753]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:40:49.978 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:49 smithi103 ceph-mon[32753]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi103", "addr": "172.21.15.103", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:40:50.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:50 smithi103 ceph-mon[32753]: Deploying cephadm binary to smithi103 2024-08-02T18:40:52.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Added host 'smithi103' with addr '172.21.15.103' 2024-08-02T18:40:52.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.749+0000 7fb285dc6640 1 Processor -- start 2024-08-02T18:40:52.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.749+0000 7fb285dc6640 1 -- start start 2024-08-02T18:40:52.750 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.749+0000 7fb285dc6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28010a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.749+0000 7fb285dc6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb28007be30 con 0x7fb280107ef0 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.749+0000 7fb27f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28010a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.750+0000 7fb27f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28010a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57474/0 (socket says 172.21.15.103:57474) 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.750+0000 7fb27f7fe640 1 -- 172.21.15.103:0/1494746229 learned_addr learned my addr 172.21.15.103:0/1494746229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.750+0000 7fb27f7fe640 1 -- 172.21.15.103:0/1494746229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28010a820 con 0x7fb280107ef0 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.750+0000 7fb27f7fe640 1 --2- 172.21.15.103:0/1494746229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28010a2e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb270009820 tx=0x7fb27002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bd90fdc8005c0d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb27e7fc640 1 -- 172.21.15.103:0/1494746229 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb270037070 con 0x7fb280107ef0 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb27e7fc640 1 -- 172.21.15.103:0/1494746229 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb270032920 con 0x7fb280107ef0 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb27e7fc640 1 -- 172.21.15.103:0/1494746229 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb270030950 con 0x7fb280107ef0 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb285dc6640 1 -- 172.21.15.103:0/1494746229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 msgr2=0x7fb28010a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb285dc6640 1 --2- 172.21.15.103:0/1494746229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28010a2e0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fb270009820 tx=0x7fb27002a270 comp rx=0 tx=0).stop 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb285dc6640 1 -- 172.21.15.103:0/1494746229 shutdown_connections 2024-08-02T18:40:52.751 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb285dc6640 1 --2- 172.21.15.103:0/1494746229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28010a2e0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb285dc6640 1 -- 172.21.15.103:0/1494746229 >> 172.21.15.103:0/1494746229 conn(0x7fb280101b50 msgr2=0x7fb280103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb285dc6640 1 -- 172.21.15.103:0/1494746229 shutdown_connections 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.751+0000 7fb285dc6640 1 -- 172.21.15.103:0/1494746229 wait complete. 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.752+0000 7fb285dc6640 1 Processor -- start 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.752+0000 7fb285dc6640 1 -- start start 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.752+0000 7fb285dc6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28019b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.752+0000 7fb285dc6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb28010b860 con 0x7fb280107ef0 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.752+0000 7fb27f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28019b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.752+0000 7fb27f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28019b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57490/0 (socket says 172.21.15.103:57490) 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.752+0000 7fb27f7fe640 1 -- 172.21.15.103:0/843427369 learned_addr learned my addr 172.21.15.103:0/843427369 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.753+0000 7fb27f7fe640 1 -- 172.21.15.103:0/843427369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb28019b9b0 con 0x7fb280107ef0 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.753+0000 7fb27f7fe640 1 --2- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28019b470 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2700097f0 tx=0x7fb270032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.753+0000 7fb27cff9640 1 -- 172.21.15.103:0/843427369 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb270037040 con 0x7fb280107ef0 2024-08-02T18:40:52.752 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.753+0000 7fb27cff9640 1 -- 172.21.15.103:0/843427369 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fb270040070 con 0x7fb280107ef0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.753+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb28019bc40 con 0x7fb280107ef0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.753+0000 7fb27cff9640 1 -- 172.21.15.103:0/843427369 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb27003a6d0 con 0x7fb280107ef0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.753+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb28019e930 con 0x7fb280107ef0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.754+0000 7fb27cff9640 1 -- 172.21.15.103:0/843427369 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fb27003a870 con 0x7fb280107ef0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.754+0000 7fb27cff9640 1 --2- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb268038fc0 0x7fb26803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.754+0000 7fb27cff9640 1 -- 172.21.15.103:0/843427369 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fb27003b8e0 con 0x7fb280107ef0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.754+0000 7fb27effd640 1 --2- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb268038fc0 0x7fb26803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.754+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb280108350 con 0x7fb280107ef0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.754+0000 7fb27effd640 1 --2- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb268038fc0 0x7fb26803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2740098c0 tx=0x7fb274006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:52.753 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.759+0000 7fb27cff9640 1 -- 172.21.15.103:0/843427369 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb2700313a0 con 0x7fb280107ef0 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:48.927+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi103", "addr": "172.21.15.103", "target": ["mon-mgr", ""]}) -- 0x7fb280102e20 con 0x7fb268038fc0 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.153+0000 7fb27cff9640 1 -- 172.21.15.103:0/843427369 <== mgr.14118 v2:172.21.15.103:6800/2532430315 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7fb280102e20 con 0x7fb268038fc0 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.155+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb268038fc0 msgr2=0x7fb26803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.155+0000 7fb285dc6640 1 --2- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb268038fc0 0x7fb26803b480 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fb2740098c0 tx=0x7fb274006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.155+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 msgr2=0x7fb28019b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.155+0000 7fb285dc6640 1 --2- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28019b470 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fb2700097f0 tx=0x7fb270032d00 comp rx=0 tx=0).stop 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.155+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 shutdown_connections 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.155+0000 7fb285dc6640 1 --2- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fb268038fc0 0x7fb26803b480 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.155+0000 7fb285dc6640 1 --2- 172.21.15.103:0/843427369 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb280107ef0 0x7fb28019b470 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.155+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 >> 172.21.15.103:0/843427369 conn(0x7fb280101b50 msgr2=0x7fb280102710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.156+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 shutdown_connections 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:52.156+0000 7fb285dc6640 1 -- 172.21.15.103:0/843427369 wait complete. 2024-08-02T18:40:52.754 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying unmanaged mon service... 2024-08-02T18:40:53.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:53 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:53.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:53 smithi103 ceph-mon[32753]: Added host smithi103 2024-08-02T18:40:53.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:53 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:40:54.076 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled mon update... 2024-08-02T18:40:54.076 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.124+0000 7f1d32c44640 1 Processor -- start 2024-08-02T18:40:54.076 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.124+0000 7f1d32c44640 1 -- start start 2024-08-02T18:40:54.076 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.124+0000 7f1d32c44640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c106c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:54.076 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.124+0000 7f1d32c44640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c107230 con 0x7f1d2c106860 2024-08-02T18:40:54.076 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.125+0000 7f1d309e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c106c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.125+0000 7f1d309e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c106c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43364/0 (socket says 172.21.15.103:43364) 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.125+0000 7f1d309e0640 1 -- 172.21.15.103:0/477383798 learned_addr learned my addr 172.21.15.103:0/477383798 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.125+0000 7f1d309e0640 1 -- 172.21.15.103:0/477383798 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c107580 con 0x7f1d2c106860 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.126+0000 7f1d309e0640 1 --2- 172.21.15.103:0/477383798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c106c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009820 tx=0x7f1d2002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e90940fd18f5da1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.126+0000 7f1d2b7fe640 1 -- 172.21.15.103:0/477383798 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20037070 con 0x7f1d2c106860 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.126+0000 7f1d2b7fe640 1 -- 172.21.15.103:0/477383798 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1d20032920 con 0x7f1d2c106860 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.126+0000 7f1d2b7fe640 1 -- 172.21.15.103:0/477383798 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20030950 con 0x7f1d2c106860 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.127+0000 7f1d32c44640 1 -- 172.21.15.103:0/477383798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 msgr2=0x7f1d2c106c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.127+0000 7f1d32c44640 1 --2- 172.21.15.103:0/477383798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c106c60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f1d20009820 tx=0x7f1d2002a270 comp rx=0 tx=0).stop 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.127+0000 7f1d32c44640 1 -- 172.21.15.103:0/477383798 shutdown_connections 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.127+0000 7f1d32c44640 1 --2- 172.21.15.103:0/477383798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c106c60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.127+0000 7f1d32c44640 1 -- 172.21.15.103:0/477383798 >> 172.21.15.103:0/477383798 conn(0x7f1d2c101250 msgr2=0x7f1d2c103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:54.077 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.127+0000 7f1d32c44640 1 -- 172.21.15.103:0/477383798 shutdown_connections 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.127+0000 7f1d32c44640 1 -- 172.21.15.103:0/477383798 wait complete. 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d32c44640 1 Processor -- start 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d32c44640 1 -- start start 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d32c44640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c19b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d32c44640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c10a930 con 0x7f1d2c106860 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d309e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c19b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d309e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c19b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43374/0 (socket says 172.21.15.103:43374) 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d309e0640 1 -- 172.21.15.103:0/2023843220 learned_addr learned my addr 172.21.15.103:0/2023843220 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d309e0640 1 -- 172.21.15.103:0/2023843220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c19bb00 con 0x7f1d2c106860 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.128+0000 7f1d309e0640 1 --2- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c19b5c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d200097f0 tx=0x7f1d20032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.129+0000 7f1d29ffb640 1 -- 172.21.15.103:0/2023843220 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d20037040 con 0x7f1d2c106860 2024-08-02T18:40:54.078 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.129+0000 7f1d29ffb640 1 -- 172.21.15.103:0/2023843220 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7f1d20040070 con 0x7f1d2c106860 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.129+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c19bd90 con 0x7f1d2c106860 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.129+0000 7f1d29ffb640 1 -- 172.21.15.103:0/2023843220 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1d2003a610 con 0x7f1d2c106860 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.129+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c19ea30 con 0x7f1d2c106860 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.130+0000 7f1d29ffb640 1 -- 172.21.15.103:0/2023843220 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f1d2003a890 con 0x7f1d2c106860 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.130+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c10aab0 con 0x7f1d2c106860 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.130+0000 7f1d29ffb640 1 --2- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1d1c038f70 0x7f1d1c03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.130+0000 7f1d29ffb640 1 -- 172.21.15.103:0/2023843220 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f1d2006c4e0 con 0x7f1d2c106860 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.130+0000 7f1d2bfff640 1 --2- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1d1c038f70 0x7f1d1c03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.131+0000 7f1d2bfff640 1 --2- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1d1c038f70 0x7f1d1c03b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d180098c0 tx=0x7f1d18006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.135+0000 7f1d29ffb640 1 -- 172.21.15.103:0/2023843220 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1d200313a0 con 0x7f1d2c106860 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.327+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7f1d2c02d8c0 con 0x7f1d1c038f70 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.332+0000 7f1d29ffb640 1 -- 172.21.15.103:0/2023843220 <== mgr.14118 v2:172.21.15.103:6800/2532430315 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7f1d2c02d8c0 con 0x7f1d1c038f70 2024-08-02T18:40:54.079 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1d1c038f70 msgr2=0x7f1d1c03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 --2- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1d1c038f70 0x7f1d1c03b430 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f1d180098c0 tx=0x7f1d18006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 msgr2=0x7f1d2c19b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 --2- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c19b5c0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f1d200097f0 tx=0x7f1d20032d00 comp rx=0 tx=0).stop 2024-08-02T18:40:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 shutdown_connections 2024-08-02T18:40:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 --2- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f1d1c038f70 0x7f1d1c03b430 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 --2- 172.21.15.103:0/2023843220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1d2c106860 0x7f1d2c19b5c0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:54.080 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 >> 172.21.15.103:0/2023843220 conn(0x7f1d2c101250 msgr2=0x7f1d2c102240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 shutdown_connections 2024-08-02T18:40:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:53.334+0000 7f1d32c44640 1 -- 172.21.15.103:0/2023843220 wait complete. 2024-08-02T18:40:54.082 INFO:teuthology.orchestra.run.smithi103.stdout:Deploying unmanaged mgr service... 2024-08-02T18:40:54.632 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:54 smithi103 ceph-mon[32753]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:40:54.632 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:54 smithi103 ceph-mon[32753]: Saving service mon spec with placement count:5 2024-08-02T18:40:54.632 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:54 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:55.873 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:55 smithi103 ceph-mon[32753]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:40:55.873 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:55 smithi103 ceph-mon[32753]: Saving service mgr spec with placement count:2 2024-08-02T18:40:55.873 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:55 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:55.874 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:55 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:55.880 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Scheduled mgr update... 2024-08-02T18:40:55.881 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.440+0000 7fe085542640 1 Processor -- start 2024-08-02T18:40:55.881 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.440+0000 7fe085542640 1 -- start start 2024-08-02T18:40:55.881 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.440+0000 7fe085542640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08007c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:55.881 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.440+0000 7fe085542640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe08007c900 con 0x7fe08007de80 2024-08-02T18:40:55.881 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.440+0000 7fe07effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08007c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:55.881 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.440+0000 7fe07effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08007c330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43388/0 (socket says 172.21.15.103:43388) 2024-08-02T18:40:55.881 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.440+0000 7fe07effd640 1 -- 172.21.15.103:0/2590881063 learned_addr learned my addr 172.21.15.103:0/2590881063 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:55.882 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.441+0000 7fe07effd640 1 -- 172.21.15.103:0/2590881063 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08007ca80 con 0x7fe08007de80 2024-08-02T18:40:55.882 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.441+0000 7fe07effd640 1 --2- 172.21.15.103:0/2590881063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08007c330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe074009820 tx=0x7fe07402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd2e2a208eea83e8 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:55.882 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.441+0000 7fe07dffb640 1 -- 172.21.15.103:0/2590881063 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe074037070 con 0x7fe08007de80 2024-08-02T18:40:55.882 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.441+0000 7fe07dffb640 1 -- 172.21.15.103:0/2590881063 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fe074032920 con 0x7fe08007de80 2024-08-02T18:40:55.882 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.441+0000 7fe07dffb640 1 -- 172.21.15.103:0/2590881063 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe074030950 con 0x7fe08007de80 2024-08-02T18:40:55.882 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.442+0000 7fe085542640 1 -- 172.21.15.103:0/2590881063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 msgr2=0x7fe08007c330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.442+0000 7fe085542640 1 --2- 172.21.15.103:0/2590881063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08007c330 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fe074009820 tx=0x7fe07402a270 comp rx=0 tx=0).stop 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.442+0000 7fe085542640 1 -- 172.21.15.103:0/2590881063 shutdown_connections 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.442+0000 7fe085542640 1 --2- 172.21.15.103:0/2590881063 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08007c330 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.442+0000 7fe085542640 1 -- 172.21.15.103:0/2590881063 >> 172.21.15.103:0/2590881063 conn(0x7fe080102c40 msgr2=0x7fe080105060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.442+0000 7fe085542640 1 -- 172.21.15.103:0/2590881063 shutdown_connections 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.442+0000 7fe085542640 1 -- 172.21.15.103:0/2590881063 wait complete. 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.443+0000 7fe085542640 1 Processor -- start 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.443+0000 7fe085542640 1 -- start start 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.443+0000 7fe085542640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08019d6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.443+0000 7fe085542640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe08010daa0 con 0x7fe08007de80 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.443+0000 7fe07effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08019d6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.443+0000 7fe07effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08019d6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43400/0 (socket says 172.21.15.103:43400) 2024-08-02T18:40:55.883 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.443+0000 7fe07effd640 1 -- 172.21.15.103:0/2336221533 learned_addr learned my addr 172.21.15.103:0/2336221533 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.443+0000 7fe07effd640 1 -- 172.21.15.103:0/2336221533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe08019dc10 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.444+0000 7fe07effd640 1 --2- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08019d6d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe074031000 tx=0x7fe074032e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.444+0000 7fe067fff640 1 -- 172.21.15.103:0/2336221533 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe074042070 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.444+0000 7fe067fff640 1 -- 172.21.15.103:0/2336221533 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1143+0+0 (secure 0 0 0) 0x7fe0740325f0 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.444+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe08019dea0 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.444+0000 7fe067fff640 1 -- 172.21.15.103:0/2336221533 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe074037040 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.444+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe0801a0b90 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.445+0000 7fe067fff640 1 -- 172.21.15.103:0/2336221533 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fe074045070 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.445+0000 7fe067fff640 1 --2- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fe068038fc0 0x7fe06803b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.445+0000 7fe067fff640 1 -- 172.21.15.103:0/2336221533 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fe07406c040 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.445+0000 7fe07e7fc640 1 --2- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fe068038fc0 0x7fe06803b480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.445+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe08007c3b0 con 0x7fe08007de80 2024-08-02T18:40:55.884 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.445+0000 7fe07e7fc640 1 --2- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fe068038fc0 0x7fe06803b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0700098c0 tx=0x7fe070006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.450+0000 7fe067fff640 1 -- 172.21.15.103:0/2336221533 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe074042210 con 0x7fe08007de80 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.639+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}) -- 0x7fe080103f60 con 0x7fe068038fc0 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.643+0000 7fe067fff640 1 -- 172.21.15.103:0/2336221533 <== mgr.14118 v2:172.21.15.103:6800/2532430315 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe080103f60 con 0x7fe068038fc0 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.645+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fe068038fc0 msgr2=0x7fe06803b480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.645+0000 7fe085542640 1 --2- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fe068038fc0 0x7fe06803b480 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7fe0700098c0 tx=0x7fe070006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.645+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 msgr2=0x7fe08019d6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.645+0000 7fe085542640 1 --2- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08019d6d0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fe074031000 tx=0x7fe074032e40 comp rx=0 tx=0).stop 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.645+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 shutdown_connections 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.645+0000 7fe085542640 1 --2- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fe068038fc0 0x7fe06803b480 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.645+0000 7fe085542640 1 --2- 172.21.15.103:0/2336221533 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe08007de80 0x7fe08019d6d0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.645+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 >> 172.21.15.103:0/2336221533 conn(0x7fe080102c40 msgr2=0x7fe080103850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.646+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 shutdown_connections 2024-08-02T18:40:55.885 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:54.646+0000 7fe085542640 1 -- 172.21.15.103:0/2336221533 wait complete. 2024-08-02T18:40:57.054 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.302+0000 7fa1d67c3640 1 Processor -- start 2024-08-02T18:40:57.054 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.302+0000 7fa1d67c3640 1 -- start start 2024-08-02T18:40:57.054 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.303+0000 7fa1d67c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d010a2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:57.054 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.303+0000 7fa1d67c3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d0075540 con 0x7fa1d0107ed0 2024-08-02T18:40:57.054 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.303+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d010a2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:57.054 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.303+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d010a2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43416/0 (socket says 172.21.15.103:43416) 2024-08-02T18:40:57.054 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.303+0000 7fa1cffff640 1 -- 172.21.15.103:0/304644509 learned_addr learned my addr 172.21.15.103:0/304644509 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:57.054 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.303+0000 7fa1cffff640 1 -- 172.21.15.103:0/304644509 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d010a800 con 0x7fa1d0107ed0 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.304+0000 7fa1cffff640 1 --2- 172.21.15.103:0/304644509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d010a2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009820 tx=0x7fa1c002a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc5c920b5181eed2 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.304+0000 7fa1cf7fe640 1 -- 172.21.15.103:0/304644509 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0037070 con 0x7fa1d0107ed0 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.304+0000 7fa1cf7fe640 1 -- 172.21.15.103:0/304644509 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa1c0032940 con 0x7fa1d0107ed0 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.304+0000 7fa1cf7fe640 1 -- 172.21.15.103:0/304644509 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c00308b0 con 0x7fa1d0107ed0 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 -- 172.21.15.103:0/304644509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 msgr2=0x7fa1d010a2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 --2- 172.21.15.103:0/304644509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d010a2c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0009820 tx=0x7fa1c002a270 comp rx=0 tx=0).stop 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 -- 172.21.15.103:0/304644509 shutdown_connections 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 --2- 172.21.15.103:0/304644509 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d010a2c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:57.055 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 -- 172.21.15.103:0/304644509 >> 172.21.15.103:0/304644509 conn(0x7fa1d0101b10 msgr2=0x7fa1d0103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 -- 172.21.15.103:0/304644509 shutdown_connections 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 -- 172.21.15.103:0/304644509 wait complete. 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 Processor -- start 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 -- start start 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d019b500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.305+0000 7fa1d67c3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d010b8e0 con 0x7fa1d0107ed0 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d019b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d019b500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43420/0 (socket says 172.21.15.103:43420) 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1cffff640 1 -- 172.21.15.103:0/3960519840 learned_addr learned my addr 172.21.15.103:0/3960519840 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1cffff640 1 -- 172.21.15.103:0/3960519840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d019ba40 con 0x7fa1d0107ed0 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1cffff640 1 --2- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d019b500 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0032670 tx=0x7fa1c00326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1cdffb640 1 -- 172.21.15.103:0/3960519840 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0042070 con 0x7fa1d0107ed0 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1cdffb640 1 -- 172.21.15.103:0/3960519840 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa1c003d930 con 0x7fa1d0107ed0 2024-08-02T18:40:57.056 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d019bcd0 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1cdffb640 1 -- 172.21.15.103:0/3960519840 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa1c0037040 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.306+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d019e9c0 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.307+0000 7fa1cdffb640 1 -- 172.21.15.103:0/3960519840 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fa1c0045070 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.307+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d0108330 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.307+0000 7fa1cdffb640 1 --2- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fa1bc038f70 0x7fa1bc03b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.307+0000 7fa1cdffb640 1 -- 172.21.15.103:0/3960519840 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fa1c006c310 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.307+0000 7fa1c7fff640 1 --2- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fa1bc038f70 0x7fa1bc03b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.308+0000 7fa1c7fff640 1 --2- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fa1bc038f70 0x7fa1bc03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098c0 tx=0x7fa1b8006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.312+0000 7fa1cdffb640 1 -- 172.21.15.103:0/3960519840 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa1c0045760 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.494+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) -- 0x7fa1d019efc0 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.497+0000 7fa1cdffb640 1 -- 172.21.15.103:0/3960519840 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) ==== 142+0+0 (secure 0 0 0) 0x7fa1c00463b0 con 0x7fa1d0107ed0 2024-08-02T18:40:57.057 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fa1bc038f70 msgr2=0x7fa1bc03b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 --2- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fa1bc038f70 0x7fa1bc03b430 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa1b80098c0 tx=0x7fa1b8006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 msgr2=0x7fa1d019b500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 --2- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d019b500 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fa1c0032670 tx=0x7fa1c00326a0 comp rx=0 tx=0).stop 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 shutdown_connections 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 --2- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fa1bc038f70 0x7fa1bc03b430 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 --2- 172.21.15.103:0/3960519840 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa1d0107ed0 0x7fa1d019b500 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 >> 172.21.15.103:0/3960519840 conn(0x7fa1d0101b10 msgr2=0x7fa1d0102760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 shutdown_connections 2024-08-02T18:40:57.058 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:56.499+0000 7fa1d67c3640 1 -- 172.21.15.103:0/3960519840 wait complete. 2024-08-02T18:40:57.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:57 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:57.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:57 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3960519840' entity='client.admin' 2024-08-02T18:40:58.789 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:58 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2942393639' entity='client.admin' 2024-08-02T18:40:58.789 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:40:58 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:40:58.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.460+0000 7f6428c88640 1 Processor -- start 2024-08-02T18:40:58.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.460+0000 7f6428c88640 1 -- start start 2024-08-02T18:40:58.796 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.460+0000 7f6428c88640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f642410a310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.460+0000 7f6428c88640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f642407be80 con 0x7f6424107f20 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.460+0000 7f642259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f642410a310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.460+0000 7f642259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f642410a310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43424/0 (socket says 172.21.15.103:43424) 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.460+0000 7f642259c640 1 -- 172.21.15.103:0/1569175534 learned_addr learned my addr 172.21.15.103:0/1569175534 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.460+0000 7f642259c640 1 -- 172.21.15.103:0/1569175534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642410a850 con 0x7f6424107f20 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f642259c640 1 --2- 172.21.15.103:0/1569175534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f642410a310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6414009820 tx=0x7f641402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad552b082fa6474c server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f6421d9b640 1 -- 172.21.15.103:0/1569175534 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6414037070 con 0x7f6424107f20 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f6421d9b640 1 -- 172.21.15.103:0/1569175534 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6414032940 con 0x7f6424107f20 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f6421d9b640 1 -- 172.21.15.103:0/1569175534 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f64140308b0 con 0x7f6424107f20 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f6428c88640 1 -- 172.21.15.103:0/1569175534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 msgr2=0x7f642410a310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f6428c88640 1 --2- 172.21.15.103:0/1569175534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f642410a310 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f6414009820 tx=0x7f641402a270 comp rx=0 tx=0).stop 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f6428c88640 1 -- 172.21.15.103:0/1569175534 shutdown_connections 2024-08-02T18:40:58.797 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f6428c88640 1 --2- 172.21.15.103:0/1569175534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f642410a310 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.461+0000 7f6428c88640 1 -- 172.21.15.103:0/1569175534 >> 172.21.15.103:0/1569175534 conn(0x7f6424101ba0 msgr2=0x7f6424103fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.462+0000 7f6428c88640 1 -- 172.21.15.103:0/1569175534 shutdown_connections 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.462+0000 7f6428c88640 1 -- 172.21.15.103:0/1569175534 wait complete. 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.462+0000 7f6428c88640 1 Processor -- start 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.462+0000 7f6428c88640 1 -- start start 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.462+0000 7f6428c88640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f64241077a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.462+0000 7f6428c88640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f642410b8c0 con 0x7f6424107f20 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f642259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f64241077a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f642259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f64241077a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43432/0 (socket says 172.21.15.103:43432) 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f642259c640 1 -- 172.21.15.103:0/2942393639 learned_addr learned my addr 172.21.15.103:0/2942393639 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f642259c640 1 -- 172.21.15.103:0/2942393639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6424107ce0 con 0x7f6424107f20 2024-08-02T18:40:58.798 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f642259c640 1 --2- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f64241077a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6414032670 tx=0x7f64140326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f641b7fe640 1 -- 172.21.15.103:0/2942393639 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6414042070 con 0x7f6424107f20 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f641b7fe640 1 -- 172.21.15.103:0/2942393639 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f641403d930 con 0x7f6424107f20 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6424105ed0 con 0x7f6424107f20 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f641b7fe640 1 -- 172.21.15.103:0/2942393639 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6414037040 con 0x7f6424107f20 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.463+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6424106410 con 0x7f6424107f20 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.464+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6424108380 con 0x7f6424107f20 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.465+0000 7f641b7fe640 1 -- 172.21.15.103:0/2942393639 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7f6414045070 con 0x7f6424107f20 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.465+0000 7f641b7fe640 1 --2- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f6410038f70 0x7f641003b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.465+0000 7f641b7fe640 1 -- 172.21.15.103:0/2942393639 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f641406c140 con 0x7f6424107f20 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.465+0000 7f641bfff640 1 --2- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f6410038f70 0x7f641003b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.466+0000 7f641bfff640 1 --2- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f6410038f70 0x7f641003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f640c0098c0 tx=0x7f640c006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:40:58.799 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.470+0000 7f641b7fe640 1 -- 172.21.15.103:0/2942393639 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f641404b170 con 0x7f6424107f20 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.648+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) -- 0x7f6424106d60 con 0x7f6424107f20 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.651+0000 7f641b7fe640 1 -- 172.21.15.103:0/2942393639 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) ==== 130+0+0 (secure 0 0 0) 0x7f6424106d60 con 0x7f6424107f20 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f6410038f70 msgr2=0x7f641003b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 --2- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f6410038f70 0x7f641003b430 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f640c0098c0 tx=0x7f640c006db0 comp rx=0 tx=0).stop 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 msgr2=0x7f64241077a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 --2- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f64241077a0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f6414032670 tx=0x7f64140326a0 comp rx=0 tx=0).stop 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 shutdown_connections 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 --2- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f6410038f70 0x7f641003b430 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 --2- 172.21.15.103:0/2942393639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6424107f20 0x7f64241077a0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 >> 172.21.15.103:0/2942393639 conn(0x7f6424101ba0 msgr2=0x7f64241027a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.653+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 shutdown_connections 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:57.654+0000 7f6428c88640 1 -- 172.21.15.103:0/2942393639 wait complete. 2024-08-02T18:40:58.800 INFO:teuthology.orchestra.run.smithi103.stdout:Enabling the dashboard module... 2024-08-02T18:41:00.724 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:00 smithi103 ceph-mon[32753]: from='mgr.14118 172.21.15.103:0/365691706' entity='mgr.x' 2024-08-02T18:41:00.724 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:00 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4288196694' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-08-02T18:41:00.724 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ignoring --setuser ceph since I am not root 2024-08-02T18:41:00.724 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ignoring --setgroup ceph since I am not root 2024-08-02T18:41:00.724 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:00.576+0000 7f7ff2ef6040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-02T18:41:00.724 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:00.722+0000 7f7ff2ef6040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:41:01.036 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:00.790+0000 7f7ff2ef6040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-02T18:41:01.036 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:01 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:01.035+0000 7f7ff2ef6040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-02T18:41:01.325 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:01 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:01.095+0000 7f7ff2ef6040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.194+0000 7feca273e640 1 Processor -- start 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.194+0000 7feca273e640 1 -- start start 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.194+0000 7feca273e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c107880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.194+0000 7feca273e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c107e50 con 0x7fec9c107480 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.194+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c107880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.194+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c107880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58202/0 (socket says 172.21.15.103:58202) 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.195+0000 7fec9bfff640 1 -- 172.21.15.103:0/2383991876 learned_addr learned my addr 172.21.15.103:0/2383991876 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.195+0000 7fec9bfff640 1 -- 172.21.15.103:0/2383991876 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9c108680 con 0x7fec9c107480 2024-08-02T18:41:01.453 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.196+0000 7fec9bfff640 1 --2- 172.21.15.103:0/2383991876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c107880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009820 tx=0x7fec8c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5790481624d5fdd server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:01.454 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.196+0000 7fec9affd640 1 -- 172.21.15.103:0/2383991876 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c037070 con 0x7fec9c107480 2024-08-02T18:41:01.454 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.196+0000 7fec9affd640 1 -- 172.21.15.103:0/2383991876 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec8c032940 con 0x7fec9c107480 2024-08-02T18:41:01.454 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.196+0000 7fec9affd640 1 -- 172.21.15.103:0/2383991876 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c0308b0 con 0x7fec9c107480 2024-08-02T18:41:01.454 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 -- 172.21.15.103:0/2383991876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 msgr2=0x7fec9c107880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:01.454 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 --2- 172.21.15.103:0/2383991876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c107880 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fec8c009820 tx=0x7fec8c02a270 comp rx=0 tx=0).stop 2024-08-02T18:41:01.454 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 -- 172.21.15.103:0/2383991876 shutdown_connections 2024-08-02T18:41:01.454 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 --2- 172.21.15.103:0/2383991876 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c107880 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:01.454 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 -- 172.21.15.103:0/2383991876 >> 172.21.15.103:0/2383991876 conn(0x7fec9c102c10 msgr2=0x7fec9c105050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 -- 172.21.15.103:0/2383991876 shutdown_connections 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 -- 172.21.15.103:0/2383991876 wait complete. 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 Processor -- start 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.197+0000 7feca273e640 1 -- start start 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7feca273e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c19b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7feca273e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec9c10ba30 con 0x7fec9c107480 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c19b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7fec9bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c19b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58206/0 (socket says 172.21.15.103:58206) 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7fec9bfff640 1 -- 172.21.15.103:0/4288196694 learned_addr learned my addr 172.21.15.103:0/4288196694 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7fec9bfff640 1 -- 172.21.15.103:0/4288196694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec9c19ba60 con 0x7fec9c107480 2024-08-02T18:41:01.455 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7fec9bfff640 1 --2- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c19b520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0097f0 tx=0x7fec8c032e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7fec997fa640 1 -- 172.21.15.103:0/4288196694 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c037040 con 0x7fec9c107480 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7fec997fa640 1 -- 172.21.15.103:0/4288196694 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec8c040070 con 0x7fec9c107480 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec9c19bcf0 con 0x7fec9c107480 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.198+0000 7fec997fa640 1 -- 172.21.15.103:0/4288196694 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fec8c03a520 con 0x7fec9c107480 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.199+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec9c19e9e0 con 0x7fec9c107480 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.199+0000 7fec997fa640 1 -- 172.21.15.103:0/4288196694 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 8) ==== 46287+0+0 (secure 0 0 0) 0x7fec8c03a7d0 con 0x7fec9c107480 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.200+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec9c107880 con 0x7fec9c107480 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.200+0000 7fec997fa640 1 --2- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fec84038f70 0x7fec8403b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:01.456 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.200+0000 7fec997fa640 1 -- 172.21.15.103:0/4288196694 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7fec8c06d680 con 0x7fec9c107480 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.200+0000 7fec9b7fe640 1 --2- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fec84038f70 0x7fec8403b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.200+0000 7fec9b7fe640 1 --2- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fec84038f70 0x7fec8403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fec900098c0 tx=0x7fec90006db0 comp rx=0 tx=0).ready entity=mgr.14118 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.204+0000 7fec997fa640 1 -- 172.21.15.103:0/4288196694 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fec8c044c70 con 0x7fec9c107480 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:40:59.423+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) -- 0x7fec9c19ebb0 con 0x7fec9c107480 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.423+0000 7fec997fa640 1 -- 172.21.15.103:0/4288196694 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) ==== 88+0+0 (secure 0 0 0) 0x7fec9c19ebb0 con 0x7fec9c107480 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.425+0000 7fec997fa640 1 -- 172.21.15.103:0/4288196694 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7fec8c02fd40 con 0x7fec9c107480 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fec84038f70 msgr2=0x7fec8403b430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 --2- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fec84038f70 0x7fec8403b430 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fec900098c0 tx=0x7fec90006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:01.457 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 msgr2=0x7fec9c19b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:01.458 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 --2- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c19b520 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fec8c0097f0 tx=0x7fec8c032e60 comp rx=0 tx=0).stop 2024-08-02T18:41:01.458 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 shutdown_connections 2024-08-02T18:41:01.458 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 --2- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7fec84038f70 0x7fec8403b430 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:01.458 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 --2- 172.21.15.103:0/4288196694 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec9c107480 0x7fec9c19b520 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:01.458 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 >> 172.21.15.103:0/4288196694 conn(0x7fec9c102c10 msgr2=0x7fec9c1037c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:01.458 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 shutdown_connections 2024-08-02T18:41:01.458 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:00.427+0000 7feca273e640 1 -- 172.21.15.103:0/4288196694 wait complete. 2024-08-02T18:41:01.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:01 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4288196694' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-08-02T18:41:01.781 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:01 smithi103 ceph-mon[32753]: mgrmap e9: x(active, since 18s) 2024-08-02T18:41:02.325 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:02 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:02.072+0000 7f7ff2ef6040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-02T18:41:02.325 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:02 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:02.193+0000 7f7ff2ef6040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-02T18:41:02.325 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:02 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:02.249+0000 7f7ff2ef6040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-02T18:41:02.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:02 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4257413090' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-08-02T18:41:02.710 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:02 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:02.463+0000 7f7ff2ef6040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-02T18:41:02.710 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:02 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:02.523+0000 7f7ff2ef6040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-02T18:41:02.710 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:02 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:02.591+0000 7f7ff2ef6040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "epoch": 9, 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "available": true, 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "active_name": "x", 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "num_standby": 0 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.858+0000 7f7da9155640 1 Processor -- start 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.859+0000 7f7da9155640 1 -- start start 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.859+0000 7f7da9155640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da41066e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.859+0000 7f7da9155640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7da4106cb0 con 0x7f7da41062e0 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.859+0000 7f7da2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da41066e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:02.719 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.859+0000 7f7da2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da41066e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58232/0 (socket says 172.21.15.103:58232) 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.859+0000 7f7da2d9d640 1 -- 172.21.15.103:0/2403397717 learned_addr learned my addr 172.21.15.103:0/2403397717 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.859+0000 7f7da2d9d640 1 -- 172.21.15.103:0/2403397717 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da41074e0 con 0x7f7da41062e0 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.860+0000 7f7da2d9d640 1 --2- 172.21.15.103:0/2403397717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da41066e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009820 tx=0x7f7d9402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c59512d0e5bb7ced server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.860+0000 7f7da1d9b640 1 -- 172.21.15.103:0/2403397717 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d94037070 con 0x7f7da41062e0 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.860+0000 7f7da1d9b640 1 -- 172.21.15.103:0/2403397717 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d94032940 con 0x7f7da41062e0 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.860+0000 7f7da1d9b640 1 -- 172.21.15.103:0/2403397717 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d940308b0 con 0x7f7da41062e0 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.860+0000 7f7da9155640 1 -- 172.21.15.103:0/2403397717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 msgr2=0x7f7da41066e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.860+0000 7f7da9155640 1 --2- 172.21.15.103:0/2403397717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da41066e0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009820 tx=0x7f7d9402a270 comp rx=0 tx=0).stop 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.861+0000 7f7da9155640 1 -- 172.21.15.103:0/2403397717 shutdown_connections 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.861+0000 7f7da9155640 1 --2- 172.21.15.103:0/2403397717 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da41066e0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.861+0000 7f7da9155640 1 -- 172.21.15.103:0/2403397717 >> 172.21.15.103:0/2403397717 conn(0x7f7da4101af0 msgr2=0x7f7da4103f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.861+0000 7f7da9155640 1 -- 172.21.15.103:0/2403397717 shutdown_connections 2024-08-02T18:41:02.720 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.861+0000 7f7da9155640 1 -- 172.21.15.103:0/2403397717 wait complete. 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.861+0000 7f7da9155640 1 Processor -- start 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.862+0000 7f7da9155640 1 -- start start 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.862+0000 7f7da9155640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da407ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.862+0000 7f7da9155640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7da410a890 con 0x7f7da41062e0 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.862+0000 7f7da2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da407ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.862+0000 7f7da2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da407ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58240/0 (socket says 172.21.15.103:58240) 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.862+0000 7f7da2d9d640 1 -- 172.21.15.103:0/4257413090 learned_addr learned my addr 172.21.15.103:0/4257413090 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.862+0000 7f7da2d9d640 1 -- 172.21.15.103:0/4257413090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7da419e220 con 0x7f7da41062e0 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.862+0000 7f7da2d9d640 1 --2- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da407ba60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009940 tx=0x7f7d94032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.863+0000 7f7d8bfff640 1 -- 172.21.15.103:0/4257413090 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d94042070 con 0x7f7da41062e0 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.863+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7da419e3f0 con 0x7f7da41062e0 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.863+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7da419e790 con 0x7f7da41062e0 2024-08-02T18:41:02.721 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.863+0000 7f7d8bfff640 1 -- 172.21.15.103:0/4257413090 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7d9403d930 con 0x7f7da41062e0 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.863+0000 7f7d8bfff640 1 -- 172.21.15.103:0/4257413090 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7d94037040 con 0x7f7da41062e0 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.864+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7da4106760 con 0x7f7da41062e0 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.864+0000 7f7d8bfff640 1 -- 172.21.15.103:0/4257413090 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7f7d94045070 con 0x7f7da41062e0 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.864+0000 7f7d8bfff640 1 --2- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f7d8c038fc0 0x7f7d8c03b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.864+0000 7f7d8bfff640 1 -- 172.21.15.103:0/4257413090 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7f7d9406c2b0 con 0x7f7da41062e0 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.864+0000 7f7da259c640 1 -- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f7d8c038fc0 msgr2=0x7f7d8c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2532430315 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.864+0000 7f7da259c640 1 --2- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f7d8c038fc0 0x7f7d8c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:01.869+0000 7f7d8bfff640 1 -- 172.21.15.103:0/4257413090 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7d9404b170 con 0x7f7da41062e0 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.065+0000 7f7da259c640 1 -- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f7d8c038fc0 msgr2=0x7f7d8c03b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2532430315 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.065+0000 7f7da259c640 1 --2- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f7d8c038fc0 0x7f7d8c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.097+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) -- 0x7f7da419a000 con 0x7f7da41062e0 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.098+0000 7f7d8bfff640 1 -- 172.21.15.103:0/4257413090 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) ==== 56+0+88 (secure 0 0 0) 0x7f7d94045520 con 0x7f7da41062e0 2024-08-02T18:41:02.722 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f7d8c038fc0 msgr2=0x7f7d8c03b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 --2- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f7d8c038fc0 0x7f7d8c03b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 msgr2=0x7f7da407ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 --2- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da407ba60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f7d94009940 tx=0x7f7d94032670 comp rx=0 tx=0).stop 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 shutdown_connections 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 --2- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7f7d8c038fc0 0x7f7d8c03b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 --2- 172.21.15.103:0/4257413090 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7da41062e0 0x7f7da407ba60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 >> 172.21.15.103:0/4257413090 conn(0x7f7da4101af0 msgr2=0x7f7da4102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 shutdown_connections 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:02.100+0000 7f7da9155640 1 -- 172.21.15.103:0/4257413090 wait complete. 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for the mgr to restart... 2024-08-02T18:41:02.723 INFO:teuthology.orchestra.run.smithi103.stdout:Waiting for mgr epoch 9... 2024-08-02T18:41:03.021 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:02 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:02.741+0000 7f7ff2ef6040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:41:03.306 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:03 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:03.167+0000 7f7ff2ef6040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-02T18:41:03.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:03 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:03.475+0000 7f7ff2ef6040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-02T18:41:03.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:03 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:03.540+0000 7f7ff2ef6040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-02T18:41:03.993 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:03 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:03.686+0000 7f7ff2ef6040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-02T18:41:03.993 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:03 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:03.992+0000 7f7ff2ef6040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-02T18:41:04.326 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:04 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:04.053+0000 7f7ff2ef6040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-02T18:41:04.326 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:04 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:04.233+0000 7f7ff2ef6040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-02T18:41:04.826 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:04 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:04.377+0000 7f7ff2ef6040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-02T18:41:04.826 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:04 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:04.439+0000 7f7ff2ef6040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-02T18:41:04.826 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:04 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:04.521+0000 7f7ff2ef6040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-02T18:41:04.827 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:04 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:04.579+0000 7f7ff2ef6040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-02T18:41:05.409 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:05.103+0000 7f7ff2ef6040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-02T18:41:05.409 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:05.258+0000 7f7ff2ef6040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-02T18:41:05.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: Active manager daemon x restarted 2024-08-02T18:41:05.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: Activating manager daemon x 2024-08-02T18:41:05.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: osdmap e3: 0 total, 0 up, 0 in 2024-08-02T18:41:05.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: mgrmap e10: x(active, starting, since 0.00341444s) 2024-08-02T18:41:05.409 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:41:05.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-02T18:41:05.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-02T18:41:05.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-02T18:41:05.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-02T18:41:05.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: Manager daemon x is now available 2024-08-02T18:41:05.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:05.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-02T18:41:05.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-02T18:41:06.819 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:06.625+0000 7f7f58b72640 -1 log_channel(cephadm) log [ERR] : [02/Aug/2024:18:41:06] ENGINE Error in HTTPServer.serve 2024-08-02T18:41:06.820 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: Traceback (most recent call last): 2024-08-02T18:41:06.820 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-02T18:41:06.820 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._connections.run(self.expiration_interval) 2024-08-02T18:41:06.820 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-02T18:41:06.821 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._run(expiration_interval) 2024-08-02T18:41:06.821 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-02T18:41:06.821 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: new_conn = self._from_server_socket(self.server.socket) 2024-08-02T18:41:06.821 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-02T18:41:06.821 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-02T18:41:06.822 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-02T18:41:06.822 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: s = self.context.wrap_socket( 2024-08-02T18:41:06.822 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-02T18:41:06.822 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: return self.sslsocket_class._create( 2024-08-02T18:41:06.822 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-02T18:41:06.822 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self.do_handshake() 2024-08-02T18:41:06.823 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-02T18:41:06.823 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._sslobj.do_handshake() 2024-08-02T18:41:06.823 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-02T18:41:06.823 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:41:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:41:07.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout { 2024-08-02T18:41:07.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "mgrmap_epoch": 11, 2024-08-02T18:41:07.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout "initialized": true 2024-08-02T18:41:07.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout } 2024-08-02T18:41:07.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.097+0000 7ffa410cf640 1 Processor -- start 2024-08-02T18:41:07.096 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.098+0000 7ffa410cf640 1 -- start start 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.098+0000 7ffa410cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c10a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.098+0000 7ffa410cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c075580 con 0x7ffa3c107e80 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.098+0000 7ffa3ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c10a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.098+0000 7ffa3ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c10a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58252/0 (socket says 172.21.15.103:58252) 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.098+0000 7ffa3ad9d640 1 -- 172.21.15.103:0/735667659 learned_addr learned my addr 172.21.15.103:0/735667659 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.098+0000 7ffa3ad9d640 1 -- 172.21.15.103:0/735667659 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c10a7b0 con 0x7ffa3c107e80 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.099+0000 7ffa3ad9d640 1 --2- 172.21.15.103:0/735667659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c10a270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009820 tx=0x7ffa2c02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb341292e291f86b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.099+0000 7ffa39d9b640 1 -- 172.21.15.103:0/735667659 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa2c037070 con 0x7ffa3c107e80 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.099+0000 7ffa39d9b640 1 -- 172.21.15.103:0/735667659 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa2c032940 con 0x7ffa3c107e80 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.099+0000 7ffa39d9b640 1 -- 172.21.15.103:0/735667659 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa2c0308b0 con 0x7ffa3c107e80 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.100+0000 7ffa410cf640 1 -- 172.21.15.103:0/735667659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 msgr2=0x7ffa3c10a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:07.097 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.100+0000 7ffa410cf640 1 --2- 172.21.15.103:0/735667659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c10a270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c009820 tx=0x7ffa2c02a270 comp rx=0 tx=0).stop 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.100+0000 7ffa410cf640 1 -- 172.21.15.103:0/735667659 shutdown_connections 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.100+0000 7ffa410cf640 1 --2- 172.21.15.103:0/735667659 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c10a270 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.100+0000 7ffa410cf640 1 -- 172.21.15.103:0/735667659 >> 172.21.15.103:0/735667659 conn(0x7ffa3c101b00 msgr2=0x7ffa3c103f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.100+0000 7ffa410cf640 1 -- 172.21.15.103:0/735667659 shutdown_connections 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.100+0000 7ffa410cf640 1 -- 172.21.15.103:0/735667659 wait complete. 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.100+0000 7ffa410cf640 1 Processor -- start 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa410cf640 1 -- start start 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa410cf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c107700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa410cf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffa3c10b8f0 con 0x7ffa3c107e80 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa3ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c107700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:07.098 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa3ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c107700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58254/0 (socket says 172.21.15.103:58254) 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa3ad9d640 1 -- 172.21.15.103:0/305596222 learned_addr learned my addr 172.21.15.103:0/305596222 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa3ad9d640 1 -- 172.21.15.103:0/305596222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa3c107c40 con 0x7ffa3c107e80 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa3ad9d640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c107700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c032670 tx=0x7ffa2c0326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.101+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa2c042070 con 0x7ffa3c107e80 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.102+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa3c105e30 con 0x7ffa3c107e80 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.102+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa2c03d930 con 0x7ffa3c107e80 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.102+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffa2c037040 con 0x7ffa3c107e80 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.102+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa3c106370 con 0x7ffa3c107e80 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.102+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 9) ==== 46300+0+0 (secure 0 0 0) 0x7ffa2c045070 con 0x7ffa3c107e80 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.103+0000 7ffa23fff640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 0x7ffa2403b480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.103+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 --> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffa3c1082e0 con 0x7ffa24038fc0 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.103+0000 7ffa3a59c640 1 -- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 msgr2=0x7ffa2403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2532430315 2024-08-02T18:41:07.099 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.103+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 940+0+0 (secure 0 0 0) 0x7ffa2c06c210 con 0x7ffa3c107e80 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.103+0000 7ffa3a59c640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 0x7ffa2403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.304+0000 7ffa3a59c640 1 -- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 msgr2=0x7ffa2403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2532430315 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.304+0000 7ffa3a59c640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 0x7ffa2403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.705+0000 7ffa3a59c640 1 -- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 msgr2=0x7ffa2403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2532430315 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:03.705+0000 7ffa3a59c640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 0x7ffa2403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.800000 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:04.506+0000 7ffa3a59c640 1 -- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 msgr2=0x7ffa2403b480 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/2532430315 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:04.506+0000 7ffa3a59c640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 0x7ffa2403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 1.600000 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:05.261+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mgrmap(e 10) ==== 46067+0+0 (secure 0 0 0) 0x7ffa2c06acc0 con 0x7ffa3c107e80 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:05.262+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 msgr2=0x7ffa2403b480 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:05.262+0000 7ffa23fff640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 0x7ffa2403b480 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.263+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7ffa2c042d00 con 0x7ffa3c107e80 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.263+0000 7ffa23fff640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa2403c890 0x7ffa2403ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.263+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7ffa2c00af30 con 0x7ffa2403c890 2024-08-02T18:41:07.100 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.264+0000 7ffa3a59c640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa2403c890 0x7ffa2403ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.264+0000 7ffa3a59c640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa2403c890 0x7ffa2403ec80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffa30003980 tx=0x7ffa30006e10 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.265+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== command_reply(tid 0: 0 ) ==== 8+0+9564 (secure 0 0 0) 0x7ffa2c00af30 con 0x7ffa2403c890 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.277+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- command(tid 1: {"prefix": "mgr_status"}) -- 0x7ffa3c1066b0 con 0x7ffa2403c890 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.277+0000 7ffa23fff640 1 -- 172.21.15.103:0/305596222 <== mgr.14150 v2:172.21.15.103:6800/3303960029 2 ==== command_reply(tid 1: 0 ) ==== 8+0+52 (secure 0 0 0) 0x7ffa3c1066b0 con 0x7ffa2403c890 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa2403c890 msgr2=0x7ffa2403ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa2403c890 0x7ffa2403ec80 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7ffa30003980 tx=0x7ffa30006e10 comp rx=0 tx=0).stop 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 msgr2=0x7ffa3c107700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c107700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7ffa2c032670 tx=0x7ffa2c0326a0 comp rx=0 tx=0).stop 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 shutdown_connections 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa2403c890 0x7ffa2403ec80 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:6800/2532430315,v1:172.21.15.103:6801/2532430315] conn(0x7ffa24038fc0 0x7ffa2403b480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 --2- 172.21.15.103:0/305596222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa3c107e80 0x7ffa3c107700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 >> 172.21.15.103:0/305596222 conn(0x7ffa3c101b00 msgr2=0x7ffa3c102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:07.101 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 shutdown_connections 2024-08-02T18:41:07.102 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:06.278+0000 7ffa410cf640 1 -- 172.21.15.103:0/305596222 wait complete. 2024-08-02T18:41:07.102 INFO:teuthology.orchestra.run.smithi103.stdout:mgr epoch 9 is available 2024-08-02T18:41:07.102 INFO:teuthology.orchestra.run.smithi103.stdout:Generating a dashboard self-signed certificate... 2024-08-02T18:41:07.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:07 smithi103 ceph-mon[32753]: mgrmap e11: x(active, since 1.00577s) 2024-08-02T18:41:07.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:07 smithi103 ceph-mon[32753]: [02/Aug/2024:18:41:06] ENGINE Bus STARTING 2024-08-02T18:41:07.337 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout Self-signed certificate created 2024-08-02T18:41:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.517+0000 7effda0de640 1 Processor -- start 2024-08-02T18:41:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.517+0000 7effda0de640 1 -- start start 2024-08-02T18:41:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.517+0000 7effda0de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd407bd00 0x7effd4109f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.517+0000 7effda0de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7effd410a550 con 0x7effd407bd00 2024-08-02T18:41:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.517+0000 7effd37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd407bd00 0x7effd4109f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.517+0000 7effd37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd407bd00 0x7effd4109f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58322/0 (socket says 172.21.15.103:58322) 2024-08-02T18:41:08.367 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.517+0000 7effd37fe640 1 -- 172.21.15.103:0/1089342128 learned_addr learned my addr 172.21.15.103:0/1089342128 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.518+0000 7effd37fe640 1 -- 172.21.15.103:0/1089342128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd410a6d0 con 0x7effd407bd00 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.518+0000 7effd37fe640 1 --2- 172.21.15.103:0/1089342128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd407bd00 0x7effd4109f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effc4009820 tx=0x7effc402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32416d1c01bf94f1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effd27fc640 1 -- 172.21.15.103:0/1089342128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc4037070 con 0x7effd407bd00 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effd27fc640 1 -- 172.21.15.103:0/1089342128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7effc4032940 con 0x7effd407bd00 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effd27fc640 1 -- 172.21.15.103:0/1089342128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc40308b0 con 0x7effd407bd00 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effda0de640 1 -- 172.21.15.103:0/1089342128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd407bd00 msgr2=0x7effd4109f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effda0de640 1 --2- 172.21.15.103:0/1089342128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd407bd00 0x7effd4109f80 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7effc4009820 tx=0x7effc402a270 comp rx=0 tx=0).stop 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effda0de640 1 -- 172.21.15.103:0/1089342128 shutdown_connections 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effda0de640 1 --2- 172.21.15.103:0/1089342128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd407bd00 0x7effd4109f80 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effda0de640 1 -- 172.21.15.103:0/1089342128 >> 172.21.15.103:0/1089342128 conn(0x7effd4101b50 msgr2=0x7effd4103f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effda0de640 1 -- 172.21.15.103:0/1089342128 shutdown_connections 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.519+0000 7effda0de640 1 -- 172.21.15.103:0/1089342128 wait complete. 2024-08-02T18:41:08.368 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.520+0000 7effda0de640 1 Processor -- start 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.520+0000 7effda0de640 1 -- start start 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.520+0000 7effda0de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd41077b0 0x7effd4105f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.520+0000 7effda0de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7effd410b870 con 0x7effd41077b0 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.520+0000 7effd37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd41077b0 0x7effd4105f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.520+0000 7effd37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd41077b0 0x7effd4105f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58338/0 (socket says 172.21.15.103:58338) 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.520+0000 7effd37fe640 1 -- 172.21.15.103:0/3591692839 learned_addr learned my addr 172.21.15.103:0/3591692839 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.521+0000 7effd37fe640 1 -- 172.21.15.103:0/3591692839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7effd4107bd0 con 0x7effd41077b0 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.521+0000 7effd37fe640 1 --2- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd41077b0 0x7effd4105f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effc4032670 tx=0x7effc40326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.521+0000 7effd0ff9640 1 -- 172.21.15.103:0/3591692839 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc4042070 con 0x7effd41077b0 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.521+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7effd4106460 con 0x7effd41077b0 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.521+0000 7effd0ff9640 1 -- 172.21.15.103:0/3591692839 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7effc403d930 con 0x7effd41077b0 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.521+0000 7effd0ff9640 1 -- 172.21.15.103:0/3591692839 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7effc4037040 con 0x7effd41077b0 2024-08-02T18:41:08.369 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.521+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7effd4106940 con 0x7effd41077b0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.522+0000 7effd0ff9640 1 -- 172.21.15.103:0/3591692839 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 11) ==== 46194+0+0 (secure 0 0 0) 0x7effc4045070 con 0x7effd41077b0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.522+0000 7effd0ff9640 1 --2- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7effbc038eb0 0x7effbc03b370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.522+0000 7effd0ff9640 1 -- 172.21.15.103:0/3591692839 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7effc406d5b0 con 0x7effd41077b0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.522+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7effd4107ff0 con 0x7effd41077b0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.522+0000 7effd2ffd640 1 --2- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7effbc038eb0 0x7effbc03b370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.523+0000 7effd2ffd640 1 --2- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7effbc038eb0 0x7effbc03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7effc80098c0 tx=0x7effc8006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.527+0000 7effd0ff9640 1 -- 172.21.15.103:0/3591692839 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7effc4045c60 con 0x7effd41077b0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.696+0000 7effd0ff9640 1 -- 172.21.15.103:0/3591692839 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7effc403bd70 con 0x7effd41077b0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.711+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) -- 0x7effd407bd00 con 0x7effbc038eb0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.774+0000 7effd0ff9640 1 -- 172.21.15.103:0/3591692839 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+32 (secure 0 0 0) 0x7effd407bd00 con 0x7effbc038eb0 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.776+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7effbc038eb0 msgr2=0x7effbc03b370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:08.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.776+0000 7effda0de640 1 --2- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7effbc038eb0 0x7effbc03b370 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7effc80098c0 tx=0x7effc8006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.776+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd41077b0 msgr2=0x7effd4105f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.776+0000 7effda0de640 1 --2- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd41077b0 0x7effd4105f20 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7effc4032670 tx=0x7effc40326a0 comp rx=0 tx=0).stop 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.777+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 shutdown_connections 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.777+0000 7effda0de640 1 --2- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7effbc038eb0 0x7effbc03b370 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.777+0000 7effda0de640 1 --2- 172.21.15.103:0/3591692839 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7effd41077b0 0x7effd4105f20 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.777+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 >> 172.21.15.103:0/3591692839 conn(0x7effd4101b50 msgr2=0x7effd4102750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.777+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 shutdown_connections 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:07.777+0000 7effda0de640 1 -- 172.21.15.103:0/3591692839 wait complete. 2024-08-02T18:41:08.371 INFO:teuthology.orchestra.run.smithi103.stdout:Creating initial admin user... 2024-08-02T18:41:08.486 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:08 smithi103 ceph-mon[32753]: [02/Aug/2024:18:41:06] ENGINE Serving on http://172.21.15.103:8765 2024-08-02T18:41:08.486 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:08 smithi103 ceph-mon[32753]: [02/Aug/2024:18:41:06] ENGINE Serving on https://172.21.15.103:7150 2024-08-02T18:41:08.486 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:08 smithi103 ceph-mon[32753]: [02/Aug/2024:18:41:06] ENGINE Bus STARTED 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:08 smithi103 ceph-mon[32753]: [02/Aug/2024:18:41:06] ENGINE Error in HTTPServer.serve 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: Traceback (most recent call last): 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._run(expiration_interval) 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-02T18:41:08.487 INFO:journalctl@ceph.mon.a.smithi103.stdout: s = self.context.wrap_socket( 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout: return self.sslsocket_class._create( 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout: self.do_handshake() 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._sslobj.do_handshake() 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:08 smithi103 ceph-mon[32753]: mgrmap e12: x(active, since 2s) 2024-08-02T18:41:08.488 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:08.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:09.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:09 smithi103 ceph-mon[32753]: from='client.14162 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:09.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:10.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout {"username": "admin", "password": "$2b$12$qvummlRmJzVgL6kjDo.3suGi9q1Ilv0TWgNXXXjvXf.X9PaWMug9m", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1722624069, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-08-02T18:41:10.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.751+0000 7eff29d66640 1 Processor -- start 2024-08-02T18:41:10.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.751+0000 7eff29d66640 1 -- start start 2024-08-02T18:41:10.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.751+0000 7eff29d66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff24107820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:10.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.751+0000 7eff29d66640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff24107df0 con 0x7eff24107420 2024-08-02T18:41:10.272 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.751+0000 7eff237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff24107820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.751+0000 7eff237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff24107820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58352/0 (socket says 172.21.15.103:58352) 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.751+0000 7eff237fe640 1 -- 172.21.15.103:0/769331584 learned_addr learned my addr 172.21.15.103:0/769331584 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.751+0000 7eff237fe640 1 -- 172.21.15.103:0/769331584 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff24108620 con 0x7eff24107420 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.752+0000 7eff237fe640 1 --2- 172.21.15.103:0/769331584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff24107820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7eff14009820 tx=0x7eff1402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aadd004bfb0bb66c server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.752+0000 7eff227fc640 1 -- 172.21.15.103:0/769331584 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff14037070 con 0x7eff24107420 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.752+0000 7eff227fc640 1 -- 172.21.15.103:0/769331584 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff14032940 con 0x7eff24107420 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.752+0000 7eff227fc640 1 -- 172.21.15.103:0/769331584 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff140308b0 con 0x7eff24107420 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.753+0000 7eff29d66640 1 -- 172.21.15.103:0/769331584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 msgr2=0x7eff24107820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.753+0000 7eff29d66640 1 --2- 172.21.15.103:0/769331584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff24107820 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7eff14009820 tx=0x7eff1402a270 comp rx=0 tx=0).stop 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.753+0000 7eff29d66640 1 -- 172.21.15.103:0/769331584 shutdown_connections 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.753+0000 7eff29d66640 1 --2- 172.21.15.103:0/769331584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff24107820 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:10.273 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.753+0000 7eff29d66640 1 -- 172.21.15.103:0/769331584 >> 172.21.15.103:0/769331584 conn(0x7eff24102bf0 msgr2=0x7eff24105010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.753+0000 7eff29d66640 1 -- 172.21.15.103:0/769331584 shutdown_connections 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.753+0000 7eff29d66640 1 -- 172.21.15.103:0/769331584 wait complete. 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.753+0000 7eff29d66640 1 Processor -- start 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.754+0000 7eff29d66640 1 -- start start 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.754+0000 7eff29d66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff2419b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.754+0000 7eff29d66640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7eff2410b9d0 con 0x7eff24107420 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.754+0000 7eff237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff2419b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.754+0000 7eff237fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff2419b510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58366/0 (socket says 172.21.15.103:58366) 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.754+0000 7eff237fe640 1 -- 172.21.15.103:0/4062877201 learned_addr learned my addr 172.21.15.103:0/4062877201 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.754+0000 7eff237fe640 1 -- 172.21.15.103:0/4062877201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2419ba50 con 0x7eff24107420 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.754+0000 7eff237fe640 1 --2- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff2419b510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff14009940 tx=0x7eff14032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.755+0000 7eff20ff9640 1 -- 172.21.15.103:0/4062877201 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff14042070 con 0x7eff24107420 2024-08-02T18:41:10.274 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.755+0000 7eff20ff9640 1 -- 172.21.15.103:0/4062877201 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7eff1403d930 con 0x7eff24107420 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.755+0000 7eff20ff9640 1 -- 172.21.15.103:0/4062877201 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff14037040 con 0x7eff24107420 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.755+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2419bce0 con 0x7eff24107420 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.755+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff2419e9d0 con 0x7eff24107420 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.755+0000 7eff20ff9640 1 -- 172.21.15.103:0/4062877201 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7eff14045070 con 0x7eff24107420 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.756+0000 7eff20ff9640 1 --2- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7eff0c039020 0x7eff0c03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.756+0000 7eff20ff9640 1 -- 172.21.15.103:0/4062877201 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7eff1406c260 con 0x7eff24107420 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.756+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff241078a0 con 0x7eff24107420 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.756+0000 7eff22ffd640 1 --2- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7eff0c039020 0x7eff0c03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.756+0000 7eff22ffd640 1 --2- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7eff0c039020 0x7eff0c03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff180098c0 tx=0x7eff18006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.760+0000 7eff20ff9640 1 -- 172.21.15.103:0/4062877201 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7eff1403ce00 con 0x7eff24107420 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:08.947+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) -- 0x7eff2419c1c0 con 0x7eff0c039020 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.172+0000 7eff20ff9640 1 -- 172.21.15.103:0/4062877201 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+252 (secure 0 0 0) 0x7eff2419c1c0 con 0x7eff0c039020 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.174+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7eff0c039020 msgr2=0x7eff0c03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:10.275 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.174+0000 7eff29d66640 1 --2- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7eff0c039020 0x7eff0c03b4e0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7eff180098c0 tx=0x7eff18006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.174+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 msgr2=0x7eff2419b510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.174+0000 7eff29d66640 1 --2- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff2419b510 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7eff14009940 tx=0x7eff14032670 comp rx=0 tx=0).stop 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.174+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 shutdown_connections 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.174+0000 7eff29d66640 1 --2- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7eff0c039020 0x7eff0c03b4e0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.174+0000 7eff29d66640 1 --2- 172.21.15.103:0/4062877201 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7eff24107420 0x7eff2419b510 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.174+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 >> 172.21.15.103:0/4062877201 conn(0x7eff24102bf0 msgr2=0x7eff24103840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.175+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 shutdown_connections 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:09.175+0000 7eff29d66640 1 -- 172.21.15.103:0/4062877201 wait complete. 2024-08-02T18:41:10.276 INFO:teuthology.orchestra.run.smithi103.stdout:Fetching dashboard port number... 2024-08-02T18:41:10.477 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:10 smithi103 ceph-mon[32753]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:11.370 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stdout 8443 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.660+0000 7ffad721e640 1 Processor -- start 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.661+0000 7ffad721e640 1 -- start start 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.661+0000 7ffad721e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad0106720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.661+0000 7ffad721e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffad0106cf0 con 0x7ffad0106320 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.661+0000 7ffad4fba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad0106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.661+0000 7ffad4fba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad0106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48658/0 (socket says 172.21.15.103:48658) 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.661+0000 7ffad4fba640 1 -- 172.21.15.103:0/2397902730 learned_addr learned my addr 172.21.15.103:0/2397902730 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.661+0000 7ffad4fba640 1 -- 172.21.15.103:0/2397902730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad0107520 con 0x7ffad0106320 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.662+0000 7ffad4fba640 1 --2- 172.21.15.103:0/2397902730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad0106720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009820 tx=0x7ffac802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f21527224d27c1ed server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.662+0000 7ffacf7fe640 1 -- 172.21.15.103:0/2397902730 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac8037070 con 0x7ffad0106320 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.662+0000 7ffacf7fe640 1 -- 172.21.15.103:0/2397902730 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffac8032940 con 0x7ffad0106320 2024-08-02T18:41:11.371 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.662+0000 7ffacf7fe640 1 -- 172.21.15.103:0/2397902730 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac80308b0 con 0x7ffad0106320 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.663+0000 7ffad721e640 1 -- 172.21.15.103:0/2397902730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 msgr2=0x7ffad0106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.663+0000 7ffad721e640 1 --2- 172.21.15.103:0/2397902730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad0106720 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009820 tx=0x7ffac802a270 comp rx=0 tx=0).stop 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.663+0000 7ffad721e640 1 -- 172.21.15.103:0/2397902730 shutdown_connections 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.663+0000 7ffad721e640 1 --2- 172.21.15.103:0/2397902730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad0106720 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.663+0000 7ffad721e640 1 -- 172.21.15.103:0/2397902730 >> 172.21.15.103:0/2397902730 conn(0x7ffad0101b10 msgr2=0x7ffad0103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.663+0000 7ffad721e640 1 -- 172.21.15.103:0/2397902730 shutdown_connections 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.663+0000 7ffad721e640 1 -- 172.21.15.103:0/2397902730 wait complete. 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.663+0000 7ffad721e640 1 Processor -- start 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad721e640 1 -- start start 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad721e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad019a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad721e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffad010a8d0 con 0x7ffad0106320 2024-08-02T18:41:11.372 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad4fba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad019a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad4fba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad019a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48666/0 (socket says 172.21.15.103:48666) 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad4fba640 1 -- 172.21.15.103:0/2825068987 learned_addr learned my addr 172.21.15.103:0/2825068987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad4fba640 1 -- 172.21.15.103:0/2825068987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad019a960 con 0x7ffad0106320 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad4fba640 1 --2- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad019a420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009940 tx=0x7ffac8032670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffacdffb640 1 -- 172.21.15.103:0/2825068987 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac8042070 con 0x7ffad0106320 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffacdffb640 1 -- 172.21.15.103:0/2825068987 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffac803d930 con 0x7ffad0106320 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad019abf0 con 0x7ffad0106320 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.664+0000 7ffacdffb640 1 -- 172.21.15.103:0/2825068987 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffac8037040 con 0x7ffad0106320 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.665+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad019d8e0 con 0x7ffad0106320 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.666+0000 7ffacdffb640 1 -- 172.21.15.103:0/2825068987 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 12) ==== 46300+0+0 (secure 0 0 0) 0x7ffac8045070 con 0x7ffad0106320 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.666+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad01067a0 con 0x7ffad0106320 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.666+0000 7ffacdffb640 1 --2- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffabc039020 0x7ffabc03b4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:11.373 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.666+0000 7ffacdffb640 1 -- 172.21.15.103:0/2825068987 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7ffac806c450 con 0x7ffad0106320 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.666+0000 7ffacffff640 1 --2- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffabc039020 0x7ffabc03b4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.666+0000 7ffacffff640 1 --2- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffabc039020 0x7ffabc03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffac000ad30 tx=0x7ffac00093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.671+0000 7ffacdffb640 1 -- 172.21.15.103:0/2825068987 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ffac803ce20 con 0x7ffad0106320 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.837+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) -- 0x7ffad019ded0 con 0x7ffad0106320 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.838+0000 7ffacdffb640 1 -- 172.21.15.103:0/2825068987 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) ==== 112+0+5 (secure 0 0 0) 0x7ffac8045520 con 0x7ffad0106320 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffabc039020 msgr2=0x7ffabc03b4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 --2- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffabc039020 0x7ffabc03b4e0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7ffac000ad30 tx=0x7ffac00093f0 comp rx=0 tx=0).stop 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 msgr2=0x7ffad019a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 --2- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad019a420 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7ffac8009940 tx=0x7ffac8032670 comp rx=0 tx=0).stop 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 shutdown_connections 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 --2- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffabc039020 0x7ffabc03b4e0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:11.374 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 --2- 172.21.15.103:0/2825068987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad0106320 0x7ffad019a420 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:11.375 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 >> 172.21.15.103:0/2825068987 conn(0x7ffad0101b10 msgr2=0x7ffad0102730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:11.375 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 shutdown_connections 2024-08-02T18:41:11.375 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:10.840+0000 7ffad721e640 1 -- 172.21.15.103:0/2825068987 wait complete. 2024-08-02T18:41:11.376 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 1 from systemctl is-enabled firewalld.service 2024-08-02T18:41:11.376 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout disabled 2024-08-02T18:41:11.384 INFO:teuthology.orchestra.run.smithi103.stdout:Non-zero exit code 3 from systemctl is-active firewalld.service 2024-08-02T18:41:11.384 INFO:teuthology.orchestra.run.smithi103.stdout:systemctl: stdout inactive 2024-08-02T18:41:11.384 INFO:teuthology.orchestra.run.smithi103.stdout:firewalld.service is not enabled 2024-08-02T18:41:11.384 INFO:teuthology.orchestra.run.smithi103.stdout:Not possible to open ports <[8443]>. firewalld.service is not available 2024-08-02T18:41:11.386 INFO:teuthology.orchestra.run.smithi103.stdout:Ceph Dashboard is now available at: 2024-08-02T18:41:11.386 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:11.386 INFO:teuthology.orchestra.run.smithi103.stdout: URL: https://smithi103.front.sepia.ceph.com:8443/ 2024-08-02T18:41:11.386 INFO:teuthology.orchestra.run.smithi103.stdout: User: admin 2024-08-02T18:41:11.386 INFO:teuthology.orchestra.run.smithi103.stdout: Password: 1yjbt3jp2t 2024-08-02T18:41:11.386 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:11.387 INFO:teuthology.orchestra.run.smithi103.stdout:Saving cluster configuration to /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config directory 2024-08-02T18:41:11.497 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:11 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2825068987' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-08-02T18:41:12.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:12 smithi103 ceph-mon[32753]: mgrmap e13: x(active, since 6s) 2024-08-02T18:41:12.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:12 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1083239034' entity='client.admin' 2024-08-02T18:41:12.635 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.808+0000 7fc9cb769640 1 Processor -- start 2024-08-02T18:41:12.635 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.809+0000 7fc9cb769640 1 -- start start 2024-08-02T18:41:12.635 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.809+0000 7fc9cb769640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c410a280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:12.635 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.809+0000 7fc9cb769640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c4075580 con 0x7fc9c4107e90 2024-08-02T18:41:12.635 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.809+0000 7fc9c9505640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c410a280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.809+0000 7fc9c9505640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c410a280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48674/0 (socket says 172.21.15.103:48674) 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.809+0000 7fc9c9505640 1 -- 172.21.15.103:0/2485722604 learned_addr learned my addr 172.21.15.103:0/2485722604 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.809+0000 7fc9c9505640 1 -- 172.21.15.103:0/2485722604 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c410a7c0 con 0x7fc9c4107e90 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.810+0000 7fc9c9505640 1 --2- 172.21.15.103:0/2485722604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c410a280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009820 tx=0x7fc9b802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31952e00abaa43cd server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.810+0000 7fc9b7fff640 1 -- 172.21.15.103:0/2485722604 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b8037070 con 0x7fc9c4107e90 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.810+0000 7fc9b7fff640 1 -- 172.21.15.103:0/2485722604 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9b8032940 con 0x7fc9c4107e90 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.810+0000 7fc9b7fff640 1 -- 172.21.15.103:0/2485722604 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b80308b0 con 0x7fc9c4107e90 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 -- 172.21.15.103:0/2485722604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 msgr2=0x7fc9c410a280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 --2- 172.21.15.103:0/2485722604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c410a280 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8009820 tx=0x7fc9b802a270 comp rx=0 tx=0).stop 2024-08-02T18:41:12.636 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 -- 172.21.15.103:0/2485722604 shutdown_connections 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 --2- 172.21.15.103:0/2485722604 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c410a280 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 -- 172.21.15.103:0/2485722604 >> 172.21.15.103:0/2485722604 conn(0x7fc9c4101b10 msgr2=0x7fc9c4103f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 -- 172.21.15.103:0/2485722604 shutdown_connections 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 -- 172.21.15.103:0/2485722604 wait complete. 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 Processor -- start 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.811+0000 7fc9cb769640 1 -- start start 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9cb769640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c419b4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9cb769640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc9c410b900 con 0x7fc9c4107e90 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9c9505640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c419b4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9c9505640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c419b4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48688/0 (socket says 172.21.15.103:48688) 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9c9505640 1 -- 172.21.15.103:0/1083239034 learned_addr learned my addr 172.21.15.103:0/1083239034 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:12.637 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9c9505640 1 -- 172.21.15.103:0/1083239034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9c419ba30 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9c9505640 1 --2- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c419b4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8032670 tx=0x7fc9b80326a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9b67fc640 1 -- 172.21.15.103:0/1083239034 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b8042070 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9b67fc640 1 -- 172.21.15.103:0/1083239034 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc9b803d930 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9b67fc640 1 -- 172.21.15.103:0/1083239034 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc9b8037040 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9c419bcc0 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.812+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9c419e9b0 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.813+0000 7fc9b67fc640 1 -- 172.21.15.103:0/1083239034 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fc9b8045070 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.813+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc9c41082f0 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.813+0000 7fc9b67fc640 1 --2- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc9b00390c0 0x7fc9b003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.813+0000 7fc9b67fc640 1 -- 172.21.15.103:0/1083239034 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7fc9b806c300 con 0x7fc9c4107e90 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.814+0000 7fc9c8d04640 1 --2- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc9b00390c0 0x7fc9b003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.814+0000 7fc9c8d04640 1 --2- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc9b00390c0 0x7fc9b003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00098c0 tx=0x7fc9c0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:12.638 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:11.818+0000 7fc9b67fc640 1 -- 172.21.15.103:0/1083239034 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc9b803b330 con 0x7fc9c4107e90 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.071+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) -- 0x7fc9c419efa0 con 0x7fc9c4107e90 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.073+0000 7fc9b67fc640 1 -- 172.21.15.103:0/1083239034 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v28)=0 set mgr/dashboard/cluster/status v28) ==== 153+0+0 (secure 0 0 0) 0x7fc9b8043d20 con 0x7fc9c4107e90 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr set mgr/dashboard/cluster/status 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.075+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc9b00390c0 msgr2=0x7fc9b003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.075+0000 7fc9cb769640 1 --2- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc9b00390c0 0x7fc9b003b580 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fc9c00098c0 tx=0x7fc9c0006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.075+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 msgr2=0x7fc9c419b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.075+0000 7fc9cb769640 1 --2- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c419b4f0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8032670 tx=0x7fc9b80326a0 comp rx=0 tx=0).stop 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.075+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 shutdown_connections 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.075+0000 7fc9cb769640 1 --2- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc9b00390c0 0x7fc9b003b580 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.075+0000 7fc9cb769640 1 --2- 172.21.15.103:0/1083239034 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc9c4107e90 0x7fc9c419b4f0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.075+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 >> 172.21.15.103:0/1083239034 conn(0x7fc9c4101b10 msgr2=0x7fc9c4102740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.076+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 shutdown_connections 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:/usr/bin/ceph: stderr 2024-08-02T18:41:12.076+0000 7fc9cb769640 1 -- 172.21.15.103:0/1083239034 wait complete. 2024-08-02T18:41:12.639 INFO:teuthology.orchestra.run.smithi103.stdout:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: sudo /home/ubuntu/cephtest/cephadm shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout:Or, if you are only running a single cluster on this host: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: sudo /home/ubuntu/cephtest/cephadm shell 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout:Please consider enabling telemetry to help improve Ceph: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: ceph telemetry on 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout:For more information see: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: https://docs.ceph.com/en/latest/mgr/telemetry/ 2024-08-02T18:41:12.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:12.641 INFO:teuthology.orchestra.run.smithi103.stdout:Bootstrap complete. 2024-08-02T18:41:12.671 INFO:tasks.cephadm:Fetching config... 2024-08-02T18:41:12.671 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:41:12.671 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-08-02T18:41:12.690 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-08-02T18:41:12.690 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:41:12.691 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-08-02T18:41:12.744 INFO:tasks.cephadm:Fetching mon keyring... 2024-08-02T18:41:12.745 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:41:12.745 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/keyring of=/dev/stdout 2024-08-02T18:41:12.810 INFO:tasks.cephadm:Fetching pub ssh key... 2024-08-02T18:41:12.810 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:41:12.811 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-08-02T18:41:12.867 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-08-02T18:41:12.867 DEBUG:teuthology.orchestra.run.smithi103:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEFan6TC4g43dArgDB5iEunY6XREWqZpRhlDXoOFcZPKKwqDHb/jMf4GGfHneptXOJBBeDFyBjYSLsyRLOUjmO1hZ9odI7HCTvKvF+3fnVP5uanl0CPjutNUYL7Nck42+eu+myxQgW0nY1S74zSWP3iV2HlSRnynNiFRzIlzKejEsiGD1IGCcw8EZqUZSrtdVmh7r27YmWOZqH+qAhRoefFiA3dkVtSZLJPDuDWuHizuW6PNGDhpN5DiUVHK3e4KKYaWod1RvnvN0ghlUeSrT3U29yD6xc5c2CQ36cBxqBVjXXMuqPM1q2yvqeQVoFnLIiYJMGv6UP8YKu/+rTpQnGM4IRVYKhoke3BtDvN4fj33fCe2t+FQ/iatmV+JtuXJ9EKxa72Nn4TlyjnxJIaCSgyAePgOs4HnvSpBfTmdxu3Nrtths55iRq6txJ87IiJWH6DOSPdoRiYWJudW/YrlDDuHinNKgEynCrL0d3CPE098vBEnCv2mxbZogAPn5fjts= ceph-7ef68402-50fe-11ef-bcca-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-02T18:41:12.944 INFO:teuthology.orchestra.run.smithi103.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEFan6TC4g43dArgDB5iEunY6XREWqZpRhlDXoOFcZPKKwqDHb/jMf4GGfHneptXOJBBeDFyBjYSLsyRLOUjmO1hZ9odI7HCTvKvF+3fnVP5uanl0CPjutNUYL7Nck42+eu+myxQgW0nY1S74zSWP3iV2HlSRnynNiFRzIlzKejEsiGD1IGCcw8EZqUZSrtdVmh7r27YmWOZqH+qAhRoefFiA3dkVtSZLJPDuDWuHizuW6PNGDhpN5DiUVHK3e4KKYaWod1RvnvN0ghlUeSrT3U29yD6xc5c2CQ36cBxqBVjXXMuqPM1q2yvqeQVoFnLIiYJMGv6UP8YKu/+rTpQnGM4IRVYKhoke3BtDvN4fj33fCe2t+FQ/iatmV+JtuXJ9EKxa72Nn4TlyjnxJIaCSgyAePgOs4HnvSpBfTmdxu3Nrtths55iRq6txJ87IiJWH6DOSPdoRiYWJudW/YrlDDuHinNKgEynCrL0d3CPE098vBEnCv2mxbZogAPn5fjts= ceph-7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:12.956 DEBUG:teuthology.orchestra.run.smithi121:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEFan6TC4g43dArgDB5iEunY6XREWqZpRhlDXoOFcZPKKwqDHb/jMf4GGfHneptXOJBBeDFyBjYSLsyRLOUjmO1hZ9odI7HCTvKvF+3fnVP5uanl0CPjutNUYL7Nck42+eu+myxQgW0nY1S74zSWP3iV2HlSRnynNiFRzIlzKejEsiGD1IGCcw8EZqUZSrtdVmh7r27YmWOZqH+qAhRoefFiA3dkVtSZLJPDuDWuHizuW6PNGDhpN5DiUVHK3e4KKYaWod1RvnvN0ghlUeSrT3U29yD6xc5c2CQ36cBxqBVjXXMuqPM1q2yvqeQVoFnLIiYJMGv6UP8YKu/+rTpQnGM4IRVYKhoke3BtDvN4fj33fCe2t+FQ/iatmV+JtuXJ9EKxa72Nn4TlyjnxJIaCSgyAePgOs4HnvSpBfTmdxu3Nrtths55iRq6txJ87IiJWH6DOSPdoRiYWJudW/YrlDDuHinNKgEynCrL0d3CPE098vBEnCv2mxbZogAPn5fjts= ceph-7ef68402-50fe-11ef-bcca-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-02T18:41:12.996 INFO:teuthology.orchestra.run.smithi121.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEFan6TC4g43dArgDB5iEunY6XREWqZpRhlDXoOFcZPKKwqDHb/jMf4GGfHneptXOJBBeDFyBjYSLsyRLOUjmO1hZ9odI7HCTvKvF+3fnVP5uanl0CPjutNUYL7Nck42+eu+myxQgW0nY1S74zSWP3iV2HlSRnynNiFRzIlzKejEsiGD1IGCcw8EZqUZSrtdVmh7r27YmWOZqH+qAhRoefFiA3dkVtSZLJPDuDWuHizuW6PNGDhpN5DiUVHK3e4KKYaWod1RvnvN0ghlUeSrT3U29yD6xc5c2CQ36cBxqBVjXXMuqPM1q2yvqeQVoFnLIiYJMGv6UP8YKu/+rTpQnGM4IRVYKhoke3BtDvN4fj33fCe2t+FQ/iatmV+JtuXJ9EKxa72Nn4TlyjnxJIaCSgyAePgOs4HnvSpBfTmdxu3Nrtths55iRq6txJ87IiJWH6DOSPdoRiYWJudW/YrlDDuHinNKgEynCrL0d3CPE098vBEnCv2mxbZogAPn5fjts= ceph-7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:13.008 DEBUG:teuthology.orchestra.run.smithi151:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEFan6TC4g43dArgDB5iEunY6XREWqZpRhlDXoOFcZPKKwqDHb/jMf4GGfHneptXOJBBeDFyBjYSLsyRLOUjmO1hZ9odI7HCTvKvF+3fnVP5uanl0CPjutNUYL7Nck42+eu+myxQgW0nY1S74zSWP3iV2HlSRnynNiFRzIlzKejEsiGD1IGCcw8EZqUZSrtdVmh7r27YmWOZqH+qAhRoefFiA3dkVtSZLJPDuDWuHizuW6PNGDhpN5DiUVHK3e4KKYaWod1RvnvN0ghlUeSrT3U29yD6xc5c2CQ36cBxqBVjXXMuqPM1q2yvqeQVoFnLIiYJMGv6UP8YKu/+rTpQnGM4IRVYKhoke3BtDvN4fj33fCe2t+FQ/iatmV+JtuXJ9EKxa72Nn4TlyjnxJIaCSgyAePgOs4HnvSpBfTmdxu3Nrtths55iRq6txJ87IiJWH6DOSPdoRiYWJudW/YrlDDuHinNKgEynCrL0d3CPE098vBEnCv2mxbZogAPn5fjts= ceph-7ef68402-50fe-11ef-bcca-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-08-02T18:41:13.048 INFO:teuthology.orchestra.run.smithi151.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDEFan6TC4g43dArgDB5iEunY6XREWqZpRhlDXoOFcZPKKwqDHb/jMf4GGfHneptXOJBBeDFyBjYSLsyRLOUjmO1hZ9odI7HCTvKvF+3fnVP5uanl0CPjutNUYL7Nck42+eu+myxQgW0nY1S74zSWP3iV2HlSRnynNiFRzIlzKejEsiGD1IGCcw8EZqUZSrtdVmh7r27YmWOZqH+qAhRoefFiA3dkVtSZLJPDuDWuHizuW6PNGDhpN5DiUVHK3e4KKYaWod1RvnvN0ghlUeSrT3U29yD6xc5c2CQ36cBxqBVjXXMuqPM1q2yvqeQVoFnLIiYJMGv6UP8YKu/+rTpQnGM4IRVYKhoke3BtDvN4fj33fCe2t+FQ/iatmV+JtuXJ9EKxa72Nn4TlyjnxJIaCSgyAePgOs4HnvSpBfTmdxu3Nrtths55iRq6txJ87IiJWH6DOSPdoRiYWJudW/YrlDDuHinNKgEynCrL0d3CPE098vBEnCv2mxbZogAPn5fjts= ceph-7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:13.060 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-08-02T18:41:13.319 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:13.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.776+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/1728456599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 msgr2=0x7f2fd41041d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:13.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.776+0000 7f2fdbf1f640 1 --2- 172.21.15.103:0/1728456599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 0x7f2fd41041d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009880 tx=0x7f2fd002a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:13.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.776+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/1728456599 shutdown_connections 2024-08-02T18:41:13.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.776+0000 7f2fdbf1f640 1 --2- 172.21.15.103:0/1728456599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 0x7f2fd41041d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:13.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.776+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/1728456599 >> 172.21.15.103:0/1728456599 conn(0x7f2fd40fb9e0 msgr2=0x7f2fd40fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:13.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.776+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/1728456599 shutdown_connections 2024-08-02T18:41:13.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.776+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/1728456599 wait complete. 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.776+0000 7f2fdbf1f640 1 Processor -- start 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fdbf1f640 1 -- start start 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fdbf1f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 0x7f2fd4198d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fdbf1f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2fd4107530 con 0x7f2fd4101de0 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fd9cbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 0x7f2fd4198d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fd9cbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 0x7f2fd4198d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48702/0 (socket says 172.21.15.103:48702) 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fd9cbb640 1 -- 172.21.15.103:0/2232223680 learned_addr learned my addr 172.21.15.103:0/2232223680 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fd9cbb640 1 -- 172.21.15.103:0/2232223680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2fd4199240 con 0x7f2fd4101de0 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fd9cbb640 1 --2- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 0x7f2fd4198d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009230 tx=0x7f2fd0032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fcaffd640 1 -- 172.21.15.103:0/2232223680 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fd003f030 con 0x7f2fd4101de0 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fcaffd640 1 -- 172.21.15.103:0/2232223680 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2fd0003e30 con 0x7f2fd4101de0 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2fd41994d0 con 0x7f2fd4101de0 2024-08-02T18:41:13.785 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fcaffd640 1 -- 172.21.15.103:0/2232223680 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2fd0035070 con 0x7f2fd4101de0 2024-08-02T18:41:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.777+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2fd419c1b0 con 0x7f2fd4101de0 2024-08-02T18:41:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.778+0000 7f2fcaffd640 1 -- 172.21.15.103:0/2232223680 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2fd0042030 con 0x7f2fd4101de0 2024-08-02T18:41:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.778+0000 7f2fcaffd640 1 --2- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2fc00390c0 0x7f2fc003b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.778+0000 7f2fcaffd640 1 -- 172.21.15.103:0/2232223680 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2fd0040070 con 0x7f2fd4101de0 2024-08-02T18:41:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.778+0000 7f2fd94ba640 1 --2- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2fc00390c0 0x7f2fc003b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.778+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2fd4107cb0 con 0x7f2fd4101de0 2024-08-02T18:41:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.779+0000 7f2fd94ba640 1 --2- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2fc00390c0 0x7f2fc003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40098c0 tx=0x7f2fc4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:13.786 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.783+0000 7f2fcaffd640 1 -- 172.21.15.103:0/2232223680 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2fd004cdf0 con 0x7f2fd4101de0 2024-08-02T18:41:13.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.952+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) -- 0x7f2fd402d650 con 0x7f2fd4101de0 2024-08-02T18:41:13.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.955+0000 7f2fcaffd640 1 -- 172.21.15.103:0/2232223680 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) ==== 125+0+0 (secure 0 0 0) 0x7f2fd004ad50 con 0x7f2fd4101de0 2024-08-02T18:41:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2fc00390c0 msgr2=0x7f2fc003b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 --2- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2fc00390c0 0x7f2fc003b580 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f2fc40098c0 tx=0x7f2fc4006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 msgr2=0x7f2fd4198d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 --2- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 0x7f2fd4198d00 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f2fd0009230 tx=0x7f2fd0032d00 comp rx=0 tx=0).stop 2024-08-02T18:41:13.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 shutdown_connections 2024-08-02T18:41:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 --2- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2fc00390c0 0x7f2fc003b580 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 --2- 172.21.15.103:0/2232223680 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2fd4101de0 0x7f2fd4198d00 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 >> 172.21.15.103:0/2232223680 conn(0x7f2fd40fb9e0 msgr2=0x7f2fd40fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 shutdown_connections 2024-08-02T18:41:13.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:13.958+0000 7f2fdbf1f640 1 -- 172.21.15.103:0/2232223680 wait complete. 2024-08-02T18:41:14.889 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-08-02T18:41:14.890 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-08-02T18:41:15.272 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:14 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2232223680' entity='client.admin' 2024-08-02T18:41:15.408 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:15.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.940+0000 7f2c60f84640 1 -- 172.21.15.103:0/1257994092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 msgr2=0x7f2c5c101750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:15.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.940+0000 7f2c60f84640 1 --2- 172.21.15.103:0/1257994092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 0x7f2c5c101750 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009880 tx=0x7f2c4402a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:15.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.940+0000 7f2c60f84640 1 -- 172.21.15.103:0/1257994092 shutdown_connections 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.940+0000 7f2c60f84640 1 --2- 172.21.15.103:0/1257994092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 0x7f2c5c101750 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.940+0000 7f2c60f84640 1 -- 172.21.15.103:0/1257994092 >> 172.21.15.103:0/1257994092 conn(0x7f2c5c0fcb20 msgr2=0x7f2c5c0fef40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.940+0000 7f2c60f84640 1 -- 172.21.15.103:0/1257994092 shutdown_connections 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.940+0000 7f2c60f84640 1 -- 172.21.15.103:0/1257994092 wait complete. 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.941+0000 7f2c60f84640 1 Processor -- start 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.941+0000 7f2c60f84640 1 -- start start 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.941+0000 7f2c60f84640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 0x7f2c5c196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.941+0000 7f2c60f84640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2c5c1075a0 con 0x7f2c5c101350 2024-08-02T18:41:15.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.941+0000 7f2c5a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 0x7f2c5c196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.941+0000 7f2c5a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 0x7f2c5c196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48708/0 (socket says 172.21.15.103:48708) 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.941+0000 7f2c5a59c640 1 -- 172.21.15.103:0/2468953709 learned_addr learned my addr 172.21.15.103:0/2468953709 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.941+0000 7f2c5a59c640 1 -- 172.21.15.103:0/2468953709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2c5c1970e0 con 0x7f2c5c101350 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.942+0000 7f2c5a59c640 1 --2- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 0x7f2c5c196ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009230 tx=0x7f2c44032d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.942+0000 7f2c537fe640 1 -- 172.21.15.103:0/2468953709 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c4403f030 con 0x7f2c5c101350 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.942+0000 7f2c537fe640 1 -- 172.21.15.103:0/2468953709 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2c44003e30 con 0x7f2c5c101350 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.942+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2c5c197370 con 0x7f2c5c101350 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.942+0000 7f2c537fe640 1 -- 172.21.15.103:0/2468953709 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2c44035070 con 0x7f2c5c101350 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.942+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2c5c19a060 con 0x7f2c5c101350 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.943+0000 7f2c537fe640 1 -- 172.21.15.103:0/2468953709 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f2c44042030 con 0x7f2c5c101350 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.943+0000 7f2c537fe640 1 --2- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2c480390c0 0x7f2c4803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.943+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2c5c107d20 con 0x7f2c5c101350 2024-08-02T18:41:15.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.943+0000 7f2c537fe640 1 -- 172.21.15.103:0/2468953709 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f2c44040070 con 0x7f2c5c101350 2024-08-02T18:41:15.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.943+0000 7f2c59d9b640 1 --2- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2c480390c0 0x7f2c4803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:15.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.943+0000 7f2c59d9b640 1 --2- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2c480390c0 0x7f2c4803b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0098c0 tx=0x7f2c4c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:15.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:15.948+0000 7f2c537fe640 1 -- 172.21.15.103:0/2468953709 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2c4402eca0 con 0x7f2c5c101350 2024-08-02T18:41:16.130 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.129+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) -- 0x7f2c5c02d650 con 0x7f2c480390c0 2024-08-02T18:41:16.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.133+0000 7f2c537fe640 1 -- 172.21.15.103:0/2468953709 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f2c5c02d650 con 0x7f2c480390c0 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2c480390c0 msgr2=0x7f2c4803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 --2- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2c480390c0 0x7f2c4803b580 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f2c4c0098c0 tx=0x7f2c4c006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 msgr2=0x7f2c5c196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 --2- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 0x7f2c5c196ba0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f2c44009230 tx=0x7f2c44032d00 comp rx=0 tx=0).stop 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 shutdown_connections 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 --2- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2c480390c0 0x7f2c4803b580 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 --2- 172.21.15.103:0/2468953709 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2c5c101350 0x7f2c5c196ba0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 >> 172.21.15.103:0/2468953709 conn(0x7f2c5c0fcb20 msgr2=0x7f2c5c0fd440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 shutdown_connections 2024-08-02T18:41:16.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:16.135+0000 7f2c60f84640 1 -- 172.21.15.103:0/2468953709 wait complete. 2024-08-02T18:41:17.202 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:17 smithi103 ceph-mon[32753]: from='client.14172 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:17.202 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:17.202 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:17.202 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:17.203 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi103", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:41:17.203 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:17.203 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:17.233 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi121 2024-08-02T18:41:17.233 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:41:17.233 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.conf 2024-08-02T18:41:17.252 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:41:17.252 DEBUG:teuthology.orchestra.run.smithi121:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:17.310 INFO:tasks.cephadm:Adding host smithi121 to orchestrator... 2024-08-02T18:41:17.310 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch host add smithi121 2024-08-02T18:41:17.571 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.004+0000 7fab02187640 1 -- 172.21.15.103:0/1004372002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 msgr2=0x7faafc101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.004+0000 7fab02187640 1 --2- 172.21.15.103:0/1004372002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 0x7faafc101940 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7faaec009880 tx=0x7faaec02a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.004+0000 7fab02187640 1 -- 172.21.15.103:0/1004372002 shutdown_connections 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.004+0000 7fab02187640 1 --2- 172.21.15.103:0/1004372002 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 0x7faafc101940 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.004+0000 7fab02187640 1 -- 172.21.15.103:0/1004372002 >> 172.21.15.103:0/1004372002 conn(0x7faafc0fcfe0 msgr2=0x7faafc0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.004+0000 7fab02187640 1 -- 172.21.15.103:0/1004372002 shutdown_connections 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.004+0000 7fab02187640 1 -- 172.21.15.103:0/1004372002 wait complete. 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.004+0000 7fab02187640 1 Processor -- start 2024-08-02T18:41:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7fab02187640 1 -- start start 2024-08-02T18:41:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7fab02187640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 0x7faafc196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7fab02187640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7faafc10baf0 con 0x7faafc101560 2024-08-02T18:41:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7faafb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 0x7faafc196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7faafb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 0x7faafc196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48722/0 (socket says 172.21.15.103:48722) 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7faafb7fe640 1 -- 172.21.15.103:0/1280772237 learned_addr learned my addr 172.21.15.103:0/1280772237 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7faafb7fe640 1 -- 172.21.15.103:0/1280772237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faafc197450 con 0x7faafc101560 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7faafb7fe640 1 --2- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 0x7faafc196f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faaec006010 tx=0x7faaec003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.005+0000 7faaf8ff9640 1 -- 172.21.15.103:0/1280772237 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaec03f070 con 0x7faafc101560 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.006+0000 7faaf8ff9640 1 -- 172.21.15.103:0/1280772237 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faaec031c20 con 0x7faafc101560 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.006+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faafc197740 con 0x7faafc101560 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.006+0000 7faaf8ff9640 1 -- 172.21.15.103:0/1280772237 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7faaec035030 con 0x7faafc101560 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.006+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faafc19b7e0 con 0x7faafc101560 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.006+0000 7faaf8ff9640 1 -- 172.21.15.103:0/1280772237 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7faaec042070 con 0x7faafc101560 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.006+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faafc102a40 con 0x7faafc101560 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.007+0000 7faaf8ff9640 1 --2- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faae80390c0 0x7faae803b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.007+0000 7faaf8ff9640 1 -- 172.21.15.103:0/1280772237 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7faaec06c8e0 con 0x7faafc101560 2024-08-02T18:41:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.007+0000 7faafaffd640 1 --2- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faae80390c0 0x7faae803b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.007+0000 7faafaffd640 1 --2- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faae80390c0 0x7faae803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faae40098c0 tx=0x7faae4006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:18.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.011+0000 7faaf8ff9640 1 -- 172.21.15.103:0/1280772237 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7faaec03b5f0 con 0x7faafc101560 2024-08-02T18:41:18.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:18.180+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}) -- 0x7faafc1019c0 con 0x7faae80390c0 2024-08-02T18:41:18.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: Updating smithi103:/etc/ceph/ceph.conf 2024-08-02T18:41:18.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:18.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:18.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:41:18.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:18.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:18.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:18.828 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:18.828 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:18.828 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:18.828 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:19.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:19 smithi103 ceph-mon[32753]: from='client.14174 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi121", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:20.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:20 smithi103 ceph-mon[32753]: Deploying cephadm binary to smithi121 2024-08-02T18:41:21.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.371+0000 7faaf8ff9640 1 -- 172.21.15.103:0/1280772237 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7faafc1019c0 con 0x7faae80390c0 2024-08-02T18:41:21.373 INFO:teuthology.orchestra.run.smithi103.stdout:Added host 'smithi121' with addr '172.21.15.121' 2024-08-02T18:41:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faae80390c0 msgr2=0x7faae803b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 --2- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faae80390c0 0x7faae803b580 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7faae40098c0 tx=0x7faae4006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 msgr2=0x7faafc196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 --2- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 0x7faafc196f10 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7faaec006010 tx=0x7faaec003c00 comp rx=0 tx=0).stop 2024-08-02T18:41:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 shutdown_connections 2024-08-02T18:41:21.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 --2- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faae80390c0 0x7faae803b580 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 --2- 172.21.15.103:0/1280772237 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7faafc101560 0x7faafc196f10 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 >> 172.21.15.103:0/1280772237 conn(0x7faafc0fcfe0 msgr2=0x7faafc108e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 shutdown_connections 2024-08-02T18:41:21.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:21.374+0000 7fab02187640 1 -- 172.21.15.103:0/1280772237 wait complete. 2024-08-02T18:41:22.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch host ls --format=json 2024-08-02T18:41:22.275 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:22.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:22.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:22 smithi103 ceph-mon[32753]: Added host smithi121 2024-08-02T18:41:22.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:22.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:22.638 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:22.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.717+0000 7f9734e6c640 1 -- 172.21.15.103:0/3773119551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 msgr2=0x7f9730101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:22.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.717+0000 7f9734e6c640 1 --2- 172.21.15.103:0/3773119551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 0x7f9730101940 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f9720009880 tx=0x7f972002a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:22.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.717+0000 7f9734e6c640 1 -- 172.21.15.103:0/3773119551 shutdown_connections 2024-08-02T18:41:22.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.717+0000 7f9734e6c640 1 --2- 172.21.15.103:0/3773119551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 0x7f9730101940 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:22.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.717+0000 7f9734e6c640 1 -- 172.21.15.103:0/3773119551 >> 172.21.15.103:0/3773119551 conn(0x7f97300fcfe0 msgr2=0x7f97300ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:22.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.717+0000 7f9734e6c640 1 -- 172.21.15.103:0/3773119551 shutdown_connections 2024-08-02T18:41:22.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.717+0000 7f9734e6c640 1 -- 172.21.15.103:0/3773119551 wait complete. 2024-08-02T18:41:22.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.718+0000 7f9734e6c640 1 Processor -- start 2024-08-02T18:41:22.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.718+0000 7f9734e6c640 1 -- start start 2024-08-02T18:41:22.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.718+0000 7f9734e6c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 0x7f9730196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.718+0000 7f9734e6c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f973010baf0 con 0x7f9730101560 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f972e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 0x7f9730196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f972e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 0x7f9730196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35938/0 (socket says 172.21.15.103:35938) 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f972e59c640 1 -- 172.21.15.103:0/4228162372 learned_addr learned my addr 172.21.15.103:0/4228162372 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f972e59c640 1 -- 172.21.15.103:0/4228162372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9730197450 con 0x7f9730101560 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f972e59c640 1 --2- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 0x7f9730196f10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9720006010 tx=0x7f9720003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f971f7fe640 1 -- 172.21.15.103:0/4228162372 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f972003f070 con 0x7f9730101560 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9730197740 con 0x7f9730101560 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f971f7fe640 1 -- 172.21.15.103:0/4228162372 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9720031c20 con 0x7f9730101560 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f971f7fe640 1 -- 172.21.15.103:0/4228162372 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9720035030 con 0x7f9730101560 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.719+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f973019b7e0 con 0x7f9730101560 2024-08-02T18:41:22.731 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.720+0000 7f971f7fe640 1 -- 172.21.15.103:0/4228162372 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f9720042070 con 0x7f9730101560 2024-08-02T18:41:22.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.720+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9730102a40 con 0x7f9730101560 2024-08-02T18:41:22.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.720+0000 7f971f7fe640 1 --2- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9718039060 0x7f971803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:22.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.720+0000 7f971f7fe640 1 -- 172.21.15.103:0/4228162372 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f972006cc80 con 0x7f9730101560 2024-08-02T18:41:22.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.720+0000 7f972dd9b640 1 --2- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9718039060 0x7f971803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:22.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.721+0000 7f972dd9b640 1 --2- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9718039060 0x7f971803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f97240098c0 tx=0x7f9724006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:22.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.725+0000 7f971f7fe640 1 -- 172.21.15.103:0/4228162372 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f972004c350 con 0x7f9730101560 2024-08-02T18:41:22.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.896+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9730198270 con 0x7f9718039060 2024-08-02T18:41:22.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.897+0000 7f971f7fe640 1 -- 172.21.15.103:0/4228162372 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+161 (secure 0 0 0) 0x7f9730198270 con 0x7f9718039060 2024-08-02T18:41:22.899 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:22.899 INFO:teuthology.orchestra.run.smithi103.stdout:[{"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.121", "hostname": "smithi121", "labels": [], "status": ""}] 2024-08-02T18:41:22.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9718039060 msgr2=0x7f971803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:22.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 --2- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9718039060 0x7f971803b520 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f97240098c0 tx=0x7f9724006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:22.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 msgr2=0x7f9730196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:22.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 --2- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 0x7f9730196f10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f9720006010 tx=0x7f9720003c00 comp rx=0 tx=0).stop 2024-08-02T18:41:22.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 shutdown_connections 2024-08-02T18:41:22.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 --2- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9718039060 0x7f971803b520 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:22.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 --2- 172.21.15.103:0/4228162372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9730101560 0x7f9730196f10 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:22.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 >> 172.21.15.103:0/4228162372 conn(0x7f97300fcfe0 msgr2=0x7f9730108e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:22.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 shutdown_connections 2024-08-02T18:41:22.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:22.900+0000 7f9734e6c640 1 -- 172.21.15.103:0/4228162372 wait complete. 2024-08-02T18:41:23.527 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi151 2024-08-02T18:41:23.527 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:41:23.527 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/etc/ceph/ceph.conf 2024-08-02T18:41:23.547 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:41:23.548 DEBUG:teuthology.orchestra.run.smithi151:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:23.606 INFO:tasks.cephadm:Adding host smithi151 to orchestrator... 2024-08-02T18:41:23.606 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch host add smithi151 2024-08-02T18:41:23.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:23.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:23 smithi103 ceph-mon[32753]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:41:23.853 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.275+0000 7f6d6560a640 1 -- 172.21.15.103:0/1797558581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 msgr2=0x7f6d60101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.275+0000 7f6d6560a640 1 --2- 172.21.15.103:0/1797558581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 0x7f6d60101940 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009c20 tx=0x7f6d5002aa90 comp rx=0 tx=0).stop 2024-08-02T18:41:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.275+0000 7f6d6560a640 1 -- 172.21.15.103:0/1797558581 shutdown_connections 2024-08-02T18:41:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.275+0000 7f6d6560a640 1 --2- 172.21.15.103:0/1797558581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 0x7f6d60101940 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:24.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.275+0000 7f6d6560a640 1 -- 172.21.15.103:0/1797558581 >> 172.21.15.103:0/1797558581 conn(0x7f6d600fcfe0 msgr2=0x7f6d600ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:24.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.275+0000 7f6d6560a640 1 -- 172.21.15.103:0/1797558581 shutdown_connections 2024-08-02T18:41:24.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.275+0000 7f6d6560a640 1 -- 172.21.15.103:0/1797558581 wait complete. 2024-08-02T18:41:24.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.276+0000 7f6d6560a640 1 Processor -- start 2024-08-02T18:41:24.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.276+0000 7f6d6560a640 1 -- start start 2024-08-02T18:41:24.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.276+0000 7f6d6560a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 0x7f6d60196f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:24.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.276+0000 7f6d6560a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6d6010baf0 con 0x7f6d60101560 2024-08-02T18:41:24.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.276+0000 7f6d5effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 0x7f6d60196f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:24.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.276+0000 7f6d5effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 0x7f6d60196f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:35958/0 (socket says 172.21.15.103:35958) 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.276+0000 7f6d5effd640 1 -- 172.21.15.103:0/1012999128 learned_addr learned my addr 172.21.15.103:0/1012999128 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.277+0000 7f6d5effd640 1 -- 172.21.15.103:0/1012999128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d601974a0 con 0x7f6d60101560 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.277+0000 7f6d5effd640 1 --2- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 0x7f6d60196f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009d40 tx=0x7f6d50003970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.277+0000 7f6d57fff640 1 -- 172.21.15.103:0/1012999128 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d50047070 con 0x7f6d60101560 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.277+0000 7f6d57fff640 1 -- 172.21.15.103:0/1012999128 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d50003e40 con 0x7f6d60101560 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.277+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d60197790 con 0x7f6d60101560 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.277+0000 7f6d57fff640 1 -- 172.21.15.103:0/1012999128 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6d50033050 con 0x7f6d60101560 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.277+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d6019b830 con 0x7f6d60101560 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.278+0000 7f6d57fff640 1 -- 172.21.15.103:0/1012999128 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f6d5004a070 con 0x7f6d60101560 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.278+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d60102a40 con 0x7f6d60101560 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.278+0000 7f6d57fff640 1 --2- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d4c039060 0x7f6d4c03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:24.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.278+0000 7f6d57fff640 1 -- 172.21.15.103:0/1012999128 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f6d5003e030 con 0x7f6d60101560 2024-08-02T18:41:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.278+0000 7f6d5e7fc640 1 --2- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d4c039060 0x7f6d4c03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:24.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.279+0000 7f6d5e7fc640 1 --2- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d4c039060 0x7f6d4c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6d480098c0 tx=0x7f6d48006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:24.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.283+0000 7f6d57fff640 1 -- 172.21.15.103:0/1012999128 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6d500413d0 con 0x7f6d60101560 2024-08-02T18:41:24.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:24.450+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}) -- 0x7f6d601019c0 con 0x7f6d4c039060 2024-08-02T18:41:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:24 smithi103 ceph-mon[32753]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi151", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:26.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:26.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: Deploying cephadm binary to smithi151 2024-08-02T18:41:26.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:26.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:26.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:26.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:26.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi121", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:41:26.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:26.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:27.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:27 smithi103 ceph-mon[32753]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-02T18:41:27.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:27 smithi103 ceph-mon[32753]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:27.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:27 smithi103 ceph-mon[32753]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:27.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:27 smithi103 ceph-mon[32753]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:41:27.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:27.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:27.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:27.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.613+0000 7f6d57fff640 1 -- 172.21.15.103:0/1012999128 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+49 (secure 0 0 0) 0x7f6d601019c0 con 0x7f6d4c039060 2024-08-02T18:41:27.615 INFO:teuthology.orchestra.run.smithi103.stdout:Added host 'smithi151' with addr '172.21.15.151' 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.615+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d4c039060 msgr2=0x7f6d4c03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.615+0000 7f6d6560a640 1 --2- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d4c039060 0x7f6d4c03b520 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f6d480098c0 tx=0x7f6d48006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.615+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 msgr2=0x7f6d60196f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.615+0000 7f6d6560a640 1 --2- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 0x7f6d60196f60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f6d50009d40 tx=0x7f6d50003970 comp rx=0 tx=0).stop 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.615+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 shutdown_connections 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.615+0000 7f6d6560a640 1 --2- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d4c039060 0x7f6d4c03b520 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.615+0000 7f6d6560a640 1 --2- 172.21.15.103:0/1012999128 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d60101560 0x7f6d60196f60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.615+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 >> 172.21.15.103:0/1012999128 conn(0x7f6d600fcfe0 msgr2=0x7f6d600fdb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.616+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 shutdown_connections 2024-08-02T18:41:27.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:27.616+0000 7f6d6560a640 1 -- 172.21.15.103:0/1012999128 wait complete. 2024-08-02T18:41:28.212 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch host ls --format=json 2024-08-02T18:41:28.461 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:28.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:28 smithi103 ceph-mon[32753]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:28.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:28.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:28.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:28.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:28.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.884+0000 7f531055f640 1 -- 172.21.15.103:0/2685003231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 msgr2=0x7f5308100aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:28.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.884+0000 7f531055f640 1 --2- 172.21.15.103:0/2685003231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 0x7f5308100aa0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f52f8009c20 tx=0x7f52f802aa90 comp rx=0 tx=0).stop 2024-08-02T18:41:28.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 -- 172.21.15.103:0/2685003231 shutdown_connections 2024-08-02T18:41:28.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 --2- 172.21.15.103:0/2685003231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 0x7f5308100aa0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:28.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 -- 172.21.15.103:0/2685003231 >> 172.21.15.103:0/2685003231 conn(0x7f5308075f80 msgr2=0x7f5308076390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 -- 172.21.15.103:0/2685003231 shutdown_connections 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 -- 172.21.15.103:0/2685003231 wait complete. 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 Processor -- start 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 -- start start 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 0x7f53080fd510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.885+0000 7f531055f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f530810aa10 con 0x7f53081006c0 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f530e2fb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 0x7f53080fd510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f530e2fb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 0x7f53080fd510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37060/0 (socket says 172.21.15.103:37060) 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f530e2fb640 1 -- 172.21.15.103:0/1625825436 learned_addr learned my addr 172.21.15.103:0/1625825436 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f530e2fb640 1 -- 172.21.15.103:0/1625825436 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53080ff400 con 0x7f53081006c0 2024-08-02T18:41:28.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f530e2fb640 1 --2- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 0x7f53080fd510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f52f8005e30 tx=0x7f52f802fc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f53077fe640 1 -- 172.21.15.103:0/1625825436 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52f8047070 con 0x7f53081006c0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f53077fe640 1 -- 172.21.15.103:0/1625825436 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52f8003dd0 con 0x7f53081006c0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53080fdab0 con 0x7f53081006c0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f53077fe640 1 -- 172.21.15.103:0/1625825436 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f52f8033050 con 0x7f53081006c0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.886+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53080fdf70 con 0x7f53081006c0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.887+0000 7f53077fe640 1 -- 172.21.15.103:0/1625825436 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f52f804a070 con 0x7f53081006c0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.887+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5308101970 con 0x7f53081006c0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.887+0000 7f53077fe640 1 --2- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52f0039060 0x7f52f003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.887+0000 7f53077fe640 1 -- 172.21.15.103:0/1625825436 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f52f803e030 con 0x7f53081006c0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.888+0000 7f530dafa640 1 --2- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52f0039060 0x7f52f003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:28.891 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.888+0000 7f530dafa640 1 --2- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52f0039060 0x7f52f003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0098c0 tx=0x7f52fc006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:28.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:28.892+0000 7f53077fe640 1 -- 172.21.15.103:0/1625825436 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f52f8040770 con 0x7f53081006c0 2024-08-02T18:41:29.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.063+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f53080fea40 con 0x7f52f0039060 2024-08-02T18:41:29.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.064+0000 7f53077fe640 1 -- 172.21.15.103:0/1625825436 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+241 (secure 0 0 0) 0x7f53080fea40 con 0x7f52f0039060 2024-08-02T18:41:29.065 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:41:29.065 INFO:teuthology.orchestra.run.smithi103.stdout:[{"addr": "172.21.15.103", "hostname": "smithi103", "labels": [], "status": ""}, {"addr": "172.21.15.121", "hostname": "smithi121", "labels": [], "status": ""}, {"addr": "172.21.15.151", "hostname": "smithi151", "labels": [], "status": ""}] 2024-08-02T18:41:29.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52f0039060 msgr2=0x7f52f003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:29.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 --2- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52f0039060 0x7f52f003b520 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f52fc0098c0 tx=0x7f52fc006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:29.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 msgr2=0x7f53080fd510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:29.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 --2- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 0x7f53080fd510 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f52f8005e30 tx=0x7f52f802fc10 comp rx=0 tx=0).stop 2024-08-02T18:41:29.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 shutdown_connections 2024-08-02T18:41:29.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 --2- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52f0039060 0x7f52f003b520 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:29.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 --2- 172.21.15.103:0/1625825436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53081006c0 0x7f53080fd510 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:29.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 >> 172.21.15.103:0/1625825436 conn(0x7f5308075f80 msgr2=0x7f53080693f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:29.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 shutdown_connections 2024-08-02T18:41:29.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:29.066+0000 7f531055f640 1 -- 172.21.15.103:0/1625825436 wait complete. 2024-08-02T18:41:29.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:29 smithi103 ceph-mon[32753]: Added host smithi151 2024-08-02T18:41:29.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:29 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:29.703 INFO:tasks.cephadm:Setting crush tunables to default 2024-08-02T18:41:29.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd crush tunables default 2024-08-02T18:41:29.947 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:30.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:30 smithi103 ceph-mon[32753]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:41:30.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:30 smithi103 ceph-mon[32753]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.350+0000 7f105f067640 1 -- 172.21.15.103:0/1365070156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 msgr2=0x7f1058101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.350+0000 7f105f067640 1 --2- 172.21.15.103:0/1365070156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 0x7f1058101940 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f1048009880 tx=0x7f104802a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 -- 172.21.15.103:0/1365070156 shutdown_connections 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 --2- 172.21.15.103:0/1365070156 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 0x7f1058101940 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 -- 172.21.15.103:0/1365070156 >> 172.21.15.103:0/1365070156 conn(0x7f10580fcfe0 msgr2=0x7f10580ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 -- 172.21.15.103:0/1365070156 shutdown_connections 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 -- 172.21.15.103:0/1365070156 wait complete. 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 Processor -- start 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 -- start start 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 0x7f1058196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105f067640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f105810baf0 con 0x7f1058101560 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.351+0000 7f105ce03640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 0x7f1058196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f105ce03640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 0x7f1058196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37080/0 (socket says 172.21.15.103:37080) 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f105ce03640 1 -- 172.21.15.103:0/3814764844 learned_addr learned my addr 172.21.15.103:0/3814764844 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:30.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f105ce03640 1 -- 172.21.15.103:0/3814764844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1058197450 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f105ce03640 1 --2- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 0x7f1058196f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1048006010 tx=0x7f1048003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f1055ffb640 1 -- 172.21.15.103:0/3814764844 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f104803f070 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f1055ffb640 1 -- 172.21.15.103:0/3814764844 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1048031c20 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1058197740 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f1055ffb640 1 -- 172.21.15.103:0/3814764844 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1048035030 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.352+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f105819b7e0 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.353+0000 7f1055ffb640 1 -- 172.21.15.103:0/3814764844 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f1048042070 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.353+0000 7f1055ffb640 1 --2- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1040039060 0x7f104003b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.353+0000 7f1055ffb640 1 -- 172.21.15.103:0/3814764844 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 1155+0+0 (secure 0 0 0) 0x7f104806cde0 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.353+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1058102a40 con 0x7f1058101560 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.353+0000 7f1057fff640 1 --2- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1040039060 0x7f104003b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:30.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.354+0000 7f1057fff640 1 --2- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1040039060 0x7f104003b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f104c0098c0 tx=0x7f104c006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:30.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.358+0000 7f1055ffb640 1 -- 172.21.15.103:0/3814764844 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f104804c350 con 0x7f1058101560 2024-08-02T18:41:30.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:30.528+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f10581019c0 con 0x7f1058101560 2024-08-02T18:41:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.274+0000 7f1055ffb640 1 -- 172.21.15.103:0/3814764844 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) ==== 124+0+0 (secure 0 0 0) 0x7f104803b5f0 con 0x7f1058101560 2024-08-02T18:41:31.275 INFO:teuthology.orchestra.run.smithi103.stderr:adjusted tunables profile to default 2024-08-02T18:41:31.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1040039060 msgr2=0x7f104003b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:31.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 --2- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1040039060 0x7f104003b520 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f104c0098c0 tx=0x7f104c006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:31.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 msgr2=0x7f1058196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:31.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 --2- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 0x7f1058196f10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1048006010 tx=0x7f1048003c00 comp rx=0 tx=0).stop 2024-08-02T18:41:31.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 shutdown_connections 2024-08-02T18:41:31.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 --2- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1040039060 0x7f104003b520 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:31.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 --2- 172.21.15.103:0/3814764844 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1058101560 0x7f1058196f10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:31.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 >> 172.21.15.103:0/3814764844 conn(0x7f10580fcfe0 msgr2=0x7f1058108e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:31.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 shutdown_connections 2024-08-02T18:41:31.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:31.277+0000 7f105f067640 1 -- 172.21.15.103:0/3814764844 wait complete. 2024-08-02T18:41:31.574 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:31 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3814764844' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-02T18:41:31.842 INFO:tasks.cephadm:Adding mon.a on smithi103 2024-08-02T18:41:31.842 INFO:tasks.cephadm:Adding mon.b on smithi121 2024-08-02T18:41:31.842 INFO:tasks.cephadm:Adding mon.c on smithi151 2024-08-02T18:41:31.842 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch apply mon '3;smithi103:172.21.15.103=a;smithi121:172.21.15.121=b;smithi151:172.21.15.151=c' 2024-08-02T18:41:32.090 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-02T18:41:32.138 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /etc/ceph/ceph.conf 2024-08-02T18:41:32.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:32.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3814764844' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-02T18:41:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi151", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:41:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 -- 172.21.15.151:0/2563584042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 msgr2=0x7fb3a0101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 --2- 172.21.15.151:0/2563584042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 0x7fb3a0101940 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fb39c009880 tx=0x7fb39c02a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 -- 172.21.15.151:0/2563584042 shutdown_connections 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 --2- 172.21.15.151:0/2563584042 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 0x7fb3a0101940 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 -- 172.21.15.151:0/2563584042 >> 172.21.15.151:0/2563584042 conn(0x7fb3a00fcfe0 msgr2=0x7fb3a00ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 -- 172.21.15.151:0/2563584042 shutdown_connections 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 -- 172.21.15.151:0/2563584042 wait complete. 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 Processor -- start 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.667+0000 7fb3a6f49640 1 -- start start 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.668+0000 7fb3a6f49640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 0x7fb3a0196f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:32.669 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.668+0000 7fb3a6f49640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb3a010baf0 con 0x7fb3a0101560 2024-08-02T18:41:32.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.668+0000 7fb3a4ce5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 0x7fb3a0196f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:32.671 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.668+0000 7fb3a4ce5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 0x7fb3a0196f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.151:34708/0 (socket says 172.21.15.151:34708) 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.668+0000 7fb3a4ce5640 1 -- 172.21.15.151:0/1064773211 learned_addr learned my addr 172.21.15.151:0/1064773211 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.668+0000 7fb3a4ce5640 1 -- 172.21.15.151:0/1064773211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3a0197450 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.668+0000 7fb3a4ce5640 1 --2- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 0x7fb3a0196f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb39c006010 tx=0x7fb39c003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.669+0000 7fb395ffb640 1 -- 172.21.15.151:0/1064773211 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb39c03f070 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.669+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3a0197740 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.669+0000 7fb395ffb640 1 -- 172.21.15.151:0/1064773211 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb39c031c20 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.669+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3a019b7e0 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.669+0000 7fb395ffb640 1 -- 172.21.15.151:0/1064773211 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb39c049060 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.670+0000 7fb395ffb640 1 -- 172.21.15.151:0/1064773211 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fb39c042070 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.670+0000 7fb395ffb640 1 --2- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb388039060 0x7fb38803b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.670+0000 7fb395ffb640 1 -- 172.21.15.151:0/1064773211 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fb39c06e120 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.670+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3a0102a40 con 0x7fb3a0101560 2024-08-02T18:41:32.672 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.670+0000 7fb397fff640 1 --2- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb388039060 0x7fb38803b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:32.673 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.671+0000 7fb397fff640 1 --2- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb388039060 0x7fb38803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb3900098c0 tx=0x7fb390006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:32.676 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.675+0000 7fb395ffb640 1 -- 172.21.15.151:0/1064773211 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb39c04a250 con 0x7fb3a0101560 2024-08-02T18:41:32.859 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.858+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi103:172.21.15.103=a;smithi121:172.21.15.121=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}) -- 0x7fb3a0198270 con 0x7fb388039060 2024-08-02T18:41:32.865 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.864+0000 7fb395ffb640 1 -- 172.21.15.151:0/1064773211 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fb3a0198270 con 0x7fb388039060 2024-08-02T18:41:32.865 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mon update... 2024-08-02T18:41:32.867 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb388039060 msgr2=0x7fb38803b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 --2- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb388039060 0x7fb38803b520 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fb3900098c0 tx=0x7fb390006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 msgr2=0x7fb3a0196f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 --2- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 0x7fb3a0196f10 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fb39c006010 tx=0x7fb39c003c00 comp rx=0 tx=0).stop 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 shutdown_connections 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 --2- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb388039060 0x7fb38803b520 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 --2- 172.21.15.151:0/1064773211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3a0101560 0x7fb3a0196f10 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 >> 172.21.15.151:0/1064773211 conn(0x7fb3a00fcfe0 msgr2=0x7fb3a0108e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 shutdown_connections 2024-08-02T18:41:32.868 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:32.866+0000 7fb3a6f49640 1 -- 172.21.15.151:0/1064773211 wait complete. 2024-08-02T18:41:33.424 DEBUG:teuthology.orchestra.run.smithi121:mon.b> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.b.service 2024-08-02T18:41:33.426 DEBUG:teuthology.orchestra.run.smithi151:mon.c> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.c.service 2024-08-02T18:41:33.429 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-02T18:41:33.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-02T18:41:33.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: Updating smithi151:/etc/ceph/ceph.conf 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:33.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:33 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:34.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:34 smithi103 ceph-mon[32753]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi103:172.21.15.103=a;smithi121:172.21.15.121=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:34.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:34 smithi103 ceph-mon[32753]: Saving service mon spec with placement smithi103:172.21.15.103=a;smithi121:172.21.15.121=b;smithi151:172.21.15.151=c;count:3 2024-08-02T18:41:34.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:34 smithi103 ceph-mon[32753]: Deploying daemon mon.c on smithi151 2024-08-02T18:41:34.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:34 smithi103 ceph-mon[32753]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:35.033 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:36.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.029+0000 7f67e8166640 1 -- 172.21.15.151:0/801662226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 msgr2=0x7f67e0100830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:36.054 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.029+0000 7f67e8166640 1 --2- 172.21.15.151:0/801662226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 0x7f67e0100830 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f67dc009880 tx=0x7f67dc02a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.029+0000 7f67e8166640 1 -- 172.21.15.151:0/801662226 shutdown_connections 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.029+0000 7f67e8166640 1 --2- 172.21.15.151:0/801662226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 0x7f67e0100830 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.029+0000 7f67e8166640 1 -- 172.21.15.151:0/801662226 >> 172.21.15.151:0/801662226 conn(0x7f67e00fbed0 msgr2=0x7f67e00fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.029+0000 7f67e8166640 1 -- 172.21.15.151:0/801662226 shutdown_connections 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.029+0000 7f67e8166640 1 -- 172.21.15.151:0/801662226 wait complete. 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.030+0000 7f67e8166640 1 Processor -- start 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.030+0000 7f67e8166640 1 -- start start 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.030+0000 7f67e8166640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 0x7f67e0197dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.031+0000 7f67e8166640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f67e010a9e0 con 0x7f67e0100450 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.031+0000 7f67e5f02640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 0x7f67e0197dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:36.055 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.031+0000 7f67e5f02640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 0x7f67e0197dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.151:34732/0 (socket says 172.21.15.151:34732) 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.031+0000 7f67e5f02640 1 -- 172.21.15.151:0/3844620511 learned_addr learned my addr 172.21.15.151:0/3844620511 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.031+0000 7f67e5f02640 1 -- 172.21.15.151:0/3844620511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67e0198300 con 0x7f67e0100450 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.031+0000 7f67e5f02640 1 --2- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 0x7f67e0197dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67dc006010 tx=0x7f67dc003c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.032+0000 7f67d6ffd640 1 -- 172.21.15.151:0/3844620511 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67dc03f070 con 0x7f67e0100450 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.032+0000 7f67d6ffd640 1 -- 172.21.15.151:0/3844620511 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67dc031c20 con 0x7f67e0100450 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.032+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67e01985f0 con 0x7f67e0100450 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.032+0000 7f67d6ffd640 1 -- 172.21.15.151:0/3844620511 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f67dc035030 con 0x7f67e0100450 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.032+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67e0198ab0 con 0x7f67e0100450 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.033+0000 7f67d6ffd640 1 -- 172.21.15.151:0/3844620511 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f67dc042070 con 0x7f67e0100450 2024-08-02T18:41:36.056 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.033+0000 7f67d6ffd640 1 --2- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f67cc039060 0x7f67cc03b520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:36.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.033+0000 7f67d6ffd640 1 -- 172.21.15.151:0/3844620511 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f67dc06cd30 con 0x7f67e0100450 2024-08-02T18:41:36.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.033+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67e0101930 con 0x7f67e0100450 2024-08-02T18:41:36.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.033+0000 7f67e5701640 1 --2- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f67cc039060 0x7f67cc03b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:36.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.034+0000 7f67e5701640 1 --2- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f67cc039060 0x7f67cc03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67d00098c0 tx=0x7f67d0006db0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:36.057 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.038+0000 7f67d6ffd640 1 -- 172.21.15.151:0/3844620511 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f67dc04c350 con 0x7f67e0100450 2024-08-02T18:41:36.320 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.317+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f67e01008b0 con 0x7f67e0100450 2024-08-02T18:41:36.320 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:41:36.320 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":1,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","modified":"2024-08-02T18:40:16.551678Z","created":"2024-08-02T18:40:16.551678Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-08-02T18:41:36.321 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.318+0000 7f67d6ffd640 1 -- 172.21.15.151:0/3844620511 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) ==== 95+0+749 (secure 0 0 0) 0x7f67dc03b5f0 con 0x7f67e0100450 2024-08-02T18:41:36.321 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 1 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.320+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f67cc039060 msgr2=0x7f67cc03b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.320+0000 7f67e8166640 1 --2- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f67cc039060 0x7f67cc03b520 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f67d00098c0 tx=0x7f67d0006db0 comp rx=0 tx=0).stop 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.320+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 msgr2=0x7f67e0197dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.320+0000 7f67e8166640 1 --2- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 0x7f67e0197dc0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f67dc006010 tx=0x7f67dc003c00 comp rx=0 tx=0).stop 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.320+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 shutdown_connections 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.320+0000 7f67e8166640 1 --2- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f67cc039060 0x7f67cc03b520 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.320+0000 7f67e8166640 1 --2- 172.21.15.151:0/3844620511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67e0100450 0x7f67e0197dc0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.320+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 >> 172.21.15.151:0/3844620511 conn(0x7f67e00fbed0 msgr2=0x7f67e00fca10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.321+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 shutdown_connections 2024-08-02T18:41:36.322 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:36.321+0000 7f67e8166640 1 -- 172.21.15.151:0/3844620511 wait complete. 2024-08-02T18:41:36.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:36 smithi151 systemd[1]: Starting Ceph mon.c for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:41:36.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:36 smithi103 ceph-mon[32753]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:37.238 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 podman[37136]: 2024-08-02 18:41:37.149599247 +0000 UTC m=+0.110120269 container create 6d6b6bf8a41ad89ba8856257801fc05d078172b6dda59f7f168e0205190877e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS) 2024-08-02T18:41:37.239 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 podman[37136]: 2024-08-02 18:41:37.056925064 +0000 UTC m=+0.017446047 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:41:37.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 podman[37136]: 2024-08-02 18:41:37.351765344 +0000 UTC m=+0.312286332 container init 6d6b6bf8a41ad89ba8856257801fc05d078172b6dda59f7f168e0205190877e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 podman[37136]: 2024-08-02 18:41:37.354817233 +0000 UTC m=+0.315338213 container start 6d6b6bf8a41ad89ba8856257801fc05d078172b6dda59f7f168e0205190877e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, ceph=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: set uid:gid to 167:167 (ceph:ceph) 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: ceph version 19.1.0-1260-g26c3fb8e (26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea) squid (rc), process ceph-mon, pid 2 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: pidfile_write: ignore empty --pid-file 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: load: jerasure load: lrc 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: RocksDB version: 7.9.2 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Git sha 0 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Compile date 2024-08-01 20:56:42 2024-08-02T18:41:37.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: DB SUMMARY 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: DB Session ID: 21A9NAYN9PZBNVD8RV0Q 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: CURRENT file: CURRENT 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: IDENTITY file: IDENTITY 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: MANIFEST file: MANIFEST-000005 size: 59 Bytes 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 0, files: 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000004.log size: 511 ; 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.error_if_exists: 0 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.create_if_missing: 0 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.paranoid_checks: 1 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.flush_verify_memtable_count: 1 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-08-02T18:41:37.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.env: 0x55df426dc7a0 2024-08-02T18:41:37.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.fs: PosixFileSystem 2024-08-02T18:41:37.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.info_log: 0x55df4460d500 2024-08-02T18:41:37.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_file_opening_threads: 16 2024-08-02T18:41:37.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.statistics: (nil) 2024-08-02T18:41:37.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.use_fsync: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_log_file_size: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.log_file_time_to_roll: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.keep_log_file_num: 1000 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.recycle_log_file_num: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.allow_fallocate: 1 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.allow_mmap_reads: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.allow_mmap_writes: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.use_direct_reads: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.create_missing_column_families: 0 2024-08-02T18:41:37.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.db_log_dir: 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.wal_dir: 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.table_cache_numshardbits: 6 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.WAL_ttl_seconds: 0 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.WAL_size_limit_MB: 0 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.is_fd_close_on_exec: 1 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.advise_random_on_open: 1 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.db_write_buffer_size: 0 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.write_buffer_manager: 0x55df4461cdc0 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-08-02T18:41:37.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.use_adaptive_mutex: 0 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.rate_limiter: (nil) 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.wal_recovery_mode: 2 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.enable_thread_tracking: 0 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.enable_pipelined_write: 0 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.unordered_write: 0 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.row_cache: None 2024-08-02T18:41:37.577 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.wal_filter: None 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.allow_ingest_behind: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.two_write_queues: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.manual_wal_flush: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.wal_compression: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.atomic_flush: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.persist_stats_to_disk: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.write_dbid_to_manifest: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.log_readahead_size: 0 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-08-02T18:41:37.578 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.best_efforts_recovery: 0 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.allow_data_in_errors: 0 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.db_host_id: __hostname__ 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.enforce_single_del_contracts: true 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_background_jobs: 2 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_background_compactions: -1 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_subcompactions: 1 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-08-02T18:41:37.579 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.delayed_write_rate : 16777216 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_total_wal_size: 0 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.stats_dump_period_sec: 600 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.stats_persist_period_sec: 600 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_open_files: -1 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bytes_per_sync: 0 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.wal_bytes_per_sync: 0 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.strict_bytes_per_sync: 0 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_readahead_size: 0 2024-08-02T18:41:37.580 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_background_flushes: -1 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Compression algorithms supported: 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: kZSTD supported: 0 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: kXpressCompression supported: 0 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: kBZip2Compression supported: 0 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: kLZ4Compression supported: 1 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: kZlibCompression supported: 1 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: kLZ4HCCompression supported: 1 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: kSnappyCompression supported: 1 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Fast CRC32 supported: Supported on x86 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: DMutex implementation: pthread_mutex_t 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-08-02T18:41:37.581 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.merge_operator: 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_filter: None 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_filter_factory: None 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.sst_partitioner_factory: None 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.memtable_factory: SkipListFactory 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.table_factory: BlockBasedTable 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55df4460d120) 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout: cache_index_and_filter_blocks: 1 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout: pin_top_level_index_and_filter: 1 2024-08-02T18:41:37.582 INFO:journalctl@ceph.mon.c.smithi151.stdout: index_type: 0 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: data_block_index_type: 0 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: index_shortening: 1 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: data_block_hash_table_util_ratio: 0.750000 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: checksum: 4 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: no_block_cache: 0 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_cache: 0x55df44601090 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_cache_name: BinnedLRUCache 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_cache_options: 2024-08-02T18:41:37.583 INFO:journalctl@ceph.mon.c.smithi151.stdout: capacity : 536870912 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: num_shard_bits : 4 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: strict_capacity_limit : 0 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: high_pri_pool_ratio: 0.000 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_cache_compressed: (nil) 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: persistent_cache: (nil) 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_size: 4096 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_size_deviation: 10 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_restart_interval: 16 2024-08-02T18:41:37.584 INFO:journalctl@ceph.mon.c.smithi151.stdout: index_block_restart_interval: 1 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: metadata_block_size: 4096 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: partition_filters: 0 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: use_delta_encoding: 1 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: filter_policy: bloomfilter 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: whole_key_filtering: 1 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: verify_compression: 0 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: read_amp_bytes_per_bit: 0 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: format_version: 5 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: enable_index_compression: 1 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: block_align: 0 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: max_auto_readahead_size: 262144 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: prepopulate_block_cache: 0 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: initial_auto_readahead_size: 8192 2024-08-02T18:41:37.585 INFO:journalctl@ceph.mon.c.smithi151.stdout: num_file_reads_for_auto_readahead: 2 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.write_buffer_size: 33554432 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_write_buffer_number: 2 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression: NoCompression 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression: Disabled 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.prefix_extractor: nullptr 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.num_levels: 7 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-08-02T18:41:37.586 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.window_bits: -14 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.level: 32767 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.strategy: 0 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-08-02T18:41:37.587 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.enabled: false 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.target_file_size_base: 67108864 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.target_file_size_multiplier: 1 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-08-02T18:41:37.588 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.arena_block_size: 1048576 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.disable_auto_compactions: 0 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-08-02T18:41:37.589 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-08-02T18:41:37.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.table_properties_collectors: CompactOnDeletionCollector (Sliding window size = 32768 Deletion trigger = 16384 Deletion ratio = 0); 2024-08-02T18:41:37.591 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.inplace_update_support: 0 2024-08-02T18:41:37.591 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.inplace_update_num_locks: 10000 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.memtable_huge_page_size: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.bloom_locality: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.max_successive_merges: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.optimize_filters_for_hits: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.paranoid_file_checks: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.force_consistency_checks: 1 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.report_bg_io_stats: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.ttl: 2592000 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.periodic_compaction_seconds: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-08-02T18:41:37.592 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.enable_blob_files: false 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.min_blob_size: 0 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.blob_file_size: 268435456 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.blob_compression_type: NoCompression 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.enable_blob_garbage_collection: false 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.blob_file_starting_level: 0 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 0 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 8c676558-7c00-422b-9df0-1ac533110c34 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722624097381429, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-08-02T18:41:37.593 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #4 mode 2 2024-08-02T18:41:37.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722624097381936, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1648, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 1, "largest_seqno": 5, "table_properties": {"data_size": 523, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_filter_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[CompactOnDeletionCollector]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1722624097, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "8c676558-7c00-422b-9df0-1ac533110c34", "db_session_id": "21A9NAYN9PZBNVD8RV0Q", "orig_file_number": 8, "seqno_to_time_mapping": "N/A"}} 2024-08-02T18:41:37.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: EVENT_LOG_v1 {"time_micros": 1722624097382067, "job": 1, "event": "recovery_finished"} 2024-08-02T18:41:37.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/version_set.cc:5047] Creating manifest 10 2024-08-02T18:41:37.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-08-02T18:41:37.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55df4462ee00 2024-08-02T18:41:37.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: DB pointer 0x55df44728000 2024-08-02T18:41:37.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-08-02T18:41:37.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: ** DB Stats ** 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: ** Compaction Stats [default] ** 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-02T18:41:37.595 INFO:journalctl@ceph.mon.c.smithi151.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: L0 1/0 1.61 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: Sum 1/0 1.61 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: ** Compaction Stats [default] ** 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 0.0 0.0 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-08-02T18:41:37.596 INFO:journalctl@ceph.mon.c.smithi151.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-08-02T18:41:37.597 INFO:journalctl@ceph.mon.c.smithi151.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-08-02T18:41:37.597 INFO:journalctl@ceph.mon.c.smithi151.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-08-02T18:41:37.597 INFO:journalctl@ceph.mon.c.smithi151.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-08-02T18:41:37.597 INFO:journalctl@ceph.mon.c.smithi151.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-08-02T18:41:37.597 INFO:journalctl@ceph.mon.c.smithi151.stdout: AddFile(Keys): cumulative 0, interval 0 2024-08-02T18:41:37.598 INFO:journalctl@ceph.mon.c.smithi151.stdout: Cumulative compaction: 0.00 GB write, 0.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-02T18:41:37.598 INFO:journalctl@ceph.mon.c.smithi151.stdout: Interval compaction: 0.00 GB write, 0.51 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-08-02T18:41:37.598 INFO:journalctl@ceph.mon.c.smithi151.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-08-02T18:41:37.598 INFO:journalctl@ceph.mon.c.smithi151.stdout: Block cache BinnedLRUCache@0x55df44601090#2 capacity: 512.00 MB usage: 0.22 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 8e-06 secs_since: 0 2024-08-02T18:41:37.598 INFO:journalctl@ceph.mon.c.smithi151.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.11 KB,2.08616e-05%) Misc(1,0.00 KB,0%) 2024-08-02T18:41:37.598 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout: ** File Read Latency Histogram By Level [default] ** 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c does not exist in monmap, will attempt to join an existing cluster 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: using public_addr v2:172.21.15.151:0/0 -> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: starting mon.c rank -1 at public addrs [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] at bind addrs [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon_data /var/lib/ceph/mon/ceph-c fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(???) e0 preinit fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).mds e1 new map 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).mds e1 print_map 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout: e1 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout: btime 2024-08-02T18:40:20:516071+0000 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-02T18:41:37.599 INFO:journalctl@ceph.mon.c.smithi151.stdout: legacy client fscid: -1 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout: 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout: No filesystems configured 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: Added host smithi151 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.600 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3814764844' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3814764844' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi151", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:37.601 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: Updating smithi151:/etc/ceph/ceph.conf 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:37.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi103:172.21.15.103=a;smithi121:172.21.15.121=b;smithi151:172.21.15.151=c", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: Saving service mon spec with placement smithi103:172.21.15.103=a;smithi121:172.21.15.121=b;smithi151:172.21.15.151=c;count:3 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: Deploying daemon mon.c on smithi151 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/3844620511' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 ceph-mon[37155]: mon.c@-1(synchronizing).paxosservice(auth 1..3) refresh upgraded, format 0 -> 3 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 bash[37136]: 6d6b6bf8a41ad89ba8856257801fc05d078172b6dda59f7f168e0205190877e9 2024-08-02T18:41:37.603 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:37 smithi151 systemd[1]: Started Ceph mon.c for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:41:37.604 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:37 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/3844620511' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-02T18:41:37.940 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-02T18:41:37.941 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-02T18:41:38.189 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: mon.a calling monitor election 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: mon.c calling monitor election 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: monmap epoch 2 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: last_changed 2024-08-02T18:41:37.407990+0000 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: min_mon_release 19 (squid) 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: election_strategy: 1 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: fsmap 2024-08-02T18:41:42.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:42.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: mgrmap e13: x(active, since 37s) 2024-08-02T18:41:42.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: overall HEALTH_OK 2024-08-02T18:41:42.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:42.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:42.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:42.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:42.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: mon.a calling monitor election 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: mon.c calling monitor election 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: monmap epoch 2 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: last_changed 2024-08-02T18:41:37.407990+0000 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: min_mon_release 19 (squid) 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: election_strategy: 1 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: fsmap 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: mgrmap e13: x(active, since 37s) 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: overall HEALTH_OK 2024-08-02T18:41:42.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:42.828 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:42.828 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:42.828 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:42.828 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:43.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.038+0000 7f6bce4e0640 1 -- 172.21.15.151:0/2658058220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 msgr2=0x7f6bb0005580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:43.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.038+0000 7f6bce4e0640 1 --2- 172.21.15.151:0/2658058220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 0x7f6bb0005580 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6bb8012c60 tx=0x7f6bb802c620 comp rx=0 tx=0).stop 2024-08-02T18:41:43.042 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.038+0000 7f6bce4e0640 1 -- 172.21.15.151:0/2658058220 shutdown_connections 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.038+0000 7f6bce4e0640 1 --2- 172.21.15.151:0/2658058220 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 0x7f6bb0005580 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.038+0000 7f6bce4e0640 1 -- 172.21.15.151:0/2658058220 >> 172.21.15.151:0/2658058220 conn(0x7f6bc80fbf50 msgr2=0x7f6bc80fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.038+0000 7f6bce4e0640 1 -- 172.21.15.151:0/2658058220 shutdown_connections 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.038+0000 7f6bce4e0640 1 -- 172.21.15.151:0/2658058220 wait complete. 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.039+0000 7f6bce4e0640 1 Processor -- start 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.039+0000 7f6bce4e0640 1 -- start start 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bce4e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 0x7f6bc81001b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bce4e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 0x7f6bc8100b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bce4e0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc8109600 con 0x7f6bc8102550 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bce4e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6bc8109480 con 0x7f6bc81006f0 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bc77fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 0x7f6bc8100b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:43.043 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bc77fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 0x7f6bc8100b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34906/0 (socket says 172.21.15.151:34906) 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bc77fe640 1 -- 172.21.15.151:0/338834283 learned_addr learned my addr 172.21.15.151:0/338834283 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bc77fe640 1 -- 172.21.15.151:0/338834283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 msgr2=0x7f6bc8100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bc77fe640 1 -- 172.21.15.151:0/338834283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 msgr2=0x7f6bc8100b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bc77fe640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 0x7f6bc8100b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bc7fff640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 0x7f6bc81001b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.040+0000 7f6bc77fe640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 0x7f6bc8100b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bc7fff640 1 -- 172.21.15.151:0/338834283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 msgr2=0x7f6bc8100b50 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bc7fff640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 0x7f6bc8100b50 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bc7fff640 1 -- 172.21.15.151:0/338834283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6bc81020a0 con 0x7f6bc8102550 2024-08-02T18:41:43.044 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bc7fff640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 0x7f6bc81001b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80338e0 tx=0x7f6bb8033910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:43.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bc57fa640 1 -- 172.21.15.151:0/338834283 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6bb8033cc0 con 0x7f6bc8102550 2024-08-02T18:41:43.045 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bc57fa640 1 -- 172.21.15.151:0/338834283 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6bb8004b40 con 0x7f6bc8102550 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6bc81a3220 con 0x7f6bc8102550 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bc57fa640 1 -- 172.21.15.151:0/338834283 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f6bb803db20 con 0x7f6bc8102550 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.041+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6bc81a37b0 con 0x7f6bc8102550 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.043+0000 7f6bc57fa640 1 -- 172.21.15.151:0/338834283 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f6bb8044020 con 0x7f6bc8102550 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.043+0000 7f6bc57fa640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6bb4038e00 0x7f6bb403b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.043+0000 7f6bc57fa640 1 -- 172.21.15.151:0/338834283 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f6bb806eb90 con 0x7f6bc8102550 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.043+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6bc806aa40 con 0x7f6bc8102550 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.043+0000 7f6bc77fe640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6bb4038e00 0x7f6bb403b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:43.046 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.044+0000 7f6bc77fe640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6bb4038e00 0x7f6bb403b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009100 tx=0x7f6bbc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:43.050 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.048+0000 7f6bc57fa640 1 -- 172.21.15.151:0/338834283 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6bb804b020 con 0x7f6bc8102550 2024-08-02T18:41:43.284 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.283+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f6bc8190db0 con 0x7f6bc8102550 2024-08-02T18:41:43.285 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.284+0000 7f6bc57fa640 1 -- 172.21.15.151:0/338834283 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f6bb803bbe0 con 0x7f6bc8102550 2024-08-02T18:41:43.285 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:41:43.285 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","modified":"2024-08-02T18:41:37.407990Z","created":"2024-08-02T18:40:16.551678Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-02T18:41:43.286 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 2 2024-08-02T18:41:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6bb4038e00 msgr2=0x7f6bb403b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6bb4038e00 0x7f6bb403b2c0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6bbc009100 tx=0x7f6bbc008040 comp rx=0 tx=0).stop 2024-08-02T18:41:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 msgr2=0x7f6bc81001b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 0x7f6bc81001b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6bb80338e0 tx=0x7f6bb8033910 comp rx=0 tx=0).stop 2024-08-02T18:41:43.287 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 shutdown_connections 2024-08-02T18:41:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6bb4038e00 0x7f6bb403b2c0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6bc81006f0 0x7f6bc8100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 --2- 172.21.15.151:0/338834283 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6bc8102550 0x7f6bc81001b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 >> 172.21.15.151:0/338834283 conn(0x7f6bc80fbf50 msgr2=0x7f6bc80fdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 shutdown_connections 2024-08-02T18:41:43.288 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:43.286+0000 7f6bce4e0640 1 -- 172.21.15.151:0/338834283 wait complete. 2024-08-02T18:41:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:43 smithi151 ceph-mon[37155]: Deploying daemon mon.b on smithi121 2024-08-02T18:41:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:43 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/338834283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-02T18:41:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:43.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:43 smithi103 ceph-mon[32753]: Deploying daemon mon.b on smithi121 2024-08-02T18:41:43.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:43 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/338834283' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-02T18:41:43.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:44.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:44 smithi151 ceph-mon[37155]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:44.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:44 smithi103 ceph-mon[32753]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:44.946 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-02T18:41:44.946 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-02T18:41:45.204 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:41:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.648+0000 7f71f7236640 1 -- 172.21.15.151:0/1327582910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 msgr2=0x7f71f01019d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.648+0000 7f71f7236640 1 --2- 172.21.15.151:0/1327582910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 0x7f71f01019d0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009880 tx=0x7f71e402a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.648+0000 7f71f7236640 1 -- 172.21.15.151:0/1327582910 shutdown_connections 2024-08-02T18:41:45.653 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.648+0000 7f71f7236640 1 --2- 172.21.15.151:0/1327582910 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 0x7f71f01019d0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.648+0000 7f71f7236640 1 -- 172.21.15.151:0/1327582910 >> 172.21.15.151:0/1327582910 conn(0x7f71f00fd050 msgr2=0x7f71f00ff470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.648+0000 7f71f7236640 1 -- 172.21.15.151:0/1327582910 shutdown_connections 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.648+0000 7f71f7236640 1 -- 172.21.15.151:0/1327582910 wait complete. 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71f7236640 1 Processor -- start 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71f7236640 1 -- start start 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71f7236640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 0x7f71f0074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71f7236640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 0x7f71f0074bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71f7236640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71f010bb80 con 0x7f71f01015f0 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71f7236640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71f010ba00 con 0x7f71f0074760 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71effff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 0x7f71f0074bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71effff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 0x7f71f0074bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34918/0 (socket says 172.21.15.151:34918) 2024-08-02T18:41:45.654 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71effff640 1 -- 172.21.15.151:0/1970397577 learned_addr learned my addr 172.21.15.151:0/1970397577 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.649+0000 7f71f4fd2640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 0x7f71f0074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71effff640 1 -- 172.21.15.151:0/1970397577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 msgr2=0x7f71f0074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71effff640 1 -- 172.21.15.151:0/1970397577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 msgr2=0x7f71f0074bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71effff640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 0x7f71f0074bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71effff640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 0x7f71f0074bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71f4fd2640 1 -- 172.21.15.151:0/1970397577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 msgr2=0x7f71f0074bc0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71f4fd2640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 0x7f71f0074bc0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71f4fd2640 1 -- 172.21.15.151:0/1970397577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f71f0076110 con 0x7f71f01015f0 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71f4fd2640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 0x7f71f0074220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009880 tx=0x7f71e4004f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71edffb640 1 -- 172.21.15.151:0/1970397577 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f71e4035030 con 0x7f71f01015f0 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71edffb640 1 -- 172.21.15.151:0/1970397577 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f71e40035f0 con 0x7f71f01015f0 2024-08-02T18:41:45.655 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f71f01a3440 con 0x7f71f01015f0 2024-08-02T18:41:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71edffb640 1 -- 172.21.15.151:0/1970397577 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 309+0+0 (secure 0 0 0) 0x7f71e40318c0 con 0x7f71f01015f0 2024-08-02T18:41:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.650+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71f01a39d0 con 0x7f71f01015f0 2024-08-02T18:41:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.651+0000 7f71edffb640 1 -- 172.21.15.151:0/1970397577 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f71e4042070 con 0x7f71f01015f0 2024-08-02T18:41:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.652+0000 7f71edffb640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f71e0038e00 0x7f71e003b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.652+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f71f0102ad0 con 0x7f71f01015f0 2024-08-02T18:41:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.652+0000 7f71edffb640 1 -- 172.21.15.151:0/1970397577 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f71e406cd10 con 0x7f71f01015f0 2024-08-02T18:41:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.652+0000 7f71effff640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f71e0038e00 0x7f71e003b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:45.656 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.652+0000 7f71effff640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f71e0038e00 0x7f71e003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009100 tx=0x7f71dc008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:45.658 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.657+0000 7f71edffb640 1 -- 172.21.15.151:0/1970397577 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f71e40303a0 con 0x7f71f01015f0 2024-08-02T18:41:45.891 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.890+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7f71f01a3c80 con 0x7f71f01015f0 2024-08-02T18:41:45.892 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.890+0000 7f71edffb640 1 -- 172.21.15.151:0/1970397577 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) ==== 95+0+1019 (secure 0 0 0) 0x7f71e404c350 con 0x7f71f01015f0 2024-08-02T18:41:45.892 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:41:45.892 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":2,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","modified":"2024-08-02T18:41:37.407990Z","created":"2024-08-02T18:40:16.551678Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-02T18:41:45.892 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 2 2024-08-02T18:41:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f71e0038e00 msgr2=0x7f71e003b2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f71e0038e00 0x7f71e003b2c0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f71dc009100 tx=0x7f71dc008040 comp rx=0 tx=0).stop 2024-08-02T18:41:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 msgr2=0x7f71f0074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 0x7f71f0074220 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f71e4009880 tx=0x7f71e4004f10 comp rx=0 tx=0).stop 2024-08-02T18:41:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 shutdown_connections 2024-08-02T18:41:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f71e0038e00 0x7f71e003b2c0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71f0074760 0x7f71f0074bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:45.895 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 --2- 172.21.15.151:0/1970397577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71f01015f0 0x7f71f0074220 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 >> 172.21.15.151:0/1970397577 conn(0x7f71f00fd050 msgr2=0x7f71f0102fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 shutdown_connections 2024-08-02T18:41:45.896 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:45.893+0000 7f71f7236640 1 -- 172.21.15.151:0/1970397577 wait complete. 2024-08-02T18:41:46.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:46 smithi121 systemd[1]: Started Ceph mon.b for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:41:47.527 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-08-02T18:41:47.527 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph mon dump -f json 2024-08-02T18:41:47.785 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:41:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.169+0000 7fd77e01a640 1 -- 172.21.15.151:0/111229263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 msgr2=0x7fd7600059c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.169+0000 7fd77e01a640 1 --2- 172.21.15.151:0/111229263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 0x7fd7600059c0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fd778104a60 tx=0x7fd76c02bce0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.169+0000 7fd77e01a640 1 -- 172.21.15.151:0/111229263 shutdown_connections 2024-08-02T18:41:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.169+0000 7fd77e01a640 1 --2- 172.21.15.151:0/111229263 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 0x7fd7600059c0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.171 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.169+0000 7fd77e01a640 1 -- 172.21.15.151:0/111229263 >> 172.21.15.151:0/111229263 conn(0x7fd7780ff2f0 msgr2=0x7fd778101710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.169+0000 7fd77e01a640 1 -- 172.21.15.151:0/111229263 shutdown_connections 2024-08-02T18:41:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.169+0000 7fd77e01a640 1 -- 172.21.15.151:0/111229263 wait complete. 2024-08-02T18:41:51.172 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.170+0000 7fd77e01a640 1 Processor -- start 2024-08-02T18:41:51.174 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.170+0000 7fd77e01a640 1 -- start start 2024-08-02T18:41:51.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd77e01a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 0x7fd778199290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:51.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd77e01a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 0x7fd77819db60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:51.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd77e01a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 0x7fd77819e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:51.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd77e01a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd77810b7c0 con 0x7fd760003530 2024-08-02T18:41:51.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd77e01a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd77810b640 con 0x7fd7781997d0 2024-08-02T18:41:51.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd77e01a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd77810b940 con 0x7fd77819e0a0 2024-08-02T18:41:51.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd777fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 0x7fd77819e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:51.175 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd777fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 0x7fd77819e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34338/0 (socket says 172.21.15.151:34338) 2024-08-02T18:41:51.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd777fff640 1 -- 172.21.15.151:0/3854674197 learned_addr learned my addr 172.21.15.151:0/3854674197 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:41:51.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd7777fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 0x7fd778199290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:51.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd776ffd640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 0x7fd77819db60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:51.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd777fff640 1 -- 172.21.15.151:0/3854674197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 msgr2=0x7fd77819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 14 2024-08-02T18:41:51.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd777fff640 1 -- 172.21.15.151:0/3854674197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 msgr2=0x7fd77819e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-02T18:41:51.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd777fff640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 0x7fd77819e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-02T18:41:51.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd777fff640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 0x7fd77819e550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:41:51.176 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd776ffd640 1 -- 172.21.15.151:0/3854674197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 msgr2=0x7fd77819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd776ffd640 1 -- 172.21.15.151:0/3854674197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 msgr2=0x7fd77819db60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd776ffd640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 0x7fd77819db60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd776ffd640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 0x7fd77819db60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd7777fe640 1 -- 172.21.15.151:0/3854674197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 msgr2=0x7fd77819e550 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd7777fe640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 0x7fd77819e550 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd7777fe640 1 -- 172.21.15.151:0/3854674197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 msgr2=0x7fd77819db60 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd7777fe640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 0x7fd77819db60 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.171+0000 7fd7777fe640 1 -- 172.21.15.151:0/3854674197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7781a5e10 con 0x7fd760003530 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.172+0000 7fd7777fe640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 0x7fd778199290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd76c011c00 tx=0x7fd76c02dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.172+0000 7fd774ff9640 1 -- 172.21.15.151:0/3854674197 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c005460 con 0x7fd760003530 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.172+0000 7fd774ff9640 1 -- 172.21.15.151:0/3854674197 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd76c003af0 con 0x7fd760003530 2024-08-02T18:41:51.177 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.172+0000 7fd774ff9640 1 -- 172.21.15.151:0/3854674197 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd76c004d30 con 0x7fd760003530 2024-08-02T18:41:51.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.172+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd7781a5fe0 con 0x7fd760003530 2024-08-02T18:41:51.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.172+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd7781a6510 con 0x7fd760003530 2024-08-02T18:41:51.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.173+0000 7fd774ff9640 1 -- 172.21.15.151:0/3854674197 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7fd76c037480 con 0x7fd760003530 2024-08-02T18:41:51.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.173+0000 7fd774ff9640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd7640394f0 0x7fd76403b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:51.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.173+0000 7fd774ff9640 1 -- 172.21.15.151:0/3854674197 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7fd76c06d830 con 0x7fd760003530 2024-08-02T18:41:51.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.173+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd77810c9e0 con 0x7fd760003530 2024-08-02T18:41:51.178 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.173+0000 7fd776ffd640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd7640394f0 0x7fd76403b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:51.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.174+0000 7fd776ffd640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd7640394f0 0x7fd76403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd768006fd0 tx=0x7fd768008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:51.180 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.178+0000 7fd774ff9640 1 -- 172.21.15.151:0/3854674197 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd76c0472a0 con 0x7fd760003530 2024-08-02T18:41:51.424 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.423+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) -- 0x7fd778193010 con 0x7fd760003530 2024-08-02T18:41:51.425 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.423+0000 7fd774ff9640 1 -- 172.21.15.151:0/3854674197 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 3 v3) ==== 95+0+1287 (secure 0 0 0) 0x7fd76c0045a0 con 0x7fd760003530 2024-08-02T18:41:51.425 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:41:51.425 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.425 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: mon.a calling monitor election 2024-08-02T18:41:51.425 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: mon.c calling monitor election 2024-08-02T18:41:51.425 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:51.425 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.425 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: monmap epoch 3 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: last_changed 2024-08-02T18:41:46.140681+0000 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: min_mon_release 19 (squid) 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: election_strategy: 1 2024-08-02T18:41:51.426 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: fsmap 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: mgrmap e13: x(active, since 45s) 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: overall HEALTH_OK 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:51.427 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:51.427 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:41:51.428 INFO:teuthology.orchestra.run.smithi151.stdout:{"epoch":3,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","modified":"2024-08-02T18:41:46.140681Z","created":"2024-08-02T18:40:16.551678Z","min_mon_release":19,"min_mon_release_name":"squid","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy","reef","squid"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:3300","nonce":0},{"type":"v1","addr":"172.21.15.103:6789","nonce":0}]},"addr":"172.21.15.103:6789/0","public_addr":"172.21.15.103:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:3300","nonce":0},{"type":"v1","addr":"172.21.15.151:6789","nonce":0}]},"addr":"172.21.15.151:6789/0","public_addr":"172.21.15.151:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:3300","nonce":0},{"type":"v1","addr":"172.21.15.121:6789","nonce":0}]},"addr":"172.21.15.121:6789/0","public_addr":"172.21.15.121:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-08-02T18:41:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:dumped monmap epoch 3 2024-08-02T18:41:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd7640394f0 msgr2=0x7fd76403b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd7640394f0 0x7fd76403b9b0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd768006fd0 tx=0x7fd768008040 comp rx=0 tx=0).stop 2024-08-02T18:41:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 msgr2=0x7fd778199290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:51.428 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 0x7fd778199290 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7fd76c011c00 tx=0x7fd76c02dbb0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 shutdown_connections 2024-08-02T18:41:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd7640394f0 0x7fd76403b9b0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd77819e0a0 0x7fd77819e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd7781997d0 0x7fd77819db60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 --2- 172.21.15.151:0/3854674197 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd760003530 0x7fd778199290 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.425+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 >> 172.21.15.151:0/3854674197 conn(0x7fd7780ff2f0 msgr2=0x7fd778101050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.426+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 shutdown_connections 2024-08-02T18:41:51.429 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:51.426+0000 7fd77e01a640 1 -- 172.21.15.151:0/3854674197 wait complete. 2024-08-02T18:41:51.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:41:51.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: mon.a calling monitor election 2024-08-02T18:41:51.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: mon.c calling monitor election 2024-08-02T18:41:51.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:51.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: monmap epoch 3 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: last_changed 2024-08-02T18:41:46.140681+0000 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:41:51.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: min_mon_release 19 (squid) 2024-08-02T18:41:51.578 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: election_strategy: 1 2024-08-02T18:41:51.578 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:41:51.578 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-08-02T18:41:51.578 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-08-02T18:41:51.578 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: fsmap 2024-08-02T18:41:51.578 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:51.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: mgrmap e13: x(active, since 45s) 2024-08-02T18:41:51.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: overall HEALTH_OK 2024-08-02T18:41:51.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:51.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:51.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:51.579 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:51.963 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-08-02T18:41:51.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph config generate-minimal-conf 2024-08-02T18:41:52.223 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:52.491 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:52 smithi103 ceph-mon[32753]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:52.491 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:52 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:52.492 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:52 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/3854674197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-02T18:41:52.492 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:52 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:52.497 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:52 smithi151 ceph-mon[37155]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:52.497 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:52 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:52.497 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:52 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/3854674197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-02T18:41:52.498 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:52 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:52.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 -- 172.21.15.103:0/1137327798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc101560 msgr2=0x7ff9fc101940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 --2- 172.21.15.103:0/1137327798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc101560 0x7ff9fc101940 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec009880 tx=0x7ff9ec02a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 -- 172.21.15.103:0/1137327798 shutdown_connections 2024-08-02T18:41:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 --2- 172.21.15.103:0/1137327798 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc101560 0x7ff9fc101940 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 -- 172.21.15.103:0/1137327798 >> 172.21.15.103:0/1137327798 conn(0x7ff9fc0fcfe0 msgr2=0x7ff9fc0ff400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 -- 172.21.15.103:0/1137327798 shutdown_connections 2024-08-02T18:41:52.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 -- 172.21.15.103:0/1137327798 wait complete. 2024-08-02T18:41:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 Processor -- start 2024-08-02T18:41:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.699+0000 7ffa02944640 1 -- start start 2024-08-02T18:41:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ffa02944640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9fc101560 0x7ff9fc1971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ffa02944640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc197720 0x7ff9fc19bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ffa02944640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9fc19bff0 0x7ff9fc19c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ffa02944640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc10baa0 con 0x7ff9fc197720 2024-08-02T18:41:52.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ffa02944640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc10b920 con 0x7ff9fc19bff0 2024-08-02T18:41:52.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ffa02944640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff9fc10bc20 con 0x7ff9fc101560 2024-08-02T18:41:52.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc197720 0x7ff9fc19bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:52.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc197720 0x7ff9fc19bab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55624/0 (socket says 172.21.15.103:55624) 2024-08-02T18:41:52.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fb7fe640 1 -- 172.21.15.103:0/4257046396 learned_addr learned my addr 172.21.15.103:0/4257046396 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:41:52.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fbfff640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9fc101560 0x7ff9fc1971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:52.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ffa00ee1640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9fc19bff0 0x7ff9fc19c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:52.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fb7fe640 1 -- 172.21.15.103:0/4257046396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9fc101560 msgr2=0x7ff9fc1971e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:52.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fb7fe640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9fc101560 0x7ff9fc1971e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fb7fe640 1 -- 172.21.15.103:0/4257046396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9fc19bff0 msgr2=0x7ff9fc19c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:52.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fb7fe640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9fc19bff0 0x7ff9fc19c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ff9fb7fe640 1 -- 172.21.15.103:0/4257046396 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9fc1a3d60 con 0x7ff9fc197720 2024-08-02T18:41:52.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.700+0000 7ffa00ee1640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9fc19bff0 0x7ff9fc19c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:41:52.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.701+0000 7ff9fb7fe640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc197720 0x7ff9fc19bab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400b520 tx=0x7ff9e400b9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:52.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.701+0000 7ff9f97fa640 1 -- 172.21.15.103:0/4257046396 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4004230 con 0x7ff9fc197720 2024-08-02T18:41:52.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.701+0000 7ff9f97fa640 1 -- 172.21.15.103:0/4257046396 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff9e40043d0 con 0x7ff9fc197720 2024-08-02T18:41:52.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.701+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9fc1a3f90 con 0x7ff9fc197720 2024-08-02T18:41:52.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.701+0000 7ff9f97fa640 1 -- 172.21.15.103:0/4257046396 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9e4003e00 con 0x7ff9fc197720 2024-08-02T18:41:52.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.701+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9fc1a4440 con 0x7ff9fc197720 2024-08-02T18:41:52.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.702+0000 7ff9f97fa640 1 -- 172.21.15.103:0/4257046396 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7ff9e400e070 con 0x7ff9fc197720 2024-08-02T18:41:52.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.702+0000 7ff9f97fa640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff9e80394f0 0x7ff9e803b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:52.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.702+0000 7ff9f97fa640 1 -- 172.21.15.103:0/4257046396 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff9e404ba70 con 0x7ff9fc197720 2024-08-02T18:41:52.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.702+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9fc1019c0 con 0x7ff9fc197720 2024-08-02T18:41:52.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.702+0000 7ff9fbfff640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff9e80394f0 0x7ff9e803b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:52.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.702+0000 7ff9fbfff640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff9e80394f0 0x7ff9e803b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec005ec0 tx=0x7ff9ec005a40 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:52.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.711+0000 7ff9f97fa640 1 -- 172.21.15.103:0/4257046396 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff9e4014020 con 0x7ff9fc197720 2024-08-02T18:41:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.898+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) -- 0x7ff9fc1a47e0 con 0x7ff9fc197720 2024-08-02T18:41:52.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.898+0000 7ff9f97fa640 1 -- 172.21.15.103:0/4257046396 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v9) ==== 76+0+277 (secure 0 0 0) 0x7ff9e401ccd0 con 0x7ff9fc197720 2024-08-02T18:41:52.900 INFO:teuthology.orchestra.run.smithi103.stdout:# minimal ceph.conf for 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:52.900 INFO:teuthology.orchestra.run.smithi103.stdout:[global] 2024-08-02T18:41:52.900 INFO:teuthology.orchestra.run.smithi103.stdout: fsid = 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:52.900 INFO:teuthology.orchestra.run.smithi103.stdout: mon_host = [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] 2024-08-02T18:41:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff9e80394f0 msgr2=0x7ff9e803b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff9e80394f0 0x7ff9e803b9b0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff9ec005ec0 tx=0x7ff9ec005a40 comp rx=0 tx=0).stop 2024-08-02T18:41:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc197720 msgr2=0x7ff9fc19bab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:52.902 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc197720 0x7ff9fc19bab0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7ff9e400b520 tx=0x7ff9e400b9e0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 shutdown_connections 2024-08-02T18:41:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff9fc19bff0 0x7ff9fc19c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff9fc197720 0x7ff9fc19bab0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff9e80394f0 0x7ff9e803b9b0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 --2- 172.21.15.103:0/4257046396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff9fc101560 0x7ff9fc1971e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 >> 172.21.15.103:0/4257046396 conn(0x7ff9fc0fcfe0 msgr2=0x7ff9fc102f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 shutdown_connections 2024-08-02T18:41:52.903 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:41:52.901+0000 7ffa02944640 1 -- 172.21.15.103:0/4257046396 wait complete. 2024-08-02T18:41:53.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:41:53.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:53.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mon.a calling monitor election 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mon.c calling monitor election 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:53.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: monmap epoch 3 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: last_changed 2024-08-02T18:41:46.140681+0000 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: min_mon_release 19 (squid) 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: election_strategy: 1 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: fsmap 2024-08-02T18:41:53.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mgrmap e13: x(active, since 45s) 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: overall HEALTH_OK 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/3854674197' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-08-02T18:41:53.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:53.561 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-08-02T18:41:53.561 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:41:53.561 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.conf 2024-08-02T18:41:53.590 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:41:53.590 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:53.656 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:41:53.656 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.conf 2024-08-02T18:41:53.683 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:41:53.683 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:53.747 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:41:53.748 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.conf 2024-08-02T18:41:53.774 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:41:53.774 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:41:53.843 INFO:tasks.cephadm:Adding mgr.x on smithi103 2024-08-02T18:41:53.843 INFO:tasks.cephadm:Adding mgr.y on smithi121 2024-08-02T18:41:53.843 INFO:tasks.cephadm:Adding mgr.z on smithi151 2024-08-02T18:41:53.843 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch apply mgr '3;smithi103=x;smithi121=y;smithi151=z' 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: mon.b calling monitor election 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: Updating smithi103:/etc/ceph/ceph.conf 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: Updating smithi151:/etc/ceph/ceph.conf 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: mon.b calling monitor election 2024-08-02T18:41:53.961 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: mon.a calling monitor election 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: mon.c calling monitor election 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: monmap epoch 3 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: last_changed 2024-08-02T18:41:46.140681+0000 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: min_mon_release 19 (squid) 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: election_strategy: 1 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: fsmap 2024-08-02T18:41:53.962 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: mgrmap e13: x(active, since 47s) 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: overall HEALTH_OK 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.963 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.964 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:53.964 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: Reconfiguring mon.a (unknown last config time)... 2024-08-02T18:41:53.964 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:53.964 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:53.964 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:53.964 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:53 smithi103 ceph-mon[32753]: Reconfiguring daemon mon.a on smithi103 2024-08-02T18:41:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mon.b calling monitor election 2024-08-02T18:41:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: Updating smithi103:/etc/ceph/ceph.conf 2024-08-02T18:41:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-02T18:41:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: Updating smithi151:/etc/ceph/ceph.conf 2024-08-02T18:41:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mon.b calling monitor election 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mon.a calling monitor election 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mon.c calling monitor election 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: monmap epoch 3 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: last_changed 2024-08-02T18:41:46.140681+0000 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: min_mon_release 19 (squid) 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: election_strategy: 1 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:41:54.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: fsmap 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: mgrmap e13: x(active, since 47s) 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: overall HEALTH_OK 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:54.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: Reconfiguring mon.a (unknown last config time)... 2024-08-02T18:41:54.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:54.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:54.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:54.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:53 smithi121 ceph-mon[37236]: Reconfiguring daemon mon.a on smithi103 2024-08-02T18:41:54.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: mon.b calling monitor election 2024-08-02T18:41:54.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: Updating smithi103:/etc/ceph/ceph.conf 2024-08-02T18:41:54.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-02T18:41:54.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: Updating smithi151:/etc/ceph/ceph.conf 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: mon.b calling monitor election 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: mon.a calling monitor election 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: mon.c calling monitor election 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: monmap epoch 3 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: last_changed 2024-08-02T18:41:46.140681+0000 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: created 2024-08-02T18:40:16.551678+0000 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: min_mon_release 19 (squid) 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: election_strategy: 1 2024-08-02T18:41:54.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: 0: [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] mon.a 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: 1: [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] mon.c 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: 2: [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] mon.b 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: fsmap 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: osdmap e4: 0 total, 0 up, 0 in 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: mgrmap e13: x(active, since 47s) 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: overall HEALTH_OK 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: Reconfiguring mon.a (unknown last config time)... 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:54.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:53 smithi151 ceph-mon[37155]: Reconfiguring daemon mon.a on smithi103 2024-08-02T18:41:54.121 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.572+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3876663605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f8100310 msgr2=0x7ff0f8100710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.572+0000 7ff0fe47a640 1 --2- 172.21.15.151:0/3876663605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f8100310 0x7ff0f8100710 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8009880 tx=0x7ff0e802a5d0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.572+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3876663605 shutdown_connections 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.572+0000 7ff0fe47a640 1 --2- 172.21.15.151:0/3876663605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f8100310 0x7ff0f8100710 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.572+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3876663605 >> 172.21.15.151:0/3876663605 conn(0x7ff0f80fbae0 msgr2=0x7ff0f80fdf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.572+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3876663605 shutdown_connections 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.572+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3876663605 wait complete. 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0fe47a640 1 Processor -- start 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0fe47a640 1 -- start start 2024-08-02T18:41:54.585 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0fe47a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0f8100310 0x7ff0f8196dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0fe47a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f8197310 0x7ff0f819c380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0fe47a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f8197790 0x7ff0f819e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0fe47a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f8106530 con 0x7ff0f8197790 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0fe47a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f81063b0 con 0x7ff0f8100310 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0fe47a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff0f81066b0 con 0x7ff0f8197310 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0f77fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f8197310 0x7ff0f819c380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0f77fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f8197310 0x7ff0f819c380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:34348/0 (socket says 172.21.15.151:34348) 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0f77fe640 1 -- 172.21.15.151:0/3692189066 learned_addr learned my addr 172.21.15.151:0/3692189066 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.573+0000 7ff0f7fff640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0f8100310 0x7ff0f8196dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f77fe640 1 -- 172.21.15.151:0/3692189066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0f8100310 msgr2=0x7ff0f8196dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f77fe640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0f8100310 0x7ff0f8196dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.586 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f77fe640 1 -- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f8197790 msgr2=0x7ff0f819e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f77fe640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f8197790 0x7ff0f819e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f77fe640 1 -- 172.21.15.151:0/3692189066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0f819f1d0 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f77fe640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f8197310 0x7ff0f819c380 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00b520 tx=0x7ff0ec00b9e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f57fa640 1 -- 172.21.15.151:0/3692189066 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec004230 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f57fa640 1 -- 172.21.15.151:0/3692189066 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0ec0043d0 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0f819f4c0 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0f57fa640 1 -- 172.21.15.151:0/3692189066 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec003e00 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.574+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0f819fa80 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.575+0000 7ff0f57fa640 1 -- 172.21.15.151:0/3692189066 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7ff0ec00e070 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.575+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff0f8190640 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.575+0000 7ff0f57fa640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0e00394f0 0x7ff0e003b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.575+0000 7ff0f57fa640 1 -- 172.21.15.151:0/3692189066 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7ff0ec04ba50 con 0x7ff0f8197310 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.576+0000 7ff0f7fff640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0e00394f0 0x7ff0e003b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:41:54.587 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.576+0000 7ff0f7fff640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0e00394f0 0x7ff0e003b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8000c00 tx=0x7ff0e8031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:41:54.588 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.580+0000 7ff0f57fa640 1 -- 172.21.15.151:0/3692189066 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff0ec014020 con 0x7ff0f8197310 2024-08-02T18:41:54.763 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.761+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi121=y;smithi151=z", "target": ["mon-mgr", ""]}) -- 0x7ff0f80623f0 con 0x7ff0e00394f0 2024-08-02T18:41:54.763 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:54.767 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.766+0000 7ff0f57fa640 1 -- 172.21.15.151:0/3692189066 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7ff0f80623f0 con 0x7ff0e00394f0 2024-08-02T18:41:54.767 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mgr update... 2024-08-02T18:41:54.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.768+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0e00394f0 msgr2=0x7ff0e003b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:54.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.768+0000 7ff0fe47a640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0e00394f0 0x7ff0e003b9b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7ff0e8000c00 tx=0x7ff0e8031640 comp rx=0 tx=0).stop 2024-08-02T18:41:54.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.768+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f8197310 msgr2=0x7ff0f819c380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:41:54.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.768+0000 7ff0fe47a640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f8197310 0x7ff0f819c380 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec00b520 tx=0x7ff0ec00b9e0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.769+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 shutdown_connections 2024-08-02T18:41:54.770 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.769+0000 7ff0fe47a640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0f8197790 0x7ff0f819e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.769+0000 7ff0fe47a640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0e00394f0 0x7ff0e003b9b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.769+0000 7ff0fe47a640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0f8197310 0x7ff0f819c380 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.769+0000 7ff0fe47a640 1 --2- 172.21.15.151:0/3692189066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0f8100310 0x7ff0f8196dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:41:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.769+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 >> 172.21.15.151:0/3692189066 conn(0x7ff0f80fbae0 msgr2=0x7ff0f8069e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:41:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.769+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 shutdown_connections 2024-08-02T18:41:54.771 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:41:54.769+0000 7ff0fe47a640 1 -- 172.21.15.151:0/3692189066 wait complete. 2024-08-02T18:41:55.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:55.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:41:55.308 DEBUG:teuthology.orchestra.run.smithi121:mgr.y> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.y.service 2024-08-02T18:41:55.310 DEBUG:teuthology.orchestra.run.smithi151:mgr.z> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.z.service 2024-08-02T18:41:55.313 INFO:tasks.cephadm:Deploying OSDs... 2024-08-02T18:41:55.313 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:41:55.313 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/scratch_devs of=/dev/stdout 2024-08-02T18:41:55.333 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-02T18:41:55.333 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_1 2024-08-02T18:41:55.391 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-02T18:41:55.391 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:55.391 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-02T18:41:55.391 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:55.391 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:55.392 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-02 18:41:15.664495287 +0000 2024-08-02T18:41:55.392 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-02 18:36:17.558014660 +0000 2024-08-02T18:41:55.392 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-02 18:36:17.558014660 +0000 2024-08-02T18:41:55.392 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-02 18:36:17.558014660 +0000 2024-08-02T18:41:55.392 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-02T18:41:55.458 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-08-02T18:41:55.459 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-08-02T18:41:55.459 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000227079 s, 2.3 MB/s 2024-08-02T18:41:55.460 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-02T18:41:55.519 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_2 2024-08-02T18:41:55.576 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-02T18:41:55.577 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:55.577 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-08-02T18:41:55.577 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:55.577 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:55.577 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-02 18:41:15.700494617 +0000 2024-08-02T18:41:55.577 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-02 18:36:17.886008521 +0000 2024-08-02T18:41:55.577 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-02 18:36:17.886008521 +0000 2024-08-02T18:41:55.577 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-02 18:36:17.886008521 +0000 2024-08-02T18:41:55.577 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-02T18:41:55.644 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-08-02T18:41:55.644 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-08-02T18:41:55.645 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000236657 s, 2.2 MB/s 2024-08-02T18:41:55.646 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-02T18:41:55.704 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_3 2024-08-02T18:41:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-02T18:41:55.761 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:55.761 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 703 Links: 1 2024-08-02T18:41:55.762 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:55.762 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:55.762 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-02 18:41:15.737493929 +0000 2024-08-02T18:41:55.762 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-02 18:36:18.209002475 +0000 2024-08-02T18:41:55.762 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-02 18:36:18.209002475 +0000 2024-08-02T18:41:55.762 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-02 18:36:18.209002475 +0000 2024-08-02T18:41:55.762 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-02T18:41:55.828 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-08-02T18:41:55.828 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-08-02T18:41:55.828 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000233017 s, 2.2 MB/s 2024-08-02T18:41:55.829 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-02T18:41:55.887 DEBUG:teuthology.orchestra.run.smithi103:> stat /dev/vg_nvme/lv_4 2024-08-02T18:41:55.943 INFO:teuthology.orchestra.run.smithi103.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-02T18:41:55.943 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:55.943 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-08-02T18:41:55.943 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:55.943 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:55.944 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-02 18:41:15.770493315 +0000 2024-08-02T18:41:55.944 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-02 18:36:18.532996410 +0000 2024-08-02T18:41:55.944 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-02 18:36:18.532996410 +0000 2024-08-02T18:41:55.944 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-02 18:36:18.532996410 +0000 2024-08-02T18:41:55.944 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-02T18:41:56.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: Reconfiguring mon.b (monmap changed)... 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: Reconfiguring daemon mon.b on smithi121 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi121=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: Saving service mgr spec with placement smithi103=x;smithi121=y;smithi151=z;count:3 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:56.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.005 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: Reconfiguring mon.b (monmap changed)... 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: Reconfiguring daemon mon.b on smithi121 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi121=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: Saving service mgr spec with placement smithi103=x;smithi121=y;smithi151=z;count:3 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:56.006 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.007 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records in 2024-08-02T18:41:56.008 INFO:teuthology.orchestra.run.smithi103.stderr:1+0 records out 2024-08-02T18:41:56.008 INFO:teuthology.orchestra.run.smithi103.stderr:512 bytes copied, 0.000199282 s, 2.6 MB/s 2024-08-02T18:41:56.009 DEBUG:teuthology.orchestra.run.smithi103:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-02T18:41:56.065 DEBUG:teuthology.orchestra.run.smithi121:> set -ex 2024-08-02T18:41:56.066 DEBUG:teuthology.orchestra.run.smithi121:> dd if=/scratch_devs of=/dev/stdout 2024-08-02T18:41:56.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: Reconfiguring mon.b (monmap changed)... 2024-08-02T18:41:56.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:56.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:56.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:56.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: Reconfiguring daemon mon.b on smithi121 2024-08-02T18:41:56.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: from='client.24103 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "3;smithi103=x;smithi121=y;smithi151=z", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:41:56.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: Saving service mgr spec with placement smithi103=x;smithi121=y;smithi151=z;count:3 2024-08-02T18:41:56.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:56.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:56.082 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-02T18:41:56.082 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_1 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 664 Links: 1 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-02 18:41:45.530249348 +0000 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-02 18:36:34.095999563 +0000 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-02 18:36:34.095999563 +0000 2024-08-02T18:41:56.138 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-02 18:36:34.095999563 +0000 2024-08-02T18:41:56.139 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-02T18:41:56.201 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-02T18:41:56.201 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-02T18:41:56.201 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000208428 s, 2.5 MB/s 2024-08-02T18:41:56.203 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-02T18:41:56.259 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_2 2024-08-02T18:41:56.313 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-02T18:41:56.313 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:56.314 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-08-02T18:41:56.314 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:56.314 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:56.314 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-02 18:41:45.530249348 +0000 2024-08-02T18:41:56.314 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-02 18:36:34.423995122 +0000 2024-08-02T18:41:56.314 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-02 18:36:34.423995122 +0000 2024-08-02T18:41:56.314 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-02 18:36:34.423995122 +0000 2024-08-02T18:41:56.314 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-02T18:41:56.376 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-02T18:41:56.376 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-02T18:41:56.376 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000200655 s, 2.6 MB/s 2024-08-02T18:41:56.377 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-02T18:41:56.432 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_3 2024-08-02T18:41:56.487 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-02T18:41:56.487 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:56.487 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-08-02T18:41:56.488 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:56.488 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:56.488 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-02 18:41:45.531249335 +0000 2024-08-02T18:41:56.488 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-02 18:36:34.775990354 +0000 2024-08-02T18:41:56.488 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-02 18:36:34.775990354 +0000 2024-08-02T18:41:56.488 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-02 18:36:34.775990354 +0000 2024-08-02T18:41:56.488 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-02T18:41:56.549 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-02T18:41:56.549 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-02T18:41:56.550 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000313764 s, 1.6 MB/s 2024-08-02T18:41:56.551 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-02T18:41:56.607 DEBUG:teuthology.orchestra.run.smithi121:> stat /dev/vg_nvme/lv_4 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout:Access: 2024-08-02 18:41:45.531249335 +0000 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout:Modify: 2024-08-02 18:36:35.108985844 +0000 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout:Change: 2024-08-02 18:36:35.108985844 +0000 2024-08-02T18:41:56.662 INFO:teuthology.orchestra.run.smithi121.stdout: Birth: 2024-08-02 18:36:35.108985844 +0000 2024-08-02T18:41:56.662 DEBUG:teuthology.orchestra.run.smithi121:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-02T18:41:56.727 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records in 2024-08-02T18:41:56.727 INFO:teuthology.orchestra.run.smithi121.stderr:1+0 records out 2024-08-02T18:41:56.727 INFO:teuthology.orchestra.run.smithi121.stderr:512 bytes copied, 0.000169164 s, 3.0 MB/s 2024-08-02T18:41:56.728 DEBUG:teuthology.orchestra.run.smithi121:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-02T18:41:56.789 DEBUG:teuthology.orchestra.run.smithi151:> set -ex 2024-08-02T18:41:56.931 DEBUG:teuthology.orchestra.run.smithi151:> dd if=/scratch_devs of=/dev/stdout 2024-08-02T18:41:56.948 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-08-02T18:41:56.948 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_1 2024-08-02T18:41:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:56 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:56 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:56 smithi121 ceph-mon[37236]: Reconfiguring mon.c (monmap changed)... 2024-08-02T18:41:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:56 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:56 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:56 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:56 smithi121 ceph-mon[37236]: Reconfiguring daemon mon.c on smithi151 2024-08-02T18:41:57.004 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-08-02T18:41:57.004 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:57.004 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-08-02T18:41:57.004 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:57.004 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:57.004 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-08-02 18:41:36.427331621 +0000 2024-08-02T18:41:57.004 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-08-02 18:36:44.274583801 +0000 2024-08-02T18:41:57.005 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-08-02 18:36:44.274583801 +0000 2024-08-02T18:41:57.005 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-08-02 18:36:44.274583801 +0000 2024-08-02T18:41:57.005 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-08-02T18:41:57.067 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-08-02T18:41:57.068 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-08-02T18:41:57.068 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000271344 s, 1.9 MB/s 2024-08-02T18:41:57.069 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-08-02T18:41:57.126 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_2 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 683 Links: 1 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-08-02 18:41:36.427331621 +0000 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-08-02 18:36:44.602579940 +0000 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-08-02 18:36:44.602579940 +0000 2024-08-02T18:41:57.181 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-08-02 18:36:44.602579940 +0000 2024-08-02T18:41:57.182 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-08-02T18:41:57.242 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:56 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:57.242 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:56 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:57.242 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:56 smithi151 ceph-mon[37155]: Reconfiguring mon.c (monmap changed)... 2024-08-02T18:41:57.243 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:56 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:57.243 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:56 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:57.243 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:56 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:57.243 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:56 smithi151 ceph-mon[37155]: Reconfiguring daemon mon.c on smithi151 2024-08-02T18:41:57.244 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-08-02T18:41:57.244 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-08-02T18:41:57.244 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000209968 s, 2.4 MB/s 2024-08-02T18:41:57.245 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-08-02T18:41:57.301 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_3 2024-08-02T18:41:57.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:56 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:57.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:56 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:57.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:56 smithi103 ceph-mon[32753]: Reconfiguring mon.c (monmap changed)... 2024-08-02T18:41:57.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:56 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-08-02T18:41:57.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:56 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-08-02T18:41:57.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:56 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:57.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:56 smithi103 ceph-mon[32753]: Reconfiguring daemon mon.c on smithi151 2024-08-02T18:41:57.357 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-08-02T18:41:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:57.359 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 701 Links: 1 2024-08-02T18:41:57.359 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:57.359 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:57.359 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-08-02 18:41:36.427331621 +0000 2024-08-02T18:41:57.359 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-08-02 18:36:44.945575903 +0000 2024-08-02T18:41:57.359 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-08-02 18:36:44.945575903 +0000 2024-08-02T18:41:57.359 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-08-02 18:36:44.945575903 +0000 2024-08-02T18:41:57.359 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-08-02T18:41:57.418 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-08-02T18:41:57.419 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-08-02T18:41:57.419 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000202373 s, 2.5 MB/s 2024-08-02T18:41:57.420 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-08-02T18:41:57.476 DEBUG:teuthology.orchestra.run.smithi151:> stat /dev/vg_nvme/lv_4 2024-08-02T18:41:57.531 INFO:teuthology.orchestra.run.smithi151.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-08-02T18:41:57.531 INFO:teuthology.orchestra.run.smithi151.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-08-02T18:41:57.531 INFO:teuthology.orchestra.run.smithi151.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-08-02T18:41:57.531 INFO:teuthology.orchestra.run.smithi151.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:41:57.531 INFO:teuthology.orchestra.run.smithi151.stdout:Context: system_u:object_r:device_t:s0 2024-08-02T18:41:57.531 INFO:teuthology.orchestra.run.smithi151.stdout:Access: 2024-08-02 18:41:36.428331609 +0000 2024-08-02T18:41:57.531 INFO:teuthology.orchestra.run.smithi151.stdout:Modify: 2024-08-02 18:36:45.265572135 +0000 2024-08-02T18:41:57.531 INFO:teuthology.orchestra.run.smithi151.stdout:Change: 2024-08-02 18:36:45.265572135 +0000 2024-08-02T18:41:57.532 INFO:teuthology.orchestra.run.smithi151.stdout: Birth: 2024-08-02 18:36:45.265572135 +0000 2024-08-02T18:41:57.532 DEBUG:teuthology.orchestra.run.smithi151:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-08-02T18:41:57.596 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records in 2024-08-02T18:41:57.596 INFO:teuthology.orchestra.run.smithi151.stderr:1+0 records out 2024-08-02T18:41:57.596 INFO:teuthology.orchestra.run.smithi151.stderr:512 bytes copied, 0.000184236 s, 2.8 MB/s 2024-08-02T18:41:57.597 DEBUG:teuthology.orchestra.run.smithi151:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-08-02T18:41:57.654 INFO:tasks.cephadm:Deploying osd.0 on smithi103 with /dev/vg_nvme/lv_4... 2024-08-02T18:41:57.654 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-02T18:41:57.911 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:41:58.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:58.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:58.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:41:58 smithi103 ceph-mon[32753]: Deploying daemon mgr.z on smithi151 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:41:58.590 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:58.591 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:41:58 smithi151 ceph-mon[37155]: Deploying daemon mgr.z on smithi151 2024-08-02T18:41:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:41:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:41:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:41:58.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:41:58.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:41:58.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.z", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-02T18:41:58.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:41:58.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:41:58.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:41:58 smithi121 ceph-mon[37236]: Deploying daemon mgr.z on smithi151 2024-08-02T18:41:59.571 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:41:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:41:59.478+0000 7f116455e040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-02T18:41:59.932 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:41:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:41:59.627+0000 7f116455e040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:41:59.932 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:41:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:41:59.693+0000 7f116455e040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-02T18:41:59.932 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:41:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:41:59.929+0000 7f116455e040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-02T18:42:00.226 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:42:00.250 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_4 2024-08-02T18:42:00.320 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:41:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:41:59.987+0000 7f116455e040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-02T18:42:00.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:00 smithi121 ceph-mon[37236]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:00.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.423 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:42:00.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-02T18:42:00.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:42:00.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:00.500 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:42:00.622 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:00 smithi103 ceph-mon[32753]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:00.622 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.622 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.622 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.622 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:42:00.622 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-02T18:42:00.623 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:42:00.623 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-mon[37155]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:00.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:42:00.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-08-02T18:42:00.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:42:00.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:00.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 -- 172.21.15.103:0/67687182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150104cc0 msgr2=0x7f31501070b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:00.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 --2- 172.21.15.103:0/67687182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150104cc0 0x7f31501070b0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f3138009900 tx=0x7f313802a410 comp rx=0 tx=0).stop 2024-08-02T18:42:00.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 -- 172.21.15.103:0/67687182 shutdown_connections 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 --2- 172.21.15.103:0/67687182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31501075f0 0x7f3150109a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 --2- 172.21.15.103:0/67687182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150104cc0 0x7f31501070b0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 --2- 172.21.15.103:0/67687182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3150102390 0x7f3150104780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 -- 172.21.15.103:0/67687182 >> 172.21.15.103:0/67687182 conn(0x7f31500fbfb0 msgr2=0x7f31500fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 -- 172.21.15.103:0/67687182 shutdown_connections 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 -- 172.21.15.103:0/67687182 wait complete. 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 Processor -- start 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.932+0000 7f31552db640 1 -- start start 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f31552db640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150102390 0x7f3150199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:00.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f31552db640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3150104cc0 0x7f315019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f31552db640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31501075f0 0x7f31501a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f31552db640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f315010d720 con 0x7f3150102390 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f31552db640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f315010d5a0 con 0x7f3150104cc0 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f31552db640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f315010d8a0 con 0x7f31501075f0 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150102390 0x7f3150199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150102390 0x7f3150199fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44754/0 (socket says 172.21.15.103:44754) 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 -- 172.21.15.103:0/923314728 learned_addr learned my addr 172.21.15.103:0/923314728 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314f7fe640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31501075f0 0x7f31501a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314e7fc640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3150104cc0 0x7f315019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:00.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 -- 172.21.15.103:0/923314728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31501075f0 msgr2=0x7f31501a1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31501075f0 0x7f31501a1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 -- 172.21.15.103:0/923314728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3150104cc0 msgr2=0x7f315019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3150104cc0 0x7f315019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 -- 172.21.15.103:0/923314728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31501a1c00 con 0x7f3150102390 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314f7fe640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31501075f0 0x7f31501a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314e7fc640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3150104cc0 0x7f315019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f314effd640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150102390 0x7f3150199fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f314800b4a0 tx=0x7f314800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148014070 con 0x7f3150102390 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3148010b10 con 0x7f3150102390 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31501a1ef0 con 0x7f3150102390 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3148017d60 con 0x7f3150102390 2024-08-02T18:42:00.940 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.933+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31501a2370 con 0x7f3150102390 2024-08-02T18:42:00.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.934+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 13) ==== 46344+0+0 (secure 0 0 0) 0x7f3148017070 con 0x7f3150102390 2024-08-02T18:42:00.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.934+0000 7f3147fff640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f313c0392c0 0x7f313c03b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:00.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.934+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 1155+0+0 (secure 0 0 0) 0x7f314804c830 con 0x7f3150102390 2024-08-02T18:42:00.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.934+0000 7f314e7fc640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f313c0392c0 0x7f313c03b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:00.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.935+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3150109120 con 0x7f3150102390 2024-08-02T18:42:00.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.935+0000 7f314e7fc640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f313c0392c0 0x7f313c03b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3138006010 tx=0x7f3138005be0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:42:00.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:00.939+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3148020300 con 0x7f3150102390 2024-08-02T18:42:01.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:01.115+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f3150062360 con 0x7f313c0392c0 2024-08-02T18:42:01.303 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:00 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:00.921+0000 7f116455e040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-02T18:42:01.303 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:01.035+0000 7f116455e040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-02T18:42:01.303 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:01.090+0000 7f116455e040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-02T18:42:01.303 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:01.299+0000 7f116455e040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-02T18:42:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:01 smithi121 ceph-mon[37236]: Deploying daemon mgr.y on smithi121 2024-08-02T18:42:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:01 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:01 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:01 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:01.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-mon[37155]: Deploying daemon mgr.y on smithi121 2024-08-02T18:42:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:01.572 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:01.361+0000 7f116455e040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-02T18:42:01.572 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:01.427+0000 7f116455e040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-02T18:42:01.616 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:01 smithi103 ceph-mon[32753]: Deploying daemon mgr.y on smithi121 2024-08-02T18:42:01.616 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:01 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:01.616 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:01 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:01.616 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:01 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:01.979 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:01.570+0000 7f116455e040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:42:02.290 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:01.977+0000 7f116455e040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-02T18:42:02.290 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:02.288+0000 7f116455e040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-02T18:42:02.386 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-mon[37236]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:02.386 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-mon[37236]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:02.386 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.386 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.386 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.387 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-mon[37155]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:02.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-mon[37155]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:02.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.571 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:02.355+0000 7f116455e040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-02T18:42:02.571 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:02.512+0000 7f116455e040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-02T18:42:02.651 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:02 smithi103 ceph-mon[32753]: from='client.14220 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:02.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:02 smithi103 ceph-mon[32753]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:02.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:02.713 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:02.455+0000 7f1eb92ab040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-02T18:42:02.713 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:02.711+0000 7f1eb92ab040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-02T18:42:02.986 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:02.787+0000 7f1eb92ab040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-02T18:42:03.118 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:02.858+0000 7f116455e040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-02T18:42:03.118 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:02.919+0000 7f116455e040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-02T18:42:03.429 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:03 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:03.429 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:03.116+0000 7f116455e040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-02T18:42:03.429 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:03.268+0000 7f116455e040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-02T18:42:03.429 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:03.332+0000 7f116455e040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-02T18:42:03.429 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:03.427+0000 7f116455e040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-02T18:42:03.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:03 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:03.654 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:03 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:03.820 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:03.488+0000 7f116455e040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-02T18:42:03.959 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:03.778+0000 7f1eb92ab040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-02T18:42:03.960 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:03.899+0000 7f1eb92ab040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-02T18:42:03.960 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:03.958+0000 7f1eb92ab040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-02T18:42:04.240 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:04.177+0000 7f1eb92ab040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-02T18:42:04.320 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:04.022+0000 7f116455e040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-02T18:42:04.321 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:42:04.178+0000 7f116455e040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-02T18:42:04.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:04.482+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 14) ==== 92061+0+0 (secure 0 0 0) 0x7f3148010cc0 con 0x7f3150102390 2024-08-02T18:42:04.501 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:04.239+0000 7f1eb92ab040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-02T18:42:04.501 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:04.306+0000 7f1eb92ab040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-02T18:42:04.501 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:04.455+0000 7f1eb92ab040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:42:04.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:04.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3807063262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]': finished 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: osdmap e5: 1 total, 0 up, 1 in 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1421572179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:04.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: Standby manager daemon z started 2024-08-02T18:42:04.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-02T18:42:04.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:42:04.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-02T18:42:04.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:42:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3807063262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]: dispatch 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]: dispatch 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]': finished 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: osdmap e5: 1 total, 0 up, 1 in 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:42:04.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:04.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1421572179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:04.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: Standby manager daemon z started 2024-08-02T18:42:04.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-02T18:42:04.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:42:04.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-02T18:42:04.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:04 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:42:04.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:04.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3807063262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]: dispatch 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]: dispatch 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9478879a-fb16-4c8a-922d-e555bf3f7ff0"}]': finished 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: osdmap e5: 1 total, 0 up, 1 in 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-08-02T18:42:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:04.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1421572179' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:04.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: Standby manager daemon z started 2024-08-02T18:42:04.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-02T18:42:04.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:42:04.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-02T18:42:04.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:04 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.151:0/1051782402' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:42:05.189 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:04.875+0000 7f1eb92ab040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-02T18:42:05.484 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:05.186+0000 7f1eb92ab040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-02T18:42:05.484 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:05.252+0000 7f1eb92ab040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-02T18:42:05.484 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:05.400+0000 7f1eb92ab040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-02T18:42:05.751 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:05.709+0000 7f1eb92ab040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-02T18:42:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-mon[37236]: Reconfiguring mgr.x (unknown last config time)... 2024-08-02T18:42:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-mon[37236]: Reconfiguring daemon mgr.x on smithi103 2024-08-02T18:42:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-mon[37236]: mgrmap e14: x(active, since 59s), standbys: z 2024-08-02T18:42:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-02T18:42:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:05.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:05 smithi151 ceph-mon[37155]: Reconfiguring mgr.x (unknown last config time)... 2024-08-02T18:42:05.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:05 smithi151 ceph-mon[37155]: Reconfiguring daemon mgr.x on smithi103 2024-08-02T18:42:05.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:05 smithi151 ceph-mon[37155]: mgrmap e14: x(active, since 59s), standbys: z 2024-08-02T18:42:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-02T18:42:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:05 smithi103 ceph-mon[32753]: Reconfiguring mgr.x (unknown last config time)... 2024-08-02T18:42:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:05 smithi103 ceph-mon[32753]: Reconfiguring daemon mgr.x on smithi103 2024-08-02T18:42:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:05 smithi103 ceph-mon[32753]: mgrmap e14: x(active, since 59s), standbys: z 2024-08-02T18:42:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-02T18:42:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:06.102 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:05.770+0000 7f1eb92ab040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-02T18:42:06.103 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:05.954+0000 7f1eb92ab040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-02T18:42:06.103 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:06.099+0000 7f1eb92ab040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-02T18:42:06.486 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:06.163+0000 7f1eb92ab040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-02T18:42:06.486 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:06.245+0000 7f1eb92ab040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-02T18:42:06.486 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:06.304+0000 7f1eb92ab040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-02T18:42:06.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:06 smithi121 ceph-mon[37236]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:06 smithi151 ceph-mon[37155]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:06 smithi103 ceph-mon[32753]: pgmap v25: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:07.251 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:06.835+0000 7f1eb92ab040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-02T18:42:07.251 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:42:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:42:06.992+0000 7f1eb92ab040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-02T18:42:07.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:07.494+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f314800d300 con 0x7f3150102390 2024-08-02T18:42:07.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:07 smithi103 ceph-mon[32753]: Standby manager daemon y started 2024-08-02T18:42:07.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:07 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-02T18:42:07.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:07 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:42:07.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:07 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-02T18:42:07.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:07 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:42:07.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:07 smithi121 ceph-mon[37236]: Standby manager daemon y started 2024-08-02T18:42:07.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:07 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-02T18:42:07.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:07 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:42:07.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:07 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-02T18:42:07.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:07 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:42:07.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:07 smithi151 ceph-mon[37155]: Standby manager daemon y started 2024-08-02T18:42:07.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:07 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-02T18:42:07.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:07 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:42:07.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:07 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-02T18:42:07.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:07 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.121:0/2607623834' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:42:08.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:08 smithi103 ceph-mon[32753]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:08.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:08 smithi103 ceph-mon[32753]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-08-02T18:42:08.691 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-02T18:42:08.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:08 smithi121 ceph-mon[37236]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:08 smithi121 ceph-mon[37236]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-08-02T18:42:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-02T18:42:08.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:08 smithi151 ceph-mon[37155]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:08.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:08 smithi151 ceph-mon[37155]: mgrmap e15: x(active, since 62s), standbys: z, y 2024-08-02T18:42:08.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-02T18:42:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:09 smithi121 ceph-mon[37236]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:09 smithi151 ceph-mon[37155]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:09.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:09 smithi103 ceph-mon[32753]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:10.879 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:10.879 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:10.880 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:10.880 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:10.880 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:10.880 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:11.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:11.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:11.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:11.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:11.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:11.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:11.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:11.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:11.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:11.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:11.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:11.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:12.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:11 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-02T18:42:12.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:11 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:12.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:11 smithi121 ceph-mon[37236]: Deploying daemon osd.0 on smithi103 2024-08-02T18:42:12.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:11 smithi121 ceph-mon[37236]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:12.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:11 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-02T18:42:12.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:11 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:12.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:11 smithi151 ceph-mon[37155]: Deploying daemon osd.0 on smithi103 2024-08-02T18:42:12.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:11 smithi151 ceph-mon[37155]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:12.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:11 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-08-02T18:42:12.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:11 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:12.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:11 smithi103 ceph-mon[32753]: Deploying daemon osd.0 on smithi103 2024-08-02T18:42:12.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:11 smithi103 ceph-mon[32753]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:14.424 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:14 smithi103 ceph-mon[32753]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:14.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:14 smithi121 ceph-mon[37236]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:14.774 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:14 smithi151 ceph-mon[37155]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:16.366 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:16 smithi103 ceph-mon[32753]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:16.366 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:16 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:16.366 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:16 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:16.367 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:16 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:16 smithi121 ceph-mon[37236]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:16 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:16 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:16 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:16.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:16 smithi151 ceph-mon[37155]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:16.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:16 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:16.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:16 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:16.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:16 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:18.714 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:18 smithi103 ceph-mon[32753]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:18.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:18 smithi121 ceph-mon[37236]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:18.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.750+0000 7f3147fff640 1 -- 172.21.15.103:0/923314728 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f3150062360 con 0x7f313c0392c0 2024-08-02T18:42:18.755 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 0 on host 'smithi103' 2024-08-02T18:42:18.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f313c0392c0 msgr2=0x7f313c03b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f313c0392c0 0x7f313c03b780 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f3138006010 tx=0x7f3138005be0 comp rx=0 tx=0).stop 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150102390 msgr2=0x7f3150199fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150102390 0x7f3150199fd0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f314800b4a0 tx=0x7f314800b960 comp rx=0 tx=0).stop 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 shutdown_connections 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f313c0392c0 0x7f313c03b780 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31501075f0 0x7f31501a1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3150104cc0 0x7f315019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 --2- 172.21.15.103:0/923314728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3150102390 0x7f3150199fd0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.752+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 >> 172.21.15.103:0/923314728 conn(0x7f31500fbfb0 msgr2=0x7f3150101a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.753+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 shutdown_connections 2024-08-02T18:42:18.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:42:18.753+0000 7f31552db640 1 -- 172.21.15.103:0/923314728 wait complete. 2024-08-02T18:42:18.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:18 smithi151 ceph-mon[37155]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:19.364 DEBUG:teuthology.orchestra.run.smithi103:osd.0> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.0.service 2024-08-02T18:42:19.366 INFO:tasks.cephadm:Deploying osd.1 on smithi121 with /dev/vg_nvme/lv_4... 2024-08-02T18:42:19.367 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-02T18:42:19.623 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T18:42:19.638 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:42:19 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0[46741]: 2024-08-02T18:42:19.594+0000 7f5337f6f640 -1 osd.0 0 log_to_monitors true 2024-08-02T18:42:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:19 smithi121 ceph-mon[37236]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:19 smithi121 ceph-mon[37236]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-02T18:42:20.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:19 smithi151 ceph-mon[37155]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:20.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:19 smithi151 ceph-mon[37155]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-02T18:42:20.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:20.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:19 smithi103 ceph-mon[32753]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:20.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:19 smithi103 ceph-mon[32753]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-08-02T18:42:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:21 smithi121 ceph-mon[37236]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-02T18:42:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:21 smithi121 ceph-mon[37236]: osdmap e6: 1 total, 0 up, 1 in 2024-08-02T18:42:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:21 smithi121 ceph-mon[37236]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:42:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:21.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:21 smithi151 ceph-mon[37155]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-02T18:42:21.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:21 smithi151 ceph-mon[37155]: osdmap e6: 1 total, 0 up, 1 in 2024-08-02T18:42:21.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:21 smithi151 ceph-mon[37155]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:42:21.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:21.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:21 smithi103 ceph-mon[32753]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-08-02T18:42:21.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:21 smithi103 ceph-mon[32753]: osdmap e6: 1 total, 0 up, 1 in 2024-08-02T18:42:21.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:21 smithi103 ceph-mon[32753]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:42:21.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:22.049 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:42:22.055 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:42:21 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0[46741]: 2024-08-02T18:42:21.778+0000 7f5334706640 -1 osd.0 0 waiting for initial osdmap 2024-08-02T18:42:22.055 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:42:21 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0[46741]: 2024-08-02T18:42:21.785+0000 7f532bd12640 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:42:22.084 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_4 2024-08-02T18:42:22.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:22 smithi151 ceph-mon[37155]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:42:22.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:22 smithi151 ceph-mon[37155]: osdmap e7: 1 total, 0 up, 1 in 2024-08-02T18:42:22.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:22 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:22.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:22 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:22.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:22 smithi151 ceph-mon[37155]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:22.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:22 smithi151 ceph-mon[37155]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' 2024-08-02T18:42:22.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:22 smithi103 ceph-mon[32753]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:42:22.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:22 smithi103 ceph-mon[32753]: osdmap e7: 1 total, 0 up, 1 in 2024-08-02T18:42:22.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:22.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:22.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:22 smithi103 ceph-mon[32753]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:22.324 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:22 smithi103 ceph-mon[32753]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' 2024-08-02T18:42:22.339 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T18:42:22.464 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:22 smithi121 ceph-mon[37236]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:42:22.464 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:22 smithi121 ceph-mon[37236]: osdmap e7: 1 total, 0 up, 1 in 2024-08-02T18:42:22.465 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:22 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:22.465 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:22 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:22.465 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:22 smithi121 ceph-mon[37236]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-08-02T18:42:22.465 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:22 smithi121 ceph-mon[37236]: from='osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835]' entity='osd.0' 2024-08-02T18:42:22.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 -- 172.21.15.121:0/2327457948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4101a20 msgr2=0x7f8be4101ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:22.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 --2- 172.21.15.121:0/2327457948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4101a20 0x7f8be4101ea0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4009ca0 tx=0x7f8bd402a8c0 comp rx=0 tx=0).stop 2024-08-02T18:42:22.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 -- 172.21.15.121:0/2327457948 shutdown_connections 2024-08-02T18:42:22.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 --2- 172.21.15.121:0/2327457948 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be41023e0 0x7f8be4108c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:22.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 --2- 172.21.15.121:0/2327457948 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be4101a20 0x7f8be4101ea0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:22.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 --2- 172.21.15.121:0/2327457948 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be4100820 0x7f8be4100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:22.826 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 -- 172.21.15.121:0/2327457948 >> 172.21.15.121:0/2327457948 conn(0x7f8be40fbfb0 msgr2=0x7f8be40fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 -- 172.21.15.121:0/2327457948 shutdown_connections 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.822+0000 7f8beaf36640 1 -- 172.21.15.121:0/2327457948 wait complete. 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8beaf36640 1 Processor -- start 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8beaf36640 1 -- start start 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8beaf36640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be4100820 0x7f8be41047b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8beaf36640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be4101a20 0x7f8be4102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8beaf36640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be41023e0 0x7f8be4103340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8beaf36640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8be410c5e0 con 0x7f8be4101a20 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8beaf36640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8be410c460 con 0x7f8be41023e0 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8beaf36640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8be410c760 con 0x7f8be4100820 2024-08-02T18:42:22.827 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be94d3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be41023e0 0x7f8be4103340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be4101a20 0x7f8be4102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be4101a20 0x7f8be4102e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.121:55474/0 (socket says 172.21.15.121:55474) 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be3fff640 1 -- 172.21.15.121:0/392388750 learned_addr learned my addr 172.21.15.121:0/392388750 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be94d3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be41023e0 0x7f8be4103340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:47024/0 (socket says 172.21.15.121:47024) 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be8cd2640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be4100820 0x7f8be41047b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be3fff640 1 -- 172.21.15.121:0/392388750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be4100820 msgr2=0x7f8be41047b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be3fff640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be4100820 0x7f8be41047b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be3fff640 1 -- 172.21.15.121:0/392388750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be41023e0 msgr2=0x7f8be4103340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be3fff640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be41023e0 0x7f8be4103340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be3fff640 1 -- 172.21.15.121:0/392388750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be4103c00 con 0x7f8be4101a20 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.823+0000 7f8be94d3640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be41023e0 0x7f8be4103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.824+0000 7f8be3fff640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be4101a20 0x7f8be4102e00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4006010 tx=0x7f8bd4031ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:42:22.828 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.824+0000 7f8be1ffb640 1 -- 172.21.15.121:0/392388750 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd402fbe0 con 0x7f8be4101a20 2024-08-02T18:42:22.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.824+0000 7f8be1ffb640 1 -- 172.21.15.121:0/392388750 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8bd402fd80 con 0x7f8be4101a20 2024-08-02T18:42:22.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.824+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be41a1e30 con 0x7f8be4101a20 2024-08-02T18:42:22.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.824+0000 7f8be1ffb640 1 -- 172.21.15.121:0/392388750 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd40469e0 con 0x7f8be4101a20 2024-08-02T18:42:22.829 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.824+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be41a2290 con 0x7f8be4101a20 2024-08-02T18:42:22.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.825+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8be41a24c0 con 0x7f8be4101a20 2024-08-02T18:42:22.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.826+0000 7f8be1ffb640 1 -- 172.21.15.121:0/392388750 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f8bd4030ce0 con 0x7f8be4101a20 2024-08-02T18:42:22.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.826+0000 7f8be1ffb640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f8bd00a2af0 0x7f8bd00a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:22.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.827+0000 7f8be1ffb640 1 -- 172.21.15.121:0/392388750 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1767+0+0 (secure 0 0 0) 0x7f8bd40eede0 con 0x7f8be4101a20 2024-08-02T18:42:22.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.827+0000 7f8be8cd2640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f8bd00a2af0 0x7f8bd00a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:22.830 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.827+0000 7f8be8cd2640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f8bd00a2af0 0x7f8bd00a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8be4101880 tx=0x7f8bdc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:42:22.831 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:22.830+0000 7f8be1ffb640 1 -- 172.21.15.121:0/392388750 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8bd40bd710 con 0x7f8be4101a20 2024-08-02T18:42:23.016 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:23.014+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f8be41a2690 con 0x7f8bd00a2af0 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi103 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi103 to 17088M 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] boot 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: osdmap e8: 1 total, 1 up, 1 in 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:23.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:23.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:42:23.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:42:23.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:23.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi103 2024-08-02T18:42:23.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:42:23.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi103 to 17088M 2024-08-02T18:42:23.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:23.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:23.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:23.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] boot 2024-08-02T18:42:23.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: osdmap e8: 1 total, 1 up, 1 in 2024-08-02T18:42:23.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:23.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:23.328 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:23.329 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.329 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:23.329 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:23.329 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:23.420 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:42:23.420 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:42:23.420 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:23.420 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi103 2024-08-02T18:42:23.420 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.420 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi103 to 17088M 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: osd.0 [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] boot 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: osdmap e8: 1 total, 1 up, 1 in 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:23.421 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:23.422 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:23.422 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:23.422 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:24.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:24 smithi151 ceph-mon[37155]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:24.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:24 smithi151 ceph-mon[37155]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:24.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:24 smithi103 ceph-mon[32753]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:24.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:24 smithi103 ceph-mon[32753]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:24.439 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:24 smithi121 ceph-mon[37236]: from='client.14250 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:24.439 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:24 smithi121 ceph-mon[37236]: pgmap v37: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:25.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:25 smithi151 ceph-mon[37155]: osdmap e9: 1 total, 1 up, 1 in 2024-08-02T18:42:25.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:25 smithi103 ceph-mon[32753]: osdmap e9: 1 total, 1 up, 1 in 2024-08-02T18:42:25.406 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:25 smithi121 ceph-mon[37236]: osdmap e9: 1 total, 1 up, 1 in 2024-08-02T18:42:26.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:26 smithi151 ceph-mon[37155]: from='client.? 172.21.15.121:0/949328227' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]: dispatch 2024-08-02T18:42:26.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:26 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]: dispatch 2024-08-02T18:42:26.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:26 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]': finished 2024-08-02T18:42:26.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:26 smithi151 ceph-mon[37155]: osdmap e10: 2 total, 1 up, 2 in 2024-08-02T18:42:26.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:26.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:26 smithi151 ceph-mon[37155]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:26.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:26 smithi151 ceph-mon[37155]: from='client.? 172.21.15.121:0/3986695816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:26.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:26 smithi103 ceph-mon[32753]: from='client.? 172.21.15.121:0/949328227' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]: dispatch 2024-08-02T18:42:26.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:26 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]: dispatch 2024-08-02T18:42:26.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:26 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]': finished 2024-08-02T18:42:26.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:26 smithi103 ceph-mon[32753]: osdmap e10: 2 total, 1 up, 2 in 2024-08-02T18:42:26.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:26.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:26 smithi103 ceph-mon[32753]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:26.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:26 smithi103 ceph-mon[32753]: from='client.? 172.21.15.121:0/3986695816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:26.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:26 smithi121 ceph-mon[37236]: from='client.? 172.21.15.121:0/949328227' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]: dispatch 2024-08-02T18:42:26.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:26 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]: dispatch 2024-08-02T18:42:26.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:26 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "9ba10d16-f7e6-47ca-80f3-cccbfce499fe"}]': finished 2024-08-02T18:42:26.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:26 smithi121 ceph-mon[37236]: osdmap e10: 2 total, 1 up, 2 in 2024-08-02T18:42:26.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:26.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:26 smithi121 ceph-mon[37236]: pgmap v40: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:26.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:26 smithi121 ceph-mon[37236]: from='client.? 172.21.15.121:0/3986695816' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:28.629 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:28 smithi121 ceph-mon[37236]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:28 smithi151 ceph-mon[37155]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:28.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:28 smithi103 ceph-mon[32753]: pgmap v41: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:30.634 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:30 smithi121 ceph-mon[37236]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:30 smithi151 ceph-mon[37155]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:30.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:30 smithi103 ceph-mon[32753]: pgmap v42: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:32.393 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:32 smithi121 ceph-mon[37236]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:32.394 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:32 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-02T18:42:32.394 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:32 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:32 smithi151 ceph-mon[37155]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:32 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-02T18:42:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:32 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:32.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:32 smithi103 ceph-mon[32753]: pgmap v43: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:32.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-08-02T18:42:32.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:33.416 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:33 smithi121 ceph-mon[37236]: Deploying daemon osd.1 on smithi121 2024-08-02T18:42:33.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:33 smithi103 ceph-mon[32753]: Deploying daemon osd.1 on smithi121 2024-08-02T18:42:33.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:33 smithi151 ceph-mon[37155]: Deploying daemon osd.1 on smithi121 2024-08-02T18:42:34.446 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:34 smithi121 ceph-mon[37236]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:34.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:34 smithi151 ceph-mon[37155]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:34.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:34 smithi103 ceph-mon[32753]: pgmap v44: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:36.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:36 smithi121 ceph-mon[37236]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:36.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:36 smithi151 ceph-mon[37155]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:36.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:36 smithi103 ceph-mon[32753]: pgmap v45: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:37.671 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:37 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:37.671 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:37 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:37.672 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:37 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:37.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:37.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:37 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:37.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:37 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:37.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:37 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:38.654 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:38 smithi121 ceph-mon[37236]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:38.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:38 smithi151 ceph-mon[37155]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:38.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:38 smithi103 ceph-mon[32753]: pgmap v46: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:39.703 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.701+0000 7f8be1ffb640 1 -- 172.21.15.121:0/392388750 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f8be41a2690 con 0x7f8bd00a2af0 2024-08-02T18:42:39.703 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 1 on host 'smithi121' 2024-08-02T18:42:39.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f8bd00a2af0 msgr2=0x7f8bd00a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:39.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f8bd00a2af0 0x7f8bd00a4fb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f8be4101880 tx=0x7f8bdc00b390 comp rx=0 tx=0).stop 2024-08-02T18:42:39.705 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be4101a20 msgr2=0x7f8be4102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:39.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be4101a20 0x7f8be4102e00 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8bd4006010 tx=0x7f8bd4031ec0 comp rx=0 tx=0).stop 2024-08-02T18:42:39.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 shutdown_connections 2024-08-02T18:42:39.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8be41023e0 0x7f8be4103340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:39.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8be4101a20 0x7f8be4102e00 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:39.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f8bd00a2af0 0x7f8bd00a4fb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:39.706 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 --2- 172.21.15.121:0/392388750 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8be4100820 0x7f8be41047b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:39.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 >> 172.21.15.121:0/392388750 conn(0x7f8be40fbfb0 msgr2=0x7f8be40fdac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:42:39.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 shutdown_connections 2024-08-02T18:42:39.707 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:42:39.703+0000 7f8beaf36640 1 -- 172.21.15.121:0/392388750 wait complete. 2024-08-02T18:42:40.309 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.309 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.309 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:40.309 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:40.309 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.309 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:40.309 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:40.310 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.310 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:40.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:40.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:40.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:40.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:40.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:40.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: pgmap v47: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:40.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:40.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:40.336 DEBUG:teuthology.orchestra.run.smithi121:osd.1> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.1.service 2024-08-02T18:42:40.339 INFO:tasks.cephadm:Deploying osd.2 on smithi151 with /dev/vg_nvme/lv_4... 2024-08-02T18:42:40.339 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_4 2024-08-02T18:42:40.595 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:42:40.651 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:42:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1[41717]: 2024-08-02T18:42:40.509+0000 7f88264a1640 -1 osd.1 0 log_to_monitors true 2024-08-02T18:42:41.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:41 smithi151 ceph-mon[37155]: from='osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-02T18:42:41.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:41 smithi151 ceph-mon[37155]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-02T18:42:41.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:41 smithi103 ceph-mon[32753]: from='osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-02T18:42:41.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:41 smithi103 ceph-mon[32753]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-02T18:42:41.440 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:41 smithi121 ceph-mon[37236]: from='osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-02T18:42:41.440 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:41 smithi121 ceph-mon[37236]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-08-02T18:42:42.269 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-02T18:42:42.269 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: from='osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:42:42.269 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: osdmap e11: 2 total, 1 up, 2 in 2024-08-02T18:42:42.269 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:42.269 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:42:42.269 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:42.269 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:42:42.270 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: osdmap e12: 2 total, 1 up, 2 in 2024-08-02T18:42:42.270 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:42.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-02T18:42:42.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: from='osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:42:42.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: osdmap e11: 2 total, 1 up, 2 in 2024-08-02T18:42:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:42:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:42:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: osdmap e12: 2 total, 1 up, 2 in 2024-08-02T18:42:42.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:42.410 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-08-02T18:42:42.410 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: from='osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:42:42.410 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: osdmap e11: 2 total, 1 up, 2 in 2024-08-02T18:42:42.410 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:42.411 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: from='osd.1 ' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:42:42.411 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: pgmap v49: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:42.411 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: from='osd.1 ' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:42:42.411 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: osdmap e12: 2 total, 1 up, 2 in 2024-08-02T18:42:42.411 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:42.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1[41717]: 2024-08-02T18:42:42.029+0000 7f8822424640 -1 osd.1 0 waiting for initial osdmap 2024-08-02T18:42:42.411 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:42:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1[41717]: 2024-08-02T18:42:42.033+0000 7f881e24c640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:42:43.003 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:42:43.029 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_4 2024-08-02T18:42:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:43.282 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:42:43.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:43.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:43.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:43.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:43.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:43.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:43.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:43.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 -- 172.21.15.151:0/3166658625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4102400 msgr2=0x7f32c4108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 --2- 172.21.15.151:0/3166658625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4102400 0x7f32c4108c90 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f32bc009ca0 tx=0x7f32bc02a8c0 comp rx=0 tx=0).stop 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 -- 172.21.15.151:0/3166658625 shutdown_connections 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 --2- 172.21.15.151:0/3166658625 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4102400 0x7f32c4108c90 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 --2- 172.21.15.151:0/3166658625 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32c4101a40 0x7f32c4101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 --2- 172.21.15.151:0/3166658625 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32c4100840 0x7f32c4100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 -- 172.21.15.151:0/3166658625 >> 172.21.15.151:0/3166658625 conn(0x7f32c40fbfd0 msgr2=0x7f32c40fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 -- 172.21.15.151:0/3166658625 shutdown_connections 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.760+0000 7f32cbc48640 1 -- 172.21.15.151:0/3166658625 wait complete. 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32cbc48640 1 Processor -- start 2024-08-02T18:42:43.779 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32cbc48640 1 -- start start 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32cbc48640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32c4100840 0x7f32c4199ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32cbc48640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4101a40 0x7f32c419a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32cbc48640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32c4102400 0x7f32c41a1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32cbc48640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32c410f900 con 0x7f32c4102400 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32cbc48640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32c410f780 con 0x7f32c4100840 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32cbc48640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32c410fa80 con 0x7f32c4101a40 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32c91e3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4101a40 0x7f32c419a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32c91e3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4101a40 0x7f32c419a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:38620/0 (socket says 172.21.15.151:38620) 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32c91e3640 1 -- 172.21.15.151:0/724989181 learned_addr learned my addr 172.21.15.151:0/724989181 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.761+0000 7f32c99e4640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32c4100840 0x7f32c4199ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32ca1e5640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32c4102400 0x7f32c41a1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32c91e3640 1 -- 172.21.15.151:0/724989181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32c4100840 msgr2=0x7f32c4199ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:43.780 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32c91e3640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32c4100840 0x7f32c4199ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32c91e3640 1 -- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32c4102400 msgr2=0x7f32c41a1460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32c91e3640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32c4102400 0x7f32c41a1460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32c91e3640 1 -- 172.21.15.151:0/724989181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32c41a1ad0 con 0x7f32c4101a40 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32ca1e5640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32c4102400 0x7f32c41a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32c91e3640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4101a40 0x7f32c419a3e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f32b400c890 tx=0x7f32b400cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32baffd640 1 -- 172.21.15.151:0/724989181 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4004220 con 0x7f32c4101a40 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32baffd640 1 -- 172.21.15.151:0/724989181 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f32b40043c0 con 0x7f32c4101a40 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32baffd640 1 -- 172.21.15.151:0/724989181 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32b4004b10 con 0x7f32c4101a40 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32c41a1dc0 con 0x7f32c4101a40 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.762+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32c41a2280 con 0x7f32c4101a40 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.763+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32c4107b70 con 0x7f32c4101a40 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.764+0000 7f32baffd640 1 -- 172.21.15.151:0/724989181 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f32b40051b0 con 0x7f32c4101a40 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.764+0000 7f32baffd640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f32b00a2ba0 0x7f32b00a5060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:42:43.781 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.765+0000 7f32baffd640 1 -- 172.21.15.151:0/724989181 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(13..13 src has 1..13) ==== 2309+0+0 (secure 0 0 0) 0x7f32b40cd3b0 con 0x7f32c4101a40 2024-08-02T18:42:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.765+0000 7f32c99e4640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f32b00a2ba0 0x7f32b00a5060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:42:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.765+0000 7f32c99e4640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f32b00a2ba0 0x7f32b00a5060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32c0005fd0 tx=0x7f32c000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:42:43.782 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.769+0000 7f32baffd640 1 -- 172.21.15.151:0/724989181 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f32b4014030 con 0x7f32c4101a40 2024-08-02T18:42:43.948 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:42:43.947+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) -- 0x7f32c4062360 con 0x7f32b00a2ba0 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi121 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi121 to 17088M 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] boot 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: osdmap e13: 2 total, 2 up, 2 in 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:44.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:44.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:44.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:44.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:44.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:44.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:44.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:44.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:42:44.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:42:44.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi121 2024-08-02T18:42:44.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:42:44.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi121 to 17088M 2024-08-02T18:42:44.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] boot 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: osdmap e13: 2 total, 2 up, 2 in 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:44.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:42:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:42:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi121 2024-08-02T18:42:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:42:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi121 to 17088M 2024-08-02T18:42:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: osd.1 [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] boot 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: osdmap e13: 2 total, 2 up, 2 in 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: pgmap v52: 0 pgs: ; 0 B data, 35 MiB used, 89 GiB / 89 GiB avail 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:42:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:45.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:45 smithi151 ceph-mon[37155]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:45.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:45 smithi151 ceph-mon[37155]: osdmap e14: 2 total, 2 up, 2 in 2024-08-02T18:42:45.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:45 smithi103 ceph-mon[32753]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:45.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:45 smithi103 ceph-mon[32753]: osdmap e14: 2 total, 2 up, 2 in 2024-08-02T18:42:45.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:45 smithi121 ceph-mon[37236]: from='client.24157 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:42:45.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:45 smithi121 ceph-mon[37236]: osdmap e14: 2 total, 2 up, 2 in 2024-08-02T18:42:46.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:46 smithi151 ceph-mon[37155]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:46.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:46 smithi103 ceph-mon[32753]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:46.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:46 smithi121 ceph-mon[37236]: pgmap v54: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:47.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:47 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/2515401962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]: dispatch 2024-08-02T18:42:47.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:47 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]: dispatch 2024-08-02T18:42:47.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:47 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]': finished 2024-08-02T18:42:47.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:47 smithi151 ceph-mon[37155]: osdmap e15: 3 total, 2 up, 3 in 2024-08-02T18:42:47.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:47 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:42:47.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:47 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/3799267197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:47 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/2515401962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]: dispatch 2024-08-02T18:42:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:47 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]: dispatch 2024-08-02T18:42:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:47 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]': finished 2024-08-02T18:42:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:47 smithi103 ceph-mon[32753]: osdmap e15: 3 total, 2 up, 3 in 2024-08-02T18:42:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:47 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:42:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:47 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/3799267197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:47.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:47 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/2515401962' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]: dispatch 2024-08-02T18:42:47.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:47 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]: dispatch 2024-08-02T18:42:47.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:47 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec"}]': finished 2024-08-02T18:42:47.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:47 smithi121 ceph-mon[37236]: osdmap e15: 3 total, 2 up, 3 in 2024-08-02T18:42:47.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:47 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:42:47.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:47 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/3799267197' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:42:48.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:48 smithi151 ceph-mon[37155]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:48.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:48 smithi103 ceph-mon[32753]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:48.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:48 smithi121 ceph-mon[37236]: pgmap v56: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:50.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:50 smithi151 ceph-mon[37155]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:50.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:50 smithi121 ceph-mon[37236]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:50.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:50 smithi103 ceph-mon[32753]: pgmap v57: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:52.529 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:52 smithi151 ceph-mon[37155]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:52.627 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:52 smithi103 ceph-mon[32753]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:52.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:52 smithi121 ceph-mon[37236]: pgmap v58: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:53.540 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-02T18:42:53.540 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-02T18:42:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-08-02T18:42:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:42:54.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:54 smithi151 ceph-mon[37155]: Deploying daemon osd.2 on smithi151 2024-08-02T18:42:54.394 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:54 smithi151 ceph-mon[37155]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:54 smithi121 ceph-mon[37236]: Deploying daemon osd.2 on smithi151 2024-08-02T18:42:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:54 smithi121 ceph-mon[37236]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:54 smithi103 ceph-mon[32753]: Deploying daemon osd.2 on smithi151 2024-08-02T18:42:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:54 smithi103 ceph-mon[32753]: pgmap v59: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:56.602 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:56 smithi151 ceph-mon[37155]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:56.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:56 smithi121 ceph-mon[37236]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:56.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:56 smithi103 ceph-mon[32753]: pgmap v60: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:58.429 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:58 smithi151 ceph-mon[37155]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:58.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:58.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:58.430 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:42:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:58 smithi121 ceph-mon[37236]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:42:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:58.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:58 smithi103 ceph-mon[32753]: pgmap v61: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:42:58.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:42:58.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:42:58.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:42:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:00 smithi151 ceph-mon[37155]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:00 smithi121 ceph-mon[37236]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:00 smithi103 ceph-mon[32753]: pgmap v62: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:00.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:00.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:00.973 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.971+0000 7f32baffd640 1 -- 172.21.15.151:0/724989181 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f32c4062360 con 0x7f32b00a2ba0 2024-08-02T18:43:00.973 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 2 on host 'smithi151' 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f32b00a2ba0 msgr2=0x7f32b00a5060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f32b00a2ba0 0x7f32b00a5060 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f32c0005fd0 tx=0x7f32c000b390 comp rx=0 tx=0).stop 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4101a40 msgr2=0x7f32c419a3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4101a40 0x7f32c419a3e0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f32b400c890 tx=0x7f32b400cd50 comp rx=0 tx=0).stop 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 shutdown_connections 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32c4102400 0x7f32c41a1460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f32b00a2ba0 0x7f32b00a5060 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32c4101a40 0x7f32c419a3e0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 --2- 172.21.15.151:0/724989181 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32c4100840 0x7f32c4199ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:00.975 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 >> 172.21.15.151:0/724989181 conn(0x7f32c40fbfd0 msgr2=0x7f32c4104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:43:00.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.973+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 shutdown_connections 2024-08-02T18:43:00.976 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:00.974+0000 7f32cbc48640 1 -- 172.21.15.151:0/724989181 wait complete. 2024-08-02T18:43:01.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:01 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:01.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:01 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:01.594 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:01 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:01.621 DEBUG:teuthology.orchestra.run.smithi151:osd.2> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.2.service 2024-08-02T18:43:01.624 INFO:tasks.cephadm:Deploying osd.3 on smithi103 with /dev/vg_nvme/lv_3... 2024-08-02T18:43:01.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-02T18:43:01.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:01 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:01.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:01 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:01.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:01 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:01.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:01 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:01.802 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:01 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:01.802 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:01 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:01.887 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:43:02.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:02 smithi103 ceph-mon[32753]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:02.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:02 smithi103 ceph-mon[32753]: from='osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-02T18:43:02.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:02 smithi103 ceph-mon[32753]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-02T18:43:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:02 smithi121 ceph-mon[37236]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:02 smithi121 ceph-mon[37236]: from='osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-02T18:43:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:02 smithi121 ceph-mon[37236]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-02T18:43:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:02 smithi151 ceph-mon[37155]: pgmap v63: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:02 smithi151 ceph-mon[37155]: from='osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-02T18:43:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:02 smithi151 ceph-mon[37155]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-08-02T18:43:03.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:03 smithi103 ceph-mon[32753]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-02T18:43:03.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:03 smithi103 ceph-mon[32753]: from='osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:43:03.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:03 smithi103 ceph-mon[32753]: osdmap e16: 3 total, 2 up, 3 in 2024-08-02T18:43:03.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:03 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:03.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:03 smithi103 ceph-mon[32753]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:43:03.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:03 smithi103 ceph-mon[32753]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:43:03.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:03 smithi103 ceph-mon[32753]: osdmap e17: 3 total, 2 up, 3 in 2024-08-02T18:43:03.564 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:03 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:03.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:03 smithi121 ceph-mon[37236]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-02T18:43:03.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:03 smithi121 ceph-mon[37236]: from='osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:43:03.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:03 smithi121 ceph-mon[37236]: osdmap e16: 3 total, 2 up, 3 in 2024-08-02T18:43:03.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:03 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:03.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:03 smithi121 ceph-mon[37236]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:43:03.653 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:03 smithi121 ceph-mon[37236]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:43:03.653 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:03 smithi121 ceph-mon[37236]: osdmap e17: 3 total, 2 up, 3 in 2024-08-02T18:43:03.653 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:03 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:03 smithi151 ceph-mon[37155]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-08-02T18:43:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:03 smithi151 ceph-mon[37155]: from='osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:43:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:03 smithi151 ceph-mon[37155]: osdmap e16: 3 total, 2 up, 3 in 2024-08-02T18:43:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:03 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:03 smithi151 ceph-mon[37155]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:43:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:03 smithi151 ceph-mon[37155]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:43:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:03 smithi151 ceph-mon[37155]: osdmap e17: 3 total, 2 up, 3 in 2024-08-02T18:43:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:03 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:04.401 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2[42100]: 2024-08-02T18:43:04.072+0000 7f73e20a9640 -1 osd.2 0 waiting for initial osdmap 2024-08-02T18:43:04.401 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2[42100]: 2024-08-02T18:43:04.077+0000 7f73d9ec9640 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:43:04.680 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:04 smithi103 ceph-mon[32753]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:04.680 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:04.680 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:04 smithi103 ceph-mon[32753]: from='osd.2 ' entity='osd.2' 2024-08-02T18:43:04.680 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:04.683 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:43:04.711 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_3 2024-08-02T18:43:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:04 smithi121 ceph-mon[37236]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:04 smithi121 ceph-mon[37236]: from='osd.2 ' entity='osd.2' 2024-08-02T18:43:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:04.794 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:04 smithi151 ceph-mon[37155]: pgmap v65: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:04.794 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:04.794 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:04 smithi151 ceph-mon[37155]: from='osd.2 ' entity='osd.2' 2024-08-02T18:43:04.794 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:05.030 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 -- 172.21.15.103:0/12544252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb01023c0 msgr2=0x7f6eb0108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/12544252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb01023c0 0x7f6eb0108c50 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f6ea8009be0 tx=0x7f6ea802a6c0 comp rx=0 tx=0).stop 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 -- 172.21.15.103:0/12544252 shutdown_connections 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/12544252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb01023c0 0x7f6eb0108c50 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/12544252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb0101a00 0x7f6eb0101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/12544252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb0100800 0x7f6eb0100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 -- 172.21.15.103:0/12544252 >> 172.21.15.103:0/12544252 conn(0x7f6eb00fbfb0 msgr2=0x7f6eb00fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 -- 172.21.15.103:0/12544252 shutdown_connections 2024-08-02T18:43:05.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.484+0000 7f6eb76bf640 1 -- 172.21.15.103:0/12544252 wait complete. 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb76bf640 1 Processor -- start 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb76bf640 1 -- start start 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb76bf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb0100800 0x7f6eb0104790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb76bf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb0101a00 0x7f6eb0102de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb76bf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb01023c0 0x7f6eb0103320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb76bf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb010c5c0 con 0x7f6eb0101a00 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb76bf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb010c440 con 0x7f6eb01023c0 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb76bf640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6eb010c740 con 0x7f6eb0100800 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb4c5a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb0101a00 0x7f6eb0102de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb4c5a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb0101a00 0x7f6eb0102de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:38814/0 (socket says 172.21.15.103:38814) 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb4c5a640 1 -- 172.21.15.103:0/2282657117 learned_addr learned my addr 172.21.15.103:0/2282657117 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:43:05.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb545b640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb0100800 0x7f6eb0104790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb5c5c640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb01023c0 0x7f6eb0103320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb545b640 1 -- 172.21.15.103:0/2282657117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb01023c0 msgr2=0x7f6eb0103320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb545b640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb01023c0 0x7f6eb0103320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb545b640 1 -- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb0101a00 msgr2=0x7f6eb0102de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb545b640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb0101a00 0x7f6eb0102de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.485+0000 7f6eb545b640 1 -- 172.21.15.103:0/2282657117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eb0103be0 con 0x7f6eb0100800 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.486+0000 7f6eb545b640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb0100800 0x7f6eb0104790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6eac005fd0 tx=0x7f6eac00ec20 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.486+0000 7f6ea67fc640 1 -- 172.21.15.103:0/2282657117 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac00cc90 con 0x7f6eb0100800 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.486+0000 7f6ea67fc640 1 -- 172.21.15.103:0/2282657117 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6eac00ee70 con 0x7f6eb0100800 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.486+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eb01a1e60 con 0x7f6eb0100800 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.486+0000 7f6ea67fc640 1 -- 172.21.15.103:0/2282657117 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6eac010430 con 0x7f6eb0100800 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.486+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eb01a2200 con 0x7f6eb0100800 2024-08-02T18:43:05.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.487+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6eb01a24c0 con 0x7f6eb0100800 2024-08-02T18:43:05.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.488+0000 7f6ea67fc640 1 -- 172.21.15.103:0/2282657117 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 15) ==== 137778+0+0 (secure 0 0 0) 0x7f6eac044b00 con 0x7f6eb0100800 2024-08-02T18:43:05.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.489+0000 7f6ea67fc640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e9c0a2af0 0x7f6e9c0a4fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:05.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.489+0000 7f6eb4c5a640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e9c0a2af0 0x7f6e9c0a4fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:05.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.489+0000 7f6ea67fc640 1 -- 172.21.15.103:0/2282657117 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 2851+0+0 (secure 0 0 0) 0x7f6eac0cdc20 con 0x7f6eb0100800 2024-08-02T18:43:05.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.489+0000 7f6eb4c5a640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e9c0a2af0 0x7f6e9c0a4fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0104510 tx=0x7f6ea0005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:43:05.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.492+0000 7f6ea67fc640 1 -- 172.21.15.103:0/2282657117 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6eac09c110 con 0x7f6eb0100800 2024-08-02T18:43:05.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:05.672+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f6eb01a2690 con 0x7f6e9c0a2af0 2024-08-02T18:43:05.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:43:05.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:43:05.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:05.673 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] boot 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: osdmap e18: 3 total, 3 up, 3 in 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:05.674 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-02T18:43:05.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] boot 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: osdmap e18: 3 total, 3 up, 3 in 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-02T18:43:06.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:43:06.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:43:06.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:06.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:06.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:06.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:06.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:06.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:06.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:06.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: osd.2 [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] boot 2024-08-02T18:43:06.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: osdmap e18: 3 total, 3 up, 3 in 2024-08-02T18:43:06.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:43:06.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]: dispatch 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi151 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi151 to 17088M 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: osdmap e19: 3 total, 3 up, 3 in 2024-08-02T18:43:06.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-02T18:43:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi151 2024-08-02T18:43:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi151 to 17088M 2024-08-02T18:43:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-02T18:43:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: osdmap e19: 3 total, 3 up, 3 in 2024-08-02T18:43:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-02T18:43:07.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi151 2024-08-02T18:43:07.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi151 to 17088M 2024-08-02T18:43:07.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: pgmap v68: 0 pgs: ; 0 B data, 61 MiB used, 179 GiB / 179 GiB avail 2024-08-02T18:43:07.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: from='client.24184 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:07.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:07.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:07.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:07.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32, "yes_i_really_mean_it": true}]': finished 2024-08-02T18:43:07.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: osdmap e19: 3 total, 3 up, 3 in 2024-08-02T18:43:07.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-08-02T18:43:07.575 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:43:07 smithi103 sudo[51418]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-02T18:43:07.576 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:43:07 smithi103 sudo[51418]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:07.576 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:43:07 smithi103 sudo[51418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:07.576 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:43:07 smithi103 sudo[51418]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:08.075 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:43:07 smithi103 sudo[51443]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-02T18:43:08.075 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:43:07 smithi103 sudo[51443]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:08.075 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:43:07 smithi103 sudo[51443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:08.075 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 18:43:07 smithi103 sudo[51443]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:08.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:08.094+0000 7f6ea67fc640 1 -- 172.21.15.103:0/2282657117 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6eac098080 con 0x7f6eb0100800 2024-08-02T18:43:08.224 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:43:07 smithi121 sudo[45671]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-02T18:43:08.224 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:43:07 smithi121 sudo[45671]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:08.225 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:43:07 smithi121 sudo[45671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:08.225 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:43:07 smithi121 sudo[45671]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:08.225 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-02T18:43:08.225 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:08 smithi121 ceph-mon[37236]: osdmap e20: 3 total, 3 up, 3 in 2024-08-02T18:43:08.225 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:08 smithi121 ceph-mon[37236]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:08.225 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:08.225 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:08 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3647046969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63933dee-170e-4e8e-b9e3-e120c55cac8b"}]: dispatch 2024-08-02T18:43:08.225 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:08 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3647046969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63933dee-170e-4e8e-b9e3-e120c55cac8b"}]': finished 2024-08-02T18:43:08.225 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:08 smithi121 ceph-mon[37236]: osdmap e21: 4 total, 3 up, 4 in 2024-08-02T18:43:08.225 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:08.494 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-02T18:43:08.494 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:08 smithi151 ceph-mon[37155]: osdmap e20: 3 total, 3 up, 3 in 2024-08-02T18:43:08.494 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:08 smithi151 ceph-mon[37155]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:08.495 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:08.495 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:08 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3647046969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63933dee-170e-4e8e-b9e3-e120c55cac8b"}]: dispatch 2024-08-02T18:43:08.495 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:08 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3647046969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63933dee-170e-4e8e-b9e3-e120c55cac8b"}]': finished 2024-08-02T18:43:08.495 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:08 smithi151 ceph-mon[37155]: osdmap e21: 4 total, 3 up, 4 in 2024-08-02T18:43:08.495 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:08.500 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:43:08 smithi121 sudo[45674]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-02T18:43:08.501 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:43:08 smithi121 sudo[45674]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:08.501 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:43:08 smithi121 sudo[45674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:08.501 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 18:43:08 smithi121 sudo[45674]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:08.562 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-08-02T18:43:08.562 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:08 smithi103 ceph-mon[32753]: osdmap e20: 3 total, 3 up, 3 in 2024-08-02T18:43:08.562 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:08 smithi103 ceph-mon[32753]: pgmap v71: 1 pgs: 1 unknown; 0 B data, 92 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:08.562 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:08.562 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:08 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3647046969' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63933dee-170e-4e8e-b9e3-e120c55cac8b"}]: dispatch 2024-08-02T18:43:08.562 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:08 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3647046969' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63933dee-170e-4e8e-b9e3-e120c55cac8b"}]': finished 2024-08-02T18:43:08.562 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:08 smithi103 ceph-mon[32753]: osdmap e21: 4 total, 3 up, 4 in 2024-08-02T18:43:08.562 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:08.751 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:08 smithi151 sudo[46020]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-02T18:43:08.752 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:08 smithi151 sudo[46020]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:08.752 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:08 smithi151 sudo[46020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:08.752 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:08 smithi151 sudo[46020]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:09.070 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:08 smithi151 sudo[46023]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-02T18:43:09.070 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:08 smithi151 sudo[46023]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:09.070 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:08 smithi151 sudo[46023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:09.070 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 18:43:08 smithi151 sudo[46023]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:09.285 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 sudo[51543]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-02T18:43:09.285 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 sudo[51543]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:09.285 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 sudo[51543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:09.285 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 sudo[51543]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:09.549 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 ceph-mon[37155]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-02T18:43:09.549 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:09.549 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2684203819' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:09.549 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:09.549 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 ceph-mon[37155]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:09.549 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 sudo[46026]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-02T18:43:09.550 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 sudo[46026]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:09.550 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 sudo[46026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:09.550 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 sudo[46026]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:09.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 sudo[51729]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-02T18:43:09.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 sudo[51729]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:09.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 sudo[51729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:09.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 sudo[51729]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:09.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 ceph-mon[32753]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-02T18:43:09.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:09.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2684203819' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:09.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:09.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:09 smithi103 ceph-mon[32753]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:09 smithi121 ceph-mon[37236]: mgrmap e16: x(active, since 2m), standbys: z, y 2024-08-02T18:43:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:09 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2684203819' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:09 smithi121 ceph-mon[37236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 sudo[46029]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-02T18:43:09.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 sudo[46029]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:09.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 sudo[46029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:09.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:09 smithi151 sudo[46029]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:10.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 sudo[45677]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/smartctl -x --json=o /dev/nvme0n1 2024-08-02T18:43:10.285 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 sudo[45677]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:10.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 sudo[45677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:10.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 sudo[45677]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:10.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 sudo[45680]: ceph : PWD=/ ; USER=root ; COMMAND=/usr/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-08-02T18:43:10.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 sudo[45680]: pam_systemd(sudo:session): Failed to connect to system bus: No such file or directory 2024-08-02T18:43:10.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 sudo[45680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=167) 2024-08-02T18:43:10.286 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 sudo[45680]: pam_unix(sudo:session): session closed for user root 2024-08-02T18:43:10.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:10 smithi151 ceph-mon[37155]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:10.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:10.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:10.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:10 smithi103 ceph-mon[32753]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: pgmap v73: 1 pgs: 1 active+clean; 577 KiB data, 94 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:43:10.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:10 smithi121 ceph-mon[37236]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-08-02T18:43:12.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:12 smithi151 ceph-mon[37155]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:12.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:12 smithi103 ceph-mon[32753]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:12 smithi121 ceph-mon[37236]: pgmap v74: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:14.462 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:14 smithi103 ceph-mon[32753]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:14.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:14 smithi151 ceph-mon[37155]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:14 smithi121 ceph-mon[37236]: pgmap v75: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:15.466 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-02T18:43:15.466 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:15.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-02T18:43:15.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:15.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-08-02T18:43:15.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:16.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:16 smithi103 ceph-mon[32753]: Deploying daemon osd.3 on smithi103 2024-08-02T18:43:16.527 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:16 smithi103 ceph-mon[32753]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-08-02T18:43:16.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:16 smithi151 ceph-mon[37155]: Deploying daemon osd.3 on smithi103 2024-08-02T18:43:16.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:16 smithi151 ceph-mon[37155]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-08-02T18:43:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:16 smithi121 ceph-mon[37236]: Deploying daemon osd.3 on smithi103 2024-08-02T18:43:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:16 smithi121 ceph-mon[37236]: pgmap v76: 1 pgs: 1 active+clean; 577 KiB data, 95 MiB used, 268 GiB / 268 GiB avail; 1.7 KiB/s rd, 44 KiB/s wr, 4 op/s 2024-08-02T18:43:18.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:18 smithi103 ceph-mon[32753]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-08-02T18:43:18.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:18 smithi151 ceph-mon[37155]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-08-02T18:43:18.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:18 smithi121 ceph-mon[37236]: pgmap v77: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1.2 KiB/s rd, 33 KiB/s wr, 3 op/s 2024-08-02T18:43:20.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:20 smithi151 ceph-mon[37155]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-02T18:43:20.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:20.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:20.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:20.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:20 smithi103 ceph-mon[32753]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-02T18:43:20.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:20.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:20.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:20 smithi121 ceph-mon[37236]: pgmap v78: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 1023 B/s rd, 26 KiB/s wr, 2 op/s 2024-08-02T18:43:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:22.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:22 smithi151 ceph-mon[37155]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-08-02T18:43:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:22 smithi103 ceph-mon[32753]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-08-02T18:43:22.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:22 smithi121 ceph-mon[37236]: pgmap v79: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-08-02T18:43:23.600 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 3 on host 'smithi103' 2024-08-02T18:43:23.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.597+0000 7f6ea67fc640 1 -- 172.21.15.103:0/2282657117 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6eb01a2690 con 0x7f6e9c0a2af0 2024-08-02T18:43:23.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e9c0a2af0 msgr2=0x7f6e9c0a4fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:23.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e9c0a2af0 0x7f6e9c0a4fb0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6eb0104510 tx=0x7f6ea0005f90 comp rx=0 tx=0).stop 2024-08-02T18:43:23.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb0100800 msgr2=0x7f6eb0104790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:23.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb0100800 0x7f6eb0104790 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0x7f6eac005fd0 tx=0x7f6eac00ec20 comp rx=0 tx=0).stop 2024-08-02T18:43:23.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 shutdown_connections 2024-08-02T18:43:23.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eb01023c0 0x7f6eb0103320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:23.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eb0101a00 0x7f6eb0102de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:23.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e9c0a2af0 0x7f6e9c0a4fb0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:23.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 --2- 172.21.15.103:0/2282657117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eb0100800 0x7f6eb0104790 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:23.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 >> 172.21.15.103:0/2282657117 conn(0x7f6eb00fbfb0 msgr2=0x7f6eb00fda70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:43:23.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 shutdown_connections 2024-08-02T18:43:23.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:43:23.600+0000 7f6eb76bf640 1 -- 172.21.15.103:0/2282657117 wait complete. 2024-08-02T18:43:24.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-08-02T18:43:24.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:24.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:24.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:24.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.278 DEBUG:teuthology.orchestra.run.smithi103:osd.3> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.3.service 2024-08-02T18:43:24.281 INFO:tasks.cephadm:Deploying osd.4 on smithi121 with /dev/vg_nvme/lv_3... 2024-08-02T18:43:24.281 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-02T18:43:24.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: pgmap v80: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail; 853 B/s rd, 22 KiB/s wr, 2 op/s 2024-08-02T18:43:24.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:24.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:24.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:24.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:24.524 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T18:43:24.960 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:24 smithi121 ceph-mon[37236]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-02T18:43:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:24 smithi103 ceph-mon[32753]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-02T18:43:25.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:24 smithi151 ceph-mon[37155]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-08-02T18:43:25.941 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:25 smithi121 ceph-mon[37236]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-02T18:43:25.941 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:25 smithi121 ceph-mon[37236]: osdmap e22: 4 total, 3 up, 4 in 2024-08-02T18:43:25.942 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:25 smithi121 ceph-mon[37236]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:43:25.942 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:25 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:25.942 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:25 smithi121 ceph-mon[37236]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:26.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:25 smithi151 ceph-mon[37155]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-02T18:43:26.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:25 smithi151 ceph-mon[37155]: osdmap e22: 4 total, 3 up, 4 in 2024-08-02T18:43:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:25 smithi151 ceph-mon[37155]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:43:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:25 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:25 smithi151 ceph-mon[37155]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:26.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:25 smithi103 ceph-mon[32753]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-08-02T18:43:26.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:25 smithi103 ceph-mon[32753]: osdmap e22: 4 total, 3 up, 4 in 2024-08-02T18:43:26.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:25 smithi103 ceph-mon[32753]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:43:26.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:25 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:26.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:25 smithi103 ceph-mon[32753]: pgmap v82: 1 pgs: 1 active+clean; 577 KiB data, 99 MiB used, 268 GiB / 268 GiB avail 2024-08-02T18:43:26.326 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 18:43:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3[53497]: 2024-08-02T18:43:25.853+0000 7f880117e640 -1 osd.3 0 waiting for initial osdmap 2024-08-02T18:43:26.326 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 18:43:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3[53497]: 2024-08-02T18:43:25.860+0000 7f87fcfa6640 -1 osd.3 23 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:43:27.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:26 smithi103 ceph-mon[32753]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:43:27.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:26 smithi103 ceph-mon[32753]: osdmap e23: 4 total, 3 up, 4 in 2024-08-02T18:43:27.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:26 smithi103 ceph-mon[32753]: osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] boot 2024-08-02T18:43:27.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:26 smithi103 ceph-mon[32753]: osdmap e24: 4 total, 4 up, 4 in 2024-08-02T18:43:27.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.130 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:26 smithi121 ceph-mon[37236]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:43:27.130 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:26 smithi121 ceph-mon[37236]: osdmap e23: 4 total, 3 up, 4 in 2024-08-02T18:43:27.130 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.130 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.130 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:26 smithi121 ceph-mon[37236]: osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] boot 2024-08-02T18:43:27.131 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:26 smithi121 ceph-mon[37236]: osdmap e24: 4 total, 4 up, 4 in 2024-08-02T18:43:27.131 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.132 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:43:27.160 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_3 2024-08-02T18:43:27.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:26 smithi151 ceph-mon[37155]: from='osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:43:27.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:26 smithi151 ceph-mon[37155]: osdmap e23: 4 total, 3 up, 4 in 2024-08-02T18:43:27.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:26 smithi151 ceph-mon[37155]: osd.3 [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] boot 2024-08-02T18:43:27.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:26 smithi151 ceph-mon[37155]: osdmap e24: 4 total, 4 up, 4 in 2024-08-02T18:43:27.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:43:27.414 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T18:43:27.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 -- 172.21.15.121:0/3523722380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c100800 msgr2=0x7f210c100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:27.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 --2- 172.21.15.121:0/3523722380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c100800 0x7f210c100c00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f20fc009ca0 tx=0x7f20fc02a8c0 comp rx=0 tx=0).stop 2024-08-02T18:43:27.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 -- 172.21.15.121:0/3523722380 shutdown_connections 2024-08-02T18:43:27.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 --2- 172.21.15.121:0/3523722380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210c1023c0 0x7f210c108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:27.875 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 --2- 172.21.15.121:0/3523722380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f210c101a00 0x7f210c101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:27.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 --2- 172.21.15.121:0/3523722380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c100800 0x7f210c100c00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:27.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 -- 172.21.15.121:0/3523722380 >> 172.21.15.121:0/3523722380 conn(0x7f210c0fbfb0 msgr2=0x7f210c0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:43:27.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 -- 172.21.15.121:0/3523722380 shutdown_connections 2024-08-02T18:43:27.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 -- 172.21.15.121:0/3523722380 wait complete. 2024-08-02T18:43:27.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 Processor -- start 2024-08-02T18:43:27.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.850+0000 7f21113cc640 1 -- start start 2024-08-02T18:43:27.876 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f21113cc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f210c100800 0x7f210c197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:27.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f21113cc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c101a00 0x7f210c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:27.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f21113cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210c1023c0 0x7f210c19f300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:27.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f21113cc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10c5c0 con 0x7f210c1023c0 2024-08-02T18:43:27.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f21113cc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10c440 con 0x7f210c101a00 2024-08-02T18:43:27.877 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f21113cc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f210c10c740 con 0x7f210c100800 2024-08-02T18:43:27.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c101a00 0x7f210c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:27.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c101a00 0x7f210c198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:59312/0 (socket says 172.21.15.121:59312) 2024-08-02T18:43:27.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 -- 172.21.15.121:0/2670026591 learned_addr learned my addr 172.21.15.121:0/2670026591 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-02T18:43:27.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210affd640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f210c100800 0x7f210c197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:27.878 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210b7fe640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210c1023c0 0x7f210c19f300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:27.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 -- 172.21.15.121:0/2670026591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f210c100800 msgr2=0x7f210c197d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:27.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f210c100800 0x7f210c197d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:27.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 -- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210c1023c0 msgr2=0x7f210c19f300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:27.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210c1023c0 0x7f210c19f300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:27.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 -- 172.21.15.121:0/2670026591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f210c19f970 con 0x7f210c101a00 2024-08-02T18:43:27.879 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210b7fe640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210c1023c0 0x7f210c19f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:43:27.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f210a7fc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c101a00 0x7f210c198280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f20f400d950 tx=0x7f20f400de10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:43:27.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.851+0000 7f2103fff640 1 -- 172.21.15.121:0/2670026591 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f4017030 con 0x7f210c101a00 2024-08-02T18:43:27.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.852+0000 7f2103fff640 1 -- 172.21.15.121:0/2670026591 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f20f4004020 con 0x7f210c101a00 2024-08-02T18:43:27.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.852+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f210c19fc60 con 0x7f210c101a00 2024-08-02T18:43:27.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.852+0000 7f2103fff640 1 -- 172.21.15.121:0/2670026591 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f20f4004a00 con 0x7f210c101a00 2024-08-02T18:43:27.880 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.852+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f210c1a01a0 con 0x7f210c101a00 2024-08-02T18:43:27.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.852+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f210c1a03d0 con 0x7f210c101a00 2024-08-02T18:43:27.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.854+0000 7f2103fff640 1 -- 172.21.15.121:0/2670026591 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f20f40041d0 con 0x7f210c101a00 2024-08-02T18:43:27.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.854+0000 7f2103fff640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f20f80a2bb0 0x7f20f80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:27.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.854+0000 7f2103fff640 1 -- 172.21.15.121:0/2670026591 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 3698+0+0 (secure 0 0 0) 0x7f20f40cde70 con 0x7f210c101a00 2024-08-02T18:43:27.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.854+0000 7f210affd640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f20f80a2bb0 0x7f20f80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:27.881 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.855+0000 7f210affd640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f20f80a2bb0 0x7f20f80a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f20fc031ae0 tx=0x7f20fc009360 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:43:27.882 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:27.858+0000 7f2103fff640 1 -- 172.21.15.121:0/2670026591 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f20f409bfd0 con 0x7f210c101a00 2024-08-02T18:43:28.035 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:28.034+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f210c1a05a0 con 0x7f20f80a2bb0 2024-08-02T18:43:28.035 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi103 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi103 to 8544M 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:28.036 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:27 smithi121 ceph-mon[37236]: osdmap e25: 4 total, 4 up, 4 in 2024-08-02T18:43:28.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:43:28.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi103 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi103 to 8544M 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:28.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:27 smithi151 ceph-mon[37155]: osdmap e25: 4 total, 4 up, 4 in 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi103 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi103 to 8544M 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:28.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:28.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:28.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:27 smithi103 ceph-mon[32753]: osdmap e25: 4 total, 4 up, 4 in 2024-08-02T18:43:29.130 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:28 smithi121 ceph-mon[37236]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:29.130 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:28 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:29.131 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:28 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:29.131 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:28 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:29.131 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:28 smithi121 ceph-mon[37236]: osdmap e26: 4 total, 4 up, 4 in 2024-08-02T18:43:29.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:28 smithi151 ceph-mon[37155]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:29.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:28 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:29.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:28 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:29.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:28 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:29.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:28 smithi151 ceph-mon[37155]: osdmap e26: 4 total, 4 up, 4 in 2024-08-02T18:43:29.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:28 smithi103 ceph-mon[32753]: from='client.24212 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:29.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:29.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:29.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:29.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:28 smithi103 ceph-mon[32753]: osdmap e26: 4 total, 4 up, 4 in 2024-08-02T18:43:30.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:29 smithi121 ceph-mon[37236]: pgmap v88: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:30.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:29 smithi151 ceph-mon[37155]: pgmap v88: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:30.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:29 smithi103 ceph-mon[32753]: pgmap v88: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 125 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:30 smithi121 ceph-mon[37236]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-02T18:43:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:30 smithi121 ceph-mon[37236]: osdmap e27: 4 total, 4 up, 4 in 2024-08-02T18:43:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:30 smithi121 ceph-mon[37236]: from='client.? 172.21.15.121:0/197495840' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]: dispatch 2024-08-02T18:43:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:30 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]: dispatch 2024-08-02T18:43:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:30 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]': finished 2024-08-02T18:43:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:30 smithi121 ceph-mon[37236]: osdmap e28: 5 total, 4 up, 5 in 2024-08-02T18:43:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:31.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:30 smithi151 ceph-mon[37155]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-02T18:43:31.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:30 smithi151 ceph-mon[37155]: osdmap e27: 4 total, 4 up, 4 in 2024-08-02T18:43:31.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:30 smithi151 ceph-mon[37155]: from='client.? 172.21.15.121:0/197495840' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]: dispatch 2024-08-02T18:43:31.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:30 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]: dispatch 2024-08-02T18:43:31.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:30 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]': finished 2024-08-02T18:43:31.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:30 smithi151 ceph-mon[37155]: osdmap e28: 5 total, 4 up, 5 in 2024-08-02T18:43:31.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:31.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:30 smithi103 ceph-mon[32753]: Health check failed: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded (PG_DEGRADED) 2024-08-02T18:43:31.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:30 smithi103 ceph-mon[32753]: osdmap e27: 4 total, 4 up, 4 in 2024-08-02T18:43:31.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:30 smithi103 ceph-mon[32753]: from='client.? 172.21.15.121:0/197495840' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]: dispatch 2024-08-02T18:43:31.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:30 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]: dispatch 2024-08-02T18:43:31.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:30 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "ef0e458a-1e86-42a3-afe4-7d80a10e12ea"}]': finished 2024-08-02T18:43:31.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:30 smithi103 ceph-mon[32753]: osdmap e28: 5 total, 4 up, 5 in 2024-08-02T18:43:31.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:32.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:31 smithi121 ceph-mon[37236]: from='client.? 172.21.15.121:0/3852354123' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:32.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:31 smithi121 ceph-mon[37236]: pgmap v91: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:32.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:31 smithi151 ceph-mon[37155]: from='client.? 172.21.15.121:0/3852354123' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:32.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:31 smithi151 ceph-mon[37155]: pgmap v91: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:32.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:31 smithi103 ceph-mon[32753]: from='client.? 172.21.15.121:0/3852354123' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:32.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:31 smithi103 ceph-mon[32753]: pgmap v91: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:34.573 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:34 smithi121 ceph-mon[37236]: pgmap v92: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:34.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:34 smithi103 ceph-mon[32753]: pgmap v92: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:34.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:34 smithi151 ceph-mon[37155]: pgmap v92: 1 pgs: 1 activating+undersized+degraded+remapped; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 2/6 objects degraded (33.333%) 2024-08-02T18:43:35.688 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:35 smithi121 ceph-mon[37236]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-02T18:43:35.688 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:35 smithi121 ceph-mon[37236]: Cluster is now healthy 2024-08-02T18:43:35.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:35 smithi151 ceph-mon[37155]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-02T18:43:35.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:35 smithi151 ceph-mon[37155]: Cluster is now healthy 2024-08-02T18:43:35.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:35 smithi103 ceph-mon[32753]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 2/6 objects degraded (33.333%), 1 pg degraded) 2024-08-02T18:43:35.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:35 smithi103 ceph-mon[32753]: Cluster is now healthy 2024-08-02T18:43:36.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:36 smithi121 ceph-mon[37236]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-08-02T18:43:36.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:36 smithi151 ceph-mon[37155]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-08-02T18:43:36.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:36 smithi103 ceph-mon[32753]: pgmap v93: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 90 KiB/s, 0 objects/s recovering 2024-08-02T18:43:37.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:37 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-02T18:43:37.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:37 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-02T18:43:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:37.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:37 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-08-02T18:43:37.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:37 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:38.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:38 smithi121 ceph-mon[37236]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-02T18:43:38.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:38 smithi121 ceph-mon[37236]: Deploying daemon osd.4 on smithi121 2024-08-02T18:43:38.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:38 smithi151 ceph-mon[37155]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-02T18:43:38.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:38 smithi151 ceph-mon[37155]: Deploying daemon osd.4 on smithi121 2024-08-02T18:43:38.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:38 smithi103 ceph-mon[32753]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-02T18:43:38.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:38 smithi103 ceph-mon[32753]: Deploying daemon osd.4 on smithi121 2024-08-02T18:43:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:40 smithi121 ceph-mon[37236]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-02T18:43:40.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:40 smithi151 ceph-mon[37155]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-02T18:43:40.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:40 smithi103 ceph-mon[32753]: pgmap v95: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 61 KiB/s, 0 objects/s recovering 2024-08-02T18:43:42.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:42 smithi121 ceph-mon[37236]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-02T18:43:42.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:42 smithi151 ceph-mon[37155]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-02T18:43:42.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:42 smithi103 ceph-mon[32753]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 53 KiB/s, 0 objects/s recovering 2024-08-02T18:43:43.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:43.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:43.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:43.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:43.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:43.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:43.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:43.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:43.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:44 smithi121 ceph-mon[37236]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:43:44.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:44 smithi151 ceph-mon[37155]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:43:44.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:44 smithi103 ceph-mon[32753]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:43:45.650 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.649+0000 7f2103fff640 1 -- 172.21.15.121:0/2670026591 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f210c1a05a0 con 0x7f20f80a2bb0 2024-08-02T18:43:45.651 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 4 on host 'smithi121' 2024-08-02T18:43:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f20f80a2bb0 msgr2=0x7f20f80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f20f80a2bb0 0x7f20f80a5070 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f20fc031ae0 tx=0x7f20fc009360 comp rx=0 tx=0).stop 2024-08-02T18:43:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c101a00 msgr2=0x7f210c198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:45.653 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c101a00 0x7f210c198280 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f20f400d950 tx=0x7f20f400de10 comp rx=0 tx=0).stop 2024-08-02T18:43:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 shutdown_connections 2024-08-02T18:43:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f210c1023c0 0x7f210c19f300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f210c101a00 0x7f210c198280 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f20f80a2bb0 0x7f20f80a5070 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 --2- 172.21.15.121:0/2670026591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f210c100800 0x7f210c197d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 >> 172.21.15.121:0/2670026591 conn(0x7f210c0fbfb0 msgr2=0x7f210c069cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:43:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 shutdown_connections 2024-08-02T18:43:45.654 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:43:45.652+0000 7f21113cc640 1 -- 172.21.15.121:0/2670026591 wait complete. 2024-08-02T18:43:46.308 DEBUG:teuthology.orchestra.run.smithi121:osd.4> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.4.service 2024-08-02T18:43:46.310 INFO:tasks.cephadm:Deploying osd.5 on smithi151 with /dev/vg_nvme/lv_3... 2024-08-02T18:43:46.311 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_3 2024-08-02T18:43:46.559 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:43:46.680 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:46 smithi151 ceph-mon[37155]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:43:46.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:46 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:46.681 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:46 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:46 smithi121 ceph-mon[37236]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:43:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:46 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:46 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:46.751 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 18:43:46 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T18:43:46.444+0000 7faacd673640 -1 osd.4 0 log_to_monitors true 2024-08-02T18:43:46.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:46 smithi103 ceph-mon[32753]: pgmap v98: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:43:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:46 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:46 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:47.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:47 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:47.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:47 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:47.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:47 smithi121 ceph-mon[37236]: from='osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-02T18:43:47.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:47 smithi121 ceph-mon[37236]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-02T18:43:47.807 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:47 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:47.807 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:47 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:47.807 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:47 smithi151 ceph-mon[37155]: from='osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-02T18:43:47.807 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:47 smithi151 ceph-mon[37155]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-02T18:43:47.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:47 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:47.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:47 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:47.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:47 smithi103 ceph-mon[32753]: from='osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-02T18:43:47.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:47 smithi103 ceph-mon[32753]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-08-02T18:43:48.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:48 smithi121 ceph-mon[37236]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:48.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:48 smithi121 ceph-mon[37236]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-02T18:43:48.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:48 smithi121 ceph-mon[37236]: osdmap e29: 5 total, 4 up, 5 in 2024-08-02T18:43:48.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:48 smithi121 ceph-mon[37236]: from='osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:43:48.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:48 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:48.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:48 smithi121 ceph-mon[37236]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:43:48.753 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 18:43:48 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T18:43:48.442+0000 7faac95f6640 -1 osd.4 0 waiting for initial osdmap 2024-08-02T18:43:48.753 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 18:43:48 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T18:43:48.447+0000 7faac541e640 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:43:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:48 smithi151 ceph-mon[37155]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:48 smithi151 ceph-mon[37155]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-02T18:43:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:48 smithi151 ceph-mon[37155]: osdmap e29: 5 total, 4 up, 5 in 2024-08-02T18:43:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:48 smithi151 ceph-mon[37155]: from='osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:43:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:48 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:48 smithi151 ceph-mon[37155]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:43:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:48 smithi103 ceph-mon[32753]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:48 smithi103 ceph-mon[32753]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-08-02T18:43:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:48 smithi103 ceph-mon[32753]: osdmap e29: 5 total, 4 up, 5 in 2024-08-02T18:43:48.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:48 smithi103 ceph-mon[32753]: from='osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:43:48.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:48 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:48.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:48 smithi103 ceph-mon[32753]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:43:49.226 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:43:49.251 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_3 2024-08-02T18:43:49.497 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:43:49.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:49 smithi151 ceph-mon[37155]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:43:49.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:49 smithi151 ceph-mon[37155]: osdmap e30: 5 total, 4 up, 5 in 2024-08-02T18:43:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:49 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:49 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:49 smithi121 ceph-mon[37236]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:43:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:49 smithi121 ceph-mon[37236]: osdmap e30: 5 total, 4 up, 5 in 2024-08-02T18:43:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:49 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:49 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:49.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:49 smithi103 ceph-mon[32753]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:43:49.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:49 smithi103 ceph-mon[32753]: osdmap e30: 5 total, 4 up, 5 in 2024-08-02T18:43:49.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:49 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:49.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:49 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 -- 172.21.15.151:0/2988105271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c107630 msgr2=0x7f132c109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:49.959 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 --2- 172.21.15.151:0/2988105271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c107630 0x7f132c109a80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f1324009ca0 tx=0x7f132402a8c0 comp rx=0 tx=0).stop 2024-08-02T18:43:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 -- 172.21.15.151:0/2988105271 shutdown_connections 2024-08-02T18:43:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 --2- 172.21.15.151:0/2988105271 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c107630 0x7f132c109a80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 --2- 172.21.15.151:0/2988105271 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f132c104d00 0x7f132c1070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 --2- 172.21.15.151:0/2988105271 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f132c1023d0 0x7f132c1047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 -- 172.21.15.151:0/2988105271 >> 172.21.15.151:0/2988105271 conn(0x7f132c0fbfd0 msgr2=0x7f132c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:43:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 -- 172.21.15.151:0/2988105271 shutdown_connections 2024-08-02T18:43:49.960 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.957+0000 7f1332e22640 1 -- 172.21.15.151:0/2988105271 wait complete. 2024-08-02T18:43:49.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.958+0000 7f1332e22640 1 Processor -- start 2024-08-02T18:43:49.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.958+0000 7f1332e22640 1 -- start start 2024-08-02T18:43:49.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1332e22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f132c1023d0 0x7f132c197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:49.962 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1332e22640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c104d00 0x7f132c1981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1332e22640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f132c107630 0x7f132c19f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1332e22640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f132c10d720 con 0x7f132c107630 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1332e22640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f132c10d5a0 con 0x7f132c1023d0 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1332e22640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f132c10d8a0 con 0x7f132c104d00 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c104d00 0x7f132c1981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c104d00 0x7f132c1981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:58168/0 (socket says 172.21.15.151:58168) 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 -- 172.21.15.151:0/1002813962 learned_addr learned my addr 172.21.15.151:0/1002813962 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1330bbe640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f132c1023d0 0x7f132c197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f13313bf640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f132c107630 0x7f132c19f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 -- 172.21.15.151:0/1002813962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f132c1023d0 msgr2=0x7f132c197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:49.963 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f132c1023d0 0x7f132c197c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 -- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f132c107630 msgr2=0x7f132c19f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f132c107630 0x7f132c19f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 -- 172.21.15.151:0/1002813962 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f132c19f8b0 con 0x7f132c104d00 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f132bfff640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c104d00 0x7f132c1981d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f131800d770 tx=0x7f131800dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1329ffb640 1 -- 172.21.15.151:0/1002813962 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1318017070 con 0x7f132c104d00 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1329ffb640 1 -- 172.21.15.151:0/1002813962 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1318009c30 con 0x7f132c104d00 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f132c19fba0 con 0x7f132c104d00 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.959+0000 7f1329ffb640 1 -- 172.21.15.151:0/1002813962 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f131800f6b0 con 0x7f132c104d00 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.960+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f132c1a00e0 con 0x7f132c104d00 2024-08-02T18:43:49.964 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.961+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f132c0fdac0 con 0x7f132c104d00 2024-08-02T18:43:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.962+0000 7f1329ffb640 1 -- 172.21.15.151:0/1002813962 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f131801a070 con 0x7f132c104d00 2024-08-02T18:43:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.962+0000 7f1329ffb640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f131c0a2b80 0x7f131c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:43:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.963+0000 7f1329ffb640 1 -- 172.21.15.151:0/1002813962 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(31..31 src has 1..31) ==== 4101+0+0 (secure 0 0 0) 0x7f13180cda60 con 0x7f132c104d00 2024-08-02T18:43:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.963+0000 7f1330bbe640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f131c0a2b80 0x7f131c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:43:49.965 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.963+0000 7f1330bbe640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f131c0a2b80 0x7f131c0a5040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f132c198b70 tx=0x7f132000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:43:49.968 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:49.967+0000 7f1329ffb640 1 -- 172.21.15.151:0/1002813962 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1318009de0 con 0x7f132c104d00 2024-08-02T18:43:50.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:43:50.142+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) -- 0x7f132c062360 con 0x7f131c0a2b80 2024-08-02T18:43:50.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:43:50.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:43:50.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:50.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:50.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] boot 2024-08-02T18:43:50.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: osdmap e31: 5 total, 5 up, 5 in 2024-08-02T18:43:50.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:50.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:50.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:50.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:50.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:50.754 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.754 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:50.754 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:50.754 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:50.754 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.754 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:50.754 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:50.755 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:50.771 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] boot 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: osdmap e31: 5 total, 5 up, 5 in 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:50.772 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.773 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:50.773 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:50.773 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:50.773 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.773 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:50.773 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:50.773 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:50.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 124 MiB used, 357 GiB / 358 GiB avail 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: osd.4 [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] boot 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: osdmap e31: 5 total, 5 up, 5 in 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:43:50.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:43:51.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:51 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi121 2024-08-02T18:43:51.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:51 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi121 to 8544M 2024-08-02T18:43:51.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:51 smithi151 ceph-mon[37155]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:51.725 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:51 smithi151 ceph-mon[37155]: osdmap e32: 5 total, 5 up, 5 in 2024-08-02T18:43:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:51 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi121 2024-08-02T18:43:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:51 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi121 to 8544M 2024-08-02T18:43:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:51 smithi121 ceph-mon[37236]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:51 smithi121 ceph-mon[37236]: osdmap e32: 5 total, 5 up, 5 in 2024-08-02T18:43:51.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:51 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi121 2024-08-02T18:43:51.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:51 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi121 to 8544M 2024-08-02T18:43:51.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:51 smithi103 ceph-mon[32753]: from='client.24223 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:43:51.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:51 smithi103 ceph-mon[32753]: osdmap e32: 5 total, 5 up, 5 in 2024-08-02T18:43:52.727 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:52 smithi103 ceph-mon[32753]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:52.738 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:52 smithi151 ceph-mon[37155]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:52.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:52 smithi121 ceph-mon[37236]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:53 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/1960486017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]: dispatch 2024-08-02T18:43:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:53 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]: dispatch 2024-08-02T18:43:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:53 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]': finished 2024-08-02T18:43:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:53 smithi121 ceph-mon[37236]: osdmap e33: 6 total, 5 up, 6 in 2024-08-02T18:43:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:53 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:43:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:53 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/1602696640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:53 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/1960486017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]: dispatch 2024-08-02T18:43:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:53 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]: dispatch 2024-08-02T18:43:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:53 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]': finished 2024-08-02T18:43:53.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:53 smithi151 ceph-mon[37155]: osdmap e33: 6 total, 5 up, 6 in 2024-08-02T18:43:53.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:53 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:43:53.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:53 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/1602696640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:53 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/1960486017' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]: dispatch 2024-08-02T18:43:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:53 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]: dispatch 2024-08-02T18:43:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:53 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "a9e2a3d3-7b17-489c-9229-04141660dc5b"}]': finished 2024-08-02T18:43:53.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:53 smithi103 ceph-mon[32753]: osdmap e33: 6 total, 5 up, 6 in 2024-08-02T18:43:53.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:53 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:43:53.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:53 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/1602696640' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:43:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:54 smithi151 ceph-mon[37155]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:54 smithi103 ceph-mon[32753]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:55.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:54 smithi121 ceph-mon[37236]: pgmap v107: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:56.816 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:56 smithi151 ceph-mon[37155]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:56.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:56 smithi103 ceph-mon[32753]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:56 smithi121 ceph-mon[37236]: pgmap v108: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:57.528 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:43:57 smithi151 ceph-mon[37155]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:57.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:43:57 smithi103 ceph-mon[32753]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:43:58.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:43:57 smithi121 ceph-mon[37236]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:00.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:00 smithi151 ceph-mon[37155]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-02T18:44:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:00 smithi121 ceph-mon[37236]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-02T18:44:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:00 smithi103 ceph-mon[32753]: pgmap v110: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-08-02T18:44:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:01.537 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:01 smithi151 ceph-mon[37155]: Deploying daemon osd.5 on smithi151 2024-08-02T18:44:01.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:01 smithi121 ceph-mon[37236]: Deploying daemon osd.5 on smithi151 2024-08-02T18:44:01.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:01 smithi103 ceph-mon[32753]: Deploying daemon osd.5 on smithi151 2024-08-02T18:44:02.500 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:02 smithi151 ceph-mon[37155]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:02.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:02 smithi121 ceph-mon[37236]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:02.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:02 smithi103 ceph-mon[32753]: pgmap v111: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:04.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:04 smithi151 ceph-mon[37155]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:04 smithi121 ceph-mon[37236]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:04.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:04 smithi103 ceph-mon[32753]: pgmap v112: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:05.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:05.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:05.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:05.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:05.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:06.606 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:06 smithi151 ceph-mon[37155]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:06.630 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:06 smithi121 ceph-mon[37236]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:06 smithi103 ceph-mon[32753]: pgmap v113: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:08.408 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.407+0000 7f1329ffb640 1 -- 172.21.15.151:0/1002813962 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f132c062360 con 0x7f131c0a2b80 2024-08-02T18:44:08.409 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 5 on host 'smithi151' 2024-08-02T18:44:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f131c0a2b80 msgr2=0x7f131c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f131c0a2b80 0x7f131c0a5040 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f132c198b70 tx=0x7f132000b390 comp rx=0 tx=0).stop 2024-08-02T18:44:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c104d00 msgr2=0x7f132c1981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c104d00 0x7f132c1981d0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f131800d770 tx=0x7f131800dc30 comp rx=0 tx=0).stop 2024-08-02T18:44:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 shutdown_connections 2024-08-02T18:44:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f132c107630 0x7f132c19f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f131c0a2b80 0x7f131c0a5040 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:08.411 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f132c104d00 0x7f132c1981d0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:08.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 --2- 172.21.15.151:0/1002813962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f132c1023d0 0x7f132c197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:08.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 >> 172.21.15.151:0/1002813962 conn(0x7f132c0fbfd0 msgr2=0x7f132c102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:44:08.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 shutdown_connections 2024-08-02T18:44:08.412 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:08.409+0000 7f1332e22640 1 -- 172.21.15.151:0/1002813962 wait complete. 2024-08-02T18:44:08.738 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:08 smithi151 ceph-mon[37155]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:08.739 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:08.739 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:08.739 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:08.739 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:08.739 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:08 smithi121 ceph-mon[37236]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:08 smithi103 ceph-mon[32753]: pgmap v114: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:08.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:08.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:08.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:09.097 DEBUG:teuthology.orchestra.run.smithi151:osd.5> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.5.service 2024-08-02T18:44:09.099 INFO:tasks.cephadm:Deploying osd.6 on smithi103 with /dev/vg_nvme/lv_2... 2024-08-02T18:44:09.099 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-02T18:44:09.367 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:44:09.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:09.489 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:09.490 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:09.490 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:09 smithi103 ceph-mon[32753]: from='osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-02T18:44:09.490 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:09 smithi103 ceph-mon[32753]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-02T18:44:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:09 smithi121 ceph-mon[37236]: from='osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-02T18:44:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:09 smithi121 ceph-mon[37236]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-02T18:44:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:09 smithi151 ceph-mon[37155]: from='osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-02T18:44:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:09 smithi151 ceph-mon[37155]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-08-02T18:44:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:10 smithi151 ceph-mon[37155]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:10 smithi151 ceph-mon[37155]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-02T18:44:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:10 smithi151 ceph-mon[37155]: osdmap e34: 6 total, 5 up, 6 in 2024-08-02T18:44:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:10 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:10 smithi151 ceph-mon[37155]: from='osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:44:10.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:10 smithi151 ceph-mon[37155]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:44:10.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 18:44:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T18:44:10.418+0000 7fe22eb77640 -1 osd.5 0 waiting for initial osdmap 2024-08-02T18:44:10.572 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 18:44:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T18:44:10.423+0000 7fe22a99f640 -1 osd.5 35 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:44:10.687 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:10 smithi103 ceph-mon[32753]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:10.688 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:10 smithi103 ceph-mon[32753]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-02T18:44:10.688 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:10 smithi103 ceph-mon[32753]: osdmap e34: 6 total, 5 up, 6 in 2024-08-02T18:44:10.688 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:10 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:10.688 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:10 smithi103 ceph-mon[32753]: from='osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:44:10.688 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:10 smithi103 ceph-mon[32753]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:44:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:10 smithi121 ceph-mon[37236]: pgmap v115: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:10 smithi121 ceph-mon[37236]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-08-02T18:44:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:10 smithi121 ceph-mon[37236]: osdmap e34: 6 total, 5 up, 6 in 2024-08-02T18:44:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:10 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:10 smithi121 ceph-mon[37236]: from='osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:44:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:10 smithi121 ceph-mon[37236]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:44:11.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:11 smithi151 ceph-mon[37155]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:44:11.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:11 smithi151 ceph-mon[37155]: osdmap e35: 6 total, 5 up, 6 in 2024-08-02T18:44:11.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:11 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:11 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:11 smithi151 ceph-mon[37155]: osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] boot 2024-08-02T18:44:11.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:11 smithi151 ceph-mon[37155]: osdmap e36: 6 total, 6 up, 6 in 2024-08-02T18:44:11.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:11 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:11 smithi103 ceph-mon[32753]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:44:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:11 smithi103 ceph-mon[32753]: osdmap e35: 6 total, 5 up, 6 in 2024-08-02T18:44:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:11 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:11 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:11 smithi103 ceph-mon[32753]: osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] boot 2024-08-02T18:44:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:11 smithi103 ceph-mon[32753]: osdmap e36: 6 total, 6 up, 6 in 2024-08-02T18:44:11.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:11 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:11 smithi121 ceph-mon[37236]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:44:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:11 smithi121 ceph-mon[37236]: osdmap e35: 6 total, 5 up, 6 in 2024-08-02T18:44:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:11 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:11 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:11 smithi121 ceph-mon[37236]: osd.5 [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] boot 2024-08-02T18:44:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:11 smithi121 ceph-mon[37236]: osdmap e36: 6 total, 6 up, 6 in 2024-08-02T18:44:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:11 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:44:11.926 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:44:11.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_2 2024-08-02T18:44:12.221 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:44:12.618 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: osdmap e37: 6 total, 6 up, 6 in 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:12.619 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 -- 172.21.15.103:0/2272472841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae98101930 msgr2=0x7fae98101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 --2- 172.21.15.103:0/2272472841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae98101930 0x7fae98101d30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fae94009900 tx=0x7fae9402a410 comp rx=0 tx=0).stop 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 -- 172.21.15.103:0/2272472841 shutdown_connections 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 --2- 172.21.15.103:0/2272472841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae981034f0 0x7fae98109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 --2- 172.21.15.103:0/2272472841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae98102b30 0x7fae98102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 --2- 172.21.15.103:0/2272472841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae98101930 0x7fae98101d30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 -- 172.21.15.103:0/2272472841 >> 172.21.15.103:0/2272472841 conn(0x7fae980fd0c0 msgr2=0x7fae980ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 -- 172.21.15.103:0/2272472841 shutdown_connections 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.699+0000 7fae9f757640 1 -- 172.21.15.103:0/2272472841 wait complete. 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9f757640 1 Processor -- start 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9f757640 1 -- start start 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9f757640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae98101930 0x7fae98075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:12.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9f757640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae98102b30 0x7fae98074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9f757640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae981034f0 0x7fae98074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9f757640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae9810d7d0 con 0x7fae981034f0 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9f757640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae9810d650 con 0x7fae98102b30 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9f757640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae9810d950 con 0x7fae98101930 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9dcf4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae981034f0 0x7fae98074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9dcf4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae981034f0 0x7fae98074850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37326/0 (socket says 172.21.15.103:37326) 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9dcf4640 1 -- 172.21.15.103:0/3537365758 learned_addr learned my addr 172.21.15.103:0/3537365758 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.700+0000 7fae9ccf2640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae98102b30 0x7fae98074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9d4f3640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae98101930 0x7fae98075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9dcf4640 1 -- 172.21.15.103:0/3537365758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae98101930 msgr2=0x7fae98075cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9dcf4640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae98101930 0x7fae98075cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9dcf4640 1 -- 172.21.15.103:0/3537365758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae98102b30 msgr2=0x7fae98074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:12.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9dcf4640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae98102b30 0x7fae98074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9dcf4640 1 -- 172.21.15.103:0/3537365758 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae98075110 con 0x7fae981034f0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9ccf2640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae98102b30 0x7fae98074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9dcf4640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae981034f0 0x7fae98074850 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fae9000b970 tx=0x7fae9000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae8e7fc640 1 -- 172.21.15.103:0/3537365758 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90019070 con 0x7fae981034f0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae8e7fc640 1 -- 172.21.15.103:0/3537365758 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae9000cb40 con 0x7fae981034f0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae981a1fc0 con 0x7fae981034f0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae8e7fc640 1 -- 172.21.15.103:0/3537365758 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae90007700 con 0x7fae981034f0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.701+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae981a2550 con 0x7fae981034f0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.702+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae98108d80 con 0x7fae981034f0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.703+0000 7fae8e7fc640 1 -- 172.21.15.103:0/3537365758 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fae9001c070 con 0x7fae981034f0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.704+0000 7fae8e7fc640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fae840a2b80 0x7fae840a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.704+0000 7fae9d4f3640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fae840a2b80 0x7fae840a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:12.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.704+0000 7fae8e7fc640 1 -- 172.21.15.103:0/3537365758 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(38..38 src has 1..38) ==== 4562+0+0 (secure 0 0 0) 0x7fae900cdc00 con 0x7fae981034f0 2024-08-02T18:44:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.704+0000 7fae9d4f3640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fae840a2b80 0x7fae840a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae94006010 tx=0x7fae94031660 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:44:12.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.707+0000 7fae8e7fc640 1 -- 172.21.15.103:0/3537365758 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fae9009ba00 con 0x7fae981034f0 2024-08-02T18:44:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:44:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:44:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: osdmap e37: 6 total, 6 up, 6 in 2024-08-02T18:44:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:12.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:12.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:12.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:12.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: pgmap v119: 1 pgs: 1 active+clean; 577 KiB data, 151 MiB used, 447 GiB / 447 GiB avail 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: osdmap e37: 6 total, 6 up, 6 in 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:12.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:12.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:12.881+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fae98062360 con 0x7fae840a2b80 2024-08-02T18:44:13.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:13 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi151 2024-08-02T18:44:13.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:13 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi151 to 8544M 2024-08-02T18:44:13.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:13 smithi103 ceph-mon[32753]: osdmap e38: 6 total, 6 up, 6 in 2024-08-02T18:44:13.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:13.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:13.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:13 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi151 2024-08-02T18:44:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:13 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi151 to 8544M 2024-08-02T18:44:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:13 smithi121 ceph-mon[37236]: osdmap e38: 6 total, 6 up, 6 in 2024-08-02T18:44:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:13 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi151 2024-08-02T18:44:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:13 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi151 to 8544M 2024-08-02T18:44:13.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:13 smithi151 ceph-mon[37155]: osdmap e38: 6 total, 6 up, 6 in 2024-08-02T18:44:13.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:13.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:13.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:14.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:14 smithi103 ceph-mon[32753]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:14.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:14 smithi103 ceph-mon[32753]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:14.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:14 smithi103 ceph-mon[32753]: osdmap e39: 6 total, 6 up, 6 in 2024-08-02T18:44:14.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:14 smithi151 ceph-mon[37155]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:14.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:14 smithi151 ceph-mon[37155]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:14.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:14 smithi151 ceph-mon[37155]: osdmap e39: 6 total, 6 up, 6 in 2024-08-02T18:44:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:14 smithi121 ceph-mon[37236]: from='client.14373 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:14 smithi121 ceph-mon[37236]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:14 smithi121 ceph-mon[37236]: osdmap e39: 6 total, 6 up, 6 in 2024-08-02T18:44:15.818 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:15 smithi103 ceph-mon[32753]: osdmap e40: 6 total, 6 up, 6 in 2024-08-02T18:44:15.819 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:15 smithi103 ceph-mon[32753]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-02T18:44:15.819 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:15 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/442285125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c779781-bb3d-4067-8c1d-86c5c5ef5dfe"}]: dispatch 2024-08-02T18:44:15.819 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:15 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/442285125' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c779781-bb3d-4067-8c1d-86c5c5ef5dfe"}]': finished 2024-08-02T18:44:15.819 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:15 smithi103 ceph-mon[32753]: osdmap e41: 7 total, 6 up, 7 in 2024-08-02T18:44:15.819 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:15.919 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:15 smithi151 ceph-mon[37155]: osdmap e40: 6 total, 6 up, 6 in 2024-08-02T18:44:15.919 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:15 smithi151 ceph-mon[37155]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-02T18:44:15.919 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:15 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/442285125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c779781-bb3d-4067-8c1d-86c5c5ef5dfe"}]: dispatch 2024-08-02T18:44:15.919 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:15 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/442285125' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c779781-bb3d-4067-8c1d-86c5c5ef5dfe"}]': finished 2024-08-02T18:44:15.919 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:15 smithi151 ceph-mon[37155]: osdmap e41: 7 total, 6 up, 7 in 2024-08-02T18:44:15.919 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:16.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:15 smithi121 ceph-mon[37236]: osdmap e40: 6 total, 6 up, 6 in 2024-08-02T18:44:16.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:15 smithi121 ceph-mon[37236]: pgmap v125: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-02T18:44:16.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:15 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/442285125' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "3c779781-bb3d-4067-8c1d-86c5c5ef5dfe"}]: dispatch 2024-08-02T18:44:16.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:15 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/442285125' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "3c779781-bb3d-4067-8c1d-86c5c5ef5dfe"}]': finished 2024-08-02T18:44:16.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:15 smithi121 ceph-mon[37236]: osdmap e41: 7 total, 6 up, 7 in 2024-08-02T18:44:16.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:17.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:16 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2206775951' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:44:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:16 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2206775951' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:44:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:16 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2206775951' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:44:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:17 smithi121 ceph-mon[37236]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-02T18:44:18.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:17 smithi151 ceph-mon[37155]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-02T18:44:18.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:17 smithi103 ceph-mon[32753]: pgmap v127: 1 pgs: 1 peering; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-02T18:44:20.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:20 smithi103 ceph-mon[32753]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-02T18:44:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:20 smithi121 ceph-mon[37236]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-02T18:44:20.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:20 smithi151 ceph-mon[37155]: pgmap v128: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-02T18:44:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:22 smithi103 ceph-mon[32753]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-02T18:44:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-02T18:44:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:22.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:22 smithi121 ceph-mon[37236]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-02T18:44:22.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:22 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-02T18:44:22.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:22 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:22.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:22 smithi151 ceph-mon[37155]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-02T18:44:22.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:22 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-08-02T18:44:22.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:22 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:23.625 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:23 smithi103 ceph-mon[32753]: Deploying daemon osd.6 on smithi103 2024-08-02T18:44:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:23 smithi121 ceph-mon[37236]: Deploying daemon osd.6 on smithi103 2024-08-02T18:44:23.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:23 smithi151 ceph-mon[37155]: Deploying daemon osd.6 on smithi103 2024-08-02T18:44:24.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:24 smithi103 ceph-mon[32753]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:24.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:24 smithi121 ceph-mon[37236]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:24.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:24 smithi151 ceph-mon[37155]: pgmap v130: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:26.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:26 smithi121 ceph-mon[37236]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:26.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:26 smithi151 ceph-mon[37155]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:26.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:26 smithi103 ceph-mon[32753]: pgmap v131: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:28.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:28 smithi103 ceph-mon[32753]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:28.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:28.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:28.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:28 smithi121 ceph-mon[37236]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:28 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:28 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:28 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:28 smithi151 ceph-mon[37155]: pgmap v132: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:28 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:28 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:28 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:30.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:30 smithi103 ceph-mon[32753]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:30.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:30.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:30 smithi121 ceph-mon[37236]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:30 smithi151 ceph-mon[37155]: pgmap v133: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.053 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 6 on host 'smithi103' 2024-08-02T18:44:31.054 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.050+0000 7fae8e7fc640 1 -- 172.21.15.103:0/3537365758 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fae98062360 con 0x7fae840a2b80 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fae840a2b80 msgr2=0x7fae840a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fae840a2b80 0x7fae840a5040 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fae94006010 tx=0x7fae94031660 comp rx=0 tx=0).stop 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae981034f0 msgr2=0x7fae98074850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae981034f0 0x7fae98074850 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fae9000b970 tx=0x7fae9000be30 comp rx=0 tx=0).stop 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 shutdown_connections 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae981034f0 0x7fae98074850 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae98102b30 0x7fae98074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fae840a2b80 0x7fae840a5040 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 --2- 172.21.15.103:0/3537365758 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae98101930 0x7fae98075cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 >> 172.21.15.103:0/3537365758 conn(0x7fae980fd0c0 msgr2=0x7fae98105f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:44:31.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 shutdown_connections 2024-08-02T18:44:31.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:44:31.053+0000 7fae9f757640 1 -- 172.21.15.103:0/3537365758 wait complete. 2024-08-02T18:44:31.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:31 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:31.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:31 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:31.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:31 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:31 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:31.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:31 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:31 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.637 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:31 smithi103 ceph-mon[32753]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-02T18:44:31.665 DEBUG:teuthology.orchestra.run.smithi103:osd.6> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.6.service 2024-08-02T18:44:31.668 INFO:tasks.cephadm:Deploying osd.7 on smithi121 with /dev/vg_nvme/lv_2... 2024-08-02T18:44:31.668 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-02T18:44:31.694 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:31 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:31.694 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:31 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:31.694 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:31 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.694 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:31 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:31.694 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:31 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.695 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:31 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.695 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:31 smithi121 ceph-mon[37236]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-02T18:44:31.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:31 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:31.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:31 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:31.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:31 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:31 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:31.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:31 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:31 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:31.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:31 smithi151 ceph-mon[37155]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-08-02T18:44:31.926 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T18:44:32.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:32 smithi103 ceph-mon[32753]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:32.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:32 smithi103 ceph-mon[32753]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-02T18:44:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:32 smithi103 ceph-mon[32753]: osdmap e42: 7 total, 6 up, 7 in 2024-08-02T18:44:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:32 smithi103 ceph-mon[32753]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:44:32.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:32 smithi121 ceph-mon[37236]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:32 smithi121 ceph-mon[37236]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-02T18:44:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:32 smithi121 ceph-mon[37236]: osdmap e42: 7 total, 6 up, 7 in 2024-08-02T18:44:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:32 smithi121 ceph-mon[37236]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:44:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:32 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:32 smithi151 ceph-mon[37155]: pgmap v134: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:32 smithi151 ceph-mon[37155]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-08-02T18:44:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:32 smithi151 ceph-mon[37155]: osdmap e42: 7 total, 6 up, 7 in 2024-08-02T18:44:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:32 smithi151 ceph-mon[37155]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:44:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:32 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:34.060 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 18:44:33 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T18:44:33.741+0000 7f94524f7640 -1 osd.6 0 waiting for initial osdmap 2024-08-02T18:44:34.061 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 18:44:33 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T18:44:33.751+0000 7f9449b03640 -1 osd.6 43 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:44:34.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:34 smithi121 ceph-mon[37236]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:44:34.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:34 smithi121 ceph-mon[37236]: osdmap e43: 7 total, 6 up, 7 in 2024-08-02T18:44:34.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:34 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:34.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:34 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:34.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:34 smithi121 ceph-mon[37236]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:34.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:34 smithi121 ceph-mon[37236]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' 2024-08-02T18:44:34.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:34 smithi151 ceph-mon[37155]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:44:34.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:34 smithi151 ceph-mon[37155]: osdmap e43: 7 total, 6 up, 7 in 2024-08-02T18:44:34.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:34 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:34.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:34 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:34.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:34 smithi151 ceph-mon[37155]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:34.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:34 smithi151 ceph-mon[37155]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' 2024-08-02T18:44:34.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:34 smithi103 ceph-mon[32753]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:44:34.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:34 smithi103 ceph-mon[32753]: osdmap e43: 7 total, 6 up, 7 in 2024-08-02T18:44:34.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:34 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:34.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:34 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:34.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:34 smithi103 ceph-mon[32753]: pgmap v137: 1 pgs: 1 active+clean; 577 KiB data, 178 MiB used, 536 GiB / 536 GiB avail 2024-08-02T18:44:34.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:34 smithi103 ceph-mon[32753]: from='osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050]' entity='osd.6' 2024-08-02T18:44:34.629 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:44:34.656 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_2 2024-08-02T18:44:34.952 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T18:44:35.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] boot 2024-08-02T18:44:35.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: osdmap e44: 7 total, 7 up, 7 in 2024-08-02T18:44:35.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:35 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:35.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:44:35.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:44:35.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:35.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] boot 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: osdmap e44: 7 total, 7 up, 7 in 2024-08-02T18:44:35.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:35 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:35.395 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:44:35.396 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:44:35.396 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:35.396 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.396 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.396 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.396 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.396 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:35.396 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.397 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:35.397 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:35.397 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:35.397 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: osd.6 [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] boot 2024-08-02T18:44:35.397 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: osdmap e44: 7 total, 7 up, 7 in 2024-08-02T18:44:35.397 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:35 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:44:35.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 -- 172.21.15.121:0/2893162194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 msgr2=0x7f6b50101d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:35.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 --2- 172.21.15.121:0/2893162194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 0x7f6b50101d30 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6b40009900 tx=0x7f6b4002a410 comp rx=0 tx=0).stop 2024-08-02T18:44:35.495 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 -- 172.21.15.121:0/2893162194 shutdown_connections 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 --2- 172.21.15.121:0/2893162194 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b501034f0 0x7f6b50109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 --2- 172.21.15.121:0/2893162194 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b50102b30 0x7f6b50102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 --2- 172.21.15.121:0/2893162194 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 0x7f6b50101d30 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 -- 172.21.15.121:0/2893162194 >> 172.21.15.121:0/2893162194 conn(0x7f6b500fd0c0 msgr2=0x7f6b500ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 -- 172.21.15.121:0/2893162194 shutdown_connections 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 -- 172.21.15.121:0/2893162194 wait complete. 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 Processor -- start 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.477+0000 7f6b569ec640 1 -- start start 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b569ec640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 0x7f6b50197d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b569ec640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b50102b30 0x7f6b50198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b569ec640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b501034f0 0x7f6b5019f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b569ec640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5010d6f0 con 0x7f6b50102b30 2024-08-02T18:44:35.496 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b569ec640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5010d570 con 0x7f6b50101930 2024-08-02T18:44:35.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b569ec640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6b5010d870 con 0x7f6b501034f0 2024-08-02T18:44:35.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 0x7f6b50197d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:35.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 0x7f6b50197d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:43636/0 (socket says 172.21.15.121:43636) 2024-08-02T18:44:35.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 -- 172.21.15.121:0/3109987288 learned_addr learned my addr 172.21.15.121:0/3109987288 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-02T18:44:35.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b54f89640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b501034f0 0x7f6b5019f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:35.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 -- 172.21.15.121:0/3109987288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b501034f0 msgr2=0x7f6b5019f2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:35.497 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b501034f0 0x7f6b5019f2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 -- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b50102b30 msgr2=0x7f6b50198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b50102b30 0x7f6b50198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 -- 172.21.15.121:0/3109987288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6b5019f960 con 0x7f6b50101930 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4ffff640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 0x7f6b50197d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b40005ab0 tx=0x7f6b400042f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4d7fa640 1 -- 172.21.15.121:0/3109987288 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b4003f030 con 0x7f6b50101930 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6b5019fbf0 con 0x7f6b50101930 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4d7fa640 1 -- 172.21.15.121:0/3109987288 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6b40003d00 con 0x7f6b50101930 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.478+0000 7f6b4d7fa640 1 -- 172.21.15.121:0/3109987288 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6b40035070 con 0x7f6b50101930 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.479+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6b501a0120 con 0x7f6b50101930 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.480+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6b50108d30 con 0x7f6b50101930 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.480+0000 7f6b4d7fa640 1 -- 172.21.15.121:0/3109987288 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6b40042030 con 0x7f6b50101930 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.481+0000 7f6b4d7fa640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6b380a2b80 0x7f6b380a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:35.498 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.481+0000 7f6b4d7fa640 1 -- 172.21.15.121:0/3109987288 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(44..44 src has 1..44) ==== 4965+0+0 (secure 0 0 0) 0x7f6b400eea40 con 0x7f6b50101930 2024-08-02T18:44:35.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.481+0000 7f6b4f7fe640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6b380a2b80 0x7f6b380a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:35.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.482+0000 7f6b4f7fe640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6b380a2b80 0x7f6b380a5040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b44005fd0 tx=0x7f6b44005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:44:35.499 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.485+0000 7f6b4d7fa640 1 -- 172.21.15.121:0/3109987288 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6b400bc6b0 con 0x7f6b50101930 2024-08-02T18:44:35.662 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:35.661+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7f6b50062360 con 0x7f6b380a2b80 2024-08-02T18:44:36.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:36 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi103 2024-08-02T18:44:36.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:36 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi103 to 5696M 2024-08-02T18:44:36.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:36 smithi151 ceph-mon[37155]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:36.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:36.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:36.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:36.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:36 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi103 2024-08-02T18:44:36.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:36 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi103 to 5696M 2024-08-02T18:44:36.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:36 smithi103 ceph-mon[32753]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:36.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:36.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:36.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:36.384 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:36 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi103 2024-08-02T18:44:36.385 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:36 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi103 to 5696M 2024-08-02T18:44:36.385 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:36 smithi121 ceph-mon[37236]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:36.385 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:36.385 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:36.385 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:37.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:37 smithi151 ceph-mon[37155]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:37.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:37 smithi151 ceph-mon[37155]: osdmap e45: 7 total, 7 up, 7 in 2024-08-02T18:44:37.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:37 smithi103 ceph-mon[32753]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:37.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:37 smithi103 ceph-mon[32753]: osdmap e45: 7 total, 7 up, 7 in 2024-08-02T18:44:37.341 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:37 smithi121 ceph-mon[37236]: from='client.24266 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:37.341 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:37 smithi121 ceph-mon[37236]: osdmap e45: 7 total, 7 up, 7 in 2024-08-02T18:44:38.346 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:38 smithi121 ceph-mon[37236]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:38.346 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:38 smithi121 ceph-mon[37236]: from='client.? 172.21.15.121:0/1006452210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]: dispatch 2024-08-02T18:44:38.346 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:38 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]: dispatch 2024-08-02T18:44:38.346 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:38 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]': finished 2024-08-02T18:44:38.346 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:38 smithi121 ceph-mon[37236]: osdmap e46: 8 total, 7 up, 8 in 2024-08-02T18:44:38.346 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:38 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:38.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:38 smithi151 ceph-mon[37155]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:38.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:38 smithi151 ceph-mon[37155]: from='client.? 172.21.15.121:0/1006452210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]: dispatch 2024-08-02T18:44:38.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:38 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]: dispatch 2024-08-02T18:44:38.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:38 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]': finished 2024-08-02T18:44:38.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:38 smithi151 ceph-mon[37155]: osdmap e46: 8 total, 7 up, 8 in 2024-08-02T18:44:38.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:38 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:38.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:38 smithi103 ceph-mon[32753]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 209 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:38.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:38 smithi103 ceph-mon[32753]: from='client.? 172.21.15.121:0/1006452210' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]: dispatch 2024-08-02T18:44:38.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:38 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]: dispatch 2024-08-02T18:44:38.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:38 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "35728743-216c-4e32-be58-71f4feafabbc"}]': finished 2024-08-02T18:44:38.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:38 smithi103 ceph-mon[32753]: osdmap e46: 8 total, 7 up, 8 in 2024-08-02T18:44:38.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:38 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:39.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:39 smithi121 ceph-mon[37236]: from='client.? 172.21.15.121:0/1560318697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:44:39.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:39 smithi151 ceph-mon[37155]: from='client.? 172.21.15.121:0/1560318697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:44:39.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:39 smithi103 ceph-mon[32753]: from='client.? 172.21.15.121:0/1560318697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:44:40.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:40 smithi121 ceph-mon[37236]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:40.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:40 smithi151 ceph-mon[37155]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:40.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:40 smithi103 ceph-mon[32753]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:42.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:42 smithi121 ceph-mon[37236]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:42.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:42 smithi151 ceph-mon[37155]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:42.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:42 smithi103 ceph-mon[32753]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:44 smithi121 ceph-mon[37236]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:44.622 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:44 smithi151 ceph-mon[37155]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:44.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:44 smithi103 ceph-mon[32753]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:45.589 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-02T18:44:45.589 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:45.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-02T18:44:45.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:45.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-08-02T18:44:45.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:46.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:46 smithi121 ceph-mon[37236]: Deploying daemon osd.7 on smithi121 2024-08-02T18:44:46.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:46 smithi121 ceph-mon[37236]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:46.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:46 smithi151 ceph-mon[37155]: Deploying daemon osd.7 on smithi121 2024-08-02T18:44:46.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:46 smithi151 ceph-mon[37155]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:46.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:46 smithi103 ceph-mon[32753]: Deploying daemon osd.7 on smithi121 2024-08-02T18:44:46.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:46 smithi103 ceph-mon[32753]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:48.622 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:48 smithi121 ceph-mon[37236]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:48 smithi151 ceph-mon[37155]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:48.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:48 smithi103 ceph-mon[32753]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:50.701 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:50 smithi121 ceph-mon[37236]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:50.701 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:50.702 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:50.702 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:50 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:50 smithi151 ceph-mon[37155]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:50 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:50.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:50 smithi103 ceph-mon[32753]: pgmap v148: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:50.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:50.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:50.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:50 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:52.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:52 smithi121 ceph-mon[37236]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:52.627 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:52 smithi103 ceph-mon[32753]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:52.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:52 smithi151 ceph-mon[37155]: pgmap v149: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:53.791 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.789+0000 7f6b4d7fa640 1 -- 172.21.15.121:0/3109987288 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f6b50062360 con 0x7f6b380a2b80 2024-08-02T18:44:53.792 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 7 on host 'smithi121' 2024-08-02T18:44:53.793 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6b380a2b80 msgr2=0x7f6b380a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6b380a2b80 0x7f6b380a5040 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f6b44005fd0 tx=0x7f6b44005850 comp rx=0 tx=0).stop 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 msgr2=0x7f6b50197d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 0x7f6b50197d40 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f6b40005ab0 tx=0x7f6b400042f0 comp rx=0 tx=0).stop 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 shutdown_connections 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6b380a2b80 0x7f6b380a5040 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6b501034f0 0x7f6b5019f2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6b50102b30 0x7f6b50198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 --2- 172.21.15.121:0/3109987288 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6b50101930 0x7f6b50197d40 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 >> 172.21.15.121:0/3109987288 conn(0x7f6b500fd0c0 msgr2=0x7f6b50105f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 shutdown_connections 2024-08-02T18:44:53.794 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:44:53.792+0000 7f6b569ec640 1 -- 172.21.15.121:0/3109987288 wait complete. 2024-08-02T18:44:54.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-02T18:44:54.425 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:54 smithi121 ceph-mon[37236]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-02T18:44:54.452 DEBUG:teuthology.orchestra.run.smithi121:osd.7> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.7.service 2024-08-02T18:44:54.454 INFO:tasks.cephadm:Deploying osd.8 on smithi151 with /dev/vg_nvme/lv_2... 2024-08-02T18:44:54.455 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_2 2024-08-02T18:44:54.481 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-02T18:44:54.482 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:54 smithi151 ceph-mon[37155]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-02T18:44:54.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-02T18:44:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:54 smithi103 ceph-mon[32753]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-08-02T18:44:54.717 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:44:56.069 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:55 smithi151 ceph-mon[37155]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-02T18:44:56.069 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:55 smithi151 ceph-mon[37155]: osdmap e47: 8 total, 7 up, 8 in 2024-08-02T18:44:56.069 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:56.069 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:55 smithi151 ceph-mon[37155]: from='osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:44:56.069 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:55 smithi151 ceph-mon[37155]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:44:56.069 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:55 smithi151 ceph-mon[37155]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:56.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:55 smithi103 ceph-mon[32753]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-02T18:44:56.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:55 smithi103 ceph-mon[32753]: osdmap e47: 8 total, 7 up, 8 in 2024-08-02T18:44:56.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:56.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:55 smithi103 ceph-mon[32753]: from='osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:44:56.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:55 smithi103 ceph-mon[32753]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:44:56.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:55 smithi103 ceph-mon[32753]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:56.106 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:55 smithi121 ceph-mon[37236]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-08-02T18:44:56.106 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:55 smithi121 ceph-mon[37236]: osdmap e47: 8 total, 7 up, 8 in 2024-08-02T18:44:56.107 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:56.107 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:55 smithi121 ceph-mon[37236]: from='osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:44:56.107 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:55 smithi121 ceph-mon[37236]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:44:56.107 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:55 smithi121 ceph-mon[37236]: pgmap v152: 1 pgs: 1 active+clean; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:56.798 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 18:44:56 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T18:44:56.518+0000 7fe88f575640 -1 osd.7 0 waiting for initial osdmap 2024-08-02T18:44:56.798 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 18:44:56 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T18:44:56.526+0000 7fe887395640 -1 osd.7 48 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:44:57.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:56 smithi151 ceph-mon[37155]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:44:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:56 smithi151 ceph-mon[37155]: osdmap e48: 8 total, 7 up, 8 in 2024-08-02T18:44:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:56 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:56 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:56 smithi151 ceph-mon[37155]: from='osd.7 ' entity='osd.7' 2024-08-02T18:44:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:56 smithi103 ceph-mon[32753]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:44:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:56 smithi103 ceph-mon[32753]: osdmap e48: 8 total, 7 up, 8 in 2024-08-02T18:44:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:56 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:56 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:56 smithi103 ceph-mon[32753]: from='osd.7 ' entity='osd.7' 2024-08-02T18:44:57.140 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:56 smithi121 ceph-mon[37236]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:44:57.140 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:56 smithi121 ceph-mon[37236]: osdmap e48: 8 total, 7 up, 8 in 2024-08-02T18:44:57.140 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:56 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:57.140 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:56 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:57.140 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:56 smithi121 ceph-mon[37236]: from='osd.7 ' entity='osd.7' 2024-08-02T18:44:57.325 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:44:57.350 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_2 2024-08-02T18:44:57.651 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:44:57.927 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:44:57.927 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:44:57.927 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:57.927 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] boot 2024-08-02T18:44:57.927 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: osdmap e49: 8 total, 8 up, 8 in 2024-08-02T18:44:57.927 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi121 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi121 to 5696M 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:57.928 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] boot 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: osdmap e49: 8 total, 8 up, 8 in 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi121 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:58.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi121 to 5696M 2024-08-02T18:44:58.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:58.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:58.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 -- 172.21.15.151:0/379390222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0181023c0 msgr2=0x7fb018108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:58.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/379390222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0181023c0 0x7fb018108c50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fb010009ca0 tx=0x7fb01002a8c0 comp rx=0 tx=0).stop 2024-08-02T18:44:58.151 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 -- 172.21.15.151:0/379390222 shutdown_connections 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/379390222 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb0181023c0 0x7fb018108c50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/379390222 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb018101a00 0x7fb018101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/379390222 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb018100800 0x7fb018100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 -- 172.21.15.151:0/379390222 >> 172.21.15.151:0/379390222 conn(0x7fb0180fbfb0 msgr2=0x7fb0180fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 -- 172.21.15.151:0/379390222 shutdown_connections 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.133+0000 7fb01eb9c640 1 -- 172.21.15.151:0/379390222 wait complete. 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01eb9c640 1 Processor -- start 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01eb9c640 1 -- start start 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01eb9c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb018100800 0x7fb01806a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:58.152 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01eb9c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb018101a00 0x7fb01819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01eb9c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0181023c0 0x7fb01819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01eb9c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb01810c5b0 con 0x7fb018100800 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01eb9c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb01810c430 con 0x7fb0181023c0 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01eb9c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb01810c730 con 0x7fb018101a00 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb018101a00 0x7fb01819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb018101a00 0x7fb01819c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:51182/0 (socket says 172.21.15.151:51182) 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 -- 172.21.15.151:0/807243322 learned_addr learned my addr 172.21.15.151:0/807243322 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01c938640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb018100800 0x7fb01806a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01d139640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0181023c0 0x7fb01819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:58.153 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 -- 172.21.15.151:0/807243322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0181023c0 msgr2=0x7fb01819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0181023c0 0x7fb01819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 -- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb018100800 msgr2=0x7fb01806a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb018100800 0x7fb01806a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 -- 172.21.15.151:0/807243322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb01819f910 con 0x7fb018101a00 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb01c938640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb018100800 0x7fb01806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00ffff640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb018101a00 0x7fb01819c9e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c890 tx=0x7fb00800cd50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.134+0000 7fb00dffb640 1 -- 172.21.15.151:0/807243322 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008004220 con 0x7fb018101a00 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.135+0000 7fb00dffb640 1 -- 172.21.15.151:0/807243322 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb0080043c0 con 0x7fb018101a00 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.135+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb01819fba0 con 0x7fb018101a00 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.135+0000 7fb00dffb640 1 -- 172.21.15.151:0/807243322 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb008004b10 con 0x7fb018101a00 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.135+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0181a0130 con 0x7fb018101a00 2024-08-02T18:44:58.154 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.136+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb018107b30 con 0x7fb018101a00 2024-08-02T18:44:58.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.137+0000 7fb00dffb640 1 -- 172.21.15.151:0/807243322 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb0080051b0 con 0x7fb018101a00 2024-08-02T18:44:58.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.138+0000 7fb00dffb640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb0000a2c00 0x7fb0000a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:44:58.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.138+0000 7fb00dffb640 1 -- 172.21.15.151:0/807243322 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(50..50 src has 1..50) ==== 5426+0+0 (secure 0 0 0) 0x7fb0080ce5b0 con 0x7fb018101a00 2024-08-02T18:44:58.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.138+0000 7fb01c938640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb0000a2c00 0x7fb0000a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:44:58.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.139+0000 7fb01c938640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb0000a2c00 0x7fb0000a50c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb014005d00 tx=0x7fb014005c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:44:58.155 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.142+0000 7fb00dffb640 1 -- 172.21.15.151:0/807243322 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb008014030 con 0x7fb018101a00 2024-08-02T18:44:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:44:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:44:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: osd.7 [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] boot 2024-08-02T18:44:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: osdmap e49: 8 total, 8 up, 8 in 2024-08-02T18:44:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:44:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: pgmap v155: 1 pgs: 1 unknown; 577 KiB data, 210 MiB used, 626 GiB / 626 GiB avail 2024-08-02T18:44:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi121 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi121 to 5696M 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:44:58.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:44:58.326 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:44:58.324+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) -- 0x7fb018062360 con 0x7fb0000a2c00 2024-08-02T18:44:58.872 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:58 smithi151 ceph-mon[37155]: osdmap e50: 8 total, 8 up, 8 in 2024-08-02T18:44:58.872 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:58 smithi151 ceph-mon[37155]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:58.873 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:58.873 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:58.873 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:58 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:58 smithi103 ceph-mon[32753]: osdmap e50: 8 total, 8 up, 8 in 2024-08-02T18:44:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:58 smithi103 ceph-mon[32753]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:58 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:44:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:58 smithi121 ceph-mon[37236]: osdmap e50: 8 total, 8 up, 8 in 2024-08-02T18:44:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:58 smithi121 ceph-mon[37236]: from='client.24280 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:44:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:44:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:44:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:58 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:00.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:59 smithi151 ceph-mon[37155]: osdmap e51: 8 total, 8 up, 8 in 2024-08-02T18:45:00.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:44:59 smithi151 ceph-mon[37155]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:00.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:59 smithi103 ceph-mon[32753]: osdmap e51: 8 total, 8 up, 8 in 2024-08-02T18:45:00.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:44:59 smithi103 ceph-mon[32753]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:00.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:59 smithi121 ceph-mon[37236]: osdmap e51: 8 total, 8 up, 8 in 2024-08-02T18:45:00.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:44:59 smithi121 ceph-mon[37236]: pgmap v158: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:01.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:00 smithi151 ceph-mon[37155]: osdmap e52: 8 total, 8 up, 8 in 2024-08-02T18:45:01.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:00 smithi121 ceph-mon[37236]: osdmap e52: 8 total, 8 up, 8 in 2024-08-02T18:45:01.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:00 smithi103 ceph-mon[32753]: osdmap e52: 8 total, 8 up, 8 in 2024-08-02T18:45:02.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:01 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/3017753042' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]: dispatch 2024-08-02T18:45:02.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:01 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]: dispatch 2024-08-02T18:45:02.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:01 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]': finished 2024-08-02T18:45:02.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:01 smithi121 ceph-mon[37236]: osdmap e53: 9 total, 8 up, 9 in 2024-08-02T18:45:02.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:01 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:02.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:01 smithi121 ceph-mon[37236]: pgmap v161: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:02.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:01 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/3891649239' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:02.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:01 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/3017753042' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]: dispatch 2024-08-02T18:45:02.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:01 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]: dispatch 2024-08-02T18:45:02.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:01 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]': finished 2024-08-02T18:45:02.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:01 smithi151 ceph-mon[37155]: osdmap e53: 9 total, 8 up, 9 in 2024-08-02T18:45:02.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:01 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:02.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:01 smithi151 ceph-mon[37155]: pgmap v161: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:02.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:01 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/3891649239' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:02.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:01 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/3017753042' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]: dispatch 2024-08-02T18:45:02.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:01 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]: dispatch 2024-08-02T18:45:02.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:01 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "277019f3-1818-4768-9a9e-dceaf7763848"}]': finished 2024-08-02T18:45:02.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:01 smithi103 ceph-mon[32753]: osdmap e53: 9 total, 8 up, 9 in 2024-08-02T18:45:02.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:01 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:02.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:01 smithi103 ceph-mon[32753]: pgmap v161: 1 pgs: 1 unknown; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:02.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:01 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/3891649239' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:04.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:04 smithi151 ceph-mon[37155]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:04 smithi121 ceph-mon[37236]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:04.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:04 smithi103 ceph-mon[32753]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 242 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:06.677 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:06 smithi151 ceph-mon[37155]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:06 smithi121 ceph-mon[37236]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:06 smithi103 ceph-mon[32753]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:08.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:08 smithi151 ceph-mon[37155]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:08.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-02T18:45:08.640 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:08 smithi121 ceph-mon[37236]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-02T18:45:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:08 smithi103 ceph-mon[32753]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.8"}]: dispatch 2024-08-02T18:45:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:09.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:09 smithi151 ceph-mon[37155]: Deploying daemon osd.8 on smithi151 2024-08-02T18:45:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:09 smithi121 ceph-mon[37236]: Deploying daemon osd.8 on smithi151 2024-08-02T18:45:09.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:09 smithi103 ceph-mon[32753]: Deploying daemon osd.8 on smithi151 2024-08-02T18:45:10.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:10 smithi151 ceph-mon[37155]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:10 smithi121 ceph-mon[37236]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:10.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:10 smithi103 ceph-mon[32753]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:12.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:12 smithi151 ceph-mon[37155]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:12 smithi121 ceph-mon[37236]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:12.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:12 smithi103 ceph-mon[32753]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:13.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:13.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:13.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:13.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:13.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:13.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:14.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:14 smithi121 ceph-mon[37236]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:14.811 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:14 smithi151 ceph-mon[37155]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:14.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:14 smithi103 ceph-mon[32753]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:16.657 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:16 smithi151 ceph-mon[37155]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:16.695 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.694+0000 7fb00dffb640 1 -- 172.21.15.151:0/807243322 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7fb018062360 con 0x7fb0000a2c00 2024-08-02T18:45:16.696 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 8 on host 'smithi151' 2024-08-02T18:45:16.698 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb0000a2c00 msgr2=0x7fb0000a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb0000a2c00 0x7fb0000a50c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fb014005d00 tx=0x7fb014005c90 comp rx=0 tx=0).stop 2024-08-02T18:45:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb018101a00 msgr2=0x7fb01819c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb018101a00 0x7fb01819c9e0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fb00800c890 tx=0x7fb00800cd50 comp rx=0 tx=0).stop 2024-08-02T18:45:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 shutdown_connections 2024-08-02T18:45:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb0181023c0 0x7fb01819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:16.699 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb0000a2c00 0x7fb0000a50c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:16.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb018101a00 0x7fb01819c9e0 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:16.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 --2- 172.21.15.151:0/807243322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb018100800 0x7fb01806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:16.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.696+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 >> 172.21.15.151:0/807243322 conn(0x7fb0180fbfb0 msgr2=0x7fb018104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:45:16.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.697+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 shutdown_connections 2024-08-02T18:45:16.700 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:45:16.697+0000 7fb01eb9c640 1 -- 172.21.15.151:0/807243322 wait complete. 2024-08-02T18:45:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:16 smithi121 ceph-mon[37236]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:16.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:16 smithi103 ceph-mon[32753]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:17.337 DEBUG:teuthology.orchestra.run.smithi151:osd.8> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.8.service 2024-08-02T18:45:17.339 INFO:tasks.cephadm:Deploying osd.9 on smithi103 with /dev/vg_nvme/lv_1... 2024-08-02T18:45:17.339 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-02T18:45:17.620 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:45:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:17 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:17 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:17 smithi121 ceph-mon[37236]: from='osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-02T18:45:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:17 smithi121 ceph-mon[37236]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-02T18:45:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:17 smithi121 ceph-mon[37236]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:17 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:17 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.038 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:17 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.039 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:17 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.039 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:17 smithi151 ceph-mon[37155]: from='osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-02T18:45:18.039 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:17 smithi151 ceph-mon[37155]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-02T18:45:18.039 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:17 smithi151 ceph-mon[37155]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:18.039 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:17 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.039 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:17 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.041 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.041 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.042 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:17 smithi103 ceph-mon[32753]: from='osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122]' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-02T18:45:18.042 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:17 smithi103 ceph-mon[32753]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]: dispatch 2024-08-02T18:45:18.042 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:17 smithi103 ceph-mon[32753]: pgmap v169: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:18.042 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:18.042 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:17 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:18 smithi121 ceph-mon[37236]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-02T18:45:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:18 smithi121 ceph-mon[37236]: osdmap e54: 9 total, 8 up, 9 in 2024-08-02T18:45:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:18 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:18 smithi121 ceph-mon[37236]: from='osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:45:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:18 smithi121 ceph-mon[37236]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:45:19.037 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:18 smithi103 ceph-mon[32753]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-02T18:45:19.037 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:18 smithi103 ceph-mon[32753]: osdmap e54: 9 total, 8 up, 9 in 2024-08-02T18:45:19.037 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:19.037 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:18 smithi103 ceph-mon[32753]: from='osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:45:19.038 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:18 smithi103 ceph-mon[32753]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:45:19.042 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:18 smithi151 ceph-mon[37155]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["8"]}]': finished 2024-08-02T18:45:19.042 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:18 smithi151 ceph-mon[37155]: osdmap e54: 9 total, 8 up, 9 in 2024-08-02T18:45:19.042 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:18 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:19.042 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:18 smithi151 ceph-mon[37155]: from='osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122]' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:45:19.042 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:18 smithi151 ceph-mon[37155]: from='osd.8 ' entity='osd.8' cmd=[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:45:19.042 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 18:45:18 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T18:45:18.705+0000 7f7c1472e640 -1 osd.8 0 waiting for initial osdmap 2024-08-02T18:45:19.042 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 18:45:18 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T18:45:18.713+0000 7f7c10556640 -1 osd.8 55 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:45:19.979 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:19 smithi103 ceph-mon[32753]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:45:19.980 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:19 smithi103 ceph-mon[32753]: osdmap e55: 9 total, 8 up, 9 in 2024-08-02T18:45:19.980 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:19.980 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:19.980 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:19 smithi103 ceph-mon[32753]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:20.000 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:19 smithi121 ceph-mon[37236]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:45:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:19 smithi121 ceph-mon[37236]: osdmap e55: 9 total, 8 up, 9 in 2024-08-02T18:45:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:19 smithi121 ceph-mon[37236]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:20.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:19 smithi151 ceph-mon[37155]: from='osd.8 ' entity='osd.8' cmd='[{"prefix": "osd crush create-or-move", "id": 8, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:45:20.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:19 smithi151 ceph-mon[37155]: osdmap e55: 9 total, 8 up, 9 in 2024-08-02T18:45:20.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:20.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:20.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:19 smithi151 ceph-mon[37155]: pgmap v172: 1 pgs: 1 active+clean; 577 KiB data, 241 MiB used, 715 GiB / 715 GiB avail 2024-08-02T18:45:20.292 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:45:20.319 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi103:vg_nvme/lv_1 2024-08-02T18:45:20.580 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:45:20.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:20 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:45:20.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:20 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:45:20.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:20.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:20 smithi103 ceph-mon[32753]: osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] boot 2024-08-02T18:45:20.853 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:20 smithi103 ceph-mon[32753]: osdmap e56: 9 total, 9 up, 9 in 2024-08-02T18:45:20.854 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:20.854 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:20 smithi103 ceph-mon[32753]: osdmap e57: 9 total, 9 up, 9 in 2024-08-02T18:45:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:20 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:45:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:20 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:45:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:20 smithi121 ceph-mon[37236]: osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] boot 2024-08-02T18:45:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:20 smithi121 ceph-mon[37236]: osdmap e56: 9 total, 9 up, 9 in 2024-08-02T18:45:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:20 smithi121 ceph-mon[37236]: osdmap e57: 9 total, 9 up, 9 in 2024-08-02T18:45:21.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/1202985331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 msgr2=0x7f2cc8104800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:21.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/1202985331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 0x7f2cc8104800 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009900 tx=0x7f2cc402a410 comp rx=0 tx=0).stop 2024-08-02T18:45:21.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/1202985331 shutdown_connections 2024-08-02T18:45:21.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/1202985331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cc8107670 0x7f2cc8109a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:21.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/1202985331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc8104d40 0x7f2cc8107130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:21.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/1202985331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 0x7f2cc8104800 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:21.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/1202985331 >> 172.21.15.103:0/1202985331 conn(0x7f2cc80fbfb0 msgr2=0x7f2cc80fe3f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/1202985331 shutdown_connections 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.052+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/1202985331 wait complete. 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccf2bb640 1 Processor -- start 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccf2bb640 1 -- start start 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccf2bb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 0x7f2cc8101d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccf2bb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cc8104d40 0x7f2cc81003c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccf2bb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc8107670 0x7f2cc8100900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccf2bb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810d700 con 0x7f2cc8102410 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccf2bb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810d580 con 0x7f2cc8107670 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccf2bb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2cc810d880 con 0x7f2cc8104d40 2024-08-02T18:45:21.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccd057640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 0x7f2cc8101d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccd057640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 0x7f2cc8101d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50186/0 (socket says 172.21.15.103:50186) 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccd057640 1 -- 172.21.15.103:0/2394321980 learned_addr learned my addr 172.21.15.103:0/2394321980 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.053+0000 7f2ccc856640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cc8104d40 0x7f2cc81003c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccd858640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc8107670 0x7f2cc8100900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccd057640 1 -- 172.21.15.103:0/2394321980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cc8104d40 msgr2=0x7f2cc81003c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccd057640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cc8104d40 0x7f2cc81003c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccd057640 1 -- 172.21.15.103:0/2394321980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc8107670 msgr2=0x7f2cc8100900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccd057640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc8107670 0x7f2cc8100900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccd057640 1 -- 172.21.15.103:0/2394321980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cc81011c0 con 0x7f2cc8102410 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccd858640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc8107670 0x7f2cc8100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccd057640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 0x7f2cc8101d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009a20 tx=0x7f2cc4004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:45:21.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2cbe7fc640 1 -- 172.21.15.103:0/2394321980 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc403f030 con 0x7f2cc8102410 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2cbe7fc640 1 -- 172.21.15.103:0/2394321980 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2cc4003d00 con 0x7f2cc8102410 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cc81a1e30 con 0x7f2cc8102410 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2cbe7fc640 1 -- 172.21.15.103:0/2394321980 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cc4035070 con 0x7f2cc8102410 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.054+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cc81a21d0 con 0x7f2cc8102410 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.055+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cc80fdaa0 con 0x7f2cc8102410 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.057+0000 7f2cbe7fc640 1 -- 172.21.15.103:0/2394321980 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2cc4042030 con 0x7f2cc8102410 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.057+0000 7f2cbe7fc640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2cb40a2b80 0x7f2cb40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.057+0000 7f2cbe7fc640 1 -- 172.21.15.103:0/2394321980 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(57..57 src has 1..57) ==== 5858+0+0 (secure 0 0 0) 0x7f2cc40ef150 con 0x7f2cc8102410 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.057+0000 7f2ccc856640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2cb40a2b80 0x7f2cb40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:45:21.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.058+0000 7f2ccc856640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2cb40a2b80 0x7f2cb40a5040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8101af0 tx=0x7f2cb800b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:45:21.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.061+0000 7f2cbe7fc640 1 -- 172.21.15.103:0/2394321980 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2cc40bca40 con 0x7f2cc8102410 2024-08-02T18:45:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:20 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:45:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:20 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:45:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:20 smithi151 ceph-mon[37155]: osd.8 [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] boot 2024-08-02T18:45:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:20 smithi151 ceph-mon[37155]: osdmap e56: 9 total, 9 up, 9 in 2024-08-02T18:45:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:45:21.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:20 smithi151 ceph-mon[37155]: osdmap e57: 9 total, 9 up, 9 in 2024-08-02T18:45:21.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:21.243+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f2cc8062360 con 0x7f2cb40a2b80 2024-08-02T18:45:21.914 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi151 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi151 to 5696M 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:21.915 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:21.916 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:21.916 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:21.916 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:45:21.916 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:45:21.916 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:45:21.916 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:21.916 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:21.916 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:21 smithi103 ceph-mon[32753]: osdmap e58: 9 total, 9 up, 9 in 2024-08-02T18:45:22.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi151 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi151 to 5696M 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:22.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:21 smithi151 ceph-mon[37155]: osdmap e58: 9 total, 9 up, 9 in 2024-08-02T18:45:22.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi151 2024-08-02T18:45:22.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:22.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:22.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi151 to 5696M 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='client.14430 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi103:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:22.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: pgmap v175: 1 pgs: 1 active+clean; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:22.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:21 smithi121 ceph-mon[37236]: osdmap e58: 9 total, 9 up, 9 in 2024-08-02T18:45:24.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:23 smithi151 ceph-mon[37155]: osdmap e59: 9 total, 9 up, 9 in 2024-08-02T18:45:24.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:23 smithi151 ceph-mon[37155]: pgmap v178: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-02T18:45:24.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:23 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3980349303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd6a19ec-851e-4957-8968-53d1a614eaaa"}]: dispatch 2024-08-02T18:45:24.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:23 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3980349303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd6a19ec-851e-4957-8968-53d1a614eaaa"}]': finished 2024-08-02T18:45:24.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:23 smithi151 ceph-mon[37155]: osdmap e60: 10 total, 9 up, 10 in 2024-08-02T18:45:24.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:24.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:23 smithi103 ceph-mon[32753]: osdmap e59: 9 total, 9 up, 9 in 2024-08-02T18:45:24.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:23 smithi103 ceph-mon[32753]: pgmap v178: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-02T18:45:24.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:23 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3980349303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd6a19ec-851e-4957-8968-53d1a614eaaa"}]: dispatch 2024-08-02T18:45:24.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:23 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3980349303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd6a19ec-851e-4957-8968-53d1a614eaaa"}]': finished 2024-08-02T18:45:24.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:23 smithi103 ceph-mon[32753]: osdmap e60: 10 total, 9 up, 10 in 2024-08-02T18:45:24.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:23 smithi121 ceph-mon[37236]: osdmap e59: 9 total, 9 up, 9 in 2024-08-02T18:45:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:23 smithi121 ceph-mon[37236]: pgmap v178: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 268 MiB used, 804 GiB / 805 GiB avail; 144 KiB/s, 0 objects/s recovering 2024-08-02T18:45:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:23 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3980349303' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dd6a19ec-851e-4957-8968-53d1a614eaaa"}]: dispatch 2024-08-02T18:45:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:23 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3980349303' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dd6a19ec-851e-4957-8968-53d1a614eaaa"}]': finished 2024-08-02T18:45:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:23 smithi121 ceph-mon[37236]: osdmap e60: 10 total, 9 up, 10 in 2024-08-02T18:45:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:24 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3027939161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:24 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3027939161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:25.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:24 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3027939161' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:25 smithi103 ceph-mon[32753]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-02T18:45:26.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:25 smithi121 ceph-mon[37236]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-02T18:45:26.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:25 smithi151 ceph-mon[37155]: pgmap v180: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 122 KiB/s, 0 objects/s recovering 2024-08-02T18:45:28.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:28 smithi103 ceph-mon[32753]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-02T18:45:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:28 smithi121 ceph-mon[37236]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-02T18:45:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:28 smithi151 ceph-mon[37155]: pgmap v181: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 96 KiB/s, 0 objects/s recovering 2024-08-02T18:45:30.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:30 smithi103 ceph-mon[32753]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-02T18:45:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:30 smithi121 ceph-mon[37236]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-02T18:45:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:30 smithi151 ceph-mon[37155]: pgmap v182: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-08-02T18:45:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:32 smithi121 ceph-mon[37236]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:32 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-02T18:45:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:32 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:32 smithi121 ceph-mon[37236]: Deploying daemon osd.9 on smithi103 2024-08-02T18:45:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:32 smithi151 ceph-mon[37155]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:32 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-02T18:45:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:32 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:32 smithi151 ceph-mon[37155]: Deploying daemon osd.9 on smithi103 2024-08-02T18:45:32.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:32 smithi103 ceph-mon[32753]: pgmap v183: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:32.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.9"}]: dispatch 2024-08-02T18:45:32.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:32 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:32.824 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:32 smithi103 ceph-mon[32753]: Deploying daemon osd.9 on smithi103 2024-08-02T18:45:34.631 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:34 smithi103 ceph-mon[32753]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:34.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:34 smithi121 ceph-mon[37236]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:34.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:34 smithi151 ceph-mon[37155]: pgmap v184: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:36.555 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:36 smithi103 ceph-mon[32753]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:36.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:36 smithi121 ceph-mon[37236]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:36.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:36 smithi151 ceph-mon[37155]: pgmap v185: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:37.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:37 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:37.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:37 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:37.645 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:37 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:37.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:37 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:37.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:37 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:37.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:37 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:37 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:38.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:38 smithi121 ceph-mon[37236]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:38.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:38 smithi151 ceph-mon[37155]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:38.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:38 smithi103 ceph-mon[32753]: pgmap v186: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:40.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:40 smithi103 ceph-mon[32753]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:40.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:40.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:40.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:40.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:40.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:40.674 INFO:teuthology.orchestra.run.smithi103.stdout:Created osd(s) 9 on host 'smithi103' 2024-08-02T18:45:40.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.672+0000 7f2cbe7fc640 1 -- 172.21.15.103:0/2394321980 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+37 (secure 0 0 0) 0x7f2cc8062360 con 0x7f2cb40a2b80 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2cb40a2b80 msgr2=0x7f2cb40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2cb40a2b80 0x7f2cb40a5040 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f2cc8101af0 tx=0x7f2cb800b410 comp rx=0 tx=0).stop 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 msgr2=0x7f2cc8101d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 0x7f2cc8101d70 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f2cc4009a20 tx=0x7f2cc4004270 comp rx=0 tx=0).stop 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 shutdown_connections 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2cc8107670 0x7f2cc8100900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2cb40a2b80 0x7f2cb40a5040 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2cc8104d40 0x7f2cc81003c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 --2- 172.21.15.103:0/2394321980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2cc8102410 0x7f2cc8101d70 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 >> 172.21.15.103:0/2394321980 conn(0x7f2cc80fbfb0 msgr2=0x7f2cc8102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:45:40.676 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 shutdown_connections 2024-08-02T18:45:40.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:45:40.674+0000 7f2ccf2bb640 1 -- 172.21.15.103:0/2394321980 wait complete. 2024-08-02T18:45:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:40 smithi121 ceph-mon[37236]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:40.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:40 smithi151 ceph-mon[37155]: pgmap v187: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:40.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:40.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:40.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:40.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:40.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:41.394 DEBUG:teuthology.orchestra.run.smithi103:osd.9> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.9.service 2024-08-02T18:45:41.397 INFO:tasks.cephadm:Deploying osd.10 on smithi121 with /dev/vg_nvme/lv_1... 2024-08-02T18:45:41.397 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-02T18:45:41.624 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:41 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:41.624 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:41 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:41.624 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:41 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:41.624 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:41 smithi103 ceph-mon[32753]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-02T18:45:41.658 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T18:45:41.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:41 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:41.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:41 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:41.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:41 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:41.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:41 smithi121 ceph-mon[37236]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-02T18:45:41.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:41 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:45:41.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:41 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:41.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:41 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:41.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:41 smithi151 ceph-mon[37155]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]: dispatch 2024-08-02T18:45:42.631 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:42 smithi103 ceph-mon[32753]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:42.631 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:42 smithi103 ceph-mon[32753]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-02T18:45:42.631 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:42 smithi103 ceph-mon[32753]: osdmap e61: 10 total, 9 up, 10 in 2024-08-02T18:45:42.632 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:42 smithi103 ceph-mon[32753]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:45:42.632 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:42 smithi121 ceph-mon[37236]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:42 smithi121 ceph-mon[37236]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-02T18:45:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:42 smithi121 ceph-mon[37236]: osdmap e61: 10 total, 9 up, 10 in 2024-08-02T18:45:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:42 smithi121 ceph-mon[37236]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:45:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:42.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:42 smithi151 ceph-mon[37155]: pgmap v188: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:42.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:42 smithi151 ceph-mon[37155]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["9"]}]': finished 2024-08-02T18:45:42.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:42 smithi151 ceph-mon[37155]: osdmap e61: 10 total, 9 up, 10 in 2024-08-02T18:45:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:42 smithi151 ceph-mon[37155]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd=[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]: dispatch 2024-08-02T18:45:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:42.919 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 18:45:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T18:45:42.687+0000 7f33a6886640 -1 osd.9 0 waiting for initial osdmap 2024-08-02T18:45:42.919 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 18:45:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T18:45:42.698+0000 7f33a26ae640 -1 osd.9 62 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:45:44.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:43 smithi121 ceph-mon[37236]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:45:44.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:43 smithi121 ceph-mon[37236]: osdmap e62: 10 total, 9 up, 10 in 2024-08-02T18:45:44.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:43 smithi121 ceph-mon[37236]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:44.022 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:43 smithi103 ceph-mon[32753]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:45:44.022 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:43 smithi103 ceph-mon[32753]: osdmap e62: 10 total, 9 up, 10 in 2024-08-02T18:45:44.022 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.023 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.023 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:43 smithi103 ceph-mon[32753]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:44.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:43 smithi151 ceph-mon[37155]: from='osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350]' entity='osd.9' cmd='[{"prefix": "osd crush create-or-move", "id": 9, "weight":0.0873, "args": ["host=smithi103", "root=default"]}]': finished 2024-08-02T18:45:44.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:43 smithi151 ceph-mon[37155]: osdmap e62: 10 total, 9 up, 10 in 2024-08-02T18:45:44.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:43 smithi151 ceph-mon[37155]: pgmap v191: 1 pgs: 1 active+clean; 577 KiB data, 269 MiB used, 804 GiB / 805 GiB avail 2024-08-02T18:45:44.365 INFO:teuthology.orchestra.run.smithi121.stdout: 2024-08-02T18:45:44.393 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi121:vg_nvme/lv_1 2024-08-02T18:45:44.655 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T18:45:44.692 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:45:44.692 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:45:44.692 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] boot 2024-08-02T18:45:44.692 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: osdmap e63: 10 total, 10 up, 10 in 2024-08-02T18:45:44.692 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi103 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi103 to 4272M 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:44.693 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:44 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.939 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:45:44.939 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:45:44.939 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] boot 2024-08-02T18:45:44.939 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: osdmap e63: 10 total, 10 up, 10 in 2024-08-02T18:45:44.939 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi103 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi103 to 4272M 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:44.940 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:44 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:45:44.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:45:44.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: osd.9 [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] boot 2024-08-02T18:45:44.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: osdmap e63: 10 total, 10 up, 10 in 2024-08-02T18:45:44.972 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi103 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi103 to 4272M 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:45:44.973 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:44 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.154+0000 7f480b663640 1 -- 172.21.15.121:0/2947195712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4804102450 msgr2=0x7f4804104840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.154+0000 7f480b663640 1 --2- 172.21.15.121:0/2947195712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4804102450 0x7f4804104840 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f4800009900 tx=0x7f480002a410 comp rx=0 tx=0).stop 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.154+0000 7f480b663640 1 -- 172.21.15.121:0/2947195712 shutdown_connections 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.154+0000 7f480b663640 1 --2- 172.21.15.121:0/2947195712 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f48041076b0 0x7f4804109aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.154+0000 7f480b663640 1 --2- 172.21.15.121:0/2947195712 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4804104d80 0x7f4804107170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.154+0000 7f480b663640 1 --2- 172.21.15.121:0/2947195712 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4804102450 0x7f4804104840 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.154+0000 7f480b663640 1 -- 172.21.15.121:0/2947195712 >> 172.21.15.121:0/2947195712 conn(0x7f48040fbfb0 msgr2=0x7f48040fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 -- 172.21.15.121:0/2947195712 shutdown_connections 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 -- 172.21.15.121:0/2947195712 wait complete. 2024-08-02T18:45:45.159 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 Processor -- start 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 -- start start 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4804102450 0x7f4804101db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4804104d80 0x7f4804100400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041076b0 0x7f4804100940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f480410d6d0 con 0x7f4804102450 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f480410d550 con 0x7f48041076b0 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f480b663640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f480410d850 con 0x7f4804104d80 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.155+0000 7f4809c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041076b0 0x7f4804100940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4809c00640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041076b0 0x7f4804100940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.121:49120/0 (socket says 172.21.15.121:49120) 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4809c00640 1 -- 172.21.15.121:0/4207147779 learned_addr learned my addr 172.21.15.121:0/4207147779 (peer_addr_for_me v2:172.21.15.121:0/0) 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4808bfe640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4804104d80 0x7f4804100400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:45:45.160 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f48093ff640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4804102450 0x7f4804101db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4809c00640 1 -- 172.21.15.121:0/4207147779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4804104d80 msgr2=0x7f4804100400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4809c00640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4804104d80 0x7f4804100400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4809c00640 1 -- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4804102450 msgr2=0x7f4804101db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4809c00640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4804102450 0x7f4804101db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4809c00640 1 -- 172.21.15.121:0/4207147779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4804101200 con 0x7f48041076b0 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f48093ff640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4804102450 0x7f4804101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f4809c00640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041076b0 0x7f4804100940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00eaa0 tx=0x7f47fc00ef60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f47fa7fc640 1 -- 172.21.15.121:0/4207147779 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc00cdb0 con 0x7f48041076b0 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f47fa7fc640 1 -- 172.21.15.121:0/4207147779 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47fc004b20 con 0x7f48041076b0 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f48041a1e60 con 0x7f48041076b0 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f47fa7fc640 1 -- 172.21.15.121:0/4207147779 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47fc011760 con 0x7f48041076b0 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.156+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f48041a22c0 con 0x7f48041076b0 2024-08-02T18:45:45.161 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.158+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f48040fdaa0 con 0x7f48041076b0 2024-08-02T18:45:45.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.159+0000 7f47fa7fc640 1 -- 172.21.15.121:0/4207147779 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f47fc004cd0 con 0x7f48041076b0 2024-08-02T18:45:45.162 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.159+0000 7f47fa7fc640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f47f00a2b80 0x7f47f00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:45:45.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.159+0000 7f47fa7fc640 1 -- 172.21.15.121:0/4207147779 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(64..64 src has 1..64) ==== 6261+0+0 (secure 0 0 0) 0x7f47fc0ceae0 con 0x7f48041076b0 2024-08-02T18:45:45.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.159+0000 7f48093ff640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f47f00a2b80 0x7f47f00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:45:45.163 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.160+0000 7f48093ff640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f47f00a2b80 0x7f47f00a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4800000c00 tx=0x7f4800031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:45:45.168 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.167+0000 7f47fa7fc640 1 -- 172.21.15.121:0/4207147779 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f47fc016030 con 0x7f48041076b0 2024-08-02T18:45:45.352 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:45:45.351+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f4804062360 con 0x7f47f00a2b80 2024-08-02T18:45:45.931 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:45 smithi121 ceph-mon[37236]: osdmap e64: 10 total, 10 up, 10 in 2024-08-02T18:45:45.932 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:45 smithi121 ceph-mon[37236]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:45.932 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:45 smithi121 ceph-mon[37236]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:45:45.932 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:45:45.932 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:45:45.932 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:45.988 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:45 smithi151 ceph-mon[37155]: osdmap e64: 10 total, 10 up, 10 in 2024-08-02T18:45:45.989 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:45 smithi151 ceph-mon[37155]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:45.989 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:45 smithi151 ceph-mon[37155]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:45:45.989 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:45:45.989 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:45:45.989 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:46.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:45 smithi103 ceph-mon[32753]: osdmap e64: 10 total, 10 up, 10 in 2024-08-02T18:45:46.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:45 smithi103 ceph-mon[32753]: pgmap v194: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:46.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:45 smithi103 ceph-mon[32753]: from='client.24329 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi121:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:45:46.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:45:46.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:45:46.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:48.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:48 smithi121 ceph-mon[37236]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:48.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:48 smithi121 ceph-mon[37236]: from='client.? 172.21.15.121:0/1757593353' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]: dispatch 2024-08-02T18:45:48.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:48 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]: dispatch 2024-08-02T18:45:48.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:48 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]': finished 2024-08-02T18:45:48.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:48 smithi121 ceph-mon[37236]: osdmap e65: 11 total, 10 up, 11 in 2024-08-02T18:45:48.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:48 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:45:48.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:48 smithi121 ceph-mon[37236]: from='client.? 172.21.15.121:0/566030995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:48 smithi151 ceph-mon[37155]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:48 smithi151 ceph-mon[37155]: from='client.? 172.21.15.121:0/1757593353' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]: dispatch 2024-08-02T18:45:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:48 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]: dispatch 2024-08-02T18:45:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:48 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]': finished 2024-08-02T18:45:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:48 smithi151 ceph-mon[37155]: osdmap e65: 11 total, 10 up, 11 in 2024-08-02T18:45:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:48 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:45:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:48 smithi151 ceph-mon[37155]: from='client.? 172.21.15.121:0/566030995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:48.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:48 smithi103 ceph-mon[32753]: pgmap v195: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:48.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:48 smithi103 ceph-mon[32753]: from='client.? 172.21.15.121:0/1757593353' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]: dispatch 2024-08-02T18:45:48.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:48 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]: dispatch 2024-08-02T18:45:48.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:48 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "29c7b69d-2db4-4ff1-b5d0-544096db8cf7"}]': finished 2024-08-02T18:45:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:48 smithi103 ceph-mon[32753]: osdmap e65: 11 total, 10 up, 11 in 2024-08-02T18:45:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:48 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:45:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:48 smithi103 ceph-mon[32753]: from='client.? 172.21.15.121:0/566030995' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:45:50.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:50 smithi121 ceph-mon[37236]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:50 smithi151 ceph-mon[37155]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:50.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:50 smithi103 ceph-mon[32753]: pgmap v197: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:52.728 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:52 smithi121 ceph-mon[37236]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:52.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:52 smithi103 ceph-mon[32753]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:52.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:52 smithi151 ceph-mon[37155]: pgmap v198: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:54.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:54 smithi121 ceph-mon[37236]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:54 smithi151 ceph-mon[37155]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:54 smithi103 ceph-mon[32753]: pgmap v199: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:55.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-02T18:45:55.424 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:55.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-02T18:45:55.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:55.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.10"}]: dispatch 2024-08-02T18:45:55.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:45:56.675 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:56 smithi121 ceph-mon[37236]: Deploying daemon osd.10 on smithi121 2024-08-02T18:45:56.675 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:56 smithi121 ceph-mon[37236]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:56.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:56 smithi151 ceph-mon[37155]: Deploying daemon osd.10 on smithi121 2024-08-02T18:45:56.692 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:56 smithi151 ceph-mon[37155]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:56.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:56 smithi103 ceph-mon[32753]: Deploying daemon osd.10 on smithi121 2024-08-02T18:45:56.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:56 smithi103 ceph-mon[32753]: pgmap v200: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:58.629 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:45:58 smithi121 ceph-mon[37236]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:58.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:45:58 smithi151 ceph-mon[37155]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:45:58.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:45:58 smithi103 ceph-mon[32753]: pgmap v201: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:00.648 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:00 smithi121 ceph-mon[37236]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:00.649 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:00.649 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:00.649 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:00 smithi151 ceph-mon[37155]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:00 smithi103 ceph-mon[32753]: pgmap v202: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:02.683 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:02 smithi121 ceph-mon[37236]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:02 smithi151 ceph-mon[37155]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:02.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:02 smithi103 ceph-mon[32753]: pgmap v203: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:03.734 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.733+0000 7f47fa7fc640 1 -- 172.21.15.121:0/4207147779 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f4804062360 con 0x7f47f00a2b80 2024-08-02T18:46:03.734 INFO:teuthology.orchestra.run.smithi121.stdout:Created osd(s) 10 on host 'smithi121' 2024-08-02T18:46:03.736 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f47f00a2b80 msgr2=0x7f47f00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f47f00a2b80 0x7f47f00a5040 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4800000c00 tx=0x7f4800031640 comp rx=0 tx=0).stop 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041076b0 msgr2=0x7f4804100940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041076b0 0x7f4804100940 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f47fc00eaa0 tx=0x7f47fc00ef60 comp rx=0 tx=0).stop 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 shutdown_connections 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f48041076b0 0x7f4804100940 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f47f00a2b80 0x7f47f00a5040 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4804104d80 0x7f4804100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 --2- 172.21.15.121:0/4207147779 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4804102450 0x7f4804101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 >> 172.21.15.121:0/4207147779 conn(0x7f48040fbfb0 msgr2=0x7f4804102cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 shutdown_connections 2024-08-02T18:46:03.737 INFO:teuthology.orchestra.run.smithi121.stderr:2024-08-02T18:46:03.735+0000 7f480b663640 1 -- 172.21.15.121:0/4207147779 wait complete. 2024-08-02T18:46:04.473 DEBUG:teuthology.orchestra.run.smithi121:osd.10> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.10.service 2024-08-02T18:46:04.475 INFO:tasks.cephadm:Deploying osd.11 on smithi151 with /dev/vg_nvme/lv_1... 2024-08-02T18:46:04.476 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea ceph-volume -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- lvm zap /dev/vg_nvme/lv_1 2024-08-02T18:46:04.738 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:46:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:04 smithi121 ceph-mon[37236]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:04 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:04 smithi121 ceph-mon[37236]: from='osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-02T18:46:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:04 smithi121 ceph-mon[37236]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-02T18:46:04.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:04 smithi151 ceph-mon[37155]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:04.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:04.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:04 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:04.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:04 smithi151 ceph-mon[37155]: from='osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-02T18:46:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:04 smithi151 ceph-mon[37155]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-02T18:46:04.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:04 smithi103 ceph-mon[32753]: pgmap v204: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:04.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:04 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:04 smithi103 ceph-mon[32753]: from='osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526]' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-02T18:46:04.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:04 smithi103 ceph-mon[32753]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]: dispatch 2024-08-02T18:46:05.747 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:05.748 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:05.748 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-mon[37236]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-02T18:46:05.748 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-mon[37236]: osdmap e66: 11 total, 10 up, 11 in 2024-08-02T18:46:05.748 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:05.748 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-mon[37236]: from='osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:46:05.748 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-mon[37236]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:46:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:05 smithi151 ceph-mon[37155]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-02T18:46:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:05 smithi151 ceph-mon[37155]: osdmap e66: 11 total, 10 up, 11 in 2024-08-02T18:46:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:05 smithi151 ceph-mon[37155]: from='osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:46:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:05 smithi151 ceph-mon[37155]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:46:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:05 smithi103 ceph-mon[32753]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["10"]}]': finished 2024-08-02T18:46:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:05 smithi103 ceph-mon[32753]: osdmap e66: 11 total, 10 up, 11 in 2024-08-02T18:46:05.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:05.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:05 smithi103 ceph-mon[32753]: from='osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526]' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:46:05.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:05 smithi103 ceph-mon[32753]: from='osd.10 ' entity='osd.10' cmd=[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]: dispatch 2024-08-02T18:46:06.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T18:46:05.745+0000 7fb6174ff640 -1 osd.10 0 waiting for initial osdmap 2024-08-02T18:46:06.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 18:46:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T18:46:05.756+0000 7fb613327640 -1 osd.10 67 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:46:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:06 smithi121 ceph-mon[37236]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:06 smithi121 ceph-mon[37236]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:46:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:06 smithi121 ceph-mon[37236]: osdmap e67: 11 total, 10 up, 11 in 2024-08-02T18:46:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:06 smithi151 ceph-mon[37155]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:06 smithi151 ceph-mon[37155]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:46:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:06 smithi151 ceph-mon[37155]: osdmap e67: 11 total, 10 up, 11 in 2024-08-02T18:46:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:06 smithi103 ceph-mon[32753]: pgmap v206: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:06 smithi103 ceph-mon[32753]: from='osd.10 ' entity='osd.10' cmd='[{"prefix": "osd crush create-or-move", "id": 10, "weight":0.0873, "args": ["host=smithi121", "root=default"]}]': finished 2024-08-02T18:46:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:06 smithi103 ceph-mon[32753]: osdmap e67: 11 total, 10 up, 11 in 2024-08-02T18:46:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:06.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:07.353 INFO:teuthology.orchestra.run.smithi151.stdout: 2024-08-02T18:46:07.379 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch daemon add osd smithi151:vg_nvme/lv_1 2024-08-02T18:46:07.643 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:46:07.924 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] boot 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: osdmap e68: 11 total, 11 up, 11 in 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:07.925 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:07.926 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:07.926 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:07.926 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:07.926 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:07 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:46:08.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:46:08.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] boot 2024-08-02T18:46:08.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: osdmap e68: 11 total, 11 up, 11 in 2024-08-02T18:46:08.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:08.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:08.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:08.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:08.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:08.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:08.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:08.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:08.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:07 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:46:08.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:46:08.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: osd.10 [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] boot 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: osdmap e68: 11 total, 11 up, 11 in 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: pgmap v209: 1 pgs: 1 active+clean; 577 KiB data, 296 MiB used, 894 GiB / 894 GiB avail 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:08.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:08.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:07 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/326487116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18102b50 msgr2=0x7f3f18102fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/326487116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18102b50 0x7f3f18102fd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c009900 tx=0x7f3f0c02a410 comp rx=0 tx=0).stop 2024-08-02T18:46:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/326487116 shutdown_connections 2024-08-02T18:46:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/326487116 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f18103510 0x7f3f18109da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:08.140 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/326487116 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18102b50 0x7f3f18102fd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/326487116 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18101950 0x7f3f18101d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/326487116 >> 172.21.15.151:0/326487116 conn(0x7f3f180fd0e0 msgr2=0x7f3f180ff520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/326487116 shutdown_connections 2024-08-02T18:46:08.141 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.138+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/326487116 wait complete. 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.139+0000 7f3f1cfa5640 1 Processor -- start 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.139+0000 7f3f1cfa5640 1 -- start start 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.139+0000 7f3f1cfa5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18101950 0x7f3f18075cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.139+0000 7f3f1cfa5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f18102b50 0x7f3f18074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.139+0000 7f3f1cfa5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18103510 0x7f3f18074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.139+0000 7f3f1cfa5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810d710 con 0x7f3f18102b50 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.139+0000 7f3f1cfa5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810d590 con 0x7f3f18101950 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.139+0000 7f3f1cfa5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3f1810d890 con 0x7f3f18103510 2024-08-02T18:46:08.143 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18101950 0x7f3f18075cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f16d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18103510 0x7f3f18074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18101950 0x7f3f18075cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.151:34666/0 (socket says 172.21.15.151:34666) 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 -- 172.21.15.151:0/4126720482 learned_addr learned my addr 172.21.15.151:0/4126720482 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f16d9d640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18103510 0x7f3f18074850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:32890/0 (socket says 172.21.15.151:32890) 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f15d9b640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f18102b50 0x7f3f18074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 -- 172.21.15.151:0/4126720482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18103510 msgr2=0x7f3f18074850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18103510 0x7f3f18074850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 -- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f18102b50 msgr2=0x7f3f18074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f18102b50 0x7f3f18074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 -- 172.21.15.151:0/4126720482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f18075110 con 0x7f3f18101950 2024-08-02T18:46:08.144 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f15d9b640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f18102b50 0x7f3f18074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:46:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f16d9d640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18103510 0x7f3f18074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:46:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1659c640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18101950 0x7f3f18075cc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800e9c0 tx=0x7f3f0800ee80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f077fe640 1 -- 172.21.15.151:0/4126720482 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f0800cd80 con 0x7f3f18101950 2024-08-02T18:46:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f077fe640 1 -- 172.21.15.151:0/4126720482 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3f080035f0 con 0x7f3f18101950 2024-08-02T18:46:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f181a1e90 con 0x7f3f18101950 2024-08-02T18:46:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f077fe640 1 -- 172.21.15.151:0/4126720482 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f08010670 con 0x7f3f18101950 2024-08-02T18:46:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.140+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f181a2230 con 0x7f3f18101950 2024-08-02T18:46:08.145 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.141+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f18108d00 con 0x7f3f18101950 2024-08-02T18:46:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.143+0000 7f3f077fe640 1 -- 172.21.15.151:0/4126720482 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3f080037a0 con 0x7f3f18101950 2024-08-02T18:46:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.143+0000 7f3f077fe640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f000a2b80 0x7f3f000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.143+0000 7f3f077fe640 1 -- 172.21.15.151:0/4126720482 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(69..69 src has 1..69) ==== 6723+0+0 (secure 0 0 0) 0x7f3f080cef90 con 0x7f3f18101950 2024-08-02T18:46:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.143+0000 7f3f15d9b640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f000a2b80 0x7f3f000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:08.146 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.144+0000 7f3f15d9b640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f000a2b80 0x7f3f000a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c000c00 tx=0x7f3f0c031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:08.148 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.146+0000 7f3f077fe640 1 -- 172.21.15.151:0/4126720482 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3f0809c480 con 0x7f3f18101950 2024-08-02T18:46:08.332 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:08.330+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}) -- 0x7f3f18062360 con 0x7f3f000a2b80 2024-08-02T18:46:08.914 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi121 2024-08-02T18:46:08.914 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi121 to 4272M 2024-08-02T18:46:08.914 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: osdmap e69: 11 total, 11 up, 11 in 2024-08-02T18:46:08.914 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:08.914 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:08.914 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:08.914 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:08.915 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:46:08.915 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:46:08.915 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:46:08.915 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:08 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:09.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi121 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi121 to 4272M 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: osdmap e69: 11 total, 11 up, 11 in 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:46:09.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:08 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi121 2024-08-02T18:46:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi121 to 4272M 2024-08-02T18:46:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: osdmap e69: 11 total, 11 up, 11 in 2024-08-02T18:46:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:09.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:09.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: from='client.24356 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi151:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:46:09.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-08-02T18:46:09.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-08-02T18:46:09.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:08 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:10.066 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:09 smithi151 ceph-mon[37155]: osdmap e70: 11 total, 11 up, 11 in 2024-08-02T18:46:10.067 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:09 smithi151 ceph-mon[37155]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:10.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:09 smithi103 ceph-mon[32753]: osdmap e70: 11 total, 11 up, 11 in 2024-08-02T18:46:10.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:09 smithi103 ceph-mon[32753]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:10.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:09 smithi121 ceph-mon[37236]: osdmap e70: 11 total, 11 up, 11 in 2024-08-02T18:46:10.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:09 smithi121 ceph-mon[37236]: pgmap v212: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:11.021 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:10 smithi151 ceph-mon[37155]: osdmap e71: 11 total, 11 up, 11 in 2024-08-02T18:46:11.021 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:10 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/2016006262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]: dispatch 2024-08-02T18:46:11.021 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:10 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]: dispatch 2024-08-02T18:46:11.021 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:10 smithi151 ceph-mon[37155]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]': finished 2024-08-02T18:46:11.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:10 smithi103 ceph-mon[32753]: osdmap e71: 11 total, 11 up, 11 in 2024-08-02T18:46:11.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:10 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/2016006262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]: dispatch 2024-08-02T18:46:11.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:10 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]: dispatch 2024-08-02T18:46:11.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:10 smithi103 ceph-mon[32753]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]': finished 2024-08-02T18:46:11.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:10 smithi121 ceph-mon[37236]: osdmap e71: 11 total, 11 up, 11 in 2024-08-02T18:46:11.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:10 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/2016006262' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]: dispatch 2024-08-02T18:46:11.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:10 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]: dispatch 2024-08-02T18:46:11.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:10 smithi121 ceph-mon[37236]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "63dc42b7-851c-44a9-896d-cd9112f9ba35"}]': finished 2024-08-02T18:46:12.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:11 smithi151 ceph-mon[37155]: osdmap e72: 12 total, 11 up, 12 in 2024-08-02T18:46:12.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:11 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:12.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:11 smithi151 ceph-mon[37155]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:12.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:11 smithi151 ceph-mon[37155]: from='client.? 172.21.15.151:0/1137404591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:46:12.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:11 smithi103 ceph-mon[32753]: osdmap e72: 12 total, 11 up, 12 in 2024-08-02T18:46:12.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:11 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:12.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:11 smithi103 ceph-mon[32753]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:12.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:11 smithi103 ceph-mon[32753]: from='client.? 172.21.15.151:0/1137404591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:46:12.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:11 smithi121 ceph-mon[37236]: osdmap e72: 12 total, 11 up, 12 in 2024-08-02T18:46:12.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:11 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:12.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:11 smithi121 ceph-mon[37236]: pgmap v215: 1 pgs: 1 remapped+peering; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:12.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:11 smithi121 ceph-mon[37236]: from='client.? 172.21.15.151:0/1137404591' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-08-02T18:46:14.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:14 smithi151 ceph-mon[37155]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-02T18:46:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:14 smithi121 ceph-mon[37236]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-02T18:46:14.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:14 smithi103 ceph-mon[32753]: pgmap v216: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 104 KiB/s, 0 objects/s recovering 2024-08-02T18:46:16.626 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:16 smithi151 ceph-mon[37155]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-02T18:46:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:16 smithi121 ceph-mon[37236]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-02T18:46:16.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:16 smithi103 ceph-mon[32753]: pgmap v217: 1 pgs: 1 active+clean; 577 KiB data, 325 MiB used, 983 GiB / 983 GiB avail; 88 KiB/s, 0 objects/s recovering 2024-08-02T18:46:18.522 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:18 smithi151 ceph-mon[37155]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-02T18:46:18.523 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:18 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-02T18:46:18.523 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:18 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:18.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:18 smithi121 ceph-mon[37236]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-02T18:46:18.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:18 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-02T18:46:18.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:18 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:18.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:18 smithi103 ceph-mon[32753]: pgmap v218: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 72 KiB/s, 0 objects/s recovering 2024-08-02T18:46:18.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "osd.11"}]: dispatch 2024-08-02T18:46:18.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:19.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:19 smithi151 ceph-mon[37155]: Deploying daemon osd.11 on smithi151 2024-08-02T18:46:19.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:19 smithi121 ceph-mon[37236]: Deploying daemon osd.11 on smithi151 2024-08-02T18:46:19.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:19 smithi103 ceph-mon[32753]: Deploying daemon osd.11 on smithi151 2024-08-02T18:46:20.536 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:20 smithi151 ceph-mon[37155]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-02T18:46:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:20 smithi121 ceph-mon[37236]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-02T18:46:20.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:20 smithi103 ceph-mon[32753]: pgmap v219: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-08-02T18:46:22.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:22 smithi151 ceph-mon[37155]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-02T18:46:22.641 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:22 smithi103 ceph-mon[32753]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-02T18:46:22.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:22 smithi121 ceph-mon[37236]: pgmap v220: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 55 KiB/s, 0 objects/s recovering 2024-08-02T18:46:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:23 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:23.758 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:23.758 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:23.758 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:23 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:23.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:23.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:23.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:23 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:24.542 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:24 smithi151 ceph-mon[37155]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:46:24.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:24 smithi121 ceph-mon[37236]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:46:24.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:24 smithi103 ceph-mon[32753]: pgmap v221: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail; 48 KiB/s, 0 objects/s recovering 2024-08-02T18:46:26.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:26 smithi151 ceph-mon[37155]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:26.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:26.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:26.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:26.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:26.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:26 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:26.748 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.745+0000 7f3f077fe640 1 -- 172.21.15.151:0/4126720482 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+38 (secure 0 0 0) 0x7f3f18062360 con 0x7f3f000a2b80 2024-08-02T18:46:26.748 INFO:teuthology.orchestra.run.smithi151.stdout:Created osd(s) 11 on host 'smithi151' 2024-08-02T18:46:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f000a2b80 msgr2=0x7f3f000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f000a2b80 0x7f3f000a5040 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c000c00 tx=0x7f3f0c031640 comp rx=0 tx=0).stop 2024-08-02T18:46:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18101950 msgr2=0x7f3f18075cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:26.750 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18101950 0x7f3f18075cc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f3f0800e9c0 tx=0x7f3f0800ee80 comp rx=0 tx=0).stop 2024-08-02T18:46:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 shutdown_connections 2024-08-02T18:46:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f000a2b80 0x7f3f000a5040 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f18103510 0x7f3f18074850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f18102b50 0x7f3f18074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 --2- 172.21.15.151:0/4126720482 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f18101950 0x7f3f18075cc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 >> 172.21.15.151:0/4126720482 conn(0x7f3f180fd0e0 msgr2=0x7f3f18105ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 shutdown_connections 2024-08-02T18:46:26.751 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:26.748+0000 7f3f1cfa5640 1 -- 172.21.15.151:0/4126720482 wait complete. 2024-08-02T18:46:26.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:26 smithi121 ceph-mon[37236]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:26.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:26.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:26.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:26.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:26.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:26 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:26.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:26 smithi103 ceph-mon[32753]: pgmap v222: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:26.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:26.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:26.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:26.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:26.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:26 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:27.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:27.395 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:27.446 DEBUG:teuthology.orchestra.run.smithi151:osd.11> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.11.service 2024-08-02T18:46:27.448 INFO:tasks.cephadm:Waiting for 12 OSDs to come up... 2024-08-02T18:46:27.448 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd stat -f json 2024-08-02T18:46:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:27 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:27 smithi151 ceph-mon[37155]: from='osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-02T18:46:27.691 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:27 smithi151 ceph-mon[37155]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-02T18:46:27.714 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:27 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:27 smithi121 ceph-mon[37236]: from='osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-02T18:46:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:27 smithi121 ceph-mon[37236]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-02T18:46:27.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:27.956 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:27.957 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:27 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:27.957 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:27 smithi103 ceph-mon[32753]: from='osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949]' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-02T18:46:27.957 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:27 smithi103 ceph-mon[32753]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]: dispatch 2024-08-02T18:46:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 -- 172.21.15.103:0/1893870609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec100800 msgr2=0x7f50ec100c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 --2- 172.21.15.103:0/1893870609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec100800 0x7f50ec100c00 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f50e8009900 tx=0x7f50e802a410 comp rx=0 tx=0).stop 2024-08-02T18:46:28.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 -- 172.21.15.103:0/1893870609 shutdown_connections 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 --2- 172.21.15.103:0/1893870609 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50ec1023c0 0x7f50ec108c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 --2- 172.21.15.103:0/1893870609 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50ec101a00 0x7f50ec101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 --2- 172.21.15.103:0/1893870609 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec100800 0x7f50ec100c00 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 -- 172.21.15.103:0/1893870609 >> 172.21.15.103:0/1893870609 conn(0x7f50ec0fbfb0 msgr2=0x7f50ec0fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 -- 172.21.15.103:0/1893870609 shutdown_connections 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 -- 172.21.15.103:0/1893870609 wait complete. 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 Processor -- start 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.183+0000 7f50f3698640 1 -- start start 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f3698640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50ec100800 0x7f50ec197dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f3698640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec101a00 0x7f50ec198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f3698640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50ec1023c0 0x7f50ec19f390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:28.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f3698640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec10c5c0 con 0x7f50ec101a00 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f3698640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec10c440 con 0x7f50ec100800 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f3698640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f50ec10c740 con 0x7f50ec1023c0 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec101a00 0x7f50ec198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec101a00 0x7f50ec198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37892/0 (socket says 172.21.15.103:37892) 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 -- 172.21.15.103:0/805454473 learned_addr learned my addr 172.21.15.103:0/805454473 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f1c35640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50ec1023c0 0x7f50ec19f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f1434640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50ec100800 0x7f50ec197dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 -- 172.21.15.103:0/805454473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50ec1023c0 msgr2=0x7f50ec19f390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50ec1023c0 0x7f50ec19f390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 -- 172.21.15.103:0/805454473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50ec100800 msgr2=0x7f50ec197dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:28.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50ec100800 0x7f50ec197dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 -- 172.21.15.103:0/805454473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50ec19fa00 con 0x7f50ec101a00 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f0c33640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec101a00 0x7f50ec198310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d770 tx=0x7f50dc00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50e27fc640 1 -- 172.21.15.103:0/805454473 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc017070 con 0x7f50ec101a00 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50e27fc640 1 -- 172.21.15.103:0/805454473 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f50dc005520 con 0x7f50ec101a00 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50ec19fcf0 con 0x7f50ec101a00 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50e27fc640 1 -- 172.21.15.103:0/805454473 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f50dc010460 con 0x7f50ec101a00 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.184+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50ec1a0180 con 0x7f50ec101a00 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.185+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50ec1a03b0 con 0x7f50ec101a00 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.187+0000 7f50e27fc640 1 -- 172.21.15.103:0/805454473 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f50dc004ea0 con 0x7f50ec101a00 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.187+0000 7f50e27fc640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f50d80a2bb0 0x7f50d80a5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.188+0000 7f50f1434640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f50d80a2bb0 0x7f50d80a5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:28.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.188+0000 7f50e27fc640 1 -- 172.21.15.103:0/805454473 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(73..73 src has 1..73) ==== 6831+0+0 (secure 0 0 0) 0x7f50dc0ce8f0 con 0x7f50ec101a00 2024-08-02T18:46:28.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.188+0000 7f50f1434640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f50d80a2bb0 0x7f50d80a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f50e8000c00 tx=0x7f50e8031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:28.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.191+0000 7f50e27fc640 1 -- 172.21.15.103:0/805454473 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f50dc09be20 con 0x7f50ec101a00 2024-08-02T18:46:28.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.362+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f50ec1a0740 con 0x7f50ec101a00 2024-08-02T18:46:28.363 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.362+0000 7f50e27fc640 1 -- 172.21.15.103:0/805454473 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v73) ==== 74+0+133 (secure 0 0 0) 0x7f50dc09b720 con 0x7f50ec101a00 2024-08-02T18:46:28.363 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:28.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f50d80a2bb0 msgr2=0x7f50d80a5070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f50d80a2bb0 0x7f50d80a5070 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f50e8000c00 tx=0x7f50e8031640 comp rx=0 tx=0).stop 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec101a00 msgr2=0x7f50ec198310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec101a00 0x7f50ec198310 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f50dc00d770 tx=0x7f50dc00dc30 comp rx=0 tx=0).stop 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 shutdown_connections 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f50d80a2bb0 0x7f50d80a5070 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50ec1023c0 0x7f50ec19f390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50ec101a00 0x7f50ec198310 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 --2- 172.21.15.103:0/805454473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50ec100800 0x7f50ec197dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 >> 172.21.15.103:0/805454473 conn(0x7f50ec0fbfb0 msgr2=0x7f50ec069d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 shutdown_connections 2024-08-02T18:46:28.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:28.364+0000 7f50f3698640 1 -- 172.21.15.103:0/805454473 wait complete. 2024-08-02T18:46:28.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:28 smithi151 ceph-mon[37155]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:28.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:28 smithi151 ceph-mon[37155]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-02T18:46:28.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:28 smithi151 ceph-mon[37155]: osdmap e73: 12 total, 11 up, 12 in 2024-08-02T18:46:28.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:28 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:28.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:28 smithi151 ceph-mon[37155]: from='osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:46:28.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:28 smithi151 ceph-mon[37155]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:46:28.730 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:28 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/805454473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-02T18:46:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:28 smithi121 ceph-mon[37236]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:28 smithi121 ceph-mon[37236]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-02T18:46:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:28 smithi121 ceph-mon[37236]: osdmap e73: 12 total, 11 up, 12 in 2024-08-02T18:46:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:28 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:28 smithi121 ceph-mon[37236]: from='osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:46:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:28 smithi121 ceph-mon[37236]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:46:28.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:28 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/805454473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-02T18:46:28.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:28 smithi103 ceph-mon[32753]: pgmap v223: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:28.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:28 smithi103 ceph-mon[32753]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["11"]}]': finished 2024-08-02T18:46:28.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:28 smithi103 ceph-mon[32753]: osdmap e73: 12 total, 11 up, 12 in 2024-08-02T18:46:28.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:28 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:28.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:28 smithi103 ceph-mon[32753]: from='osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949]' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:46:28.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:28 smithi103 ceph-mon[32753]: from='osd.11 ' entity='osd.11' cmd=[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]: dispatch 2024-08-02T18:46:28.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:28 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/805454473' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-02T18:46:29.097 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":73,"num_osds":12,"num_up_osds":11,"osd_up_since":1722624366,"num_in_osds":12,"osd_in_since":1722624370,"num_remapped_pgs":0} 2024-08-02T18:46:29.759 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 18:46:29 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T18:46:29.431+0000 7f8663eba640 -1 osd.11 0 waiting for initial osdmap 2024-08-02T18:46:29.759 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 18:46:29 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T18:46:29.442+0000 7f865bcda640 -1 osd.11 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-08-02T18:46:30.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:29 smithi151 ceph-mon[37155]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:46:30.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:29 smithi151 ceph-mon[37155]: osdmap e74: 12 total, 11 up, 12 in 2024-08-02T18:46:30.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:29 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:30.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:29 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:30.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:29 smithi151 ceph-mon[37155]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:30.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:29 smithi151 ceph-mon[37155]: from='osd.11 ' entity='osd.11' 2024-08-02T18:46:30.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:29 smithi103 ceph-mon[32753]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:46:30.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:29 smithi103 ceph-mon[32753]: osdmap e74: 12 total, 11 up, 12 in 2024-08-02T18:46:30.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:29 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:30.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:29 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:30.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:29 smithi103 ceph-mon[32753]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:30.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:29 smithi103 ceph-mon[32753]: from='osd.11 ' entity='osd.11' 2024-08-02T18:46:30.098 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd stat -f json 2024-08-02T18:46:30.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:29 smithi121 ceph-mon[37236]: from='osd.11 ' entity='osd.11' cmd='[{"prefix": "osd crush create-or-move", "id": 11, "weight":0.0873, "args": ["host=smithi151", "root=default"]}]': finished 2024-08-02T18:46:30.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:29 smithi121 ceph-mon[37236]: osdmap e74: 12 total, 11 up, 12 in 2024-08-02T18:46:30.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:29 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:30.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:29 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:30.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:29 smithi121 ceph-mon[37236]: pgmap v226: 1 pgs: 1 active+clean; 577 KiB data, 324 MiB used, 983 GiB / 983 GiB avail 2024-08-02T18:46:30.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:29 smithi121 ceph-mon[37236]: from='osd.11 ' entity='osd.11' 2024-08-02T18:46:30.363 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 -- 172.21.15.103:0/3047980251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 msgr2=0x7f5af0101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 --2- 172.21.15.103:0/3047980251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 0x7f5af0101ec0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009900 tx=0x7f5ae402a410 comp rx=0 tx=0).stop 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 -- 172.21.15.103:0/3047980251 shutdown_connections 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 --2- 172.21.15.103:0/3047980251 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5af0102400 0x7f5af0108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 --2- 172.21.15.103:0/3047980251 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 0x7f5af0101ec0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 --2- 172.21.15.103:0/3047980251 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5af0100840 0x7f5af0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 -- 172.21.15.103:0/3047980251 >> 172.21.15.103:0/3047980251 conn(0x7f5af00fbfd0 msgr2=0x7f5af00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 -- 172.21.15.103:0/3047980251 shutdown_connections 2024-08-02T18:46:30.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.802+0000 7f5af481d640 1 -- 172.21.15.103:0/3047980251 wait complete. 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5af481d640 1 Processor -- start 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5af481d640 1 -- start start 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5af481d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5af0100840 0x7f5af0196c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5af481d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 0x7f5af0197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5af481d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5af0102400 0x7f5af019e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5af481d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5af010c600 con 0x7f5af0101a40 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5af481d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5af010c480 con 0x7f5af0100840 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5af481d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5af010c780 con 0x7f5af0102400 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aedd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 0x7f5af0197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aedd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 0x7f5af0197190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51864/0 (socket says 172.21.15.103:51864) 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aedd9b640 1 -- 172.21.15.103:0/2768739297 learned_addr learned my addr 172.21.15.103:0/2768739297 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aeed9d640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5af0102400 0x7f5af019e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:30.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aee59c640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5af0100840 0x7f5af0196c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aedd9b640 1 -- 172.21.15.103:0/2768739297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5af0102400 msgr2=0x7f5af019e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aedd9b640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5af0102400 0x7f5af019e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aedd9b640 1 -- 172.21.15.103:0/2768739297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5af0100840 msgr2=0x7f5af0196c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aedd9b640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5af0100840 0x7f5af0196c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aedd9b640 1 -- 172.21.15.103:0/2768739297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5af019e870 con 0x7f5af0101a40 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.803+0000 7f5aee59c640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5af0100840 0x7f5af0196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.804+0000 7f5aedd9b640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 0x7f5af0197190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009a20 tx=0x7f5ae4004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.804+0000 7f5adf7fe640 1 -- 172.21.15.103:0/2768739297 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae403f030 con 0x7f5af0101a40 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.804+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5af019eb00 con 0x7f5af0101a40 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.804+0000 7f5adf7fe640 1 -- 172.21.15.103:0/2768739297 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5ae4003d00 con 0x7f5af0101a40 2024-08-02T18:46:30.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.804+0000 7f5adf7fe640 1 -- 172.21.15.103:0/2768739297 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ae4035070 con 0x7f5af0101a40 2024-08-02T18:46:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.804+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5af019f030 con 0x7f5af0101a40 2024-08-02T18:46:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.805+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5af0107bf0 con 0x7f5af0101a40 2024-08-02T18:46:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.807+0000 7f5adf7fe640 1 -- 172.21.15.103:0/2768739297 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5ae4042030 con 0x7f5af0101a40 2024-08-02T18:46:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.807+0000 7f5adf7fe640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5ad80a2b80 0x7f5ad80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.807+0000 7f5aee59c640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5ad80a2b80 0x7f5ad80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.807+0000 7f5adf7fe640 1 -- 172.21.15.103:0/2768739297 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(75..75 src has 1..75) ==== 7127+0+0 (secure 0 0 0) 0x7f5ae40ef670 con 0x7f5af0101a40 2024-08-02T18:46:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.808+0000 7f5aee59c640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5ad80a2b80 0x7f5ad80a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5af0198130 tx=0x7f5ae0005e90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:30.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.810+0000 7f5adf7fe640 1 -- 172.21.15.103:0/2768739297 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5ae40bca70 con 0x7f5af0101a40 2024-08-02T18:46:30.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.977+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) -- 0x7f5af002d830 con 0x7f5af0101a40 2024-08-02T18:46:30.979 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.977+0000 7f5adf7fe640 1 -- 172.21.15.103:0/2768739297 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v75) ==== 74+0+133 (secure 0 0 0) 0x7f5ae40bc370 con 0x7f5af0101a40 2024-08-02T18:46:30.979 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:30.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5ad80a2b80 msgr2=0x7f5ad80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:30.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5ad80a2b80 0x7f5ad80a5040 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f5af0198130 tx=0x7f5ae0005e90 comp rx=0 tx=0).stop 2024-08-02T18:46:30.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 msgr2=0x7f5af0197190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:30.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 0x7f5af0197190 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f5ae4009a20 tx=0x7f5ae4004430 comp rx=0 tx=0).stop 2024-08-02T18:46:30.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 shutdown_connections 2024-08-02T18:46:30.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5ad80a2b80 0x7f5ad80a5040 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5af0102400 0x7f5af019e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5af0101a40 0x7f5af0197190 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.979+0000 7f5af481d640 1 --2- 172.21.15.103:0/2768739297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5af0100840 0x7f5af0196c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:30.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.980+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 >> 172.21.15.103:0/2768739297 conn(0x7f5af00fbfd0 msgr2=0x7f5af0104dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:30.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.980+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 shutdown_connections 2024-08-02T18:46:30.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:30.980+0000 7f5af481d640 1 -- 172.21.15.103:0/2768739297 wait complete. 2024-08-02T18:46:31.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: purged_snaps scrub starts 2024-08-02T18:46:31.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: purged_snaps scrub ok 2024-08-02T18:46:31.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:31.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] boot 2024-08-02T18:46:31.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: osdmap e75: 12 total, 12 up, 12 in 2024-08-02T18:46:31.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:31.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:31.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:31.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:30 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: purged_snaps scrub starts 2024-08-02T18:46:31.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: purged_snaps scrub ok 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] boot 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: osdmap e75: 12 total, 12 up, 12 in 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:31.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:30 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: purged_snaps scrub starts 2024-08-02T18:46:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: purged_snaps scrub ok 2024-08-02T18:46:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: osd.11 [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] boot 2024-08-02T18:46:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: osdmap e75: 12 total, 12 up, 12 in 2024-08-02T18:46:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:46:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:31.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:30 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:31.734 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":75,"num_osds":12,"num_up_osds":12,"osd_up_since":1722624390,"num_in_osds":12,"osd_in_since":1722624370,"num_remapped_pgs":0} 2024-08-02T18:46:31.735 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:46:31.985 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:32.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:31 smithi151 ceph-mon[37155]: Detected new or changed devices on smithi151 2024-08-02T18:46:32.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:31 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi151 to 4272M 2024-08-02T18:46:32.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:31 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2768739297' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-02T18:46:32.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:31 smithi151 ceph-mon[37155]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:32.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:31 smithi103 ceph-mon[32753]: Detected new or changed devices on smithi151 2024-08-02T18:46:32.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:31 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi151 to 4272M 2024-08-02T18:46:32.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:31 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2768739297' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-02T18:46:32.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:31 smithi103 ceph-mon[32753]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:32.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:31 smithi121 ceph-mon[37236]: Detected new or changed devices on smithi151 2024-08-02T18:46:32.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:31 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi151 to 4272M 2024-08-02T18:46:32.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:31 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2768739297' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-08-02T18:46:32.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:31 smithi121 ceph-mon[37236]: pgmap v228: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:32.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 -- 172.21.15.103:0/3825286453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60681033f0 msgr2=0x7f606810b8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:32.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 --2- 172.21.15.103:0/3825286453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60681033f0 0x7f606810b8e0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f605c009900 tx=0x7f605c02a480 comp rx=0 tx=0).stop 2024-08-02T18:46:32.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 -- 172.21.15.103:0/3825286453 shutdown_connections 2024-08-02T18:46:32.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 --2- 172.21.15.103:0/3825286453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f606810beb0 0x7f606810e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 --2- 172.21.15.103:0/3825286453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f60681033f0 0x7f606810b8e0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 --2- 172.21.15.103:0/3825286453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6068102ad0 0x7f6068102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 -- 172.21.15.103:0/3825286453 >> 172.21.15.103:0/3825286453 conn(0x7f60680fc4d0 msgr2=0x7f60680fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:32.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 -- 172.21.15.103:0/3825286453 shutdown_connections 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.443+0000 7f606d78f640 1 -- 172.21.15.103:0/3825286453 wait complete. 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.444+0000 7f606d78f640 1 Processor -- start 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.444+0000 7f606d78f640 1 -- start start 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.444+0000 7f606d78f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6068102ad0 0x7f6068100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.444+0000 7f606d78f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60681033f0 0x7f6068100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.444+0000 7f606d78f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606810beb0 0x7f60681011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.444+0000 7f606d78f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6068111e30 con 0x7f6068102ad0 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.444+0000 7f606d78f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6068111cb0 con 0x7f606810beb0 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.444+0000 7f606d78f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6068111fb0 con 0x7f60681033f0 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6068102ad0 0x7f6068100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6068102ad0 0x7f6068100730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51872/0 (socket says 172.21.15.103:51872) 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 -- 172.21.15.103:0/1160811252 learned_addr learned my addr 172.21.15.103:0/1160811252 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:32.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f60667fc640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60681033f0 0x7f6068100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f60677fe640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606810beb0 0x7f60681011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 -- 172.21.15.103:0/1160811252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60681033f0 msgr2=0x7f6068100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60681033f0 0x7f6068100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 -- 172.21.15.103:0/1160811252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606810beb0 msgr2=0x7f60681011b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606810beb0 0x7f60681011b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 -- 172.21.15.103:0/1160811252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f60681a6790 con 0x7f6068102ad0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f60667fc640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60681033f0 0x7f6068100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f60677fe640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606810beb0 0x7f60681011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f6066ffd640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6068102ad0 0x7f6068100730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f605800b4a0 tx=0x7f605800b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f604ffff640 1 -- 172.21.15.103:0/1160811252 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058014070 con 0x7f6068102ad0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f60681a6a80 con 0x7f6068102ad0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f604ffff640 1 -- 172.21.15.103:0/1160811252 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6058010b10 con 0x7f6068102ad0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f604ffff640 1 -- 172.21.15.103:0/1160811252 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6058017d60 con 0x7f6068102ad0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.445+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f60681a6fc0 con 0x7f6068102ad0 2024-08-02T18:46:32.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.446+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6068102eb0 con 0x7f6068102ad0 2024-08-02T18:46:32.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.447+0000 7f604ffff640 1 -- 172.21.15.103:0/1160811252 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6058017070 con 0x7f6068102ad0 2024-08-02T18:46:32.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.448+0000 7f604ffff640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f60500a2b80 0x7f60500a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:32.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.448+0000 7f604ffff640 1 -- 172.21.15.103:0/1160811252 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f60580cdff0 con 0x7f6068102ad0 2024-08-02T18:46:32.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.448+0000 7f60667fc640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f60500a2b80 0x7f60500a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:32.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.448+0000 7f60667fc640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f60500a2b80 0x7f60500a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60681021c0 tx=0x7f605c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:32.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.452+0000 7f604ffff640 1 -- 172.21.15.103:0/1160811252 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f605809b3f0 con 0x7f6068102ad0 2024-08-02T18:46:32.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.622+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6068106ef0 con 0x7f6068102ad0 2024-08-02T18:46:32.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.622+0000 7f604ffff640 1 -- 172.21.15.103:0/1160811252 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v76) ==== 74+0+18501 (secure 0 0 0) 0x7f605809acf0 con 0x7f6068102ad0 2024-08-02T18:46:32.624 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:32.624 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":76,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:46:31.759151+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":26,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":39,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":51,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":71,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:46:32.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f60500a2b80 msgr2=0x7f60500a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:32.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f60500a2b80 0x7f60500a5040 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f60681021c0 tx=0x7f605c005a20 comp rx=0 tx=0).stop 2024-08-02T18:46:32.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6068102ad0 msgr2=0x7f6068100730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:32.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6068102ad0 0x7f6068100730 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f605800b4a0 tx=0x7f605800b960 comp rx=0 tx=0).stop 2024-08-02T18:46:32.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 shutdown_connections 2024-08-02T18:46:32.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f606810beb0 0x7f60681011b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f60500a2b80 0x7f60500a5040 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f60681033f0 0x7f6068100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 --2- 172.21.15.103:0/1160811252 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6068102ad0 0x7f6068100730 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:32.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 >> 172.21.15.103:0/1160811252 conn(0x7f60680fc4d0 msgr2=0x7f60680fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:32.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 shutdown_connections 2024-08-02T18:46:32.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:32.625+0000 7f606d78f640 1 -- 172.21.15.103:0/1160811252 wait complete. 2024-08-02T18:46:32.946 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:32 smithi103 ceph-mon[32753]: osdmap e76: 12 total, 12 up, 12 in 2024-08-02T18:46:32.946 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:32 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1160811252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:46:33.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:32 smithi151 ceph-mon[37155]: osdmap e76: 12 total, 12 up, 12 in 2024-08-02T18:46:33.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:32 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1160811252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:46:33.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:32 smithi121 ceph-mon[37236]: osdmap e76: 12 total, 12 up, 12 in 2024-08-02T18:46:33.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:32 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1160811252' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:46:33.292 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-02T18:43:05.562258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-08-02T18:46:33.292 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-08-02T18:46:33.546 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:33.942 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:33 smithi103 ceph-mon[32753]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 -- 172.21.15.103:0/348308109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c102250 msgr2=0x7fdf5c10e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:34.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 --2- 172.21.15.103:0/348308109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c102250 0x7fdf5c10e780 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fdf54009cd0 tx=0x7fdf5402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 -- 172.21.15.103:0/348308109 shutdown_connections 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 --2- 172.21.15.103:0/348308109 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c102250 0x7fdf5c10e780 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 --2- 172.21.15.103:0/348308109 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf5c1018b0 0x7fdf5c101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 --2- 172.21.15.103:0/348308109 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c1078b0 0x7fdf5c107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 -- 172.21.15.103:0/348308109 >> 172.21.15.103:0/348308109 conn(0x7fdf5c0fd5f0 msgr2=0x7fdf5c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 -- 172.21.15.103:0/348308109 shutdown_connections 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.023+0000 7fdf60a76640 1 -- 172.21.15.103:0/348308109 wait complete. 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf60a76640 1 Processor -- start 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf60a76640 1 -- start start 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf60a76640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c1018b0 0x7fdf5c19a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf60a76640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c102250 0x7fdf5c19a960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:34.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf60a76640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf5c1078b0 0x7fdf5c19ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf60a76640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c111dd0 con 0x7fdf5c1018b0 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf60a76640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c111c50 con 0x7fdf5c1078b0 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf60a76640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdf5c111f50 con 0x7fdf5c102250 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf5a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c1018b0 0x7fdf5c19a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf5a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c1018b0 0x7fdf5c19a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51890/0 (socket says 172.21.15.103:51890) 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.024+0000 7fdf5a59c640 1 -- 172.21.15.103:0/3558964061 learned_addr learned my addr 172.21.15.103:0/3558964061 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf59d9b640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c102250 0x7fdf5c19a960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf5ad9d640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf5c1078b0 0x7fdf5c19ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf5a59c640 1 -- 172.21.15.103:0/3558964061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c102250 msgr2=0x7fdf5c19a960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf5a59c640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c102250 0x7fdf5c19a960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf5a59c640 1 -- 172.21.15.103:0/3558964061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf5c1078b0 msgr2=0x7fdf5c19ecf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf5a59c640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf5c1078b0 0x7fdf5c19ecf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf5a59c640 1 -- 172.21.15.103:0/3558964061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdf5c19f3d0 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf5a59c640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c1018b0 0x7fdf5c19a420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00d770 tx=0x7fdf4c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3558964061 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c017070 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdf5c19f6c0 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3558964061 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdf4c005520 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3558964061 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdf4c010460 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.025+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdf5c1a6fa0 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.026+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdf5c101d10 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.028+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3558964061 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fdf4c004ea0 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.028+0000 7fdf4b7fe640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fdf440a2b80 0x7fdf440a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.028+0000 7fdf59d9b640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fdf440a2b80 0x7fdf440a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.028+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3558964061 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fdf4c0ce540 con 0x7fdf5c1018b0 2024-08-02T18:46:34.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.029+0000 7fdf59d9b640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fdf440a2b80 0x7fdf440a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c10e8f0 tx=0x7fdf50005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:34.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.032+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3558964061 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdf4c09b2f0 con 0x7fdf5c1018b0 2024-08-02T18:46:34.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:33 smithi151 ceph-mon[37155]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:34.152 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:33 smithi121 ceph-mon[37236]: pgmap v230: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.196+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdf5c1a71d0 con 0x7fdf5c1018b0 2024-08-02T18:46:34.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.197+0000 7fdf4b7fe640 1 -- 172.21.15.103:0/3558964061 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v76) ==== 93+0+10 (secure 0 0 0) 0x7fdf4c09f5f0 con 0x7fdf5c1018b0 2024-08-02T18:46:34.198 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-08-02T18:46:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fdf440a2b80 msgr2=0x7fdf440a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fdf440a2b80 0x7fdf440a5040 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fdf5c10e8f0 tx=0x7fdf50005f90 comp rx=0 tx=0).stop 2024-08-02T18:46:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c1018b0 msgr2=0x7fdf5c19a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:34.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c1018b0 0x7fdf5c19a420 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdf4c00d770 tx=0x7fdf4c00dc30 comp rx=0 tx=0).stop 2024-08-02T18:46:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 shutdown_connections 2024-08-02T18:46:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdf5c1078b0 0x7fdf5c19ecf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fdf440a2b80 0x7fdf440a5040 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdf5c102250 0x7fdf5c19a960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 --2- 172.21.15.103:0/3558964061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdf5c1018b0 0x7fdf5c19a420 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 >> 172.21.15.103:0/3558964061 conn(0x7fdf5c0fd5f0 msgr2=0x7fdf5c10ce60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 shutdown_connections 2024-08-02T18:46:34.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:34.199+0000 7fdf60a76640 1 -- 172.21.15.103:0/3558964061 wait complete. 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.a on smithi103 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.d on smithi103 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.g on smithi103 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.j on smithi103 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.b on smithi121 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.e on smithi121 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.h on smithi121 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.k on smithi121 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.c on smithi151 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.f on smithi151 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.i on smithi151 2024-08-02T18:46:34.853 INFO:tasks.cephadm:Adding mds.l on smithi151 2024-08-02T18:46:34.854 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph orch apply mds all '12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l' 2024-08-02T18:46:35.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:34 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3558964061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:46:35.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:34 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3558964061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:46:35.119 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T18:46:35.167 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:34 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3558964061' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:46:35.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 -- 172.21.15.151:0/304422199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248102b30 msgr2=0x7fa248102fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:35.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/304422199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248102b30 0x7fa248102fb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fa23c009900 tx=0x7fa23c02a410 comp rx=0 tx=0).stop 2024-08-02T18:46:35.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 -- 172.21.15.151:0/304422199 shutdown_connections 2024-08-02T18:46:35.621 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/304422199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2481034f0 0x7fa248109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/304422199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248102b30 0x7fa248102fb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/304422199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa248101930 0x7fa248101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 -- 172.21.15.151:0/304422199 >> 172.21.15.151:0/304422199 conn(0x7fa2480fd0c0 msgr2=0x7fa2480ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 -- 172.21.15.151:0/304422199 shutdown_connections 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.611+0000 7fa24e0f1640 1 -- 172.21.15.151:0/304422199 wait complete. 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa24e0f1640 1 Processor -- start 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa24e0f1640 1 -- start start 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa24e0f1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248101930 0x7fa248197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa24e0f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa248102b30 0x7fa2481981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa24e0f1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2481034f0 0x7fa24819f1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:35.622 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa24e0f1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa24810d6f0 con 0x7fa248102b30 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa24e0f1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa24810d570 con 0x7fa2481034f0 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa24e0f1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa24810d870 con 0x7fa248101930 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248101930 0x7fa248197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa2477fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248101930 0x7fa248197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.151:54720/0 (socket says 172.21.15.151:54720) 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.612+0000 7fa2477fe640 1 -- 172.21.15.151:0/372078370 learned_addr learned my addr 172.21.15.151:0/372078370 (peer_addr_for_me v2:172.21.15.151:0/0) 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa247fff640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2481034f0 0x7fa24819f1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa246ffd640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa248102b30 0x7fa2481981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa2477fe640 1 -- 172.21.15.151:0/372078370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2481034f0 msgr2=0x7fa24819f1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa2477fe640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2481034f0 0x7fa24819f1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa2477fe640 1 -- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa248102b30 msgr2=0x7fa2481981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa2477fe640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa248102b30 0x7fa2481981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa2477fe640 1 -- 172.21.15.151:0/372078370 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa24819f880 con 0x7fa248101930 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa2477fe640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248101930 0x7fa248197c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa23800c970 tx=0x7fa23800ce30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:35.623 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa244ff9640 1 -- 172.21.15.151:0/372078370 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa238007c10 con 0x7fa248101930 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa244ff9640 1 -- 172.21.15.151:0/372078370 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa238007db0 con 0x7fa248101930 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa24819fb70 con 0x7fa248101930 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa244ff9640 1 -- 172.21.15.151:0/372078370 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa23800fa40 con 0x7fa248101930 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.613+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2481a00b0 con 0x7fa248101930 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.614+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa248108c60 con 0x7fa248101930 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.615+0000 7fa244ff9640 1 -- 172.21.15.151:0/372078370 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fa23800fbe0 con 0x7fa248101930 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.616+0000 7fa244ff9640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fa2300a2b80 0x7fa2300a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.616+0000 7fa244ff9640 1 -- 172.21.15.151:0/372078370 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fa2380cf1e0 con 0x7fa248101930 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.616+0000 7fa246ffd640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fa2300a2b80 0x7fa2300a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.617+0000 7fa246ffd640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fa2300a2b80 0x7fa2300a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa23c000c00 tx=0x7fa23c031640 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:35.624 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.619+0000 7fa244ff9640 1 -- 172.21.15.151:0/372078370 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa23809c700 con 0x7fa248101930 2024-08-02T18:46:35.799 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.798+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}) -- 0x7fa248062460 con 0x7fa2300a2b80 2024-08-02T18:46:35.806 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.805+0000 7fa244ff9640 1 -- 172.21.15.151:0/372078370 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+28 (secure 0 0 0) 0x7fa248062460 con 0x7fa2300a2b80 2024-08-02T18:46:35.807 INFO:teuthology.orchestra.run.smithi151.stdout:Scheduled mds.all update... 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fa2300a2b80 msgr2=0x7fa2300a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fa2300a2b80 0x7fa2300a5040 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa23c000c00 tx=0x7fa23c031640 comp rx=0 tx=0).stop 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248101930 msgr2=0x7fa248197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248101930 0x7fa248197c60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fa23800c970 tx=0x7fa23800ce30 comp rx=0 tx=0).stop 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 shutdown_connections 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2481034f0 0x7fa24819f1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa248102b30 0x7fa2481981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fa2300a2b80 0x7fa2300a5040 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.809 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 --2- 172.21.15.151:0/372078370 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa248101930 0x7fa248197c60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 >> 172.21.15.151:0/372078370 conn(0x7fa2480fd0c0 msgr2=0x7fa248105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 shutdown_connections 2024-08-02T18:46:35.810 INFO:teuthology.orchestra.run.smithi151.stderr:2024-08-02T18:46:35.807+0000 7fa24e0f1640 1 -- 172.21.15.151:0/372078370 wait complete. 2024-08-02T18:46:36.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:35 smithi151 ceph-mon[37155]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:36.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:35 smithi103 ceph-mon[32753]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:36.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:35 smithi121 ceph-mon[37236]: pgmap v231: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:36.988 DEBUG:teuthology.orchestra.run.smithi103:mds.a> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.a.service 2024-08-02T18:46:36.991 DEBUG:teuthology.orchestra.run.smithi103:mds.d> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.d.service 2024-08-02T18:46:37.034 DEBUG:teuthology.orchestra.run.smithi103:mds.g> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.g.service 2024-08-02T18:46:37.056 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:46:37.056 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-08-02T18:46:37.056 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:37.056 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:37.056 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:37.056 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:37.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:37.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:37.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:37.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:37.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:36 smithi103 ceph-mon[32753]: Deploying daemon mds.l on smithi151 2024-08-02T18:46:37.058 DEBUG:teuthology.orchestra.run.smithi103:mds.j> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.j.service 2024-08-02T18:46:37.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:46:37.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:37.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:36 smithi151 ceph-mon[37155]: Deploying daemon mds.l on smithi151 2024-08-02T18:46:37.100 DEBUG:teuthology.orchestra.run.smithi121:mds.b> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.b.service 2024-08-02T18:46:37.103 DEBUG:teuthology.orchestra.run.smithi121:mds.e> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.e.service 2024-08-02T18:46:37.125 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='client.24391 -' entity='client.admin' cmd=[{"prefix": "orch apply mds", "fs_name": "all", "placement": "12;smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:46:37.125 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: Saving service mds.all spec with placement smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-08-02T18:46:37.125 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:37.125 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:46:37.125 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:37.126 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:46:37.126 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:37.126 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:37.126 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.l", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:37.126 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:37.126 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:36 smithi121 ceph-mon[37236]: Deploying daemon mds.l on smithi151 2024-08-02T18:46:37.127 DEBUG:teuthology.orchestra.run.smithi121:mds.h> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.h.service 2024-08-02T18:46:37.170 DEBUG:teuthology.orchestra.run.smithi121:mds.k> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.k.service 2024-08-02T18:46:37.213 DEBUG:teuthology.orchestra.run.smithi151:mds.c> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.c.service 2024-08-02T18:46:37.216 DEBUG:teuthology.orchestra.run.smithi151:mds.f> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.f.service 2024-08-02T18:46:37.258 DEBUG:teuthology.orchestra.run.smithi151:mds.i> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.i.service 2024-08-02T18:46:37.301 DEBUG:teuthology.orchestra.run.smithi151:mds.l> sudo journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.l.service 2024-08-02T18:46:37.344 INFO:tasks.cephadm:Setting up CephFS filesystem(s)... 2024-08-02T18:46:37.344 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:46:37.596 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:38.040 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:37 smithi103 ceph-mon[32753]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:38.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.038+0000 7f31774c5640 1 -- 172.21.15.103:0/3999234946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170100860 msgr2=0x7f3170100c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.038+0000 7f31774c5640 1 --2- 172.21.15.103:0/3999234946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170100860 0x7f3170100c40 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f316c009900 tx=0x7f316c02a470 comp rx=0 tx=0).stop 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.038+0000 7f31774c5640 1 -- 172.21.15.103:0/3999234946 shutdown_connections 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.038+0000 7f31774c5640 1 --2- 172.21.15.103:0/3999234946 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3170105c70 0x7f3170106100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.038+0000 7f31774c5640 1 --2- 172.21.15.103:0/3999234946 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3170101180 0x7f3170105650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.038+0000 7f31774c5640 1 --2- 172.21.15.103:0/3999234946 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170100860 0x7f3170100c40 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.038+0000 7f31774c5640 1 -- 172.21.15.103:0/3999234946 >> 172.21.15.103:0/3999234946 conn(0x7f31700fc4d0 msgr2=0x7f31700fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.039+0000 7f31774c5640 1 -- 172.21.15.103:0/3999234946 shutdown_connections 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.039+0000 7f31774c5640 1 -- 172.21.15.103:0/3999234946 wait complete. 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.039+0000 7f31774c5640 1 Processor -- start 2024-08-02T18:46:38.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.039+0000 7f31774c5640 1 -- start start 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31774c5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3170100860 0x7f31701a45b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31774c5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170101180 0x7f31701a4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31774c5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3170105c70 0x7f317019e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31774c5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f31701183d0 con 0x7f3170101180 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31774c5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3170118250 con 0x7f3170105c70 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31774c5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3170118550 con 0x7f3170100860 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170101180 0x7f31701a4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170101180 0x7f31701a4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51912/0 (socket says 172.21.15.103:51912) 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 -- 172.21.15.103:0/1801099789 learned_addr learned my addr 172.21.15.103:0/1801099789 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3175261640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3170100860 0x7f31701a45b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3175a62640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3170105c70 0x7f317019e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:38.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 -- 172.21.15.103:0/1801099789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3170100860 msgr2=0x7f31701a45b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3170100860 0x7f31701a45b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 -- 172.21.15.103:0/1801099789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3170105c70 msgr2=0x7f317019e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3170105c70 0x7f317019e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 -- 172.21.15.103:0/1801099789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f317019eef0 con 0x7f3170101180 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f3174a60640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170101180 0x7f31701a4af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f316000d740 tx=0x7f316000dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31667fc640 1 -- 172.21.15.103:0/1801099789 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3160017070 con 0x7f3170101180 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31667fc640 1 -- 172.21.15.103:0/1801099789 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f316000de50 con 0x7f3170101180 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31667fc640 1 -- 172.21.15.103:0/1801099789 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f316000f620 con 0x7f3170101180 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f317019f1e0 con 0x7f3170101180 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.040+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31701ab530 con 0x7f3170101180 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.041+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f317019f550 con 0x7f3170101180 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.043+0000 7f31667fc640 1 -- 172.21.15.103:0/1801099789 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3160009c30 con 0x7f3170101180 2024-08-02T18:46:38.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.044+0000 7f31667fc640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f315c0a2b80 0x7f315c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:38.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.044+0000 7f3175261640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f315c0a2b80 0x7f315c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:38.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.044+0000 7f31667fc640 1 -- 172.21.15.103:0/1801099789 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f31600ce770 con 0x7f3170101180 2024-08-02T18:46:38.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.044+0000 7f3175261640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f315c0a2b80 0x7f315c0a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f316c009230 tx=0x7f316c0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:38.073 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.047+0000 7f31667fc640 1 -- 172.21.15.103:0/1801099789 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f316009b520 con 0x7f3170101180 2024-08-02T18:46:38.073 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:37 smithi151 ceph-mon[37155]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.248+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f317006ada0 con 0x7f3170101180 2024-08-02T18:46:38.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.249+0000 7f31667fc640 1 -- 172.21.15.103:0/1801099789 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 1 v1) ==== 93+0+611 (secure 0 0 0) 0x7f316009f820 con 0x7f3170101180 2024-08-02T18:46:38.250 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:38.251 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":1,"btime":"2024-08-02T18:40:20:516071+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[],"filesystems":[]} 2024-08-02T18:46:38.251 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 1 2024-08-02T18:46:38.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:37 smithi121 ceph-mon[37236]: pgmap v232: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f315c0a2b80 msgr2=0x7f315c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f315c0a2b80 0x7f315c0a5040 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f316c009230 tx=0x7f316c0058d0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170101180 msgr2=0x7f31701a4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170101180 0x7f31701a4af0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f316000d740 tx=0x7f316000dc00 comp rx=0 tx=0).stop 2024-08-02T18:46:38.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 shutdown_connections 2024-08-02T18:46:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3170105c70 0x7f317019e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3170101180 0x7f31701a4af0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f315c0a2b80 0x7f315c0a5040 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 --2- 172.21.15.103:0/1801099789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3170100860 0x7f31701a45b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 >> 172.21.15.103:0/1801099789 conn(0x7f31700fc4d0 msgr2=0x7f3170103620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 shutdown_connections 2024-08-02T18:46:38.253 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:38.251+0000 7f31774c5640 1 -- 172.21.15.103:0/1801099789 wait complete. 2024-08-02T18:46:39.061 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:38 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1801099789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:39.062 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:38 smithi151 systemd[1]: Starting Ceph mds.l for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:46:39.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:38 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1801099789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:39.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:38 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1801099789' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:39.320 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:39 smithi151 podman[66480]: 2024-08-02 18:46:38.962739687 +0000 UTC m=+0.017524959 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:46:39.320 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:39 smithi151 podman[66480]: 2024-08-02 18:46:39.085893639 +0000 UTC m=+0.140678914 container create 6f3d26102afc3e73946e6bebffb9014f15f822f61f7bbd3d779c3c642d6dea70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS) 2024-08-02T18:46:39.822 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:39 smithi151 podman[66480]: 2024-08-02 18:46:39.321591585 +0000 UTC m=+0.376376871 container init 6f3d26102afc3e73946e6bebffb9014f15f822f61f7bbd3d779c3c642d6dea70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l, org.label-schema.build-date=20240731, ceph=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-08-02T18:46:39.822 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:39 smithi151 podman[66480]: 2024-08-02 18:46:39.324189891 +0000 UTC m=+0.378975163 container start 6f3d26102afc3e73946e6bebffb9014f15f822f61f7bbd3d779c3c642d6dea70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD) 2024-08-02T18:46:39.823 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:39 smithi151 ceph-mds[66499]: -- 172.21.15.151:0/3233720590 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x565406f75860 con 0x565406f52800 2024-08-02T18:46:39.823 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l[66495]: starting mds.l at 2024-08-02T18:46:39.823 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:39 smithi151 bash[66480]: 6f3d26102afc3e73946e6bebffb9014f15f822f61f7bbd3d779c3c642d6dea70 2024-08-02T18:46:39.823 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 18:46:39 smithi151 systemd[1]: Started Ceph mds.l for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:46:40.740 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6832/13799064,v1:172.21.15.151:6833/13799064] up:boot 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: fsmap 1 up:standby 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:40.741 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:40 smithi151 ceph-mon[37155]: Deploying daemon mds.k on smithi121 2024-08-02T18:46:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6832/13799064,v1:172.21.15.151:6833/13799064] up:boot 2024-08-02T18:46:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: fsmap 1 up:standby 2024-08-02T18:46:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-02T18:46:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:40.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:40.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:40.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:40 smithi121 ceph-mon[37236]: Deploying daemon mds.k on smithi121 2024-08-02T18:46:40.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: pgmap v233: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6832/13799064,v1:172.21.15.151:6833/13799064] up:boot 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: fsmap 1 up:standby 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.k", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:40.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:40.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:40 smithi103 ceph-mon[32753]: Deploying daemon mds.k on smithi121 2024-08-02T18:46:40.935 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:46:41.198 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 -- 172.21.15.103:0/624562896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1018c0 msgr2=0x7f33ac101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 --2- 172.21.15.103:0/624562896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1018c0 0x7f33ac101d20 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3394009930 tx=0x7f339402a420 comp rx=0 tx=0).stop 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 -- 172.21.15.103:0/624562896 shutdown_connections 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 --2- 172.21.15.103:0/624562896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33ac102260 0x7f33ac10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 --2- 172.21.15.103:0/624562896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1018c0 0x7f33ac101d20 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 --2- 172.21.15.103:0/624562896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33ac1078c0 0x7f33ac107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 -- 172.21.15.103:0/624562896 >> 172.21.15.103:0/624562896 conn(0x7f33ac0fd620 msgr2=0x7f33ac0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 -- 172.21.15.103:0/624562896 shutdown_connections 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.672+0000 7f33b147c640 1 -- 172.21.15.103:0/624562896 wait complete. 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33b147c640 1 Processor -- start 2024-08-02T18:46:41.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33b147c640 1 -- start start 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33b147c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33ac1018c0 0x7f33ac19a4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33b147c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33ac102260 0x7f33ac19aa20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33b147c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1078c0 0x7f33ac19edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33b147c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac111de0 con 0x7f33ac1078c0 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33b147c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac111c60 con 0x7f33ac1018c0 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33b147c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f33ac111f60 con 0x7f33ac102260 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1078c0 0x7f33ac19edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33ab7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1078c0 0x7f33ac19edb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41840/0 (socket says 172.21.15.103:41840) 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33ab7fe640 1 -- 172.21.15.103:0/2489570743 learned_addr learned my addr 172.21.15.103:0/2489570743 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33a27fc640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33ac102260 0x7f33ac19aa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:41.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.673+0000 7f33aaffd640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33ac1018c0 0x7f33ac19a4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33ab7fe640 1 -- 172.21.15.103:0/2489570743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33ac102260 msgr2=0x7f33ac19aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33ab7fe640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33ac102260 0x7f33ac19aa20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33ab7fe640 1 -- 172.21.15.103:0/2489570743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33ac1018c0 msgr2=0x7f33ac19a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33ab7fe640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33ac1018c0 0x7f33ac19a4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33ab7fe640 1 -- 172.21.15.103:0/2489570743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33ac19f490 con 0x7f33ac1078c0 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33ab7fe640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1078c0 0x7f33ac19edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f33a400eaa0 tx=0x7f33a400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33a8ff9640 1 -- 172.21.15.103:0/2489570743 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a400cdb0 con 0x7f33ac1078c0 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33a8ff9640 1 -- 172.21.15.103:0/2489570743 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f33a4004b20 con 0x7f33ac1078c0 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33ac19f780 con 0x7f33ac1078c0 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33a8ff9640 1 -- 172.21.15.103:0/2489570743 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33a4011760 con 0x7f33ac1078c0 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.674+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33ac1a7060 con 0x7f33ac1078c0 2024-08-02T18:46:41.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.675+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33ac101d20 con 0x7f33ac1078c0 2024-08-02T18:46:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.676+0000 7f33a8ff9640 1 -- 172.21.15.103:0/2489570743 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f33a4004cd0 con 0x7f33ac1078c0 2024-08-02T18:46:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.677+0000 7f33a8ff9640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f33980a2b80 0x7f33980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.677+0000 7f33aaffd640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f33980a2b80 0x7f33980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.677+0000 7f33a8ff9640 1 -- 172.21.15.103:0/2489570743 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f33a40ced60 con 0x7f33ac1078c0 2024-08-02T18:46:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.677+0000 7f33aaffd640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f33980a2b80 0x7f33980a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f339c00bb60 tx=0x7f339c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:41.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.681+0000 7f33a8ff9640 1 -- 172.21.15.103:0/2489570743 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f33a4016030 con 0x7f33ac1078c0 2024-08-02T18:46:41.726 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:41 smithi121 systemd[1]: Starting Ceph mds.k for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:46:41.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.883+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33ac1a7230 con 0x7f33ac1078c0 2024-08-02T18:46:41.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.883+0000 7f33a8ff9640 1 -- 172.21.15.103:0/2489570743 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1432 (secure 0 0 0) 0x7f33a409bb10 con 0x7f33ac1078c0 2024-08-02T18:46:41.885 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:41.885 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":2,"btime":"2024-08-02T18:46:39:351601+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-08-02T18:46:41.885 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 2 2024-08-02T18:46:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.885+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f33980a2b80 msgr2=0x7f33980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.885+0000 7f33b147c640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f33980a2b80 0x7f33980a5040 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f339c00bb60 tx=0x7f339c00b390 comp rx=0 tx=0).stop 2024-08-02T18:46:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1078c0 msgr2=0x7f33ac19edb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1078c0 0x7f33ac19edb0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f33a400eaa0 tx=0x7f33a400ef60 comp rx=0 tx=0).stop 2024-08-02T18:46:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 shutdown_connections 2024-08-02T18:46:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f33ac1078c0 0x7f33ac19edb0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f33980a2b80 0x7f33980a5040 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f33ac102260 0x7f33ac19aa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 --2- 172.21.15.103:0/2489570743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33ac1018c0 0x7f33ac19a4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:41.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 >> 172.21.15.103:0/2489570743 conn(0x7f33ac0fd620 msgr2=0x7f33ac10cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:41.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 shutdown_connections 2024-08-02T18:46:41.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:41.886+0000 7f33b147c640 1 -- 172.21.15.103:0/2489570743 wait complete. 2024-08-02T18:46:41.999 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:41 smithi121 podman[66226]: 2024-08-02 18:46:41.627803009 +0000 UTC m=+0.017310115 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:46:41.999 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:41 smithi121 podman[66226]: 2024-08-02 18:46:41.736806148 +0000 UTC m=+0.126313254 container create 2d5eeeccfd548c46b72cdb10bb82bf8976f3c6b61321ff73a2bbe88e195f16e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-08-02T18:46:41.999 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:41 smithi121 podman[66226]: 2024-08-02 18:46:41.972830465 +0000 UTC m=+0.362337571 container init 2d5eeeccfd548c46b72cdb10bb82bf8976f3c6b61321ff73a2bbe88e195f16e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, ceph=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-02T18:46:41.999 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:41 smithi121 podman[66226]: 2024-08-02 18:46:41.975654534 +0000 UTC m=+0.365161643 container start 2d5eeeccfd548c46b72cdb10bb82bf8976f3c6b61321ff73a2bbe88e195f16e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-02T18:46:42.251 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:41 smithi121 ceph-mds[66245]: -- 172.21.15.121:0/1099376475 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d5faa5d860 con 0x55d5faa3a800 2024-08-02T18:46:42.251 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k[66241]: starting mds.k at 2024-08-02T18:46:42.251 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:42 smithi121 bash[66226]: 2d5eeeccfd548c46b72cdb10bb82bf8976f3c6b61321ff73a2bbe88e195f16e9 2024-08-02T18:46:42.251 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 18:46:42 smithi121 systemd[1]: Started Ceph mds.k for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:46:42.740 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:42 smithi103 ceph-mon[32753]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:42.740 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:42 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2489570743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:42.740 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.740 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.740 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.740 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:42.741 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:42.741 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:42 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-mon[37236]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2489570743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:42 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:42.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:42 smithi151 ceph-mon[37155]: pgmap v234: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:42 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2489570743' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.j", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:42.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:42 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:43.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:43 smithi121 ceph-mon[37236]: Deploying daemon mds.j on smithi103 2024-08-02T18:46:43.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:43 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.121:6832/4001571667,v1:172.21.15.121:6833/4001571667] up:boot 2024-08-02T18:46:43.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:43 smithi121 ceph-mon[37236]: fsmap 2 up:standby 2024-08-02T18:46:43.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:43 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-02T18:46:43.752 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:43 smithi103 ceph-mon[32753]: Deploying daemon mds.j on smithi103 2024-08-02T18:46:43.752 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:43 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.121:6832/4001571667,v1:172.21.15.121:6833/4001571667] up:boot 2024-08-02T18:46:43.752 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:43 smithi103 ceph-mon[32753]: fsmap 2 up:standby 2024-08-02T18:46:43.752 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:43 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-02T18:46:43.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:43 smithi151 ceph-mon[37155]: Deploying daemon mds.j on smithi103 2024-08-02T18:46:43.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:43 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.121:6832/4001571667,v1:172.21.15.121:6833/4001571667] up:boot 2024-08-02T18:46:43.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:43 smithi151 ceph-mon[37155]: fsmap 2 up:standby 2024-08-02T18:46:43.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:43 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-02T18:46:44.326 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 systemd[1]: Starting Ceph mds.j for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:46:44.579 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:46:44.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:44 smithi103 ceph-mon[32753]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:44.700 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 podman[72732]: 2024-08-02 18:46:44.319282788 +0000 UTC m=+0.017016143 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:46:44.700 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 podman[72732]: 2024-08-02 18:46:44.437513441 +0000 UTC m=+0.135246783 container create d84c0df1ea2f5ed74819319b1f93fac468ba2c70e5ecd6b94d536168d6007bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD) 2024-08-02T18:46:44.700 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 podman[72732]: 2024-08-02 18:46:44.698882816 +0000 UTC m=+0.396616160 container init d84c0df1ea2f5ed74819319b1f93fac468ba2c70e5ecd6b94d536168d6007bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T18:46:44.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:44 smithi151 ceph-mon[37155]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:44.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:44 smithi121 ceph-mon[37236]: pgmap v235: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:44.864 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:44.987 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 podman[72732]: 2024-08-02 18:46:44.702308818 +0000 UTC m=+0.400042171 container start d84c0df1ea2f5ed74819319b1f93fac468ba2c70e5ecd6b94d536168d6007bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8) 2024-08-02T18:46:44.988 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 ceph-mds[72769]: -- 172.21.15.103:0/2037445537 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562f4a14dc20 con 0x562f4a12b000 2024-08-02T18:46:44.988 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j[72747]: starting mds.j at 2024-08-02T18:46:44.988 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 bash[72732]: d84c0df1ea2f5ed74819319b1f93fac468ba2c70e5ecd6b94d536168d6007bb4 2024-08-02T18:46:44.988 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 18:46:44 smithi103 systemd[1]: Started Ceph mds.j for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.410+0000 7f9f748e0640 1 -- 172.21.15.103:0/3740437950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 msgr2=0x7f9f70100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.410+0000 7f9f748e0640 1 --2- 172.21.15.103:0/3740437950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 0x7f9f70100c20 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f9f64009930 tx=0x7f9f6402a420 comp rx=0 tx=0).stop 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 -- 172.21.15.103:0/3740437950 shutdown_connections 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 --2- 172.21.15.103:0/3740437950 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f70101160 0x7f9f7010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 --2- 172.21.15.103:0/3740437950 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 0x7f9f70100c20 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 --2- 172.21.15.103:0/3740437950 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f701067c0 0x7f9f70106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 -- 172.21.15.103:0/3740437950 >> 172.21.15.103:0/3740437950 conn(0x7f9f700fc500 msgr2=0x7f9f700fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 -- 172.21.15.103:0/3740437950 shutdown_connections 2024-08-02T18:46:45.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 -- 172.21.15.103:0/3740437950 wait complete. 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 Processor -- start 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.411+0000 7f9f748e0640 1 -- start start 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f748e0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 0x7f9f701990d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f748e0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f70101160 0x7f9f70199610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f748e0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f701067c0 0x7f9f701a4150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f748e0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f70110ce0 con 0x7f9f701007c0 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f748e0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9f70110b60 con 0x7f9f701067c0 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f748e0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9f70110e60 con 0x7f9f70101160 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 0x7f9f701990d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 0x7f9f701990d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:41880/0 (socket says 172.21.15.103:41880) 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 -- 172.21.15.103:0/2251896551 learned_addr learned my addr 172.21.15.103:0/2251896551 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:45.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6dd9b640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f70101160 0x7f9f70199610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 -- 172.21.15.103:0/2251896551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f70101160 msgr2=0x7f9f70199610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f70101160 0x7f9f70199610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 -- 172.21.15.103:0/2251896551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f701067c0 msgr2=0x7f9f701a4150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f701067c0 0x7f9f701a4150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 -- 172.21.15.103:0/2251896551 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f701a4690 con 0x7f9f701007c0 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f6e59c640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 0x7f9f701990d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000d950 tx=0x7f9f6000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f5f7fe640 1 -- 172.21.15.103:0/2251896551 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f60017070 con 0x7f9f701007c0 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f701a4860 con 0x7f9f701007c0 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f5f7fe640 1 -- 172.21.15.103:0/2251896551 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f60009c30 con 0x7f9f701007c0 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f701a4da0 con 0x7f9f701007c0 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.412+0000 7f9f5f7fe640 1 -- 172.21.15.103:0/2251896551 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f6000f740 con 0x7f9f701007c0 2024-08-02T18:46:45.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.413+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9f70100c20 con 0x7f9f701007c0 2024-08-02T18:46:45.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.415+0000 7f9f5f7fe640 1 -- 172.21.15.103:0/2251896551 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f9f60010a80 con 0x7f9f701007c0 2024-08-02T18:46:45.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.415+0000 7f9f5f7fe640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9f580a2b80 0x7f9f580a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:45.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.415+0000 7f9f6dd9b640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9f580a2b80 0x7f9f580a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:45.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.415+0000 7f9f5f7fe640 1 -- 172.21.15.103:0/2251896551 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f9f600ceb90 con 0x7f9f701007c0 2024-08-02T18:46:45.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.416+0000 7f9f6dd9b640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9f580a2b80 0x7f9f580a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f64006010 tx=0x7f9f64000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:45.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.418+0000 7f9f5f7fe640 1 -- 172.21.15.103:0/2251896551 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9f60009de0 con 0x7f9f701007c0 2024-08-02T18:46:45.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.636+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9f70108d30 con 0x7f9f701007c0 2024-08-02T18:46:45.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.637+0000 7f9f5f7fe640 1 -- 172.21.15.103:0/2251896551 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 4 v4) ==== 93+0+3088 (secure 0 0 0) 0x7f9f6009bf90 con 0x7f9f701007c0 2024-08-02T18:46:45.638 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:45.639 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":4,"btime":"2024-08-02T18:46:45:374370+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-02T18:46:45.639 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 4 2024-08-02T18:46:45.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9f580a2b80 msgr2=0x7f9f580a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:45.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9f580a2b80 0x7f9f580a5040 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f9f64006010 tx=0x7f9f64000bc0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 msgr2=0x7f9f701990d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 0x7f9f701990d0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f9f6000d950 tx=0x7f9f6000de10 comp rx=0 tx=0).stop 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 shutdown_connections 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f701067c0 0x7f9f701a4150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9f580a2b80 0x7f9f580a5040 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f70101160 0x7f9f70199610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 --2- 172.21.15.103:0/2251896551 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f701007c0 0x7f9f701990d0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 >> 172.21.15.103:0/2251896551 conn(0x7f9f700fc500 msgr2=0x7f9f700fccb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 shutdown_connections 2024-08-02T18:46:45.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:45.639+0000 7f9f748e0640 1 -- 172.21.15.103:0/2251896551 wait complete. 2024-08-02T18:46:45.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:45.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:45.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:45.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:45.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:45.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:45.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: Deploying daemon mds.d on smithi103 2024-08-02T18:46:45.909 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:45.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.103:6834/1945803931,v1:172.21.15.103:6835/1945803931] up:boot 2024-08-02T18:46:45.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: fsmap 3 up:standby 2024-08-02T18:46:45.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-02T18:46:45.910 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:45 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2251896551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:46.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:46.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: Deploying daemon mds.d on smithi103 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.103:6834/1945803931,v1:172.21.15.103:6835/1945803931] up:boot 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: fsmap 3 up:standby 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-02T18:46:46.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:45 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2251896551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:46.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:46.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:46.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:46.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:46.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.d", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:46.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:46.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: Deploying daemon mds.d on smithi103 2024-08-02T18:46:46.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: pgmap v236: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:46.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.103:6834/1945803931,v1:172.21.15.103:6835/1945803931] up:boot 2024-08-02T18:46:46.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: fsmap 3 up:standby 2024-08-02T18:46:46.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-02T18:46:46.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:45 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2251896551' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:47.465 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:47 smithi103 systemd[1]: Starting Ceph mds.d for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:46:48.011 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:47 smithi103 podman[73145]: 2024-08-02 18:46:47.642366823 +0000 UTC m=+0.017558068 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:46:48.011 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:47 smithi103 podman[73145]: 2024-08-02 18:46:47.765910694 +0000 UTC m=+0.141101929 container create 8973ba515c3ca700f97562ef695711e8725ca6df5f8a40b7b5ce6a76f41ad3a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-02T18:46:48.325 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:48 smithi103 podman[73145]: 2024-08-02 18:46:48.010414088 +0000 UTC m=+0.385605335 container init 8973ba515c3ca700f97562ef695711e8725ca6df5f8a40b7b5ce6a76f41ad3a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-02T18:46:48.325 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:48 smithi103 podman[73145]: 2024-08-02 18:46:48.013414147 +0000 UTC m=+0.388605391 container start 8973ba515c3ca700f97562ef695711e8725ca6df5f8a40b7b5ce6a76f41ad3a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-02T18:46:48.325 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-mds[73164]: -- 172.21.15.103:0/204259009 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x560b290ad860 con 0x560b2908b000 2024-08-02T18:46:48.325 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d[73160]: starting mds.d at 2024-08-02T18:46:48.326 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:48 smithi103 bash[73145]: 8973ba515c3ca700f97562ef695711e8725ca6df5f8a40b7b5ce6a76f41ad3a6 2024-08-02T18:46:48.326 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 18:46:48 smithi103 systemd[1]: Started Ceph mds.d for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:46:48.729 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:48 smithi121 ceph-mon[37236]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:48.729 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:48 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.729 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:48 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.730 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:48 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.730 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:48 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:48.730 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:48 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:48.730 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:48 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:48 smithi151 ceph-mon[37155]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:48 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:48 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:48 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:48 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:48 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:48.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:48 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:48.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-mon[32753]: pgmap v237: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.e", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:48.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:48 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:49.495 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:46:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:49 smithi121 ceph-mon[37236]: Deploying daemon mds.e on smithi121 2024-08-02T18:46:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:49 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.103:6836/3186466318,v1:172.21.15.103:6837/3186466318] up:boot 2024-08-02T18:46:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:49 smithi121 ceph-mon[37236]: fsmap 4 up:standby 2024-08-02T18:46:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:49 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-02T18:46:49.762 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:49.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:49 smithi151 ceph-mon[37155]: Deploying daemon mds.e on smithi121 2024-08-02T18:46:49.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:49 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.103:6836/3186466318,v1:172.21.15.103:6837/3186466318] up:boot 2024-08-02T18:46:49.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:49 smithi151 ceph-mon[37155]: fsmap 4 up:standby 2024-08-02T18:46:49.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:49 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-02T18:46:49.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:49 smithi103 ceph-mon[32753]: Deploying daemon mds.e on smithi121 2024-08-02T18:46:49.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:49 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.103:6836/3186466318,v1:172.21.15.103:6837/3186466318] up:boot 2024-08-02T18:46:49.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:49 smithi103 ceph-mon[32753]: fsmap 4 up:standby 2024-08-02T18:46:49.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:49 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-02T18:46:50.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 -- 172.21.15.103:0/2952619410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04106c80 msgr2=0x7fcc0410e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2952619410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04106c80 0x7fcc0410e820 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc009cd0 tx=0x7fcbfc02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 -- 172.21.15.103:0/2952619410 shutdown_connections 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2952619410 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04106c80 0x7fcc0410e820 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2952619410 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc04100a30 0x7fcc04106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2952619410 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc04100080 0x7fcc04100460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 -- 172.21.15.103:0/2952619410 >> 172.21.15.103:0/2952619410 conn(0x7fcc04076f40 msgr2=0x7fcc040fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 -- 172.21.15.103:0/2952619410 shutdown_connections 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.278+0000 7fcc0c391640 1 -- 172.21.15.103:0/2952619410 wait complete. 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0c391640 1 Processor -- start 2024-08-02T18:46:50.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0c391640 1 -- start start 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0c391640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04100080 0x7fcc04198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0c391640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc04100a30 0x7fcc041987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0c391640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc04106c80 0x7fcc0419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0c391640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04111e10 con 0x7fcc04100080 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0c391640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04111c90 con 0x7fcc04100a30 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0c391640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcc04111f90 con 0x7fcc04106c80 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0a12d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04100080 0x7fcc04198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0a12d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04100080 0x7fcc04198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39952/0 (socket says 172.21.15.103:39952) 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0a12d640 1 -- 172.21.15.103:0/2285309294 learned_addr learned my addr 172.21.15.103:0/2285309294 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0992c640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc04100a30 0x7fcc041987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:50.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.279+0000 7fcc0a92e640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc04106c80 0x7fcc0419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcc0a12d640 1 -- 172.21.15.103:0/2285309294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc04106c80 msgr2=0x7fcc0419cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcc0a12d640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc04106c80 0x7fcc0419cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcc0a12d640 1 -- 172.21.15.103:0/2285309294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc04100a30 msgr2=0x7fcc041987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcc0a12d640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc04100a30 0x7fcc041987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcc0a12d640 1 -- 172.21.15.103:0/2285309294 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc0419d230 con 0x7fcc04100080 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcc0a12d640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04100080 0x7fcc04198280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000e9f0 tx=0x7fcc0000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcbfb7fe640 1 -- 172.21.15.103:0/2285309294 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc0000cd80 con 0x7fcc04100080 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcbfb7fe640 1 -- 172.21.15.103:0/2285309294 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc00005520 con 0x7fcc04100080 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc0419d520 con 0x7fcc04100080 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcbfb7fe640 1 -- 172.21.15.103:0/2285309294 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc00010690 con 0x7fcc04100080 2024-08-02T18:46:50.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.280+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc041a4e00 con 0x7fcc04100080 2024-08-02T18:46:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.281+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc04100460 con 0x7fcc04100080 2024-08-02T18:46:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.282+0000 7fcbfb7fe640 1 -- 172.21.15.103:0/2285309294 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fcc000046c0 con 0x7fcc04100080 2024-08-02T18:46:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.283+0000 7fcbfb7fe640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcbf00a2b80 0x7fcbf00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.283+0000 7fcc0992c640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcbf00a2b80 0x7fcbf00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.283+0000 7fcbfb7fe640 1 -- 172.21.15.103:0/2285309294 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fcc000cf060 con 0x7fcc04100080 2024-08-02T18:46:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.283+0000 7fcc0992c640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcbf00a2b80 0x7fcbf00a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40095f0 tx=0x7fcbf4005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:50.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.287+0000 7fcbfb7fe640 1 -- 172.21.15.103:0/2285309294 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcc0009c460 con 0x7fcc04100080 2024-08-02T18:46:50.393 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 systemd[1]: Starting Ceph mds.e for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:46:50.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.488+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fcc041995e0 con 0x7fcc04100080 2024-08-02T18:46:50.490 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:50 smithi103 ceph-mon[32753]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:50.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.488+0000 7fcbfb7fe640 1 -- 172.21.15.103:0/2285309294 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+3916 (secure 0 0 0) 0x7fcc0009bd60 con 0x7fcc04100080 2024-08-02T18:46:50.490 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:50.491 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":5,"btime":"2024-08-02T18:46:48:376659+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-08-02T18:46:50.491 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 5 2024-08-02T18:46:50.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcbf00a2b80 msgr2=0x7fcbf00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcbf00a2b80 0x7fcbf00a5040 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fcbf40095f0 tx=0x7fcbf4005f90 comp rx=0 tx=0).stop 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04100080 msgr2=0x7fcc04198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04100080 0x7fcc04198280 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fcc0000e9f0 tx=0x7fcc0000edf0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 shutdown_connections 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcbf00a2b80 0x7fcbf00a5040 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc04106c80 0x7fcc0419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc04100a30 0x7fcc041987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 --2- 172.21.15.103:0/2285309294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc04100080 0x7fcc04198280 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 >> 172.21.15.103:0/2285309294 conn(0x7fcc04076f40 msgr2=0x7fcc04105400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 shutdown_connections 2024-08-02T18:46:50.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:50.491+0000 7fcc0c391640 1 -- 172.21.15.103:0/2285309294 wait complete. 2024-08-02T18:46:50.656 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:50 smithi121 ceph-mon[37236]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:50.656 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 podman[66531]: 2024-08-02 18:46:50.416129041 +0000 UTC m=+0.017485574 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:46:50.656 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 podman[66531]: 2024-08-02 18:46:50.533161264 +0000 UTC m=+0.134517795 container create 1aa3f21ff7e7917211ae640494304c7db6d5bbd6a1fec2e6e31919b577e7a303 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T18:46:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:50 smithi151 ceph-mon[37155]: pgmap v238: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:51.001 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 podman[66531]: 2024-08-02 18:46:50.786615455 +0000 UTC m=+0.387971997 container init 1aa3f21ff7e7917211ae640494304c7db6d5bbd6a1fec2e6e31919b577e7a303 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T18:46:51.001 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 podman[66531]: 2024-08-02 18:46:50.789245 +0000 UTC m=+0.390601541 container start 1aa3f21ff7e7917211ae640494304c7db6d5bbd6a1fec2e6e31919b577e7a303 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8) 2024-08-02T18:46:51.001 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 ceph-mds[66550]: -- 172.21.15.121:0/46099436 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x558affcab860 con 0x558affc89000 2024-08-02T18:46:51.001 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e[66546]: starting mds.e at 2024-08-02T18:46:51.001 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 bash[66531]: 1aa3f21ff7e7917211ae640494304c7db6d5bbd6a1fec2e6e31919b577e7a303 2024-08-02T18:46:51.001 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 18:46:50 smithi121 systemd[1]: Started Ceph mds.e for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:46:51.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:51 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2285309294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:51.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:51.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:51.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:51 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:51.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:51 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2285309294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:51.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:51.634 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:51.635 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:51 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:51 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2285309294' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:51 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:51 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:51 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:51 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:51 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.f", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:51 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:52.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:52 smithi151 ceph-mon[37155]: Deploying daemon mds.f on smithi151 2024-08-02T18:46:52.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:52 smithi151 ceph-mon[37155]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:52.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:52 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.121:6834/1461531566,v1:172.21.15.121:6835/1461531566] up:boot 2024-08-02T18:46:52.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:52 smithi151 ceph-mon[37155]: fsmap 5 up:standby 2024-08-02T18:46:52.656 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:52 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T18:46:52.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:52 smithi103 ceph-mon[32753]: Deploying daemon mds.f on smithi151 2024-08-02T18:46:52.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:52 smithi103 ceph-mon[32753]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:52.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:52 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.121:6834/1461531566,v1:172.21.15.121:6835/1461531566] up:boot 2024-08-02T18:46:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:52 smithi103 ceph-mon[32753]: fsmap 5 up:standby 2024-08-02T18:46:52.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:52 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T18:46:52.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:52 smithi121 ceph-mon[37236]: Deploying daemon mds.f on smithi151 2024-08-02T18:46:52.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:52 smithi121 ceph-mon[37236]: pgmap v239: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:52.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:52 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.121:6834/1461531566,v1:172.21.15.121:6835/1461531566] up:boot 2024-08-02T18:46:52.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:52 smithi121 ceph-mon[37236]: fsmap 5 up:standby 2024-08-02T18:46:52.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:52 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T18:46:53.058 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 systemd[1]: Starting Ceph mds.f for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:46:53.226 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:46:53.320 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 podman[66795]: 2024-08-02 18:46:53.177067699 +0000 UTC m=+0.016820120 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:46:53.320 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 podman[66795]: 2024-08-02 18:46:53.299237274 +0000 UTC m=+0.138989684 container create 18f73e5f41af4d4cf54537467fc049f9cf1ebb0502e5533e9ea8bc84aa4f52d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0) 2024-08-02T18:46:53.487 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:53.820 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 podman[66795]: 2024-08-02 18:46:53.543426934 +0000 UTC m=+0.383179344 container init 18f73e5f41af4d4cf54537467fc049f9cf1ebb0502e5533e9ea8bc84aa4f52d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f, GIT_CLEAN=True, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-02T18:46:53.820 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 podman[66795]: 2024-08-02 18:46:53.546914271 +0000 UTC m=+0.386666684 container start 18f73e5f41af4d4cf54537467fc049f9cf1ebb0502e5533e9ea8bc84aa4f52d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, ceph=True, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True) 2024-08-02T18:46:53.821 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 ceph-mds[66815]: -- 172.21.15.151:0/596429287 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5633835cf860 con 0x5633835ad400 2024-08-02T18:46:53.821 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f[66811]: starting mds.f at 2024-08-02T18:46:53.821 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 bash[66795]: 18f73e5f41af4d4cf54537467fc049f9cf1ebb0502e5533e9ea8bc84aa4f52d2 2024-08-02T18:46:53.821 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 18:46:53 smithi151 systemd[1]: Started Ceph mds.f for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:46:54.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 -- 172.21.15.103:0/2281167113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c102260 msgr2=0x7f227c10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:54.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 --2- 172.21.15.103:0/2281167113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c102260 0x7f227c10e790 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f2274009cd0 tx=0x7f227402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 -- 172.21.15.103:0/2281167113 shutdown_connections 2024-08-02T18:46:54.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 --2- 172.21.15.103:0/2281167113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c102260 0x7f227c10e790 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 --2- 172.21.15.103:0/2281167113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f227c1018c0 0x7f227c101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 --2- 172.21.15.103:0/2281167113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227c1078c0 0x7f227c107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 -- 172.21.15.103:0/2281167113 >> 172.21.15.103:0/2281167113 conn(0x7f227c0fd5e0 msgr2=0x7f227c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 -- 172.21.15.103:0/2281167113 shutdown_connections 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.067+0000 7f2283e60640 1 -- 172.21.15.103:0/2281167113 wait complete. 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2283e60640 1 Processor -- start 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2283e60640 1 -- start start 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2283e60640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c1018c0 0x7f227c198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2283e60640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227c102260 0x7f227c198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2283e60640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f227c1078c0 0x7f227c19cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2283e60640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f227c111de0 con 0x7f227c1018c0 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2283e60640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f227c111c60 con 0x7f227c102260 2024-08-02T18:46:54.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2283e60640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f227c111f60 con 0x7f227c1078c0 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2281bfc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c1018c0 0x7f227c198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2281bfc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c1018c0 0x7f227c198240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39968/0 (socket says 172.21.15.103:39968) 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f2281bfc640 1 -- 172.21.15.103:0/1858532940 learned_addr learned my addr 172.21.15.103:0/1858532940 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f22813fb640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227c102260 0x7f227c198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.068+0000 7f22823fd640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f227c1078c0 0x7f227c19cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f2281bfc640 1 -- 172.21.15.103:0/1858532940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f227c1078c0 msgr2=0x7f227c19cb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f2281bfc640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f227c1078c0 0x7f227c19cb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f2281bfc640 1 -- 172.21.15.103:0/1858532940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227c102260 msgr2=0x7f227c198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f2281bfc640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227c102260 0x7f227c198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f2281bfc640 1 -- 172.21.15.103:0/1858532940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f227c19d1f0 con 0x7f227c1018c0 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f2281bfc640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c1018c0 0x7f227c198240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f227000e9f0 tx=0x7f227000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:54.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f226effd640 1 -- 172.21.15.103:0/1858532940 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f227000cd80 con 0x7f227c1018c0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f227c19d4e0 con 0x7f227c1018c0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f226effd640 1 -- 172.21.15.103:0/1858532940 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2270010930 con 0x7f227c1018c0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f226effd640 1 -- 172.21.15.103:0/1858532940 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2270018b00 con 0x7f227c1018c0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.069+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f227c1a4dc0 con 0x7f227c1018c0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.070+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f227c101d20 con 0x7f227c1018c0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.071+0000 7f226effd640 1 -- 172.21.15.103:0/1858532940 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f2270018ca0 con 0x7f227c1018c0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.072+0000 7f226effd640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f22680a2b80 0x7f22680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.072+0000 7f22813fb640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f22680a2b80 0x7f22680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.072+0000 7f226effd640 1 -- 172.21.15.103:0/1858532940 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f22700ceed0 con 0x7f227c1018c0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.072+0000 7f22813fb640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f22680a2b80 0x7f22680a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f227c0ffb50 tx=0x7f227800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:54.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.076+0000 7f226effd640 1 -- 172.21.15.103:0/1858532940 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f227009bc80 con 0x7f227c1018c0 2024-08-02T18:46:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.276+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f227c1a4fc0 con 0x7f227c1018c0 2024-08-02T18:46:54.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.276+0000 7f226effd640 1 -- 172.21.15.103:0/1858532940 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) ==== 93+0+4744 (secure 0 0 0) 0x7f227009ff80 con 0x7f227c1018c0 2024-08-02T18:46:54.278 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:54.278 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":6,"btime":"2024-08-02T18:46:51:391956+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6}],"filesystems":[]} 2024-08-02T18:46:54.278 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 6 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f22680a2b80 msgr2=0x7f22680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f22680a2b80 0x7f22680a5040 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f227c0ffb50 tx=0x7f227800b390 comp rx=0 tx=0).stop 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c1018c0 msgr2=0x7f227c198240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c1018c0 0x7f227c198240 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f227000e9f0 tx=0x7f227000eeb0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 shutdown_connections 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f22680a2b80 0x7f22680a5040 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f227c1078c0 0x7f227c19cb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f227c102260 0x7f227c198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 --2- 172.21.15.103:0/1858532940 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f227c1018c0 0x7f227c198240 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 >> 172.21.15.103:0/1858532940 conn(0x7f227c0fd5e0 msgr2=0x7f227c0fdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 shutdown_connections 2024-08-02T18:46:54.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:54.278+0000 7f2283e60640 1 -- 172.21.15.103:0/1858532940 wait complete. 2024-08-02T18:46:54.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:54 smithi103 ceph-mon[32753]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:54.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:54 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:54.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:54 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1858532940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:54 smithi121 ceph-mon[37236]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:54 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:54 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1858532940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:54 smithi151 ceph-mon[37155]: pgmap v240: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.c", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:54 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:54 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1858532940' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:55.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:55 smithi151 ceph-mon[37155]: Deploying daemon mds.c on smithi151 2024-08-02T18:46:55.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:55 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6834/126654937,v1:172.21.15.151:6835/126654937] up:boot 2024-08-02T18:46:55.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:55 smithi151 ceph-mon[37155]: fsmap 6 up:standby 2024-08-02T18:46:55.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:55 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T18:46:55.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:55 smithi121 ceph-mon[37236]: Deploying daemon mds.c on smithi151 2024-08-02T18:46:55.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:55 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6834/126654937,v1:172.21.15.151:6835/126654937] up:boot 2024-08-02T18:46:55.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:55 smithi121 ceph-mon[37236]: fsmap 6 up:standby 2024-08-02T18:46:55.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:55 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T18:46:55.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:55 smithi103 ceph-mon[32753]: Deploying daemon mds.c on smithi151 2024-08-02T18:46:55.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:55 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6834/126654937,v1:172.21.15.151:6835/126654937] up:boot 2024-08-02T18:46:55.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:55 smithi103 ceph-mon[32753]: fsmap 6 up:standby 2024-08-02T18:46:55.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:55 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T18:46:56.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:56 smithi151 ceph-mon[37155]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:56.571 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:46:56 smithi151 systemd[1]: Started Ceph mds.c for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:46:56.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:56 smithi121 ceph-mon[37236]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:56.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:56 smithi103 ceph-mon[32753]: pgmap v241: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:57.051 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:46:57.317 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:46:57.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:boot 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: fsmap 7 up:standby 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:57.751 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:57 smithi103 ceph-mon[32753]: Deploying daemon mds.h on smithi121 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:boot 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: fsmap 7 up:standby 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:57.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:57 smithi121 ceph-mon[37236]: Deploying daemon mds.h on smithi121 2024-08-02T18:46:57.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:boot 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: fsmap 7 up:standby 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.h", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:46:57.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:57 smithi151 ceph-mon[37155]: Deploying daemon mds.h on smithi121 2024-08-02T18:46:57.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.828+0000 7f55eb620640 1 -- 172.21.15.103:0/616662151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 msgr2=0x7f55e410b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:57.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.828+0000 7f55eb620640 1 --2- 172.21.15.103:0/616662151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 0x7f55e410b880 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f55d4009900 tx=0x7f55d402a480 comp rx=0 tx=0).stop 2024-08-02T18:46:57.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.828+0000 7f55eb620640 1 -- 172.21.15.103:0/616662151 shutdown_connections 2024-08-02T18:46:57.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.828+0000 7f55eb620640 1 --2- 172.21.15.103:0/616662151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e410bea0 0x7f55e410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:57.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.828+0000 7f55eb620640 1 --2- 172.21.15.103:0/616662151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 0x7f55e410b880 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:57.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.828+0000 7f55eb620640 1 --2- 172.21.15.103:0/616662151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e4102a70 0x7f55e4102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:57.859 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.828+0000 7f55eb620640 1 -- 172.21.15.103:0/616662151 >> 172.21.15.103:0/616662151 conn(0x7f55e40fc4d0 msgr2=0x7f55e40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 -- 172.21.15.103:0/616662151 shutdown_connections 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 -- 172.21.15.103:0/616662151 wait complete. 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 Processor -- start 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 -- start start 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102a70 0x7f55e4198250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 0x7f55e4198790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e410bea0 0x7f55e419cb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4111dc0 con 0x7f55e4103390 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4111c40 con 0x7f55e4102a70 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.829+0000 7f55eb620640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f55e4111f40 con 0x7f55e410bea0 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 0x7f55e4198790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:57.860 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 0x7f55e4198790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:39982/0 (socket says 172.21.15.103:39982) 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 -- 172.21.15.103:0/1055250556 learned_addr learned my addr 172.21.15.103:0/1055250556 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e93bc640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102a70 0x7f55e4198250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e9bbd640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e410bea0 0x7f55e419cb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 -- 172.21.15.103:0/1055250556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e410bea0 msgr2=0x7f55e419cb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e410bea0 0x7f55e419cb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 -- 172.21.15.103:0/1055250556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102a70 msgr2=0x7f55e4198250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102a70 0x7f55e4198250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 -- 172.21.15.103:0/1055250556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55e419d200 con 0x7f55e4103390 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55e8bbb640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 0x7f55e4198790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55d4006010 tx=0x7f55d40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55da7fc640 1 -- 172.21.15.103:0/1055250556 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d403f030 con 0x7f55e4103390 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55da7fc640 1 -- 172.21.15.103:0/1055250556 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55d4003d00 con 0x7f55e4103390 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55e419d490 con 0x7f55e4103390 2024-08-02T18:46:57.861 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55da7fc640 1 -- 172.21.15.103:0/1055250556 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55d4035070 con 0x7f55e4103390 2024-08-02T18:46:57.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.830+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55e41a4dd0 con 0x7f55e4103390 2024-08-02T18:46:57.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.831+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f55e4102e50 con 0x7f55e4103390 2024-08-02T18:46:57.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.832+0000 7f55da7fc640 1 -- 172.21.15.103:0/1055250556 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f55d4042030 con 0x7f55e4103390 2024-08-02T18:46:57.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.833+0000 7f55da7fc640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55d00a2b80 0x7f55d00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:46:57.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.833+0000 7f55e93bc640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55d00a2b80 0x7f55d00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:46:57.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.833+0000 7f55da7fc640 1 -- 172.21.15.103:0/1055250556 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f55d40eefa0 con 0x7f55e4103390 2024-08-02T18:46:57.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.833+0000 7f55e93bc640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55d00a2b80 0x7f55d00a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55e000bbe0 tx=0x7f55e000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:46:57.862 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:57.837+0000 7f55da7fc640 1 -- 172.21.15.103:0/1055250556 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f55d40bc3a0 con 0x7f55e4103390 2024-08-02T18:46:58.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.037+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f55e41995b0 con 0x7f55e4103390 2024-08-02T18:46:58.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.038+0000 7f55da7fc640 1 -- 172.21.15.103:0/1055250556 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 8 v8) ==== 93+0+6397 (secure 0 0 0) 0x7f55d40bbca0 con 0x7f55e4103390 2024-08-02T18:46:58.039 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:46:58.039 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":8,"btime":"2024-08-02T18:46:56:410693+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-02T18:46:58.040 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 8 2024-08-02T18:46:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55d00a2b80 msgr2=0x7f55d00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55d00a2b80 0x7f55d00a5040 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f55e000bbe0 tx=0x7f55e000b390 comp rx=0 tx=0).stop 2024-08-02T18:46:58.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 msgr2=0x7f55e4198790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 0x7f55e4198790 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f55d4006010 tx=0x7f55d40042f0 comp rx=0 tx=0).stop 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 shutdown_connections 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55d00a2b80 0x7f55d00a5040 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55e410bea0 0x7f55e419cb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55e4103390 0x7f55e4198790 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 --2- 172.21.15.103:0/1055250556 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55e4102a70 0x7f55e4198250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 >> 172.21.15.103:0/1055250556 conn(0x7f55e40fc4d0 msgr2=0x7f55e40fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 shutdown_connections 2024-08-02T18:46:58.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:46:58.040+0000 7f55eb620640 1 -- 172.21.15.103:0/1055250556 wait complete. 2024-08-02T18:46:58.710 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:58 smithi121 ceph-mon[37236]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:58.711 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:46:58 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1055250556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:58.711 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:58 smithi121 systemd[1]: Starting Ceph mds.h for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:46:58.791 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:58 smithi103 ceph-mon[32753]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:58.791 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:46:58 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1055250556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:58.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:58 smithi151 ceph-mon[37155]: pgmap v242: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:46:58.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:46:58 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1055250556' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:46:58.975 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:58 smithi121 podman[66834]: 2024-08-02 18:46:58.612105017 +0000 UTC m=+0.017760748 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:46:58.975 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:58 smithi121 podman[66834]: 2024-08-02 18:46:58.712871336 +0000 UTC m=+0.118527108 container create 948319a123191de59fbf14ea42e428274abec56977f5709fcccddce746194f85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.36.0) 2024-08-02T18:46:58.975 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:58 smithi121 podman[66834]: 2024-08-02 18:46:58.973845076 +0000 UTC m=+0.379500810 container init 948319a123191de59fbf14ea42e428274abec56977f5709fcccddce746194f85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-02T18:46:59.251 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:58 smithi121 podman[66834]: 2024-08-02 18:46:58.976567632 +0000 UTC m=+0.382223369 container start 948319a123191de59fbf14ea42e428274abec56977f5709fcccddce746194f85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T18:46:59.251 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:58 smithi121 ceph-mds[66854]: -- 172.21.15.121:0/747756721 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55a7ef79f860 con 0x55a7ef77d400 2024-08-02T18:46:59.251 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:59 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h[66850]: starting mds.h at 2024-08-02T18:46:59.251 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:59 smithi121 bash[66834]: 948319a123191de59fbf14ea42e428274abec56977f5709fcccddce746194f85 2024-08-02T18:46:59.251 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 18:46:59 smithi121 systemd[1]: Started Ceph mds.h for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:47:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: Deploying daemon mds.i on smithi151 2024-08-02T18:47:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.121:6836/1633433490,v1:172.21.15.121:6837/1633433490] up:boot 2024-08-02T18:47:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: fsmap 8 up:standby 2024-08-02T18:47:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:00 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T18:47:00.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: Deploying daemon mds.i on smithi151 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.121:6836/1633433490,v1:172.21.15.121:6837/1633433490] up:boot 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: fsmap 8 up:standby 2024-08-02T18:47:00.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:00 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T18:47:00.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.i", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: Deploying daemon mds.i on smithi151 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: pgmap v243: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.121:6836/1633433490,v1:172.21.15.121:6837/1633433490] up:boot 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: fsmap 8 up:standby 2024-08-02T18:47:00.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:00 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T18:47:00.820 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:47:01.087 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:01.571 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:47:01 smithi151 podman[67411]: 2024-08-02 18:47:01.490425008 +0000 UTC m=+0.134127724 container create edf35a6810a6f105dd6b029166d4480644b6ebb5e8a747fac0c41c1a720f59e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T18:47:01.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3753971851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 msgr2=0x7f3f601026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:01.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3753971851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 0x7f3f601026e0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f3f48009900 tx=0x7f3f4802a480 comp rx=0 tx=0).stop 2024-08-02T18:47:01.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3753971851 shutdown_connections 2024-08-02T18:47:01.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3753971851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f60102c20 0x7f3f6010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3753971851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 0x7f3f601026e0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3753971851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f60100b50 0x7f3f60100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3753971851 >> 172.21.15.103:0/3753971851 conn(0x7f3f600fc500 msgr2=0x7f3f600fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3753971851 shutdown_connections 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.631+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3753971851 wait complete. 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.632+0000 7f3f65ddf640 1 Processor -- start 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.632+0000 7f3f65ddf640 1 -- start start 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.632+0000 7f3f65ddf640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f60100b50 0x7f3f60199200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.632+0000 7f3f65ddf640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 0x7f3f60199740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.632+0000 7f3f65ddf640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f60102c20 0x7f3f601a4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.632+0000 7f3f65ddf640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60110dd0 con 0x7f3f601022a0 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.632+0000 7f3f65ddf640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60110c50 con 0x7f3f60100b50 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.632+0000 7f3f65ddf640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3f60110f50 con 0x7f3f60102c20 2024-08-02T18:47:01.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 0x7f3f60199740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 0x7f3f60199740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55358/0 (socket says 172.21.15.103:55358) 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 -- 172.21.15.103:0/3691791334 learned_addr learned my addr 172.21.15.103:0/3691791334 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f5ffff640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f60102c20 0x7f3f601a4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 -- 172.21.15.103:0/3691791334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f60102c20 msgr2=0x7f3f601a4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f60102c20 0x7f3f601a4280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 -- 172.21.15.103:0/3691791334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f60100b50 msgr2=0x7f3f60199200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f60100b50 0x7f3f60199200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 -- 172.21.15.103:0/3691791334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f601a47c0 con 0x7f3f601022a0 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f5ffff640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f60102c20 0x7f3f601a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f56ffd640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 0x7f3f60199740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3f48006010 tx=0x7f3f48004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f5d7fa640 1 -- 172.21.15.103:0/3691791334 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f4803f030 con 0x7f3f601022a0 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f5d7fa640 1 -- 172.21.15.103:0/3691791334 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3f48005500 con 0x7f3f601022a0 2024-08-02T18:47:01.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f601a4990 con 0x7f3f601022a0 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f5d7fa640 1 -- 172.21.15.103:0/3691791334 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3f48035070 con 0x7f3f601022a0 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.633+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f601a4de0 con 0x7f3f601022a0 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.634+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f60100f30 con 0x7f3f601022a0 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.635+0000 7f3f5d7fa640 1 -- 172.21.15.103:0/3691791334 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3f48042030 con 0x7f3f601022a0 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.636+0000 7f3f5d7fa640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f4c0a2b80 0x7f3f4c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.636+0000 7f3f5f7fe640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f4c0a2b80 0x7f3f4c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.636+0000 7f3f5d7fa640 1 -- 172.21.15.103:0/3691791334 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f3f480ef050 con 0x7f3f601022a0 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.636+0000 7f3f5f7fe640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f4c0a2b80 0x7f3f4c0a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000a8f0 tx=0x7f3f50005bf0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:01.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.640+0000 7f3f5d7fa640 1 -- 172.21.15.103:0/3691791334 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3f480bc450 con 0x7f3f601022a0 2024-08-02T18:47:01.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.841+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3f60108dc0 con 0x7f3f601022a0 2024-08-02T18:47:01.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.841+0000 7f3f5d7fa640 1 -- 172.21.15.103:0/3691791334 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 9 v9) ==== 93+0+7225 (secure 0 0 0) 0x7f3f480bbd50 con 0x7f3f601022a0 2024-08-02T18:47:01.843 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:01.843 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":9,"btime":"2024-08-02T18:46:59:480468+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8}],"filesystems":[]} 2024-08-02T18:47:01.843 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 9 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f4c0a2b80 msgr2=0x7f3f4c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f4c0a2b80 0x7f3f4c0a5040 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f3f5000a8f0 tx=0x7f3f50005bf0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 msgr2=0x7f3f60199740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 0x7f3f60199740 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f3f48006010 tx=0x7f3f48004c00 comp rx=0 tx=0).stop 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 shutdown_connections 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3f4c0a2b80 0x7f3f4c0a5040 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3f60102c20 0x7f3f601a4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3f601022a0 0x7f3f60199740 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 --2- 172.21.15.103:0/3691791334 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3f60100b50 0x7f3f60199200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:01.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 >> 172.21.15.103:0/3691791334 conn(0x7f3f600fc500 msgr2=0x7f3f60105c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:01.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 shutdown_connections 2024-08-02T18:47:01.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:01.843+0000 7f3f65ddf640 1 -- 172.21.15.103:0/3691791334 wait complete. 2024-08-02T18:47:02.070 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:47:01 smithi151 podman[67411]: 2024-08-02 18:47:01.727443254 +0000 UTC m=+0.371145983 container init edf35a6810a6f105dd6b029166d4480644b6ebb5e8a747fac0c41c1a720f59e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-02T18:47:02.071 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:47:01 smithi151 podman[67411]: 2024-08-02 18:47:01.73014 +0000 UTC m=+0.373842716 container start edf35a6810a6f105dd6b029166d4480644b6ebb5e8a747fac0c41c1a720f59e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i, org.label-schema.schema-version=1.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-02T18:47:02.071 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:47:01 smithi151 ceph-mds[67431]: -- 172.21.15.151:0/3402205766 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x562afe5b9c20 con 0x562afe597000 2024-08-02T18:47:02.071 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:47:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: starting mds.i at 2024-08-02T18:47:02.071 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:47:01 smithi151 bash[67411]: edf35a6810a6f105dd6b029166d4480644b6ebb5e8a747fac0c41c1a720f59e5 2024-08-02T18:47:02.071 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:47:01 smithi151 systemd[1]: Started Ceph mds.i for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:47:02.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:02 smithi103 ceph-mon[32753]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:02.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:02 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3691791334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:02.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:02.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:02.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:02 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:02 smithi121 ceph-mon[37236]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:02 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3691791334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:02 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:02 smithi151 ceph-mon[37155]: pgmap v244: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:02 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3691791334' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.g", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:02 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:03 smithi121 ceph-mon[37236]: Deploying daemon mds.g on smithi103 2024-08-02T18:47:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:03 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:boot 2024-08-02T18:47:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:03 smithi121 ceph-mon[37236]: fsmap 9 up:standby 2024-08-02T18:47:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:03 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T18:47:03.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:03 smithi151 ceph-mon[37155]: Deploying daemon mds.g on smithi103 2024-08-02T18:47:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:03 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:boot 2024-08-02T18:47:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:03 smithi151 ceph-mon[37155]: fsmap 9 up:standby 2024-08-02T18:47:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:03 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T18:47:03.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:03 smithi103 ceph-mon[32753]: Deploying daemon mds.g on smithi103 2024-08-02T18:47:03.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:03 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:boot 2024-08-02T18:47:03.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:03 smithi103 ceph-mon[32753]: fsmap 9 up:standby 2024-08-02T18:47:03.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:03 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T18:47:04.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:04 smithi103 ceph-mon[32753]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:04.576 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:04 smithi103 systemd[1]: Starting Ceph mds.g for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:47:04.620 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:47:04.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:04 smithi121 ceph-mon[37236]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:04.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:04 smithi151 ceph-mon[37155]: pgmap v245: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:04.950 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:04 smithi103 podman[73915]: 2024-08-02 18:47:04.519628248 +0000 UTC m=+0.016851683 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:47:04.951 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:04 smithi103 podman[73915]: 2024-08-02 18:47:04.63804061 +0000 UTC m=+0.135264028 container create 3a0c4ca74da89165ab3beed6f4787a9f89f41c0b1a3fb7d2a6fda88344f68047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True) 2024-08-02T18:47:04.951 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:04 smithi103 podman[73915]: 2024-08-02 18:47:04.950054967 +0000 UTC m=+0.447278392 container init 3a0c4ca74da89165ab3beed6f4787a9f89f41c0b1a3fb7d2a6fda88344f68047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-08-02T18:47:05.110 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:05.234 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:04 smithi103 podman[73915]: 2024-08-02 18:47:04.953145992 +0000 UTC m=+0.450369411 container start 3a0c4ca74da89165ab3beed6f4787a9f89f41c0b1a3fb7d2a6fda88344f68047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-release-26c3fb8) 2024-08-02T18:47:05.234 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:04 smithi103 ceph-mds[73973]: -- 172.21.15.103:0/3277454068 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55978caeb860 con 0x55978cac8800 2024-08-02T18:47:05.234 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:04 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g[73949]: starting mds.g at 2024-08-02T18:47:05.234 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:05 smithi103 bash[73915]: 3a0c4ca74da89165ab3beed6f4787a9f89f41c0b1a3fb7d2a6fda88344f68047 2024-08-02T18:47:05.234 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 18:47:05 smithi103 systemd[1]: Started Ceph mds.g for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:47:05.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 -- 172.21.15.103:0/4019811486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 msgr2=0x7f4ec410b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:05.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 --2- 172.21.15.103:0/4019811486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 0x7f4ec410b880 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8009900 tx=0x7f4eb802a480 comp rx=0 tx=0).stop 2024-08-02T18:47:05.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 -- 172.21.15.103:0/4019811486 shutdown_connections 2024-08-02T18:47:05.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 --2- 172.21.15.103:0/4019811486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec410bea0 0x7f4ec410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 --2- 172.21.15.103:0/4019811486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 0x7f4ec410b880 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 --2- 172.21.15.103:0/4019811486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ec4102a70 0x7f4ec4102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 -- 172.21.15.103:0/4019811486 >> 172.21.15.103:0/4019811486 conn(0x7f4ec40fc4d0 msgr2=0x7f4ec40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:05.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 -- 172.21.15.103:0/4019811486 shutdown_connections 2024-08-02T18:47:05.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.634+0000 7f4eca16e640 1 -- 172.21.15.103:0/4019811486 wait complete. 2024-08-02T18:47:05.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4eca16e640 1 Processor -- start 2024-08-02T18:47:05.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4eca16e640 1 -- start start 2024-08-02T18:47:05.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4eca16e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec4102a70 0x7f4ec41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:05.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4eca16e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 0x7f4ec4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4eca16e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ec410bea0 0x7f4ec419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4eca16e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4111e40 con 0x7f4ec4103390 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4eca16e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4111cc0 con 0x7f4ec4102a70 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4eca16e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ec4111fc0 con 0x7f4ec410bea0 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4ec2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 0x7f4ec4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4ec2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 0x7f4ec4198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55396/0 (socket says 172.21.15.103:55396) 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.635+0000 7f4ec2ffd640 1 -- 172.21.15.103:0/851636566 learned_addr learned my addr 172.21.15.103:0/851636566 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec37fe640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec4102a70 0x7f4ec41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec3fff640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ec410bea0 0x7f4ec419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec2ffd640 1 -- 172.21.15.103:0/851636566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ec410bea0 msgr2=0x7f4ec419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec2ffd640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ec410bea0 0x7f4ec419cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec2ffd640 1 -- 172.21.15.103:0/851636566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec4102a70 msgr2=0x7f4ec41982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:05.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec2ffd640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec4102a70 0x7f4ec41982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec2ffd640 1 -- 172.21.15.103:0/851636566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ec419d270 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec2ffd640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 0x7f4ec4198800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8006010 tx=0x7f4eb80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec0ff9640 1 -- 172.21.15.103:0/851636566 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb803f030 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ec419d500 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec0ff9640 1 -- 172.21.15.103:0/851636566 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4eb8003d00 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4ec0ff9640 1 -- 172.21.15.103:0/851636566 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb8035070 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.636+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ec41a4e40 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.637+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ec406ada0 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.639+0000 7f4ec0ff9640 1 -- 172.21.15.103:0/851636566 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4eb8042030 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.639+0000 7f4ec0ff9640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4eac0a2b80 0x7f4eac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.640+0000 7f4ec37fe640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4eac0a2b80 0x7f4eac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.640+0000 7f4ec0ff9640 1 -- 172.21.15.103:0/851636566 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f4eb80eefe0 con 0x7f4ec4103390 2024-08-02T18:47:05.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.640+0000 7f4ec37fe640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4eac0a2b80 0x7f4eac0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4005fd0 tx=0x7f4eb400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:05.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.644+0000 7f4ec0ff9640 1 -- 172.21.15.103:0/851636566 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4eb80bc380 con 0x7f4ec4103390 2024-08-02T18:47:05.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.852+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ec41a5010 con 0x7f4ec4103390 2024-08-02T18:47:05.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.852+0000 7f4ec0ff9640 1 -- 172.21.15.103:0/851636566 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 11 v11) ==== 94+0+8884 (secure 0 0 0) 0x7f4eb80bbc80 con 0x7f4ec4103390 2024-08-02T18:47:05.855 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:05.855 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":11,"btime":"2024-08-02T18:47:05:392948+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-02T18:47:05.855 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 11 2024-08-02T18:47:05.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4eac0a2b80 msgr2=0x7f4eac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:05.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4eac0a2b80 0x7f4eac0a5040 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4005fd0 tx=0x7f4eb400b390 comp rx=0 tx=0).stop 2024-08-02T18:47:05.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 msgr2=0x7f4ec4198800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 0x7f4ec4198800 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f4eb8006010 tx=0x7f4eb80042f0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 shutdown_connections 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4eac0a2b80 0x7f4eac0a5040 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ec410bea0 0x7f4ec419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ec4103390 0x7f4ec4198800 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 --2- 172.21.15.103:0/851636566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ec4102a70 0x7f4ec41982c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.854+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 >> 172.21.15.103:0/851636566 conn(0x7f4ec40fc4d0 msgr2=0x7f4ec40fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.855+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 shutdown_connections 2024-08-02T18:47:05.858 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:05.855+0000 7f4eca16e640 1 -- 172.21.15.103:0/851636566 wait complete. 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: Deploying daemon mds.a on smithi103 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.103:6838/4168002022,v1:172.21.15.103:6839/4168002022] up:boot 2024-08-02T18:47:06.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: fsmap 10 up:standby 2024-08-02T18:47:06.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-02T18:47:06.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:06 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/851636566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:06.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: Deploying daemon mds.a on smithi103 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.103:6838/4168002022,v1:172.21.15.103:6839/4168002022] up:boot 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: fsmap 10 up:standby 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-02T18:47:06.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:06 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/851636566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.a", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: Deploying daemon mds.a on smithi103 2024-08-02T18:47:06.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: pgmap v246: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:06.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.103:6838/4168002022,v1:172.21.15.103:6839/4168002022] up:boot 2024-08-02T18:47:06.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: fsmap 10 up:standby 2024-08-02T18:47:06.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-02T18:47:06.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:06 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/851636566' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:08.310 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 systemd[1]: Starting Ceph mds.a for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T18:47:08.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:08 smithi103 ceph-mon[32753]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:08.576 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 podman[74332]: 2024-08-02 18:47:08.2121398 +0000 UTC m=+0.017061696 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T18:47:08.576 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 podman[74332]: 2024-08-02 18:47:08.340917942 +0000 UTC m=+0.145839843 container create d11753086e073f7347569fb28df426f9287bfef6701e3062ad586a8b666792e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True) 2024-08-02T18:47:08.628 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:47:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:08 smithi121 ceph-mon[37236]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:08.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:08 smithi151 ceph-mon[37155]: pgmap v247: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:08.912 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:09.034 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 podman[74332]: 2024-08-02 18:47:08.602516208 +0000 UTC m=+0.407438103 container init d11753086e073f7347569fb28df426f9287bfef6701e3062ad586a8b666792e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS) 2024-08-02T18:47:09.034 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 podman[74332]: 2024-08-02 18:47:08.605474581 +0000 UTC m=+0.410396471 container start d11753086e073f7347569fb28df426f9287bfef6701e3062ad586a8b666792e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True) 2024-08-02T18:47:09.034 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 ceph-mds[74351]: -- 172.21.15.103:0/2140869286 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5593b3f81860 con 0x5593b3f5f400 2024-08-02T18:47:09.034 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a[74347]: starting mds.a at 2024-08-02T18:47:09.035 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 bash[74332]: d11753086e073f7347569fb28df426f9287bfef6701e3062ad586a8b666792e4 2024-08-02T18:47:09.035 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 18:47:08 smithi103 systemd[1]: Started Ceph mds.a for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:47:09.449 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 -- 172.21.15.103:0/1687533610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 msgr2=0x7fd63010e320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 --2- 172.21.15.103:0/1687533610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 0x7fd63010e320 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fd628009ca0 tx=0x7fd62802a950 comp rx=0 tx=0).stop 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 -- 172.21.15.103:0/1687533610 shutdown_connections 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 --2- 172.21.15.103:0/1687533610 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 0x7fd63010e320 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 --2- 172.21.15.103:0/1687533610 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd630103410 0x7fd63010b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 --2- 172.21.15.103:0/1687533610 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd630102af0 0x7fd630102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 -- 172.21.15.103:0/1687533610 >> 172.21.15.103:0/1687533610 conn(0x7fd6300fc4b0 msgr2=0x7fd6300fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 -- 172.21.15.103:0/1687533610 shutdown_connections 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.429+0000 7fd636253640 1 -- 172.21.15.103:0/1687533610 wait complete. 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd636253640 1 Processor -- start 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd636253640 1 -- start start 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd636253640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd630102af0 0x7fd630198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:09.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd636253640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd630103410 0x7fd630198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd636253640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 0x7fd63019cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd636253640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd630111da0 con 0x7fd63010be90 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd636253640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd630111c20 con 0x7fd630102af0 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd636253640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd630111f20 con 0x7fd630103410 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd62ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 0x7fd63019cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd62ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 0x7fd63019cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34598/0 (socket says 172.21.15.103:34598) 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd62ffff640 1 -- 172.21.15.103:0/3265298360 learned_addr learned my addr 172.21.15.103:0/3265298360 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd62f7fe640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd630102af0 0x7fd630198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.430+0000 7fd62effd640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd630103410 0x7fd630198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62ffff640 1 -- 172.21.15.103:0/3265298360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd630103410 msgr2=0x7fd630198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62ffff640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd630103410 0x7fd630198740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62ffff640 1 -- 172.21.15.103:0/3265298360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd630102af0 msgr2=0x7fd630198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62ffff640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd630102af0 0x7fd630198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62ffff640 1 -- 172.21.15.103:0/3265298360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd63019d1b0 con 0x7fd63010be90 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62f7fe640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd630102af0 0x7fd630198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62ffff640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 0x7fd63019cad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd628005cc0 tx=0x7fd62802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62cff9640 1 -- 172.21.15.103:0/3265298360 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd628034040 con 0x7fd63010be90 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd63019d440 con 0x7fd63010be90 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62cff9640 1 -- 172.21.15.103:0/3265298360 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd628030940 con 0x7fd63010be90 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd62cff9640 1 -- 172.21.15.103:0/3265298360 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6280456e0 con 0x7fd63010be90 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.431+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd6301a4d80 con 0x7fd63010be90 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.432+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd630102ed0 con 0x7fd63010be90 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.433+0000 7fd62cff9640 1 -- 172.21.15.103:0/3265298360 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd628037020 con 0x7fd63010be90 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.434+0000 7fd62cff9640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd6180a2b80 0x7fd6180a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:09.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.434+0000 7fd62f7fe640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd6180a2b80 0x7fd6180a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.434+0000 7fd62cff9640 1 -- 172.21.15.103:0/3265298360 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd6280efcd0 con 0x7fd63010be90 2024-08-02T18:47:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.434+0000 7fd62f7fe640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd6180a2b80 0x7fd6180a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd6200058c0 tx=0x7fd620005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:09.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.437+0000 7fd62cff9640 1 -- 172.21.15.103:0/3265298360 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd6280bd0d0 con 0x7fd63010be90 2024-08-02T18:47:09.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.639+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd630199560 con 0x7fd63010be90 2024-08-02T18:47:09.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.639+0000 7fd62cff9640 1 -- 172.21.15.103:0/3265298360 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+9713 (secure 0 0 0) 0x7fd630199560 con 0x7fd63010be90 2024-08-02T18:47:09.642 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:09.642 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":12,"btime":"2024-08-02T18:47:09:381824+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[]} 2024-08-02T18:47:09.642 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 12 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.641+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd6180a2b80 msgr2=0x7fd6180a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.641+0000 7fd636253640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd6180a2b80 0x7fd6180a5040 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7fd6200058c0 tx=0x7fd620005850 comp rx=0 tx=0).stop 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.641+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 msgr2=0x7fd63019cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.641+0000 7fd636253640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 0x7fd63019cad0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fd628005cc0 tx=0x7fd62802f790 comp rx=0 tx=0).stop 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.642+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 shutdown_connections 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.642+0000 7fd636253640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd63010be90 0x7fd63019cad0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.642+0000 7fd636253640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd6180a2b80 0x7fd6180a5040 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.642+0000 7fd636253640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd630103410 0x7fd630198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.642+0000 7fd636253640 1 --2- 172.21.15.103:0/3265298360 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd630102af0 0x7fd630198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:09.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.642+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 >> 172.21.15.103:0/3265298360 conn(0x7fd6300fc4b0 msgr2=0x7fd6300fdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:09.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.642+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 shutdown_connections 2024-08-02T18:47:09.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:09.642+0000 7fd636253640 1 -- 172.21.15.103:0/3265298360 wait complete. 2024-08-02T18:47:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: Deploying daemon mds.b on smithi121 2024-08-02T18:47:10.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:10.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.103:6840/1212214786,v1:172.21.15.103:6841/1212214786] up:boot 2024-08-02T18:47:10.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: fsmap 11 up:standby 2024-08-02T18:47:10.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-02T18:47:10.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:09 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3265298360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:10.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:10.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:10.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:10.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: Deploying daemon mds.b on smithi121 2024-08-02T18:47:10.012 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:10.013 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.103:6840/1212214786,v1:172.21.15.103:6841/1212214786] up:boot 2024-08-02T18:47:10.013 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: fsmap 11 up:standby 2024-08-02T18:47:10.013 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-02T18:47:10.013 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:09 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3265298360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "auth get-or-create", "entity": "mds.b", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: Deploying daemon mds.b on smithi121 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: pgmap v248: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:10.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.103:6840/1212214786,v1:172.21.15.103:6841/1212214786] up:boot 2024-08-02T18:47:10.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: fsmap 11 up:standby 2024-08-02T18:47:10.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-02T18:47:10.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:09 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3265298360' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:11.751 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 18:47:11 smithi121 systemd[1]: Started Ceph mds.b for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T18:47:12.439 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:47:12.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:12 smithi151 ceph-mon[37155]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:12.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.649 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.650 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:12 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:47:12.683 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:12 smithi121 ceph-mon[37236]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:12.683 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.683 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.683 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.683 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.684 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.684 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:12 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:47:12.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:12 smithi103 ceph-mon[32753]: pgmap v249: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:12.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:12.699 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:12 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:47:13.042 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:13.478 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:13 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] up:boot 2024-08-02T18:47:13.478 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:13 smithi103 ceph-mon[32753]: fsmap 12 up:standby 2024-08-02T18:47:13.478 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T18:47:13.478 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:13.478 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:13 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:13.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 -- 172.21.15.103:0/1185527497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100600 msgr2=0x7fd0c01009e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:13.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 --2- 172.21.15.103:0/1185527497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100600 0x7fd0c01009e0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009900 tx=0x7fd0b002a410 comp rx=0 tx=0).stop 2024-08-02T18:47:13.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 -- 172.21.15.103:0/1185527497 shutdown_connections 2024-08-02T18:47:13.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 --2- 172.21.15.103:0/1185527497 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0c010e1b0 0x7fd0c01105a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 --2- 172.21.15.103:0/1185527497 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c0100fb0 0x7fd0c010dc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 --2- 172.21.15.103:0/1185527497 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100600 0x7fd0c01009e0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 -- 172.21.15.103:0/1185527497 >> 172.21.15.103:0/1185527497 conn(0x7fd0c00fc4d0 msgr2=0x7fd0c00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 -- 172.21.15.103:0/1185527497 shutdown_connections 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 -- 172.21.15.103:0/1185527497 wait complete. 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.555+0000 7fd0c5839640 1 Processor -- start 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0c5839640 1 -- start start 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0c5839640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0c0100600 0x7fd0c019a4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0c5839640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100fb0 0x7fd0c019aa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0c5839640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c010e1b0 0x7fd0c019eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0c5839640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0113ff0 con 0x7fd0c0100fb0 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0c5839640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0113e70 con 0x7fd0c0100600 2024-08-02T18:47:13.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0c5839640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd0c0114170 con 0x7fd0c010e1b0 2024-08-02T18:47:13.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0be7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100fb0 0x7fd0c019aa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:13.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0be7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100fb0 0x7fd0c019aa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34624/0 (socket says 172.21.15.103:34624) 2024-08-02T18:47:13.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0be7fc640 1 -- 172.21.15.103:0/160933123 learned_addr learned my addr 172.21.15.103:0/160933123 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:13.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0beffd640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0c0100600 0x7fd0c019a4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:13.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0bf7fe640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c010e1b0 0x7fd0c019eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:13.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0be7fc640 1 -- 172.21.15.103:0/160933123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c010e1b0 msgr2=0x7fd0c019eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:13.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0be7fc640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c010e1b0 0x7fd0c019eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0be7fc640 1 -- 172.21.15.103:0/160933123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0c0100600 msgr2=0x7fd0c019a4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0be7fc640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0c0100600 0x7fd0c019a4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0be7fc640 1 -- 172.21.15.103:0/160933123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0c019f480 con 0x7fd0c0100fb0 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.556+0000 7fd0beffd640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0c0100600 0x7fd0c019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.557+0000 7fd0be7fc640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100fb0 0x7fd0c019aa10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800d950 tx=0x7fd0a800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.557+0000 7fd0c4837640 1 -- 172.21.15.103:0/160933123 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8017030 con 0x7fd0c0100fb0 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.557+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0c019f770 con 0x7fd0c0100fb0 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.557+0000 7fd0c4837640 1 -- 172.21.15.103:0/160933123 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd0a8004020 con 0x7fd0c0100fb0 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.557+0000 7fd0c4837640 1 -- 172.21.15.103:0/160933123 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd0a8004a00 con 0x7fd0c0100fb0 2024-08-02T18:47:13.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.557+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0c01a7050 con 0x7fd0c0100fb0 2024-08-02T18:47:13.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.558+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0c01009e0 con 0x7fd0c0100fb0 2024-08-02T18:47:13.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.559+0000 7fd0c4837640 1 -- 172.21.15.103:0/160933123 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd0a80041d0 con 0x7fd0c0100fb0 2024-08-02T18:47:13.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.559+0000 7fd0c4837640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0ac0a2b80 0x7fd0ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:13.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.560+0000 7fd0beffd640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0ac0a2b80 0x7fd0ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:13.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.560+0000 7fd0c4837640 1 -- 172.21.15.103:0/160933123 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd0a80ce510 con 0x7fd0c0100fb0 2024-08-02T18:47:13.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.560+0000 7fd0beffd640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0ac0a2b80 0x7fd0ac0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009230 tx=0x7fd0b00058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:13.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.564+0000 7fd0c4837640 1 -- 172.21.15.103:0/160933123 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd0a809b910 con 0x7fd0c0100fb0 2024-08-02T18:47:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:13 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] up:boot 2024-08-02T18:47:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:13 smithi121 ceph-mon[37236]: fsmap 12 up:standby 2024-08-02T18:47:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T18:47:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:13 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:13.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.800+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd0c002d5e0 con 0x7fd0c0100fb0 2024-08-02T18:47:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.800+0000 7fd0c4837640 1 -- 172.21.15.103:0/160933123 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) ==== 94+0+10542 (secure 0 0 0) 0x7fd0a809b210 con 0x7fd0c0100fb0 2024-08-02T18:47:13.803 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:13.803 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":13,"btime":"2024-08-02T18:47:12:381464+0000","default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10},{"gid":24473,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":13}],"filesystems":[]} 2024-08-02T18:47:13.803 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 13 2024-08-02T18:47:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.802+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0ac0a2b80 msgr2=0x7fd0ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.802+0000 7fd0c5839640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0ac0a2b80 0x7fd0ac0a5040 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fd0b0009230 tx=0x7fd0b00058d0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.802+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100fb0 msgr2=0x7fd0c019aa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.802+0000 7fd0c5839640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100fb0 0x7fd0c019aa10 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fd0a800d950 tx=0x7fd0a800de10 comp rx=0 tx=0).stop 2024-08-02T18:47:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.803+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 shutdown_connections 2024-08-02T18:47:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.803+0000 7fd0c5839640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0ac0a2b80 0x7fd0ac0a5040 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.803+0000 7fd0c5839640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0c010e1b0 0x7fd0c019eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.803+0000 7fd0c5839640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0c0100fb0 0x7fd0c019aa10 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.803+0000 7fd0c5839640 1 --2- 172.21.15.103:0/160933123 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0c0100600 0x7fd0c019a4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:13.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.803+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 >> 172.21.15.103:0/160933123 conn(0x7fd0c00fc4d0 msgr2=0x7fd0c00fe8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:13.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.803+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 shutdown_connections 2024-08-02T18:47:13.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:13.803+0000 7fd0c5839640 1 -- 172.21.15.103:0/160933123 wait complete. 2024-08-02T18:47:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:13 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] up:boot 2024-08-02T18:47:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:13 smithi151 ceph-mon[37155]: fsmap 12 up:standby 2024-08-02T18:47:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T18:47:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:13 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:14.684 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:14 smithi103 ceph-mon[32753]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:14.685 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:14 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:14.685 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:14 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:14.685 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:14 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/160933123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:14.715 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph --format=json-pretty osd lspools 2024-08-02T18:47:14.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:14 smithi151 ceph-mon[37155]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:14.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:14 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:14.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:14 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:14.722 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:14 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/160933123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:14 smithi121 ceph-mon[37236]: pgmap v250: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:14 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:14 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:14 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/160933123' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:15.008 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:15.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 -- 172.21.15.103:0/2266367993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 msgr2=0x7f6fb0102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 --2- 172.21.15.103:0/2266367993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 0x7f6fb0102ec0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009930 tx=0x7f6fa002a440 comp rx=0 tx=0).stop 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 -- 172.21.15.103:0/2266367993 shutdown_connections 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 --2- 172.21.15.103:0/2266367993 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0108010 0x7f6fb010e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 --2- 172.21.15.103:0/2266367993 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fb0103490 0x7f6fb01078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 --2- 172.21.15.103:0/2266367993 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 0x7f6fb0102ec0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 -- 172.21.15.103:0/2266367993 >> 172.21.15.103:0/2266367993 conn(0x7f6fb00fc500 msgr2=0x7f6fb00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 -- 172.21.15.103:0/2266367993 shutdown_connections 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.480+0000 7f6fb5022640 1 -- 172.21.15.103:0/2266367993 wait complete. 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.481+0000 7f6fb5022640 1 Processor -- start 2024-08-02T18:47:15.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.481+0000 7f6fb5022640 1 -- start start 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.481+0000 7f6fb5022640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 0x7f6fb0198420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6fb5022640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fb0103490 0x7f6fb0198960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6fb5022640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0108010 0x7f6fb019ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6fb5022640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0111f80 con 0x7f6fb0102ae0 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6fb5022640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0111e00 con 0x7f6fb0103490 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6fb5022640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6fb0112100 con 0x7f6fb0108010 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 0x7f6fb0198420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 0x7f6fb0198420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34648/0 (socket says 172.21.15.103:34648) 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 -- 172.21.15.103:0/4262328347 learned_addr learned my addr 172.21.15.103:0/4262328347 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:15.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faf59e640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0108010 0x7f6fb019ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6fa7fff640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fb0103490 0x7f6fb0198960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 -- 172.21.15.103:0/4262328347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0108010 msgr2=0x7f6fb019ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0108010 0x7f6fb019ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 -- 172.21.15.103:0/4262328347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fb0103490 msgr2=0x7f6fb0198960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fb0103490 0x7f6fb0198960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 -- 172.21.15.103:0/4262328347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6fb019d3d0 con 0x7f6fb0102ae0 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faf59e640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0108010 0x7f6fb019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6faed9d640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 0x7f6fb0198420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009230 tx=0x7f6fa0004b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6facd99640 1 -- 172.21.15.103:0/4262328347 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa003f030 con 0x7f6fb0102ae0 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6fb019d660 con 0x7f6fb0102ae0 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.482+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6fb01a4fa0 con 0x7f6fb0102ae0 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.483+0000 7f6facd99640 1 -- 172.21.15.103:0/4262328347 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6fa0005000 con 0x7f6fb0102ae0 2024-08-02T18:47:15.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.483+0000 7f6facd99640 1 -- 172.21.15.103:0/4262328347 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6fa0035070 con 0x7f6fb0102ae0 2024-08-02T18:47:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.484+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f90005290 con 0x7f6fb0102ae0 2024-08-02T18:47:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.485+0000 7f6facd99640 1 -- 172.21.15.103:0/4262328347 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6fa0042030 con 0x7f6fb0102ae0 2024-08-02T18:47:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.485+0000 7f6facd99640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f9c0a2c00 0x7f6f9c0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.485+0000 7f6fa7fff640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f9c0a2c00 0x7f6f9c0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.485+0000 7f6facd99640 1 -- 172.21.15.103:0/4262328347 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7f6fa00eeee0 con 0x7f6fb0102ae0 2024-08-02T18:47:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.486+0000 7f6fa7fff640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f9c0a2c00 0x7f6f9c0a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00feb00 tx=0x7f6f98008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:15.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.489+0000 7f6facd99640 1 -- 172.21.15.103:0/4262328347 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6fa00bc2e0 con 0x7f6fb0102ae0 2024-08-02T18:47:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.669+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7f6f90005850 con 0x7f6fb0102ae0 2024-08-02T18:47:15.671 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.670+0000 7f6facd99640 1 -- 172.21.15.103:0/4262328347 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v76) ==== 84+0+65 (secure 0 0 0) 0x7f6fa0004770 con 0x7f6fb0102ae0 2024-08-02T18:47:15.671 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-08-02T18:47:15.672 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:47:15.672 INFO:teuthology.orchestra.run.smithi103.stdout: "poolnum": 1, 2024-08-02T18:47:15.672 INFO:teuthology.orchestra.run.smithi103.stdout: "poolname": ".mgr" 2024-08-02T18:47:15.672 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:47:15.672 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-08-02T18:47:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f9c0a2c00 msgr2=0x7f6f9c0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f9c0a2c00 0x7f6f9c0a50c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f6fb00feb00 tx=0x7f6f98008040 comp rx=0 tx=0).stop 2024-08-02T18:47:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 msgr2=0x7f6fb0198420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 0x7f6fb0198420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f6fa0009230 tx=0x7f6fa0004b80 comp rx=0 tx=0).stop 2024-08-02T18:47:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 shutdown_connections 2024-08-02T18:47:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f9c0a2c00 0x7f6f9c0a50c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6fb0108010 0x7f6fb019ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6fb0103490 0x7f6fb0198960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 --2- 172.21.15.103:0/4262328347 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6fb0102ae0 0x7f6fb0198420 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 >> 172.21.15.103:0/4262328347 conn(0x7f6fb00fc500 msgr2=0x7f6fb0105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 shutdown_connections 2024-08-02T18:47:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:15.672+0000 7f6fb5022640 1 -- 172.21.15.103:0/4262328347 wait complete. 2024-08-02T18:47:16.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:16.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:16.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:47:16.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:47:16.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:15 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4262328347' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-02T18:47:16.186 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.186 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.186 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:16.186 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.186 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:16.187 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:47:16.187 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.187 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:47:16.187 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:15 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4262328347' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-02T18:47:16.198 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.199 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.199 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: pgmap v251: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:16.199 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.199 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:16.199 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:47:16.199 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:16.199 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:47:16.199 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:15 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4262328347' entity='client.admin' cmd=[{"prefix": "osd lspools", "format": "json-pretty"}]: dispatch 2024-08-02T18:47:16.464 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-08-02T18:47:16.465 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd pool create cephfs_metadata --pg_num_min 64 2024-08-02T18:47:17.291 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:17.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 -- 172.21.15.103:0/1982963157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 msgr2=0x7fd48010b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:17.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 --2- 172.21.15.103:0/1982963157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 0x7fd48010b880 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fd474009900 tx=0x7fd47402a480 comp rx=0 tx=0).stop 2024-08-02T18:47:17.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 -- 172.21.15.103:0/1982963157 shutdown_connections 2024-08-02T18:47:17.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 --2- 172.21.15.103:0/1982963157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd48010bea0 0x7fd48010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:17.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 --2- 172.21.15.103:0/1982963157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 0x7fd48010b880 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:17.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 --2- 172.21.15.103:0/1982963157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd480102a70 0x7fd480102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 -- 172.21.15.103:0/1982963157 >> 172.21.15.103:0/1982963157 conn(0x7fd4800fc4d0 msgr2=0x7fd4800fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 -- 172.21.15.103:0/1982963157 shutdown_connections 2024-08-02T18:47:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.785+0000 7fd4862ed640 1 -- 172.21.15.103:0/1982963157 wait complete. 2024-08-02T18:47:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd4862ed640 1 Processor -- start 2024-08-02T18:47:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd4862ed640 1 -- start start 2024-08-02T18:47:17.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd4862ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd480102a70 0x7fd4801983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd4862ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 0x7fd4801988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd4862ed640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd48010bea0 0x7fd48019cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd4862ed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd480111ea0 con 0x7fd480103390 2024-08-02T18:47:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd4862ed640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd480111d20 con 0x7fd480102a70 2024-08-02T18:47:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd4862ed640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd480112020 con 0x7fd48010bea0 2024-08-02T18:47:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd47f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 0x7fd4801988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:17.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd47f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 0x7fd4801988e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34662/0 (socket says 172.21.15.103:34662) 2024-08-02T18:47:17.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.786+0000 7fd47f7fe640 1 -- 172.21.15.103:0/3890779587 learned_addr learned my addr 172.21.15.103:0/3890779587 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:17.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd48488a640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd48010bea0 0x7fd48019cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:17.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47ffff640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd480102a70 0x7fd4801983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:17.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47f7fe640 1 -- 172.21.15.103:0/3890779587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd48010bea0 msgr2=0x7fd48019cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:17.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47f7fe640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd48010bea0 0x7fd48019cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:17.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47f7fe640 1 -- 172.21.15.103:0/3890779587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd480102a70 msgr2=0x7fd4801983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47f7fe640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd480102a70 0x7fd4801983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47f7fe640 1 -- 172.21.15.103:0/3890779587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd48019d350 con 0x7fd480103390 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd48488a640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd48010bea0 0x7fd48019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47f7fe640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 0x7fd4801988e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd474006010 tx=0x7fd4740042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47d7fa640 1 -- 172.21.15.103:0/3890779587 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd47403f030 con 0x7fd480103390 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd48019d5e0 con 0x7fd480103390 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47d7fa640 1 -- 172.21.15.103:0/3890779587 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd474003d00 con 0x7fd480103390 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd47d7fa640 1 -- 172.21.15.103:0/3890779587 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd474035070 con 0x7fd480103390 2024-08-02T18:47:17.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.787+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd4801a4f20 con 0x7fd480103390 2024-08-02T18:47:17.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.788+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd480102ed0 con 0x7fd480103390 2024-08-02T18:47:17.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.789+0000 7fd47d7fa640 1 -- 172.21.15.103:0/3890779587 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd474042030 con 0x7fd480103390 2024-08-02T18:47:17.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.790+0000 7fd47d7fa640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd4680a2b80 0x7fd4680a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:17.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.790+0000 7fd47ffff640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd4680a2b80 0x7fd4680a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:17.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.790+0000 7fd47d7fa640 1 -- 172.21.15.103:0/3890779587 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(76..76 src has 1..76) ==== 7127+0+0 (secure 0 0 0) 0x7fd4740ef210 con 0x7fd480103390 2024-08-02T18:47:17.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.790+0000 7fd47ffff640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd4680a2b80 0x7fd4680a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd470009890 tx=0x7fd470008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:17.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:17.794+0000 7fd47d7fa640 1 -- 172.21.15.103:0/3890779587 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd4740bc610 con 0x7fd480103390 2024-08-02T18:47:18.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.000+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7fd480106f10 con 0x7fd480103390 2024-08-02T18:47:18.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.295+0000 7fd47d7fa640 1 -- 172.21.15.103:0/3890779587 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v77) ==== 138+0+0 (secure 0 0 0) 0x7fd4740bbf10 con 0x7fd480103390 2024-08-02T18:47:18.297 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' created 2024-08-02T18:47:18.297 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.297 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.297 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.297 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.297 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:18 smithi103 ceph-mon[32753]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd4680a2b80 msgr2=0x7fd4680a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd4680a2b80 0x7fd4680a5040 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fd470009890 tx=0x7fd470008040 comp rx=0 tx=0).stop 2024-08-02T18:47:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 msgr2=0x7fd4801988e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 0x7fd4801988e0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fd474006010 tx=0x7fd4740042f0 comp rx=0 tx=0).stop 2024-08-02T18:47:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 shutdown_connections 2024-08-02T18:47:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd4680a2b80 0x7fd4680a5040 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd48010bea0 0x7fd48019cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:18.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd480103390 0x7fd4801988e0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:18.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 --2- 172.21.15.103:0/3890779587 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd480102a70 0x7fd4801983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:18.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.297+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 >> 172.21.15.103:0/3890779587 conn(0x7fd4800fc4d0 msgr2=0x7fd4800fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:18.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.298+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 shutdown_connections 2024-08-02T18:47:18.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:18.298+0000 7fd4862ed640 1 -- 172.21.15.103:0/3890779587 wait complete. 2024-08-02T18:47:18.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:18 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:18 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:18 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:18 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:18 smithi121 ceph-mon[37236]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:18.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:18 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:18 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:18 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:18 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:18.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:18 smithi151 ceph-mon[37155]: pgmap v252: 1 pgs: 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:19.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-08-02T18:47:19.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:19 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3890779587' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-02T18:47:19.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:19.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:47:19.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:19 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:19 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3890779587' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-02T18:47:19.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:19 smithi103 ceph-mon[32753]: osdmap e77: 12 total, 12 up, 12 in 2024-08-02T18:47:19.366 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:19 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3890779587' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-02T18:47:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:47:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:19 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:19 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3890779587' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-02T18:47:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:19 smithi121 ceph-mon[37236]: osdmap e77: 12 total, 12 up, 12 in 2024-08-02T18:47:19.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:19 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3890779587' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]: dispatch 2024-08-02T18:47:19.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:47:19.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:47:19.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:19 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:47:19.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:19 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3890779587' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]': finished 2024-08-02T18:47:19.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:19 smithi151 ceph-mon[37155]: osdmap e77: 12 total, 12 up, 12 in 2024-08-02T18:47:19.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 -- 172.21.15.103:0/142781206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 msgr2=0x7f552c10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:19.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 --2- 172.21.15.103:0/142781206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 0x7f552c10d770 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f5524009ca0 tx=0x7f552402a950 comp rx=0 tx=0).stop 2024-08-02T18:47:19.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 -- 172.21.15.103:0/142781206 shutdown_connections 2024-08-02T18:47:19.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 --2- 172.21.15.103:0/142781206 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 0x7f552c10d770 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:19.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 --2- 172.21.15.103:0/142781206 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f552c1022a0 0x7f552c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:19.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 --2- 172.21.15.103:0/142781206 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f552c100b50 0x7f552c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:19.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 -- 172.21.15.103:0/142781206 >> 172.21.15.103:0/142781206 conn(0x7f552c0fc500 msgr2=0x7f552c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:19.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 -- 172.21.15.103:0/142781206 shutdown_connections 2024-08-02T18:47:19.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.836+0000 7f5530d33640 1 -- 172.21.15.103:0/142781206 wait complete. 2024-08-02T18:47:19.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5530d33640 1 Processor -- start 2024-08-02T18:47:19.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5530d33640 1 -- start start 2024-08-02T18:47:19.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5530d33640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f552c100b50 0x7f552c199130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:19.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5530d33640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f552c1022a0 0x7f552c199670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:19.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5530d33640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 0x7f552c1a41b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:19.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5530d33640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f552c110e60 con 0x7f552c102c20 2024-08-02T18:47:19.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5530d33640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f552c110ce0 con 0x7f552c100b50 2024-08-02T18:47:19.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5530d33640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f552c110fe0 con 0x7f552c1022a0 2024-08-02T18:47:19.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 0x7f552c1a41b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:19.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 0x7f552c1a41b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56874/0 (socket says 172.21.15.103:56874) 2024-08-02T18:47:19.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552ad9d640 1 -- 172.21.15.103:0/3450946505 learned_addr learned my addr 172.21.15.103:0/3450946505 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:19.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552a59c640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f552c100b50 0x7f552c199130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:19.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f5529d9b640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f552c1022a0 0x7f552c199670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:19.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552ad9d640 1 -- 172.21.15.103:0/3450946505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f552c1022a0 msgr2=0x7f552c199670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:19.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552ad9d640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f552c1022a0 0x7f552c199670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:19.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552ad9d640 1 -- 172.21.15.103:0/3450946505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f552c100b50 msgr2=0x7f552c199130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:19.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552ad9d640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f552c100b50 0x7f552c199130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:19.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552ad9d640 1 -- 172.21.15.103:0/3450946505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f552c1a46f0 con 0x7f552c102c20 2024-08-02T18:47:19.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.837+0000 7f552a59c640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f552c100b50 0x7f552c199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:19.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.838+0000 7f552ad9d640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 0x7f552c1a41b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55240098d0 tx=0x7f552402ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:19.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.838+0000 7f551b7fe640 1 -- 172.21.15.103:0/3450946505 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5524034040 con 0x7f552c102c20 2024-08-02T18:47:19.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.838+0000 7f551b7fe640 1 -- 172.21.15.103:0/3450946505 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5524030940 con 0x7f552c102c20 2024-08-02T18:47:19.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.838+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f552c1a48c0 con 0x7f552c102c20 2024-08-02T18:47:19.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.838+0000 7f551b7fe640 1 -- 172.21.15.103:0/3450946505 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55240456e0 con 0x7f552c102c20 2024-08-02T18:47:19.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.838+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f552c1a4d10 con 0x7f552c102c20 2024-08-02T18:47:19.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.839+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f552c100f30 con 0x7f552c102c20 2024-08-02T18:47:19.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.841+0000 7f551b7fe640 1 -- 172.21.15.103:0/3450946505 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5524037020 con 0x7f552c102c20 2024-08-02T18:47:19.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.841+0000 7f551b7fe640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55140a2b80 0x7f55140a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:19.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.842+0000 7f552a59c640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55140a2b80 0x7f55140a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:19.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.842+0000 7f551b7fe640 1 -- 172.21.15.103:0/3450946505 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(78..78 src has 1..78) ==== 7497+0+0 (secure 0 0 0) 0x7f55240eff50 con 0x7f552c102c20 2024-08-02T18:47:19.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.842+0000 7f552a59c640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55140a2b80 0x7f55140a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f551c00abe0 tx=0x7f551c00a5c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:19.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:19.846+0000 7f551b7fe640 1 -- 172.21.15.103:0/3450946505 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f55240bd140 con 0x7f552c102c20 2024-08-02T18:47:20.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.011+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7f552c1a4f70 con 0x7f552c102c20 2024-08-02T18:47:20.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.303+0000 7f551b7fe640 1 -- 172.21.15.103:0/3450946505 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v79) ==== 171+0+0 (secure 0 0 0) 0x7f55240bca40 con 0x7f552c102c20 2024-08-02T18:47:20.306 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' created 2024-08-02T18:47:20.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55140a2b80 msgr2=0x7f55140a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:20.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55140a2b80 0x7f55140a5040 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f551c00abe0 tx=0x7f551c00a5c0 comp rx=0 tx=0).stop 2024-08-02T18:47:20.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 msgr2=0x7f552c1a41b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:20.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 0x7f552c1a41b0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f55240098d0 tx=0x7f552402ff90 comp rx=0 tx=0).stop 2024-08-02T18:47:20.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 shutdown_connections 2024-08-02T18:47:20.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f552c102c20 0x7f552c1a41b0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:20.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55140a2b80 0x7f55140a5040 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:20.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f552c1022a0 0x7f552c199670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:20.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 --2- 172.21.15.103:0/3450946505 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f552c100b50 0x7f552c199130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:20.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 >> 172.21.15.103:0/3450946505 conn(0x7f552c0fc500 msgr2=0x7f552c1054b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:20.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 shutdown_connections 2024-08-02T18:47:20.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:20.306+0000 7f5530d33640 1 -- 172.21.15.103:0/3450946505 wait complete. 2024-08-02T18:47:20.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:20 smithi151 ceph-mon[37155]: osdmap e78: 12 total, 12 up, 12 in 2024-08-02T18:47:20.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:20 smithi151 ceph-mon[37155]: pgmap v255: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:20.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:20 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3450946505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-02T18:47:20.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:20 smithi103 ceph-mon[32753]: osdmap e78: 12 total, 12 up, 12 in 2024-08-02T18:47:20.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:20 smithi103 ceph-mon[32753]: pgmap v255: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:20.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:20 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3450946505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-02T18:47:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:20 smithi121 ceph-mon[37236]: osdmap e78: 12 total, 12 up, 12 in 2024-08-02T18:47:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:20 smithi121 ceph-mon[37236]: pgmap v255: 33 pgs: 4 creating+peering, 28 unknown, 1 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:20 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3450946505' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]: dispatch 2024-08-02T18:47:21.116 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs new cephfs cephfs_metadata cephfs_data 2024-08-02T18:47:21.380 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:21.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:21 smithi103 ceph-mon[32753]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-02T18:47:21.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:21 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3450946505' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-02T18:47:21.502 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:21 smithi103 ceph-mon[32753]: osdmap e79: 12 total, 12 up, 12 in 2024-08-02T18:47:21.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:21 smithi151 ceph-mon[37155]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-02T18:47:21.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:21 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3450946505' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-02T18:47:21.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:21 smithi151 ceph-mon[37155]: osdmap e79: 12 total, 12 up, 12 in 2024-08-02T18:47:21.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:21 smithi121 ceph-mon[37236]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-02T18:47:21.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:21 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3450946505' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]': finished 2024-08-02T18:47:21.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:21 smithi121 ceph-mon[37236]: osdmap e79: 12 total, 12 up, 12 in 2024-08-02T18:47:21.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.857+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/1229601921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a281078b0 msgr2=0x7f6a28107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:21.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.857+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/1229601921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a281078b0 0x7f6a28107c90 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f6a18009930 tx=0x7f6a1802a420 comp rx=0 tx=0).stop 2024-08-02T18:47:21.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/1229601921 shutdown_connections 2024-08-02T18:47:21.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/1229601921 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a28102250 0x7f6a2810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/1229601921 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a281018b0 0x7f6a28101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/1229601921 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a281078b0 0x7f6a28107c90 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/1229601921 >> 172.21.15.103:0/1229601921 conn(0x7f6a280fd5f0 msgr2=0x7f6a280ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/1229601921 shutdown_connections 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/1229601921 wait complete. 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 Processor -- start 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.858+0000 7f6a2e5eb640 1 -- start start 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2e5eb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a281018b0 0x7f6a28198350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2e5eb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28102250 0x7f6a28198890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2e5eb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a281078b0 0x7f6a2819cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2e5eb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6a28111e10 con 0x7f6a28102250 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2e5eb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6a28111c90 con 0x7f6a281018b0 2024-08-02T18:47:21.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2e5eb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6a28111f90 con 0x7f6a281078b0 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28102250 0x7f6a28198890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28102250 0x7f6a28198890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56892/0 (socket says 172.21.15.103:56892) 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 -- 172.21.15.103:0/237001202 learned_addr learned my addr 172.21.15.103:0/237001202 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a27fff640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a281018b0 0x7f6a28198350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2cb88640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a281078b0 0x7f6a2819cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 -- 172.21.15.103:0/237001202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a281078b0 msgr2=0x7f6a2819cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a281078b0 0x7f6a2819cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 -- 172.21.15.103:0/237001202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a281018b0 msgr2=0x7f6a28198350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a281018b0 0x7f6a28198350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 -- 172.21.15.103:0/237001202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a2819d300 con 0x7f6a28102250 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a27fff640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a281018b0 0x7f6a28198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a277fe640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28102250 0x7f6a28198890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00b4a0 tx=0x7f6a1c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:21.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a257fa640 1 -- 172.21.15.103:0/237001202 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c014070 con 0x7f6a28102250 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a2819d5f0 con 0x7f6a28102250 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a257fa640 1 -- 172.21.15.103:0/237001202 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6a1c010b10 con 0x7f6a28102250 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a257fa640 1 -- 172.21.15.103:0/237001202 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6a1c017d60 con 0x7f6a28102250 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.859+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a281a4ed0 con 0x7f6a28102250 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.860+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a28101d10 con 0x7f6a28102250 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.861+0000 7f6a257fa640 1 -- 172.21.15.103:0/237001202 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6a1c017070 con 0x7f6a28102250 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.862+0000 7f6a257fa640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6a100a2b80 0x7f6a100a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.862+0000 7f6a27fff640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6a100a2b80 0x7f6a100a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.862+0000 7f6a257fa640 1 -- 172.21.15.103:0/237001202 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(80..80 src has 1..80) ==== 7879+0+0 (secure 0 0 0) 0x7f6a1c0ce780 con 0x7f6a28102250 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.862+0000 7f6a27fff640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6a100a2b80 0x7f6a100a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000c00 tx=0x7f6a18005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:21.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:21.865+0000 7f6a257fa640 1 -- 172.21.15.103:0/237001202 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6a1c09b7f0 con 0x7f6a28102250 2024-08-02T18:47:22.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.066+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7f6a2802d5e0 con 0x7f6a28102250 2024-08-02T18:47:22.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.313+0000 7f6a257fa640 1 -- 172.21.15.103:0/237001202 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v14) ==== 172+0+0 (secure 0 0 0) 0x7f6a1c09b0f0 con 0x7f6a28102250 2024-08-02T18:47:22.315 INFO:teuthology.orchestra.run.smithi103.stderr:new fs with metadata pool 2 and data pool 3 2024-08-02T18:47:22.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.315+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6a100a2b80 msgr2=0x7f6a100a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:22.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.315+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6a100a2b80 0x7f6a100a5040 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000c00 tx=0x7f6a18005a20 comp rx=0 tx=0).stop 2024-08-02T18:47:22.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.315+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28102250 msgr2=0x7f6a28198890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:22.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.315+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28102250 0x7f6a28198890 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f6a1c00b4a0 tx=0x7f6a1c00b960 comp rx=0 tx=0).stop 2024-08-02T18:47:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.316+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 shutdown_connections 2024-08-02T18:47:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.316+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6a100a2b80 0x7f6a100a5040 secure :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6a18000c00 tx=0x7f6a18005a20 comp rx=0 tx=0).stop 2024-08-02T18:47:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.316+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6a281078b0 0x7f6a2819cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.316+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6a28102250 0x7f6a28198890 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.316+0000 7f6a2e5eb640 1 --2- 172.21.15.103:0/237001202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6a281018b0 0x7f6a28198350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.316+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 >> 172.21.15.103:0/237001202 conn(0x7f6a280fd5f0 msgr2=0x7f6a280fdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.316+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 shutdown_connections 2024-08-02T18:47:22.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:22.316+0000 7f6a2e5eb640 1 -- 172.21.15.103:0/237001202 wait complete. 2024-08-02T18:47:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:22 smithi103 ceph-mon[32753]: osdmap e80: 12 total, 12 up, 12 in 2024-08-02T18:47:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:22 smithi103 ceph-mon[32753]: pgmap v258: 97 pgs: 21 creating+peering, 60 unknown, 16 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:22.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:22 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/237001202' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-02T18:47:22.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:22 smithi103 ceph-mon[32753]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-02T18:47:22.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:22 smithi121 ceph-mon[37236]: osdmap e80: 12 total, 12 up, 12 in 2024-08-02T18:47:22.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:22 smithi121 ceph-mon[37236]: pgmap v258: 97 pgs: 21 creating+peering, 60 unknown, 16 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:22.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:22 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/237001202' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-02T18:47:22.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:22 smithi121 ceph-mon[37236]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-02T18:47:22.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:22 smithi151 ceph-mon[37155]: osdmap e80: 12 total, 12 up, 12 in 2024-08-02T18:47:22.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:22 smithi151 ceph-mon[37155]: pgmap v258: 97 pgs: 21 creating+peering, 60 unknown, 16 active+clean; 577 KiB data, 356 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:22.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:22 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/237001202' entity='client.admin' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]: dispatch 2024-08-02T18:47:22.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:22 smithi151 ceph-mon[37155]: daemon mds.b assigned to filesystem cephfs as rank 0 2024-08-02T18:47:23.127 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-08-02T18:47:23.128 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-08-02T18:47:23.387 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:23.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:23 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/237001202' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-02T18:47:23.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:23 smithi103 ceph-mon[32753]: osdmap e81: 12 total, 12 up, 12 in 2024-08-02T18:47:23.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:23 smithi103 ceph-mon[32753]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-02T18:47:23.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:23 smithi103 ceph-mon[32753]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-02T18:47:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:23 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/237001202' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-02T18:47:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:23 smithi121 ceph-mon[37236]: osdmap e81: 12 total, 12 up, 12 in 2024-08-02T18:47:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:23 smithi121 ceph-mon[37236]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-02T18:47:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:23 smithi121 ceph-mon[37236]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-02T18:47:23.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:23 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/237001202' entity='client.admin' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]': finished 2024-08-02T18:47:23.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:23 smithi151 ceph-mon[37155]: osdmap e81: 12 total, 12 up, 12 in 2024-08-02T18:47:23.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:23 smithi151 ceph-mon[37155]: fsmap cephfs:1 {0=b=up:creating} 11 up:standby 2024-08-02T18:47:23.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:23 smithi151 ceph-mon[37155]: daemon mds.b is now active in filesystem cephfs as rank 0 2024-08-02T18:47:23.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 -- 172.21.15.103:0/2293228382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714102b00 msgr2=0x7f1714102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:23.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 --2- 172.21.15.103:0/2293228382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714102b00 0x7f1714102ee0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f1704009cd0 tx=0x7f170402a8d0 comp rx=0 tx=0).stop 2024-08-02T18:47:23.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 -- 172.21.15.103:0/2293228382 shutdown_connections 2024-08-02T18:47:23.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 --2- 172.21.15.103:0/2293228382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1714108030 0x7f171410e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:23.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 --2- 172.21.15.103:0/2293228382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f17141034b0 0x7f17141078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:23.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 --2- 172.21.15.103:0/2293228382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714102b00 0x7f1714102ee0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:23.912 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 -- 172.21.15.103:0/2293228382 >> 172.21.15.103:0/2293228382 conn(0x7f17140fc500 msgr2=0x7f17140fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 -- 172.21.15.103:0/2293228382 shutdown_connections 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 -- 172.21.15.103:0/2293228382 wait complete. 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.904+0000 7f17199c7640 1 Processor -- start 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17199c7640 1 -- start start 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17199c7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1714102b00 0x7f17141983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17199c7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17141034b0 0x7f17141988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17199c7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714108030 0x7f171419cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17199c7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1714111f20 con 0x7f1714108030 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17199c7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1714111da0 con 0x7f1714102b00 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17199c7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f17141120a0 con 0x7f17141034b0 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714108030 0x7f171419cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714108030 0x7f171419cc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56908/0 (socket says 172.21.15.103:56908) 2024-08-02T18:47:23.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 -- 172.21.15.103:0/2011535258 learned_addr learned my addr 172.21.15.103:0/2011535258 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f1712ffd640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1714102b00 0x7f17141983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17127fc640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17141034b0 0x7f17141988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 -- 172.21.15.103:0/2011535258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17141034b0 msgr2=0x7f17141988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17141034b0 0x7f17141988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 -- 172.21.15.103:0/2011535258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1714102b00 msgr2=0x7f17141983a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1714102b00 0x7f17141983a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 -- 172.21.15.103:0/2011535258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f171419d350 con 0x7f1714108030 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17127fc640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17141034b0 0x7f17141988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f1712ffd640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1714102b00 0x7f17141983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.905+0000 7f17137fe640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714108030 0x7f171419cc70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c970 tx=0x7f170c00ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:23.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.906+0000 7f17189c5640 1 -- 172.21.15.103:0/2011535258 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c007bb0 con 0x7f1714108030 2024-08-02T18:47:23.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.906+0000 7f17189c5640 1 -- 172.21.15.103:0/2011535258 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f170c007d50 con 0x7f1714108030 2024-08-02T18:47:23.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.906+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f171419d640 con 0x7f1714108030 2024-08-02T18:47:23.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.906+0000 7f17189c5640 1 -- 172.21.15.103:0/2011535258 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f170c00f450 con 0x7f1714108030 2024-08-02T18:47:23.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.906+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17141a4f20 con 0x7f1714108030 2024-08-02T18:47:23.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.907+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f171406a4e0 con 0x7f1714108030 2024-08-02T18:47:23.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.908+0000 7f17189c5640 1 -- 172.21.15.103:0/2011535258 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f170c005000 con 0x7f1714108030 2024-08-02T18:47:23.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.909+0000 7f17189c5640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f17000a2b80 0x7f17000a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:23.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.909+0000 7f1712ffd640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f17000a2b80 0x7f17000a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:23.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.909+0000 7f17189c5640 1 -- 172.21.15.103:0/2011535258 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(81..81 src has 1..81) ==== 7979+0+0 (secure 0 0 0) 0x7f170c0cefa0 con 0x7f1714108030 2024-08-02T18:47:23.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.910+0000 7f1712ffd640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f17000a2b80 0x7f17000a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1704006010 tx=0x7f17040093f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:23.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:23.913+0000 7f17189c5640 1 -- 172.21.15.103:0/2011535258 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f170c014030 con 0x7f1714108030 2024-08-02T18:47:24.088 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.087+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7f171410a070 con 0x7f1714108030 2024-08-02T18:47:24.340 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.338+0000 7f17189c5640 1 -- 172.21.15.103:0/2011535258 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v82) ==== 157+0+0 (secure 0 0 0) 0x7f170c09c030 con 0x7f1714108030 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f17000a2b80 msgr2=0x7f17000a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f17000a2b80 0x7f17000a5040 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f1704006010 tx=0x7f17040093f0 comp rx=0 tx=0).stop 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714108030 msgr2=0x7f171419cc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714108030 0x7f171419cc70 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f170c00c970 tx=0x7f170c00ce30 comp rx=0 tx=0).stop 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 shutdown_connections 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1714108030 0x7f171419cc70 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f17000a2b80 0x7f17000a5040 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f17141034b0 0x7f17141988e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 --2- 172.21.15.103:0/2011535258 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1714102b00 0x7f17141983a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:24.342 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 >> 172.21.15.103:0/2011535258 conn(0x7f17140fc500 msgr2=0x7f17141060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 shutdown_connections 2024-08-02T18:47:24.343 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:24.340+0000 7f17199c7640 1 -- 172.21.15.103:0/2011535258 wait complete. 2024-08-02T18:47:24.683 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:24 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] up:active 2024-08-02T18:47:24.683 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:24 smithi103 ceph-mon[32753]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:24.683 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:24 smithi103 ceph-mon[32753]: pgmap v260: 97 pgs: 21 creating+peering, 14 unknown, 62 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 1 op/s 2024-08-02T18:47:24.683 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:24 smithi103 ceph-mon[32753]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:24.683 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:24 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2011535258' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-02T18:47:24.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:24 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] up:active 2024-08-02T18:47:24.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:24 smithi121 ceph-mon[37236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:24.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:24 smithi121 ceph-mon[37236]: pgmap v260: 97 pgs: 21 creating+peering, 14 unknown, 62 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 1 op/s 2024-08-02T18:47:24.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:24 smithi121 ceph-mon[37236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:24.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:24 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2011535258' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-02T18:47:24.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:24 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] up:active 2024-08-02T18:47:24.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:24 smithi151 ceph-mon[37155]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:24.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:24 smithi151 ceph-mon[37155]: pgmap v260: 97 pgs: 21 creating+peering, 14 unknown, 62 active+clean; 578 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 762 B/s wr, 1 op/s 2024-08-02T18:47:24.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:24 smithi151 ceph-mon[37155]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:24.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:24 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2011535258' entity='client.admin' cmd=[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]: dispatch 2024-08-02T18:47:25.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-08-02T18:47:25.292 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:25 smithi103 ceph-mon[32753]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-02T18:47:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:25 smithi103 ceph-mon[32753]: Cluster is now healthy 2024-08-02T18:47:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:25 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2011535258' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-02T18:47:25.702 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:25 smithi103 ceph-mon[32753]: osdmap e82: 12 total, 12 up, 12 in 2024-08-02T18:47:25.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:25 smithi121 ceph-mon[37236]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-02T18:47:25.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:25 smithi121 ceph-mon[37236]: Cluster is now healthy 2024-08-02T18:47:25.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:25 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2011535258' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-02T18:47:25.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:25 smithi121 ceph-mon[37236]: osdmap e82: 12 total, 12 up, 12 in 2024-08-02T18:47:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 -- 172.21.15.103:0/1849390268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1007b0 msgr2=0x7f14ac100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 --2- 172.21.15.103:0/1849390268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1007b0 0x7f14ac100c10 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f149c009930 tx=0x7f149c02a440 comp rx=0 tx=0).stop 2024-08-02T18:47:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 -- 172.21.15.103:0/1849390268 shutdown_connections 2024-08-02T18:47:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 --2- 172.21.15.103:0/1849390268 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac101150 0x7f14ac10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 --2- 172.21.15.103:0/1849390268 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1007b0 0x7f14ac100c10 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:25.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 --2- 172.21.15.103:0/1849390268 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14ac1067b0 0x7f14ac106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 -- 172.21.15.103:0/1849390268 >> 172.21.15.103:0/1849390268 conn(0x7f14ac0fc4d0 msgr2=0x7f14ac0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 -- 172.21.15.103:0/1849390268 shutdown_connections 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.789+0000 7f14b3856640 1 -- 172.21.15.103:0/1849390268 wait complete. 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b3856640 1 Processor -- start 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b3856640 1 -- start start 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b3856640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac1007b0 0x7f14ac0fca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b3856640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14ac101150 0x7f14ac0fcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b3856640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1067b0 0x7f14ac0fd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b3856640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac110d30 con 0x7f14ac1067b0 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b3856640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac110bb0 con 0x7f14ac101150 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b3856640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f14ac110eb0 con 0x7f14ac1007b0 2024-08-02T18:47:25.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1067b0 0x7f14ac0fd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1067b0 0x7f14ac0fd4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56936/0 (socket says 172.21.15.103:56936) 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 -- 172.21.15.103:0/2157878132 learned_addr learned my addr 172.21.15.103:0/2157878132 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b15f2640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac1007b0 0x7f14ac0fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b0df1640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14ac101150 0x7f14ac0fcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 -- 172.21.15.103:0/2157878132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac1007b0 msgr2=0x7f14ac0fca20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac1007b0 0x7f14ac0fca20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 -- 172.21.15.103:0/2157878132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14ac101150 msgr2=0x7f14ac0fcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14ac101150 0x7f14ac0fcf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 -- 172.21.15.103:0/2157878132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14ac1a6740 con 0x7f14ac1067b0 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b0df1640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14ac101150 0x7f14ac0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.790+0000 7f14b1df3640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1067b0 0x7f14ac0fd4a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14a400b990 tx=0x7f14a400bd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:25.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.791+0000 7f14a27fc640 1 -- 172.21.15.103:0/2157878132 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4019070 con 0x7f14ac1067b0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.791+0000 7f14a27fc640 1 -- 172.21.15.103:0/2157878132 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f14a4014440 con 0x7f14ac1067b0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.791+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14ac1a6a30 con 0x7f14ac1067b0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.791+0000 7f14a27fc640 1 -- 172.21.15.103:0/2157878132 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a4007650 con 0x7f14ac1067b0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.791+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14ac1a6ef0 con 0x7f14ac1067b0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.792+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14ac100c10 con 0x7f14ac1067b0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.793+0000 7f14a27fc640 1 -- 172.21.15.103:0/2157878132 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f14a401c070 con 0x7f14ac1067b0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.793+0000 7f14a27fc640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f14980a2b80 0x7f14980a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.793+0000 7f14b15f2640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f14980a2b80 0x7f14980a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.793+0000 7f14a27fc640 1 -- 172.21.15.103:0/2157878132 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(82..82 src has 1..82) ==== 8277+0+0 (secure 0 0 0) 0x7f14a40ce690 con 0x7f14ac1067b0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.794+0000 7f14b15f2640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f14980a2b80 0x7f14980a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14a800abe0 tx=0x7f14a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:25.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.798+0000 7f14a27fc640 1 -- 172.21.15.103:0/2157878132 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f14a409b650 con 0x7f14ac1067b0 2024-08-02T18:47:25.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:25 smithi151 ceph-mon[37155]: Health check cleared: POOL_APP_NOT_ENABLED (was: 2 pool(s) do not have an application enabled) 2024-08-02T18:47:25.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:25 smithi151 ceph-mon[37155]: Cluster is now healthy 2024-08-02T18:47:25.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:25 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2011535258' entity='client.admin' cmd='[{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]': finished 2024-08-02T18:47:25.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:25 smithi151 ceph-mon[37155]: osdmap e82: 12 total, 12 up, 12 in 2024-08-02T18:47:25.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:25.964+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f14ac109d50 con 0x7f14ac1067b0 2024-08-02T18:47:27.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:26 smithi121 ceph-mon[37236]: pgmap v262: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 814 B/s wr, 2 op/s 2024-08-02T18:47:27.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:26 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2157878132' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-02T18:47:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:26 smithi151 ceph-mon[37155]: pgmap v262: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 814 B/s wr, 2 op/s 2024-08-02T18:47:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:26 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2157878132' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-02T18:47:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:26 smithi103 ceph-mon[32753]: pgmap v262: 97 pgs: 17 creating+peering, 80 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 814 B/s wr, 2 op/s 2024-08-02T18:47:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:26 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2157878132' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]: dispatch 2024-08-02T18:47:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.348+0000 7f14a27fc640 1 -- 172.21.15.103:0/2157878132 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v84) ==== 228+0+0 (secure 0 0 0) 0x7f14a409af50 con 0x7f14ac1067b0 2024-08-02T18:47:27.350 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' created 2024-08-02T18:47:27.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.351+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f14980a2b80 msgr2=0x7f14980a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:27.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.351+0000 7f14b3856640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f14980a2b80 0x7f14980a5040 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f14a800abe0 tx=0x7f14a800a2d0 comp rx=0 tx=0).stop 2024-08-02T18:47:27.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.351+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1067b0 msgr2=0x7f14ac0fd4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:27.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.351+0000 7f14b3856640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1067b0 0x7f14ac0fd4a0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f14a400b990 tx=0x7f14a400bd90 comp rx=0 tx=0).stop 2024-08-02T18:47:27.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.351+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 shutdown_connections 2024-08-02T18:47:27.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.351+0000 7f14b3856640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f14ac1067b0 0x7f14ac0fd4a0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:27.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.351+0000 7f14b3856640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14ac101150 0x7f14ac0fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:27.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.351+0000 7f14b3856640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f14980a2b80 0x7f14980a5040 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:27.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.352+0000 7f14b3856640 1 --2- 172.21.15.103:0/2157878132 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f14ac1007b0 0x7f14ac0fca20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:27.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.352+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 >> 172.21.15.103:0/2157878132 conn(0x7f14ac0fc4d0 msgr2=0x7f14ac06a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:27.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.352+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 shutdown_connections 2024-08-02T18:47:27.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:27.352+0000 7f14b3856640 1 -- 172.21.15.103:0/2157878132 wait complete. 2024-08-02T18:47:27.727 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:27 smithi103 ceph-mon[32753]: osdmap e83: 12 total, 12 up, 12 in 2024-08-02T18:47:27.727 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:27 smithi103 ceph-mon[32753]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-02T18:47:27.727 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:27 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2157878132' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-02T18:47:27.727 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:27 smithi103 ceph-mon[32753]: osdmap e84: 12 total, 12 up, 12 in 2024-08-02T18:47:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:27 smithi121 ceph-mon[37236]: osdmap e83: 12 total, 12 up, 12 in 2024-08-02T18:47:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:27 smithi121 ceph-mon[37236]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-02T18:47:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:27 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2157878132' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-02T18:47:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:27 smithi121 ceph-mon[37236]: osdmap e84: 12 total, 12 up, 12 in 2024-08-02T18:47:27.751 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 18:47:27 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b[67166]: 2024-08-02T18:47:27.391+0000 7f6aeaf58640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2024-08-02T18:47:28.060 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-08-02T18:47:28.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:27 smithi151 ceph-mon[37155]: osdmap e83: 12 total, 12 up, 12 in 2024-08-02T18:47:28.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:27 smithi151 ceph-mon[37155]: pgmap v264: 97 pgs: 97 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.3 KiB/s wr, 7 op/s 2024-08-02T18:47:28.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:27 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2157878132' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]': finished 2024-08-02T18:47:28.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:27 smithi151 ceph-mon[37155]: osdmap e84: 12 total, 12 up, 12 in 2024-08-02T18:47:28.317 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 -- 172.21.15.103:0/2636062804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c101150 msgr2=0x7f051c10d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 --2- 172.21.15.103:0/2636062804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c101150 0x7f051c10d680 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f0514009cd0 tx=0x7f051402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:47:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 -- 172.21.15.103:0/2636062804 shutdown_connections 2024-08-02T18:47:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 --2- 172.21.15.103:0/2636062804 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c101150 0x7f051c10d680 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 --2- 172.21.15.103:0/2636062804 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f051c1007b0 0x7f051c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 --2- 172.21.15.103:0/2636062804 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051c1067b0 0x7f051c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:28.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 -- 172.21.15.103:0/2636062804 >> 172.21.15.103:0/2636062804 conn(0x7f051c0fc4d0 msgr2=0x7f051c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 -- 172.21.15.103:0/2636062804 shutdown_connections 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.799+0000 7f0522a79640 1 -- 172.21.15.103:0/2636062804 wait complete. 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0522a79640 1 Processor -- start 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0522a79640 1 -- start start 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0522a79640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c1007b0 0x7f051c199080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0522a79640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051c101150 0x7f051c1995c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0522a79640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f051c1067b0 0x7f051c1a4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0522a79640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f051c110d10 con 0x7f051c1007b0 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0522a79640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f051c110b90 con 0x7f051c101150 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0522a79640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f051c110e90 con 0x7f051c1067b0 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0520815640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c1007b0 0x7f051c199080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0520815640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c1007b0 0x7f051c199080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56962/0 (socket says 172.21.15.103:56962) 2024-08-02T18:47:28.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0520815640 1 -- 172.21.15.103:0/2875157733 learned_addr learned my addr 172.21.15.103:0/2875157733 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0521016640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f051c1067b0 0x7f051c1a4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0520815640 1 -- 172.21.15.103:0/2875157733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f051c1067b0 msgr2=0x7f051c1a4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f051bfff640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051c101150 0x7f051c1995c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0520815640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f051c1067b0 0x7f051c1a4100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.800+0000 7f0520815640 1 -- 172.21.15.103:0/2875157733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051c101150 msgr2=0x7f051c1995c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.801+0000 7f0520815640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051c101150 0x7f051c1995c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.801+0000 7f0520815640 1 -- 172.21.15.103:0/2875157733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051c1a4640 con 0x7f051c1007b0 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.801+0000 7f0520815640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c1007b0 0x7f051c199080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f051000b4a0 tx=0x7f051000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.801+0000 7f0519ffb640 1 -- 172.21.15.103:0/2875157733 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510014070 con 0x7f051c1007b0 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.801+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051c1a4810 con 0x7f051c1007b0 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.801+0000 7f0519ffb640 1 -- 172.21.15.103:0/2875157733 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0510010b10 con 0x7f051c1007b0 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.801+0000 7f0519ffb640 1 -- 172.21.15.103:0/2875157733 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0510017d60 con 0x7f051c1007b0 2024-08-02T18:47:28.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.801+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f051c1a4da0 con 0x7f051c1007b0 2024-08-02T18:47:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.802+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f051c100c10 con 0x7f051c1007b0 2024-08-02T18:47:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.803+0000 7f0519ffb640 1 -- 172.21.15.103:0/2875157733 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f0510017070 con 0x7f051c1007b0 2024-08-02T18:47:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.804+0000 7f0519ffb640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f050c0a2b80 0x7f050c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.804+0000 7f051bfff640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f050c0a2b80 0x7f050c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.804+0000 7f0519ffb640 1 -- 172.21.15.103:0/2875157733 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(85..85 src has 1..85) ==== 8770+0+0 (secure 0 0 0) 0x7f05100cea80 con 0x7f051c1007b0 2024-08-02T18:47:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.804+0000 7f051bfff640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f050c0a2b80 0x7f050c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0508005fd0 tx=0x7f0508005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:28.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.807+0000 7f0519ffb640 1 -- 172.21.15.103:0/2875157733 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f051009b7c0 con 0x7f051c1007b0 2024-08-02T18:47:28.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:28.972+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f051c1a50a0 con 0x7f051c1007b0 2024-08-02T18:47:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.355+0000 7f0519ffb640 1 -- 172.21.15.103:0/2875157733 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v86) ==== 169+0+0 (secure 0 0 0) 0x7f051009b0c0 con 0x7f051c1007b0 2024-08-02T18:47:29.356 INFO:teuthology.orchestra.run.smithi103.stderr:set pool 4 allow_ec_overwrites to true 2024-08-02T18:47:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f050c0a2b80 msgr2=0x7f050c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f050c0a2b80 0x7f050c0a5040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0508005fd0 tx=0x7f0508005850 comp rx=0 tx=0).stop 2024-08-02T18:47:29.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c1007b0 msgr2=0x7f051c199080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c1007b0 0x7f051c199080 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f051000b4a0 tx=0x7f051000b960 comp rx=0 tx=0).stop 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 shutdown_connections 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f050c0a2b80 0x7f050c0a5040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f051c1067b0 0x7f051c1a4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f051c101150 0x7f051c1995c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 --2- 172.21.15.103:0/2875157733 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f051c1007b0 0x7f051c199080 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 >> 172.21.15.103:0/2875157733 conn(0x7f051c0fc4d0 msgr2=0x7f051c0fdb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 shutdown_connections 2024-08-02T18:47:29.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:29.358+0000 7f0522a79640 1 -- 172.21.15.103:0/2875157733 wait complete. 2024-08-02T18:47:29.672 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:29 smithi103 ceph-mon[32753]: osdmap e85: 12 total, 12 up, 12 in 2024-08-02T18:47:29.672 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:29 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2875157733' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-02T18:47:29.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:29 smithi121 ceph-mon[37236]: osdmap e85: 12 total, 12 up, 12 in 2024-08-02T18:47:29.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:29 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2875157733' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-02T18:47:29.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:29 smithi151 ceph-mon[37155]: osdmap e85: 12 total, 12 up, 12 in 2024-08-02T18:47:29.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:29 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2875157733' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]: dispatch 2024-08-02T18:47:30.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs add_data_pool cephfs cephfs_data_ec 2024-08-02T18:47:30.321 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:30.617 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:30 smithi103 ceph-mon[32753]: pgmap v267: 129 pgs: 3 creating+peering, 24 unknown, 102 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-08-02T18:47:30.617 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:30 smithi103 ceph-mon[32753]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-02T18:47:30.617 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:30 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2875157733' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-02T18:47:30.617 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:30 smithi103 ceph-mon[32753]: osdmap e86: 12 total, 12 up, 12 in 2024-08-02T18:47:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:30 smithi121 ceph-mon[37236]: pgmap v267: 129 pgs: 3 creating+peering, 24 unknown, 102 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-08-02T18:47:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:30 smithi121 ceph-mon[37236]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-02T18:47:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:30 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2875157733' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-02T18:47:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:30 smithi121 ceph-mon[37236]: osdmap e86: 12 total, 12 up, 12 in 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.808+0000 7fe5f3052640 1 -- 172.21.15.103:0/3872273208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec1018b0 msgr2=0x7fe5ec101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.808+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3872273208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec1018b0 0x7fe5ec101d10 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009930 tx=0x7fe5d802a420 comp rx=0 tx=0).stop 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.808+0000 7fe5f3052640 1 -- 172.21.15.103:0/3872273208 shutdown_connections 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.808+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3872273208 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5ec102250 0x7fe5ec10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.808+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3872273208 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec1018b0 0x7fe5ec101d10 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.808+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3872273208 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec1078b0 0x7fe5ec107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.808+0000 7fe5f3052640 1 -- 172.21.15.103:0/3872273208 >> 172.21.15.103:0/3872273208 conn(0x7fe5ec0fd5f0 msgr2=0x7fe5ec0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.808+0000 7fe5f3052640 1 -- 172.21.15.103:0/3872273208 shutdown_connections 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 -- 172.21.15.103:0/3872273208 wait complete. 2024-08-02T18:47:30.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 Processor -- start 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 -- start start 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec1018b0 0x7fe5ec198330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec102250 0x7fe5ec198870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5ec1078b0 0x7fe5ec19cc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ec111e10 con 0x7fe5ec102250 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ec111c90 con 0x7fe5ec1078b0 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5f3052640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe5ec111f90 con 0x7fe5ec1018b0 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5ebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec102250 0x7fe5ec198870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.809+0000 7fe5ebfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec102250 0x7fe5ec198870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33728/0 (socket says 172.21.15.103:33728) 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5ebfff640 1 -- 172.21.15.103:0/3631865054 learned_addr learned my addr 172.21.15.103:0/3631865054 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5f15ef640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5ec1078b0 0x7fe5ec19cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5ebfff640 1 -- 172.21.15.103:0/3631865054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec1018b0 msgr2=0x7fe5ec198330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5ebfff640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec1018b0 0x7fe5ec198330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:30.813 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5ebfff640 1 -- 172.21.15.103:0/3631865054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5ec1078b0 msgr2=0x7fe5ec19cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5ebfff640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5ec1078b0 0x7fe5ec19cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5ebfff640 1 -- 172.21.15.103:0/3631865054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5ec19d2e0 con 0x7fe5ec102250 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5f15ef640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5ec1078b0 0x7fe5ec19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5ebfff640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec102250 0x7fe5ec198870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009a50 tx=0x7fe5d8004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5e9ffb640 1 -- 172.21.15.103:0/3631865054 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d803f030 con 0x7fe5ec102250 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5e9ffb640 1 -- 172.21.15.103:0/3631865054 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe5d8003af0 con 0x7fe5ec102250 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5ec19d570 con 0x7fe5ec102250 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5e9ffb640 1 -- 172.21.15.103:0/3631865054 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8035070 con 0x7fe5ec102250 2024-08-02T18:47:30.814 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.810+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5ec1a4eb0 con 0x7fe5ec102250 2024-08-02T18:47:30.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.811+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5ec101d10 con 0x7fe5ec102250 2024-08-02T18:47:30.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.812+0000 7fe5e9ffb640 1 -- 172.21.15.103:0/3631865054 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fe5d8042030 con 0x7fe5ec102250 2024-08-02T18:47:30.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.813+0000 7fe5e9ffb640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe5dc0a2c00 0x7fe5dc0a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:30.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.813+0000 7fe5f0dee640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe5dc0a2c00 0x7fe5dc0a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:30.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.813+0000 7fe5e9ffb640 1 -- 172.21.15.103:0/3631865054 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(86..86 src has 1..86) ==== 8770+0+0 (secure 0 0 0) 0x7fe5d80effa0 con 0x7fe5ec102250 2024-08-02T18:47:30.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.814+0000 7fe5f0dee640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe5dc0a2c00 0x7fe5dc0a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009710 tx=0x7fe5e0006c90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:30.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:30.816+0000 7fe5e9ffb640 1 -- 172.21.15.103:0/3631865054 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe5d80bcce0 con 0x7fe5ec102250 2024-08-02T18:47:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:30 smithi151 ceph-mon[37155]: pgmap v267: 129 pgs: 3 creating+peering, 24 unknown, 102 active+clean; 579 KiB data, 357 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 KiB/s wr, 7 op/s 2024-08-02T18:47:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:30 smithi151 ceph-mon[37155]: Health check failed: 1 pool(s) do not have an application enabled (POOL_APP_NOT_ENABLED) 2024-08-02T18:47:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:30 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2875157733' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]': finished 2024-08-02T18:47:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:30 smithi151 ceph-mon[37155]: osdmap e86: 12 total, 12 up, 12 in 2024-08-02T18:47:31.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.019+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7fe5ec199690 con 0x7fe5ec102250 2024-08-02T18:47:31.367 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.366+0000 7fe5e9ffb640 1 -- 172.21.15.103:0/3631865054 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v17) ==== 137+0+0 (secure 0 0 0) 0x7fe5ec199690 con 0x7fe5ec102250 2024-08-02T18:47:31.367 INFO:teuthology.orchestra.run.smithi103.stderr:added data pool 4 to fsmap 2024-08-02T18:47:31.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe5dc0a2c00 msgr2=0x7fe5dc0a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe5dc0a2c00 0x7fe5dc0a50c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0009710 tx=0x7fe5e0006c90 comp rx=0 tx=0).stop 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec102250 msgr2=0x7fe5ec198870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec102250 0x7fe5ec198870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fe5d8009a50 tx=0x7fe5d8004270 comp rx=0 tx=0).stop 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 shutdown_connections 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe5ec1078b0 0x7fe5ec19cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe5ec102250 0x7fe5ec198870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe5dc0a2c00 0x7fe5dc0a50c0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 --2- 172.21.15.103:0/3631865054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe5ec1018b0 0x7fe5ec198330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 >> 172.21.15.103:0/3631865054 conn(0x7fe5ec0fd5f0 msgr2=0x7fe5ec0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 shutdown_connections 2024-08-02T18:47:31.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:31.368+0000 7fe5f3052640 1 -- 172.21.15.103:0/3631865054 wait complete. 2024-08-02T18:47:31.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:31 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3631865054' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-02T18:47:31.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:31 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3631865054' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-02T18:47:31.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:31 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3631865054' entity='client.admin' cmd=[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]: dispatch 2024-08-02T18:47:31.969 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:47:32.222 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:32.610 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:32 smithi103 ceph-mon[32753]: pgmap v269: 129 pgs: 3 creating+peering, 6 unknown, 120 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 1 op/s 2024-08-02T18:47:32.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:32 smithi103 ceph-mon[32753]: osdmap e87: 12 total, 12 up, 12 in 2024-08-02T18:47:32.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:32 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3631865054' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-02T18:47:32.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:32 smithi103 ceph-mon[32753]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:32.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 -- 172.21.15.103:0/3242964193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab810bea0 msgr2=0x7f4ab810e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/3242964193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab810bea0 0x7f4ab810e340 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f4ab0009900 tx=0x7f4ab002a480 comp rx=0 tx=0).stop 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 -- 172.21.15.103:0/3242964193 shutdown_connections 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/3242964193 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab810bea0 0x7f4ab810e340 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/3242964193 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8103390 0x7f4ab810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/3242964193 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab8102a70 0x7f4ab8102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 -- 172.21.15.103:0/3242964193 >> 172.21.15.103:0/3242964193 conn(0x7f4ab80fc4d0 msgr2=0x7f4ab80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 -- 172.21.15.103:0/3242964193 shutdown_connections 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.688+0000 7f4abdf3b640 1 -- 172.21.15.103:0/3242964193 wait complete. 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.689+0000 7f4abdf3b640 1 Processor -- start 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.689+0000 7f4abdf3b640 1 -- start start 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.689+0000 7f4abdf3b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab8102a70 0x7f4ab81981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4abdf3b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8103390 0x7f4ab8198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:32.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4abdf3b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810bea0 0x7f4ab819cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4abdf3b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab8111e10 con 0x7f4ab8102a70 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4abdf3b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab8111c90 con 0x7f4ab8103390 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4abdf3b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ab8111f90 con 0x7f4ab810bea0 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab8102a70 0x7f4ab81981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab8102a70 0x7f4ab81981f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33746/0 (socket says 172.21.15.103:33746) 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 -- 172.21.15.103:0/778822949 learned_addr learned my addr 172.21.15.103:0/778822949 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab7fff640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810bea0 0x7f4ab819cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab6ffd640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8103390 0x7f4ab8198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 -- 172.21.15.103:0/778822949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810bea0 msgr2=0x7f4ab819cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810bea0 0x7f4ab819cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 -- 172.21.15.103:0/778822949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8103390 msgr2=0x7f4ab8198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:32.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8103390 0x7f4ab8198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 -- 172.21.15.103:0/778822949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ab819d1a0 con 0x7f4ab8102a70 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab6ffd640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8103390 0x7f4ab8198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab77fe640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab8102a70 0x7f4ab81981f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800eab0 tx=0x7f4aa800ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab4ff9640 1 -- 172.21.15.103:0/778822949 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa800ce40 con 0x7f4ab8102a70 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ab819d490 con 0x7f4ab8102a70 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab4ff9640 1 -- 172.21.15.103:0/778822949 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4aa8011970 con 0x7f4ab8102a70 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4ab4ff9640 1 -- 172.21.15.103:0/778822949 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4aa8010bb0 con 0x7f4ab8102a70 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.690+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ab81a4d70 con 0x7f4ab8102a70 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.691+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ab8102e50 con 0x7f4ab8102a70 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.693+0000 7f4ab4ff9640 1 -- 172.21.15.103:0/778822949 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f4aa8010d50 con 0x7f4ab8102a70 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.693+0000 7f4ab4ff9640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4aa00a2b80 0x7f4aa00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.693+0000 7f4ab6ffd640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4aa00a2b80 0x7f4aa00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:32.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.693+0000 7f4ab4ff9640 1 -- 172.21.15.103:0/778822949 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f4aa80cf990 con 0x7f4ab8102a70 2024-08-02T18:47:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.694+0000 7f4ab6ffd640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4aa00a2b80 0x7f4aa00a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4aac005fd0 tx=0x7f4aac005f00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:32.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.698+0000 7f4ab4ff9640 1 -- 172.21.15.103:0/778822949 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4aa8016030 con 0x7f4ab8102a70 2024-08-02T18:47:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:32 smithi121 ceph-mon[37236]: pgmap v269: 129 pgs: 3 creating+peering, 6 unknown, 120 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 1 op/s 2024-08-02T18:47:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:32 smithi121 ceph-mon[37236]: osdmap e87: 12 total, 12 up, 12 in 2024-08-02T18:47:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:32 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3631865054' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-02T18:47:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:32 smithi121 ceph-mon[37236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:32 smithi151 ceph-mon[37155]: pgmap v269: 129 pgs: 3 creating+peering, 6 unknown, 120 active+clean; 579 KiB data, 358 MiB used, 1.0 TiB / 1.0 TiB avail; 411 B/s wr, 1 op/s 2024-08-02T18:47:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:32 smithi151 ceph-mon[37155]: osdmap e87: 12 total, 12 up, 12 in 2024-08-02T18:47:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:32 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3631865054' entity='client.admin' cmd='[{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]': finished 2024-08-02T18:47:32.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:32 smithi151 ceph-mon[37155]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:47:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.896+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4ab81a5000 con 0x7f4ab8102a70 2024-08-02T18:47:32.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.896+0000 7f4ab4ff9640 1 -- 172.21.15.103:0/778822949 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11860 (secure 0 0 0) 0x7f4aa809c6b0 con 0x7f4ab8102a70 2024-08-02T18:47:32.898 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:32.898 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-08-02T18:47:31:357794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:47:31.021108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24473,"qdb_cluster":[24473]},"id":1}]} 2024-08-02T18:47:32.898 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-08-02T18:47:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.898+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4aa00a2b80 msgr2=0x7f4aa00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.898+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4aa00a2b80 0x7f4aa00a5040 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4aac005fd0 tx=0x7f4aac005f00 comp rx=0 tx=0).stop 2024-08-02T18:47:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.898+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab8102a70 msgr2=0x7f4ab81981f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.898+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab8102a70 0x7f4ab81981f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f4aa800eab0 tx=0x7f4aa800ef70 comp rx=0 tx=0).stop 2024-08-02T18:47:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.899+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 shutdown_connections 2024-08-02T18:47:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.899+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4aa00a2b80 0x7f4aa00a5040 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.899+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ab810bea0 0x7f4ab819cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.899+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ab8103390 0x7f4ab8198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.899+0000 7f4abdf3b640 1 --2- 172.21.15.103:0/778822949 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ab8102a70 0x7f4ab81981f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.899+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 >> 172.21.15.103:0/778822949 conn(0x7f4ab80fc4d0 msgr2=0x7f4ab80fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.899+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 shutdown_connections 2024-08-02T18:47:32.901 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:32.899+0000 7f4abdf3b640 1 -- 172.21.15.103:0/778822949 wait complete. 2024-08-02T18:47:33.524 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:33 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/778822949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:33.552 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:47:33.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:33 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/778822949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:33.814 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:33.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:33 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/778822949' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 -- 172.21.15.103:0/3040020058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 msgr2=0x7f298410e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 --2- 172.21.15.103:0/3040020058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 0x7f298410e780 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f297c009930 tx=0x7f297c02a420 comp rx=0 tx=0).stop 2024-08-02T18:47:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 -- 172.21.15.103:0/3040020058 shutdown_connections 2024-08-02T18:47:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 --2- 172.21.15.103:0/3040020058 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 0x7f298410e780 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 --2- 172.21.15.103:0/3040020058 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29841018b0 0x7f2984101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 --2- 172.21.15.103:0/3040020058 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29841078b0 0x7f2984107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 -- 172.21.15.103:0/3040020058 >> 172.21.15.103:0/3040020058 conn(0x7f29840fd5f0 msgr2=0x7f29840ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 -- 172.21.15.103:0/3040020058 shutdown_connections 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.274+0000 7f2989200640 1 -- 172.21.15.103:0/3040020058 wait complete. 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.275+0000 7f2989200640 1 Processor -- start 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f2989200640 1 -- start start 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f2989200640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29841018b0 0x7f2984198390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f2989200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 0x7f29841988d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f2989200640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29841078b0 0x7f298419cc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f2989200640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2984111e90 con 0x7f2984102250 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f2989200640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2984111d10 con 0x7f29841018b0 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f2989200640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2984112010 con 0x7f29841078b0 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 0x7f29841988d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:34.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 0x7f29841988d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33772/0 (socket says 172.21.15.103:33772) 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 -- 172.21.15.103:0/2298610165 learned_addr learned my addr 172.21.15.103:0/2298610165 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f2982d9d640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29841018b0 0x7f2984198390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298359e640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29841078b0 0x7f298419cc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 -- 172.21.15.103:0/2298610165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29841078b0 msgr2=0x7f298419cc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29841078b0 0x7f298419cc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 -- 172.21.15.103:0/2298610165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29841018b0 msgr2=0x7f2984198390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29841018b0 0x7f2984198390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 -- 172.21.15.103:0/2298610165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f298419d340 con 0x7f2984102250 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298359e640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29841078b0 0x7f298419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.276+0000 7f298259c640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 0x7f29841988d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f296c00b4a0 tx=0x7f296c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.277+0000 7f297bfff640 1 -- 172.21.15.103:0/2298610165 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c014070 con 0x7f2984102250 2024-08-02T18:47:34.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.277+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f298419d630 con 0x7f2984102250 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.277+0000 7f297bfff640 1 -- 172.21.15.103:0/2298610165 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f296c010b10 con 0x7f2984102250 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.277+0000 7f297bfff640 1 -- 172.21.15.103:0/2298610165 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f296c017d60 con 0x7f2984102250 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.277+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f29841a4f10 con 0x7f2984102250 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.278+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2984101d90 con 0x7f2984102250 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.279+0000 7f297bfff640 1 -- 172.21.15.103:0/2298610165 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f296c017070 con 0x7f2984102250 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.279+0000 7f297bfff640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f29700a2b80 0x7f29700a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.280+0000 7f2982d9d640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f29700a2b80 0x7f29700a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.280+0000 7f297bfff640 1 -- 172.21.15.103:0/2298610165 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f296c0ceaf0 con 0x7f2984102250 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.280+0000 7f2982d9d640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f29700a2b80 0x7f29700a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2974009f20 tx=0x7f29740094f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:34.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.283+0000 7f297bfff640 1 -- 172.21.15.103:0/2298610165 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f296c09b7b0 con 0x7f2984102250 2024-08-02T18:47:34.453 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:34 smithi103 ceph-mon[32753]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-02T18:47:34.453 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:34 smithi103 ceph-mon[32753]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-02T18:47:34.453 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:34 smithi103 ceph-mon[32753]: Cluster is now healthy 2024-08-02T18:47:34.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.451+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f29841996f0 con 0x7f2984102250 2024-08-02T18:47:34.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.453+0000 7f297bfff640 1 -- 172.21.15.103:0/2298610165 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24173 (secure 0 0 0) 0x7f29841996f0 con 0x7f2984102250 2024-08-02T18:47:34.454 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:34.455 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:47:31.020978+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:47:34.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f29700a2b80 msgr2=0x7f29700a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:34.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f29700a2b80 0x7f29700a5040 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f2974009f20 tx=0x7f29740094f0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 msgr2=0x7f29841988d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 0x7f29841988d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f296c00b4a0 tx=0x7f296c00b960 comp rx=0 tx=0).stop 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 shutdown_connections 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f29700a2b80 0x7f29700a5040 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f29841078b0 0x7f298419cc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2984102250 0x7f29841988d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 --2- 172.21.15.103:0/2298610165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f29841018b0 0x7f2984198390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 >> 172.21.15.103:0/2298610165 conn(0x7f29840fd5f0 msgr2=0x7f29840fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 shutdown_connections 2024-08-02T18:47:34.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:34.455+0000 7f2989200640 1 -- 172.21.15.103:0/2298610165 wait complete. 2024-08-02T18:47:34.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:34 smithi121 ceph-mon[37236]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-02T18:47:34.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:34 smithi121 ceph-mon[37236]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-02T18:47:34.652 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:34 smithi121 ceph-mon[37236]: Cluster is now healthy 2024-08-02T18:47:34.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:34 smithi151 ceph-mon[37155]: pgmap v271: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-02T18:47:34.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:34 smithi151 ceph-mon[37155]: Health check cleared: POOL_APP_NOT_ENABLED (was: 1 pool(s) do not have an application enabled) 2024-08-02T18:47:34.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:34 smithi151 ceph-mon[37155]: Cluster is now healthy 2024-08-02T18:47:35.163 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:47:35.418 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:35.669 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:35 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2298610165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:35.671 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:35 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2298610165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:35.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:35 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2298610165' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:35.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 -- 172.21.15.103:0/307157922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4103470 msgr2=0x7fefd41078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:35.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 --2- 172.21.15.103:0/307157922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4103470 0x7fefd41078b0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fefc0009930 tx=0x7fefc002a420 comp rx=0 tx=0).stop 2024-08-02T18:47:35.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 -- 172.21.15.103:0/307157922 shutdown_connections 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 --2- 172.21.15.103:0/307157922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefd4107fc0 0x7fefd410e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 --2- 172.21.15.103:0/307157922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4103470 0x7fefd41078b0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 --2- 172.21.15.103:0/307157922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd4102ac0 0x7fefd4102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 -- 172.21.15.103:0/307157922 >> 172.21.15.103:0/307157922 conn(0x7fefd40fc500 msgr2=0x7fefd40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 -- 172.21.15.103:0/307157922 shutdown_connections 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.889+0000 7fefdaabe640 1 -- 172.21.15.103:0/307157922 wait complete. 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefdaabe640 1 Processor -- start 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefdaabe640 1 -- start start 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefdaabe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefd4102ac0 0x7fefd4198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefdaabe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd4103470 0x7fefd4198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:35.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefdaabe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4107fc0 0x7fefd419cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefdaabe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4111ee0 con 0x7fefd4107fc0 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefdaabe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4111d60 con 0x7fefd4103470 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefdaabe640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fefd4112060 con 0x7fefd4102ac0 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd905b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4107fc0 0x7fefd419cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd905b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4107fc0 0x7fefd419cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33794/0 (socket says 172.21.15.103:33794) 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd905b640 1 -- 172.21.15.103:0/2327732594 learned_addr learned my addr 172.21.15.103:0/2327732594 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd3fff640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd4103470 0x7fefd4198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd885a640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefd4102ac0 0x7fefd4198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd905b640 1 -- 172.21.15.103:0/2327732594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefd4102ac0 msgr2=0x7fefd4198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd905b640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefd4102ac0 0x7fefd4198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd905b640 1 -- 172.21.15.103:0/2327732594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd4103470 msgr2=0x7fefd4198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd905b640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd4103470 0x7fefd4198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:35.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd905b640 1 -- 172.21.15.103:0/2327732594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fefd419d2f0 con 0x7fefd4107fc0 2024-08-02T18:47:35.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.890+0000 7fefd3fff640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd4103470 0x7fefd4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:47:35.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.891+0000 7fefd905b640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4107fc0 0x7fefd419cc10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00cce0 tx=0x7fefcc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:35.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.891+0000 7fefd1ffb640 1 -- 172.21.15.103:0/2327732594 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc00f450 con 0x7fefd4107fc0 2024-08-02T18:47:35.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.891+0000 7fefd1ffb640 1 -- 172.21.15.103:0/2327732594 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fefcc00faf0 con 0x7fefd4107fc0 2024-08-02T18:47:35.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.891+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fefd419d5e0 con 0x7fefd4107fc0 2024-08-02T18:47:35.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.891+0000 7fefd1ffb640 1 -- 172.21.15.103:0/2327732594 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fefcc018cc0 con 0x7fefd4107fc0 2024-08-02T18:47:35.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.891+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fefd41a4ec0 con 0x7fefd4107fc0 2024-08-02T18:47:35.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.892+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fefd4102ea0 con 0x7fefd4107fc0 2024-08-02T18:47:35.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.893+0000 7fefd1ffb640 1 -- 172.21.15.103:0/2327732594 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fefcc00f5f0 con 0x7fefd4107fc0 2024-08-02T18:47:35.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.893+0000 7fefd1ffb640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fefc40a2c00 0x7fefc40a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:35.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.893+0000 7fefd885a640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fefc40a2c00 0x7fefc40a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:35.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.893+0000 7fefd1ffb640 1 -- 172.21.15.103:0/2327732594 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fefcc0cf670 con 0x7fefd4107fc0 2024-08-02T18:47:35.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.894+0000 7fefd885a640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fefc40a2c00 0x7fefc40a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009b60 tx=0x7fefc8005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:35.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:35.898+0000 7fefd1ffb640 1 -- 172.21.15.103:0/2327732594 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fefcc014030 con 0x7fefd4107fc0 2024-08-02T18:47:36.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.063+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fefd4109fd0 con 0x7fefd4107fc0 2024-08-02T18:47:36.066 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.064+0000 7fefd1ffb640 1 -- 172.21.15.103:0/2327732594 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24173 (secure 0 0 0) 0x7fefcc09c390 con 0x7fefd4107fc0 2024-08-02T18:47:36.066 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:36.066 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:47:31.020978+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:47:36.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fefc40a2c00 msgr2=0x7fefc40a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:36.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fefc40a2c00 0x7fefc40a50c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fefc8009b60 tx=0x7fefc8005f90 comp rx=0 tx=0).stop 2024-08-02T18:47:36.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4107fc0 msgr2=0x7fefd419cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4107fc0 0x7fefd419cc10 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fefcc00cce0 tx=0x7fefcc00a620 comp rx=0 tx=0).stop 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 shutdown_connections 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fefd4107fc0 0x7fefd419cc10 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fefd4103470 0x7fefd4198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fefc40a2c00 0x7fefc40a50c0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 --2- 172.21.15.103:0/2327732594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fefd4102ac0 0x7fefd4198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 >> 172.21.15.103:0/2327732594 conn(0x7fefd40fc500 msgr2=0x7fefd41060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 shutdown_connections 2024-08-02T18:47:36.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:36.067+0000 7fefdaabe640 1 -- 172.21.15.103:0/2327732594 wait complete. 2024-08-02T18:47:36.709 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:36 smithi103 ceph-mon[32753]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-02T18:47:36.710 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:36 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2327732594' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:36.758 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:47:36.758 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:36 smithi121 ceph-mon[37236]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-02T18:47:36.759 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:36 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2327732594' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:36.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:36 smithi151 ceph-mon[37155]: pgmap v272: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 0 B/s wr, 0 op/s 2024-08-02T18:47:36.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:36 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2327732594' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:37.010 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 -- 172.21.15.103:0/3244388067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc102260 msgr2=0x7f5dcc10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/3244388067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc102260 0x7f5dcc10e790 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f5dc4009cd0 tx=0x7f5dc402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 -- 172.21.15.103:0/3244388067 shutdown_connections 2024-08-02T18:47:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/3244388067 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc102260 0x7f5dcc10e790 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/3244388067 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc1018c0 0x7f5dcc101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/3244388067 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dcc1078c0 0x7f5dcc107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 -- 172.21.15.103:0/3244388067 >> 172.21.15.103:0/3244388067 conn(0x7f5dcc0fd5e0 msgr2=0x7f5dcc0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:37.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 -- 172.21.15.103:0/3244388067 shutdown_connections 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.482+0000 7f5dd25f7640 1 -- 172.21.15.103:0/3244388067 wait complete. 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd25f7640 1 Processor -- start 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd25f7640 1 -- start start 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd25f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc1018c0 0x7f5dcc074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd25f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dcc102260 0x7f5dcc074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd25f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc1078c0 0x7f5dcc074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd25f7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc111de0 con 0x7f5dcc1018c0 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd25f7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc111c60 con 0x7f5dcc102260 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd25f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5dcc111f60 con 0x7f5dcc1078c0 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dcbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc1018c0 0x7f5dcc074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dcbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc1018c0 0x7f5dcc074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33804/0 (socket says 172.21.15.103:33804) 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dcbfff640 1 -- 172.21.15.103:0/290345866 learned_addr learned my addr 172.21.15.103:0/290345866 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:37.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dd0b94640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc1078c0 0x7f5dcc074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.483+0000 7f5dcb7fe640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dcc102260 0x7f5dcc074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dcbfff640 1 -- 172.21.15.103:0/290345866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc1078c0 msgr2=0x7f5dcc074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dcbfff640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc1078c0 0x7f5dcc074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dcbfff640 1 -- 172.21.15.103:0/290345866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dcc102260 msgr2=0x7f5dcc074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dcbfff640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dcc102260 0x7f5dcc074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dcbfff640 1 -- 172.21.15.103:0/290345866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dcc1a66c0 con 0x7f5dcc1018c0 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dd0b94640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc1078c0 0x7f5dcc074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dcb7fe640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dcc102260 0x7f5dcc074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dcbfff640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc1018c0 0x7f5dcc074220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00e9f0 tx=0x7f5dbc00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dc97fa640 1 -- 172.21.15.103:0/290345866 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc00cd80 con 0x7f5dcc1018c0 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dcc1a69b0 con 0x7f5dcc1018c0 2024-08-02T18:47:37.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dc97fa640 1 -- 172.21.15.103:0/290345866 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dbc010930 con 0x7f5dcc1018c0 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dc97fa640 1 -- 172.21.15.103:0/290345866 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dbc018b00 con 0x7f5dcc1018c0 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.484+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dcc1a6f40 con 0x7f5dcc1018c0 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.485+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dcc101d20 con 0x7f5dcc1018c0 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.486+0000 7f5dc97fa640 1 -- 172.21.15.103:0/290345866 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f5dbc018ca0 con 0x7f5dcc1018c0 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.487+0000 7f5dc97fa640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5db40a2b80 0x7f5db40a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.487+0000 7f5dcb7fe640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5db40a2b80 0x7f5db40a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.487+0000 7f5dc97fa640 1 -- 172.21.15.103:0/290345866 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f5dbc0cf710 con 0x7f5dcc1018c0 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.487+0000 7f5dcb7fe640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5db40a2b80 0x7f5db40a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00058c0 tx=0x7f5dc0005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:37.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.491+0000 7f5dc97fa640 1 -- 172.21.15.103:0/290345866 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5dbc09c430 con 0x7f5dcc1018c0 2024-08-02T18:47:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.692+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5dcc1a7140 con 0x7f5dcc1018c0 2024-08-02T18:47:37.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.693+0000 7f5dc97fa640 1 -- 172.21.15.103:0/290345866 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 17 v17) ==== 94+0+11860 (secure 0 0 0) 0x7f5dbc09bd30 con 0x7f5dcc1018c0 2024-08-02T18:47:37.695 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:37.695 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"btime":"2024-08-02T18:47:31:357794+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":24425,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":6},{"gid":24442,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":7},{"gid":24449,"name":"h","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":9},{"gid":24454,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":8},{"gid":24469,"name":"i","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":10}],"filesystems":[{"mdsmap":{"epoch":17,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:47:31.021108+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":24473},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":24473,"qdb_cluster":[24473]},"id":1}]} 2024-08-02T18:47:37.695 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 17 2024-08-02T18:47:37.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5db40a2b80 msgr2=0x7f5db40a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:37.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5db40a2b80 0x7f5db40a5040 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f5dc00058c0 tx=0x7f5dc0005850 comp rx=0 tx=0).stop 2024-08-02T18:47:37.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc1018c0 msgr2=0x7f5dcc074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:37.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc1018c0 0x7f5dcc074220 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f5dbc00e9f0 tx=0x7f5dbc00eeb0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 shutdown_connections 2024-08-02T18:47:37.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5db40a2b80 0x7f5db40a5040 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dcc1078c0 0x7f5dcc074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dcc102260 0x7f5dcc074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 --2- 172.21.15.103:0/290345866 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dcc1018c0 0x7f5dcc074220 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 >> 172.21.15.103:0/290345866 conn(0x7f5dcc0fd5e0 msgr2=0x7f5dcc0fdc30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.695+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 shutdown_connections 2024-08-02T18:47:37.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:37.696+0000 7f5dd25f7640 1 -- 172.21.15.103:0/290345866 wait complete. 2024-08-02T18:47:38.414 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:47:38.666 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:38.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:38 smithi121 ceph-mon[37236]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:38.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:38 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/290345866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:38.787 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:38 smithi103 ceph-mon[32753]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:38.787 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:38 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/290345866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:38.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:38 smithi151 ceph-mon[37155]: pgmap v273: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:38.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:38 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/290345866' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:47:39.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 -- 172.21.15.103:0/1070986903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d01067b0 msgr2=0x7f06d0106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:39.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/1070986903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d01067b0 0x7f06d0106b90 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f06c4009930 tx=0x7f06c402a420 comp rx=0 tx=0).stop 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 -- 172.21.15.103:0/1070986903 shutdown_connections 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/1070986903 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d0101150 0x7f06d010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/1070986903 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d01007b0 0x7f06d0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/1070986903 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d01067b0 0x7f06d0106b90 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 -- 172.21.15.103:0/1070986903 >> 172.21.15.103:0/1070986903 conn(0x7f06d00fc4d0 msgr2=0x7f06d00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 -- 172.21.15.103:0/1070986903 shutdown_connections 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.174+0000 7f06d6b0c640 1 -- 172.21.15.103:0/1070986903 wait complete. 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d6b0c640 1 Processor -- start 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d6b0c640 1 -- start start 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d6b0c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d01007b0 0x7f06d0102380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:39.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d6b0c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d0101150 0x7f06d01028c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d6b0c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d01067b0 0x7f06d0102e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d6b0c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f06d0110d10 con 0x7f06d0101150 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d6b0c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f06d0110b90 con 0x7f06d01067b0 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d6b0c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f06d0110e90 con 0x7f06d01007b0 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d0101150 0x7f06d01028c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06cffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d0101150 0x7f06d01028c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49036/0 (socket says 172.21.15.103:49036) 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06cffff640 1 -- 172.21.15.103:0/2951380986 learned_addr learned my addr 172.21.15.103:0/2951380986 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d48a8640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d01007b0 0x7f06d0102380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06d50a9640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d01067b0 0x7f06d0102e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06cffff640 1 -- 172.21.15.103:0/2951380986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d01007b0 msgr2=0x7f06d0102380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06cffff640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d01007b0 0x7f06d0102380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.175+0000 7f06cffff640 1 -- 172.21.15.103:0/2951380986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d01067b0 msgr2=0x7f06d0102e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:39.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06cffff640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d01067b0 0x7f06d0102e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06cffff640 1 -- 172.21.15.103:0/2951380986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f06d01a66c0 con 0x7f06d0101150 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06d48a8640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d01007b0 0x7f06d0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06d50a9640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d01067b0 0x7f06d0102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06cffff640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d0101150 0x7f06d01028c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00c920 tx=0x7f06bc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06cdffb640 1 -- 172.21.15.103:0/2951380986 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc007c70 con 0x7f06d0101150 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f06d01a69b0 con 0x7f06d0101150 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06cdffb640 1 -- 172.21.15.103:0/2951380986 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f06bc007e10 con 0x7f06d0101150 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06cdffb640 1 -- 172.21.15.103:0/2951380986 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f06bc018940 con 0x7f06d0101150 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.176+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f06d01a6ef0 con 0x7f06d0101150 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.177+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f06d0100c10 con 0x7f06d0101150 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.178+0000 7f06cdffb640 1 -- 172.21.15.103:0/2951380986 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f06bc018b20 con 0x7f06d0101150 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.179+0000 7f06cdffb640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f06c00a2b80 0x7f06c00a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.179+0000 7f06d48a8640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f06c00a2b80 0x7f06c00a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:39.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.179+0000 7f06cdffb640 1 -- 172.21.15.103:0/2951380986 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f06bc0cf4d0 con 0x7f06d0101150 2024-08-02T18:47:39.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.179+0000 7f06d48a8640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f06c00a2b80 0x7f06c00a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f06c4000c00 tx=0x7f06c4032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:39.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.183+0000 7f06cdffb640 1 -- 172.21.15.103:0/2951380986 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f06bc014030 con 0x7f06d0101150 2024-08-02T18:47:39.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.350+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f06d01a7180 con 0x7f06d0101150 2024-08-02T18:47:39.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.352+0000 7f06cdffb640 1 -- 172.21.15.103:0/2951380986 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24173 (secure 0 0 0) 0x7f06bc00de20 con 0x7f06d0101150 2024-08-02T18:47:39.353 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:39.353 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:47:31.020978+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f06c00a2b80 msgr2=0x7f06c00a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f06c00a2b80 0x7f06c00a5040 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f06c4000c00 tx=0x7f06c4032d60 comp rx=0 tx=0).stop 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d0101150 msgr2=0x7f06d01028c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d0101150 0x7f06d01028c0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f06bc00c920 tx=0x7f06bc00cde0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 shutdown_connections 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f06d01067b0 0x7f06d0102e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f06d0101150 0x7f06d01028c0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f06c00a2b80 0x7f06c00a5040 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 --2- 172.21.15.103:0/2951380986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f06d01007b0 0x7f06d0102380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 >> 172.21.15.103:0/2951380986 conn(0x7f06d00fc4d0 msgr2=0x7f06d00fe1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 shutdown_connections 2024-08-02T18:47:39.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:39.354+0000 7f06d6b0c640 1 -- 172.21.15.103:0/2951380986 wait complete. 2024-08-02T18:47:39.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:39 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2951380986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:39.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:39 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2951380986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:39.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:39 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2951380986' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:40.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 17, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-08-02T18:47:22.067716+0000', 'modified': '2024-08-02T18:47:31.021108+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 24473}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.121:6839/3512573309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3512573309}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3512573309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 24473, 'qdb_cluster': [24473]} 2024-08-02T18:47:40.040 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-08-02T18:47:40.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.b status 2024-08-02T18:47:40.292 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:40.698 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:40 smithi103 ceph-mon[32753]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:40 smithi121 ceph-mon[37236]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/1886452810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14106790 msgr2=0x7f6f14106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/1886452810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14106790 0x7f6f14106b70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6f08009930 tx=0x7f6f0802a420 comp rx=0 tx=0).stop 2024-08-02T18:47:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/1886452810 shutdown_connections 2024-08-02T18:47:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/1886452810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f14101130 0x7f6f1410d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/1886452810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f14100790 0x7f6f14100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/1886452810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14106790 0x7f6f14106b70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/1886452810 >> 172.21.15.103:0/1886452810 conn(0x7f6f140fc4b0 msgr2=0x7f6f140fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:40.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/1886452810 shutdown_connections 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/1886452810 wait complete. 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 Processor -- start 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- start start 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f14100790 0x7f6f141990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14101130 0x7f6f14199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f14106790 0x7f6f141a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f14110cf0 con 0x7f6f14101130 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f14110b70 con 0x7f6f14106790 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.777+0000 7f6f1b1c1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6f14110e70 con 0x7f6f14100790 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14101130 0x7f6f14199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14101130 0x7f6f14199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49058/0 (socket says 172.21.15.103:49058) 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 -- 172.21.15.103:0/35516262 learned_addr learned my addr 172.21.15.103:0/35516262 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:40.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f14100790 0x7f6f141990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f1975e640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f14106790 0x7f6f141a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 -- 172.21.15.103:0/35516262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f14100790 msgr2=0x7f6f141990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f14100790 0x7f6f141990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 -- 172.21.15.103:0/35516262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f14106790 msgr2=0x7f6f141a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f14106790 0x7f6f141a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 -- 172.21.15.103:0/35516262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f141a4680 con 0x7f6f14101130 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f13fff640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14101130 0x7f6f14199600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c890 tx=0x7f6f0000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f11ffb640 1 -- 172.21.15.103:0/35516262 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00004220 con 0x7f6f14101130 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f11ffb640 1 -- 172.21.15.103:0/35516262 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f000043c0 con 0x7f6f14101130 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f11ffb640 1 -- 172.21.15.103:0/35516262 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00004b10 con 0x7f6f14101130 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.778+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/35516262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f141a4850 con 0x7f6f14101130 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.779+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/35516262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f141a4d60 con 0x7f6f14101130 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f11ffb640 1 -- 172.21.15.103:0/35516262 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f6f000051b0 con 0x7f6f14101130 2024-08-02T18:47:40.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f1d5bf740 1 Processor -- start 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f1d5bf740 1 -- start start 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab2a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abfc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563ac5a17710 con 0x563ac5abd810 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563ac59af770 con 0x563ac5ab2630 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563ac5a136d0 con 0x563ac5ab2f50 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f11ffb640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f040a2b80 0x7f6f040a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.781+0000 7f6f13fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abfc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f13fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abfc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49070/0 (socket says 172.21.15.103:49070) 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f13fff640 1 -- 172.21.15.103:0/1119928325 learned_addr learned my addr 172.21.15.103:0/1119928325 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f1975e640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f040a2b80 0x7f6f040a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f1975e640 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab2a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f11ffb640 1 -- 172.21.15.103:0/35516262 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f6f000cf250 con 0x7f6f14101130 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f13fff640 1 -- 172.21.15.103:0/1119928325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 msgr2=0x563ac5abd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f13fff640 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abd2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f13fff640 1 -- 172.21.15.103:0/1119928325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 msgr2=0x563ac5ab2a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f13fff640 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab2a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f13fff640 1 -- 172.21.15.103:0/1119928325 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac59b63e0 con 0x563ac5abd810 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f13fff640 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abfc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f000982f0 tx=0x7f6f0001b000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15627d9c14bf7aae server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6f1975e640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f040a2b80 0x7f6f040a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009fd0 tx=0x7f6f0c009c30 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6efeffd640 1 -- 172.21.15.103:0/1119928325 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0001d050 con 0x563ac5abd810 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6efeffd640 1 -- 172.21.15.103:0/1119928325 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f000a6d20 con 0x563ac5abd810 2024-08-02T18:47:40.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.782+0000 7f6efeffd640 1 -- 172.21.15.103:0/1119928325 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f00099cb0 con 0x563ac5abd810 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1119928325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 msgr2=0x563ac5abfc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abfc00 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f6f000982f0 tx=0x7f6f0001b000 comp rx=0 tx=0).stop 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1119928325 shutdown_connections 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abfc00 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/1119928325 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab2a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1119928325 >> 172.21.15.103:0/1119928325 conn(0x563ac5aaebc0 msgr2=0x563ac5aaefa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1119928325 shutdown_connections 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1119928325 wait complete. 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 -- start start 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.783+0000 7f6f1d5bf740 1 Processor -- start 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5aba710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abac50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abb190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563ac5ac03e0 con 0x563ac5abd810 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563ac59d2970 con 0x563ac5ab2630 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563ac5ac0560 con 0x563ac5ab2f50 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1d5bf740 10 client.0 _ll_register_callbacks cb 0x563ac57267b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1975e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1975e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abb190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49076/0 (socket says 172.21.15.103:49076) 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1975e640 1 -- 172.21.15.103:0/196201760 learned_addr learned my addr 172.21.15.103:0/196201760 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f13fff640 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5aba710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1975e640 1 -- 172.21.15.103:0/196201760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 msgr2=0x563ac5abac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1975e640 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1975e640 1 -- 172.21.15.103:0/196201760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 msgr2=0x563ac5aba710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1975e640 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5aba710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.784+0000 7f6f1975e640 1 -- 172.21.15.103:0/196201760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ac57892b0 con 0x563ac5abd810 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1975e640 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abb190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c01a6d0 tx=0x7f6f0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c05143d9ad393f21 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6ef3fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6ef3fff640 1 -- 172.21.15.103:0/196201760 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c02a060 con 0x563ac5abd810 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6ef3fff640 1 -- 172.21.15.103:0/196201760 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f6f0c022750 con 0x563ac5abd810 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/196201760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f000a6d20 con 0x563ac5abd810 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6ef3fff640 1 -- 172.21.15.103:0/196201760 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6f0c014040 con 0x563ac5abd810 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 10 client.14727 fetch_fsmap learned FSMap version 17 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/196201760 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x563ac5acc010 con 0x563ac5abd810 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6ef3fff640 1 -- 172.21.15.103:0/196201760 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f000a6d20 con 0x563ac5abd810 2024-08-02T18:47:40.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6ef3fff640 1 -- 172.21.15.103:0/196201760 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f6f0c024070 con 0x563ac5abd810 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 10 client.14727 fetch_fsmap finished waiting for FSMap version 17 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 10 client.14727 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 20 client.14727 populate_metadata read hostname 'smithi103' 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563ac5ace670 0x563ac5acfae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 4 client.14727 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.785+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/196201760 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563ac5a24c80 con 0x563ac5ace670 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.786+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563ac5ace670 0x563ac5acfae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.786+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563ac5ace670 0x563ac5acfae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5d457b540433088d server_cookie=4a579ed1539a2e44 in_seq=0 out_seq=0 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.786+0000 7f6ef3fff640 10 client.14727 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:47:40.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6ef3fff640 1 -- 172.21.15.103:0/196201760 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563ac5a24c80 con 0x563ac5ace670 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6ef3fff640 10 client.14727 handle_command_reply: tid=0 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 client.14727 shutdown 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/196201760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 msgr2=0x563ac5abb190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abb190 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c01a6d0 tx=0x7f6f0c004a40 comp rx=0 tx=0).stop 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/196201760 shutdown_connections 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563ac5ace670 0x563ac5acfae0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5abb190 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5abac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/196201760 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5aba710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6ef3fff640 0 client.14727 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:47:40.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/196201760 >> 172.21.15.103:0/196201760 conn(0x563ac5aaebc0 msgr2=0x563ac5aadd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:40.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.787+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/196201760 shutdown_connections 2024-08-02T18:47:40.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.788+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/196201760 wait complete. 2024-08-02T18:47:40.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.788+0000 7f6f1d5bf740 20 client.14727 trim_cache size 0 max 16384 2024-08-02T18:47:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.805+0000 7f6f1d5bf740 1 Processor -- start 2024-08-02T18:47:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.805+0000 7f6f1d5bf740 1 -- start start 2024-08-02T18:47:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.805+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ad81b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.805+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5ab2f50 0x563ac5ab9000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.805+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5abd810 0x563ac5ab9540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563ac5acde20 con 0x563ac5ab2f50 2024-08-02T18:47:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563ac5ace4f0 con 0x563ac5ab2630 2024-08-02T18:47:40.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563ac5acebc0 con 0x563ac5abd810 2024-08-02T18:47:40.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5ab2f50 0x563ac5ab9000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5ab2f50 0x563ac5ab9000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49080/0 (socket says 172.21.15.103:49080) 2024-08-02T18:47:40.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 -- 172.21.15.103:0/1221535824 learned_addr learned my addr 172.21.15.103:0/1221535824 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f1975e640 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5abd810 0x563ac5ab9540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 -- 172.21.15.103:0/1221535824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5abd810 msgr2=0x563ac5ab9540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ad81b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5abd810 0x563ac5ab9540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 -- 172.21.15.103:0/1221535824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 msgr2=0x563ac5ad81b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ad81b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 -- 172.21.15.103:0/1221535824 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563ac5aaa130 con 0x563ac5ab2f50 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f1975e640 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5abd810 0x563ac5ab9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:40.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6f13fff640 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5ab2f50 0x563ac5ab9000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f000ccb60 tx=0x7f6f000cf170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ca61208e33d894b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6efe7fc640 1 -- 172.21.15.103:0/1221535824 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f000a44e0 con 0x563ac5ab2f50 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6efe7fc640 1 -- 172.21.15.103:0/1221535824 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f0009fc20 con 0x563ac5ab2f50 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.806+0000 7f6efe7fc640 1 -- 172.21.15.103:0/1221535824 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f000a4050 con 0x563ac5ab2f50 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1221535824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5ab2f50 msgr2=0x563ac5ab9000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5ab2f50 0x563ac5ab9000 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6f000ccb60 tx=0x7f6f000cf170 comp rx=0 tx=0).stop 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1221535824 shutdown_connections 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5abd810 0x563ac5ab9540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5ab2f50 0x563ac5ab9000 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/1221535824 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ad81b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1221535824 >> 172.21.15.103:0/1221535824 conn(0x563ac5aaebc0 msgr2=0x563ac5ab5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:40.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1221535824 shutdown_connections 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/1221535824 wait complete. 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 -- start start 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.807+0000 7f6f1d5bf740 1 Processor -- start 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab7fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5ab6a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1d5bf740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5ab6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563ac5acf960 con 0x563ac5abd810 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563ac5acf290 con 0x563ac5ab2630 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1d5bf740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563ac5ad0030 con 0x563ac5ab2f50 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1d5bf740 10 client.0 _ll_register_callbacks cb 0x7f6f0c00b670 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:47:40.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5ab6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5ab6fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49092/0 (socket says 172.21.15.103:49092) 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 -- 172.21.15.103:0/4066768032 learned_addr learned my addr 172.21.15.103:0/4066768032 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab7fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f13fff640 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5ab6a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 -- 172.21.15.103:0/4066768032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 msgr2=0x563ac5ab6a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5ab6a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 -- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 msgr2=0x563ac5ab7fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab7fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 -- 172.21.15.103:0/4066768032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563ac5ab7500 con 0x563ac5abd810 2024-08-02T18:47:40.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6f1975e640 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5ab6fc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c025a30 tx=0x7f6f0c022800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e39b633d4eb6a23c server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.808+0000 7f6ef3fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6ef3fff640 1 -- 172.21.15.103:0/4066768032 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f0c03b020 con 0x563ac5abd810 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6ef3fff640 1 -- 172.21.15.103:0/4066768032 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f6f0c022e00 con 0x563ac5abd810 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/4066768032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f0009fc20 con 0x563ac5abd810 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6ef3fff640 1 -- 172.21.15.103:0/4066768032 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f6f0c02a040 con 0x563ac5abd810 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 10 client.14733 fetch_fsmap learned FSMap version 17 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/4066768032 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=17,monmap=4+}) -- 0x563ac5b3ca70 con 0x563ac5abd810 2024-08-02T18:47:40.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6ef3fff640 1 -- 172.21.15.103:0/4066768032 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f0009fc20 con 0x563ac5abd810 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6ef3fff640 1 -- 172.21.15.103:0/4066768032 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 17) ==== 8350+0+0 (secure 0 0 0) 0x7f6f0c024040 con 0x563ac5abd810 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 10 client.14733 fetch_fsmap finished waiting for FSMap version 17 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 10 client.14733 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 20 client.14733 populate_metadata read hostname 'smithi103' 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563ac5b41700 0x563ac5b40410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 4 client.14733 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.809+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/4066768032 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "status"}) -- 0x563ac5a1f190 con 0x563ac5b41700 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563ac5b41700 0x563ac5b40410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6ef3fff640 10 client.14733 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:47:40.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f18f5d640 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563ac5b41700 0x563ac5b40410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e9bfc8d1b53702f6 server_cookie=43fcc9a002407496 in_seq=0 out_seq=0 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6ef3fff640 1 -- 172.21.15.103:0/4066768032 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x563ac5a1f190 con 0x563ac5b41700 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6ef3fff640 10 client.14733 handle_command_reply: tid=0 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 client.14733 shutdown 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/4066768032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 msgr2=0x563ac5ab6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5ab6fc0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c025a30 tx=0x7f6f0c022800 comp rx=0 tx=0).stop 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/4066768032 shutdown_connections 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563ac5b41700 0x563ac5b40410 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563ac5abd810 0x563ac5ab6fc0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563ac5ab2f50 0x563ac5ab6a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 --2- 172.21.15.103:0/4066768032 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563ac5ab2630 0x563ac5ab7fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/4066768032 >> 172.21.15.103:0/4066768032 conn(0x563ac5aaebc0 msgr2=0x563ac5ab8c00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:40.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.810+0000 7f6ef3fff640 0 client.14733 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:47:40.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/4066768032 shutdown_connections 2024-08-02T18:47:40.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1d5bf740 1 -- 172.21.15.103:0/4066768032 wait complete. 2024-08-02T18:47:40.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1d5bf740 20 client.14733 trim_cache size 0 max 16384 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24473, 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 18.495378801000001, 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 17, 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 87, 2024-08-02T18:47:40.826 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-08-02T18:47:40.827 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 29.188513488000002 2024-08-02T18:47:40.827 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:47:40.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f040a2b80 msgr2=0x7f6f040a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f040a2b80 0x7f6f040a5040 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6f0c009fd0 tx=0x7f6f0c009c30 comp rx=0 tx=0).stop 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14101130 msgr2=0x7f6f14199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14101130 0x7f6f14199600 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f6f0000c890 tx=0x7f6f0000cd50 comp rx=0 tx=0).stop 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/35516262 shutdown_connections 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f14106790 0x7f6f141a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f14101130 0x7f6f14199600 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6f040a2b80 0x7f6f040a5040 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 --2- 172.21.15.103:0/35516262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f14100790 0x7f6f141990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/35516262 >> 172.21.15.103:0/35516262 conn(0x7f6f140fc4b0 msgr2=0x7f6f140fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/35516262 shutdown_connections 2024-08-02T18:47:40.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:40.811+0000 7f6f1b1c1640 1 -- 172.21.15.103:0/35516262 wait complete. 2024-08-02T18:47:40.829 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:40 smithi151 ceph-mon[37155]: pgmap v274: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:41.506 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-02T18:47:41.506 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-02T18:47:41.506 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs ls 2024-08-02T18:47:41.758 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.285+0000 7f3a9dec2640 1 -- 172.21.15.103:0/892464163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a981067a0 msgr2=0x7f3a98106b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.285+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/892464163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a981067a0 0x7f3a98106b80 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009930 tx=0x7f3a8802a420 comp rx=0 tx=0).stop 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 -- 172.21.15.103:0/892464163 shutdown_connections 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/892464163 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a98101140 0x7f3a9810d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/892464163 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a981007a0 0x7f3a98100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/892464163 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a981067a0 0x7f3a98106b80 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 -- 172.21.15.103:0/892464163 >> 172.21.15.103:0/892464163 conn(0x7f3a980fc4c0 msgr2=0x7f3a980fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 -- 172.21.15.103:0/892464163 shutdown_connections 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 -- 172.21.15.103:0/892464163 wait complete. 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 Processor -- start 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.286+0000 7f3a9dec2640 1 -- start start 2024-08-02T18:47:42.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a9dec2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a981007a0 0x7f3a98198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a9dec2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a98101140 0x7f3a981987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a9dec2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a981067a0 0x7f3a9819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a9dec2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98110cc0 con 0x7f3a98101140 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a9dec2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98110b40 con 0x7f3a981007a0 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a9dec2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3a98110e40 con 0x7f3a981067a0 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a98101140 0x7f3a981987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a98101140 0x7f3a981987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49110/0 (socket says 172.21.15.103:49110) 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 -- 172.21.15.103:0/1450690339 learned_addr learned my addr 172.21.15.103:0/1450690339 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a977fe640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a981007a0 0x7f3a98198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a97fff640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a981067a0 0x7f3a9819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 -- 172.21.15.103:0/1450690339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a981067a0 msgr2=0x7f3a9819cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a981067a0 0x7f3a9819cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 -- 172.21.15.103:0/1450690339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a981007a0 msgr2=0x7f3a98198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a981007a0 0x7f3a98198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 -- 172.21.15.103:0/1450690339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a9819d240 con 0x7f3a98101140 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a96ffd640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a98101140 0x7f3a981987d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000c920 tx=0x7f3a8000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a94ff9640 1 -- 172.21.15.103:0/1450690339 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80007c70 con 0x7f3a98101140 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a94ff9640 1 -- 172.21.15.103:0/1450690339 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3a80007e10 con 0x7f3a98101140 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a94ff9640 1 -- 172.21.15.103:0/1450690339 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a80018940 con 0x7f3a98101140 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a9819d530 con 0x7f3a98101140 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.287+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a981a4e10 con 0x7f3a98101140 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.289+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a98100c00 con 0x7f3a98101140 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.290+0000 7f3a94ff9640 1 -- 172.21.15.103:0/1450690339 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3a80018b20 con 0x7f3a98101140 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.290+0000 7f3a94ff9640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3a840a2c00 0x7f3a840a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.290+0000 7f3a977fe640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3a840a2c00 0x7f3a840a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:42.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.291+0000 7f3a94ff9640 1 -- 172.21.15.103:0/1450690339 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f3a800cf220 con 0x7f3a98101140 2024-08-02T18:47:42.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.291+0000 7f3a977fe640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3a840a2c00 0x7f3a840a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009900 tx=0x7f3a880058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:42.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.295+0000 7f3a94ff9640 1 -- 172.21.15.103:0/1450690339 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3a80014030 con 0x7f3a98101140 2024-08-02T18:47:42.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.499+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f3a9802d5e0 con 0x7f3a98101140 2024-08-02T18:47:42.501 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:42 smithi103 ceph-mon[32753]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:42.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.499+0000 7f3a94ff9640 1 -- 172.21.15.103:0/1450690339 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v17) ==== 53+0+88 (secure 0 0 0) 0x7f3a8009bfe0 con 0x7f3a98101140 2024-08-02T18:47:42.501 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-02T18:47:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3a840a2c00 msgr2=0x7f3a840a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3a840a2c00 0x7f3a840a50c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f3a88009900 tx=0x7f3a880058d0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a98101140 msgr2=0x7f3a981987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a98101140 0x7f3a981987d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3a8000c920 tx=0x7f3a8000cde0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 shutdown_connections 2024-08-02T18:47:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3a840a2c00 0x7f3a840a50c0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3a981067a0 0x7f3a9819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3a98101140 0x7f3a981987d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 --2- 172.21.15.103:0/1450690339 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3a981007a0 0x7f3a98198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.501+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 >> 172.21.15.103:0/1450690339 conn(0x7f3a980fc4c0 msgr2=0x7f3a9806a800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.502+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 shutdown_connections 2024-08-02T18:47:42.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:42.502+0000 7f3a9dec2640 1 -- 172.21.15.103:0/1450690339 wait complete. 2024-08-02T18:47:42.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:42 smithi121 ceph-mon[37236]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:42.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:42 smithi151 ceph-mon[37155]: pgmap v275: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:43.167 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-08-02T18:47:43.167 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-02T18:47:43.168 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-08-02T18:47:43.168 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-08-02T18:47:43.168 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-08-02T18:47:43.168 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-08-02T18:47:43.168 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-02T18:47:43.168 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-02T18:47:43.168 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-08-02T18:47:43.168 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:43.169 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-08-02T18:47:43.186 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42281sec preferred_lft 42281sec 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-08-02T18:47:43.187 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-02T18:47:43.188 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-02T18:47:43.188 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:47:43.188 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:47:43.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-08-02T18:47:43.188 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-08-02T18:47:43.189 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-08-02T18:47:43.189 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-02T18:47:43.189 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:47:43.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:47:43.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:47:43.385 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:43.385 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-02T18:47:43.411 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-08-02T18:47:43.413 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:43.413 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-08-02T18:47:43.476 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-08-02T18:47:43.476 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-02T18:47:43.476 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-02T18:47:43.476 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-02T18:47:43.476 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-02T18:47:43.477 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:47:43.477 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:47:43.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-02T18:47:43.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-02T18:47:43.477 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-02T18:47:43.477 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:47:43.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:47:43.573 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:43 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1450690339' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-02T18:47:43.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:43 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1450690339' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-02T18:47:43.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:47:43.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:43.759 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-02T18:47:43.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:43.777 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-08-02T18:47:43.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:43 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1450690339' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-02T18:47:43.831 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:47:43.831 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:47:43.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-02T18:47:43.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-08-02T18:47:43.832 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:47:43.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:43 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:47:43.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:43 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:47:43.953 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-08-02T18:47:43.954 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:47:43.954 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:47:43.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-08-02T18:47:43.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-02T18:47:43.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-08-02T18:47:43.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-08-02T18:47:43.954 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-08-02T18:47:43.954 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:47:44.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:47:44.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:47:44.083 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:47:44.083 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:47:44.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-08-02T18:47:44.083 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-08-02T18:47:44.083 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:47:44.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:44 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:47:44.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:47:44.160 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-08-02T18:47:44.161 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-02T18:47:44.161 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-08-02T18:47:44.176 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-08-02T18:47:44.176 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-02T18:47:44.176 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-08-02T18:47:44.232 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-02T18:47:44.297 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-02T18:47:44.354 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-02T18:47:44.354 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-02T18:47:44.355 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-02T18:47:44.356 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-02T18:47:44.357 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-02T18:47:44.357 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-08-02T18:47:44.357 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/ed09b2522d69f682128099f150cdc760c32189a8679f8765a148cfddbbf3bc84/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/a15630e4ddeb5bbb7916f153e9e5d505b3f332f9c1ea9a48bf6b6ae459c56727/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3118c8eb561b0b1d13e4f5066540fc305aaff97b4769f510924fe8191432892c/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/c4012e2155d1401851a4fdfe6afd5693285177a0003c65c95bf1d4eaf9ada626/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/cb19b6cef98f950f86fce9d924545e718cfafab1f9c94a9549f23218579de1b4/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/af99fe687f18f3630603662dba96a562ff4d15382cd33a2f39cae6657fc06526/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/190980413da39d389effe85cbebc95daf61e9b6c0b8db49930d1d74a4d39eded/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/094ada1a4cb6d028b0bcdbc3854bdba1dbefda5073409cad74c98d4a79e8644f/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/53c4e172a8adbd4f3665b632af44942cbd0983afc9750c07ca9b3ac72d0d4f7d/merged 2024-08-02T18:47:44.358 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/80c7dffb7a220cdcf2a7dd599086ada20e3d40a51009beeaed8de3fae28c18f7/merged 2024-08-02T18:47:44.359 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-02T18:47:44.359 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-02T18:47:44.359 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-02T18:47:44.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:44.359 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-02T18:47:44.411 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-08-02T18:47:44.412 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-08-02T18:47:44.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo modprobe fuse 2024-08-02T18:47:44.479 DEBUG:teuthology.orchestra.run.smithi103:> cat /proc/self/mounts | awk '{print $2}' 2024-08-02T18:47:44.535 INFO:teuthology.orchestra.run.smithi103.stdout:/proc 2024-08-02T18:47:44.535 INFO:teuthology.orchestra.run.smithi103.stdout:/sys 2024-08-02T18:47:44.535 INFO:teuthology.orchestra.run.smithi103.stdout:/dev 2024-08-02T18:47:44.535 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/security 2024-08-02T18:47:44.535 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/shm 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/pts 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/run 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/cgroup 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/pstore 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/bpf 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/ 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/selinux 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/mqueue 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/dev/hugepages 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/debug 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/tracing 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/fs/fuse/connections 2024-08-02T18:47:44.536 INFO:teuthology.orchestra.run.smithi103.stdout:/sys/kernel/config 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-sysctl.service 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup-dev.service 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/run/credentials/systemd-tmpfiles-setup.service 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/nfs/rpc_pipefs 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/1000 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/ceph 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/ed09b2522d69f682128099f150cdc760c32189a8679f8765a148cfddbbf3bc84/merged 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/a15630e4ddeb5bbb7916f153e9e5d505b3f332f9c1ea9a48bf6b6ae459c56727/merged 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/run/user/0 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/proc/sys/fs/binfmt_misc 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/3118c8eb561b0b1d13e4f5066540fc305aaff97b4769f510924fe8191432892c/merged 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/c4012e2155d1401851a4fdfe6afd5693285177a0003c65c95bf1d4eaf9ada626/merged 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/cb19b6cef98f950f86fce9d924545e718cfafab1f9c94a9549f23218579de1b4/merged 2024-08-02T18:47:44.537 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/af99fe687f18f3630603662dba96a562ff4d15382cd33a2f39cae6657fc06526/merged 2024-08-02T18:47:44.538 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/190980413da39d389effe85cbebc95daf61e9b6c0b8db49930d1d74a4d39eded/merged 2024-08-02T18:47:44.538 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/094ada1a4cb6d028b0bcdbc3854bdba1dbefda5073409cad74c98d4a79e8644f/merged 2024-08-02T18:47:44.538 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/53c4e172a8adbd4f3665b632af44942cbd0983afc9750c07ca9b3ac72d0d4f7d/merged 2024-08-02T18:47:44.538 INFO:teuthology.orchestra.run.smithi103.stdout:/var/lib/containers/storage/overlay/80c7dffb7a220cdcf2a7dd599086ada20e3d40a51009beeaed8de3fae28c18f7/merged 2024-08-02T18:47:44.538 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns 2024-08-02T18:47:44.538 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-02T18:47:44.538 INFO:teuthology.orchestra.run.smithi103.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-02T18:47:44.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:44.538 DEBUG:teuthology.orchestra.run.smithi103:> ls /sys/fs/fuse/connections 2024-08-02T18:47:44.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:2024-08-02T18:47:44.561+0000 7ffa43fd3480 -1 init, newargv = 0x564b012fba80 newargc=15 2024-08-02T18:47:44.563 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[77618]: starting ceph client 2024-08-02T18:47:44.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[77618]: starting fuse 2024-08-02T18:47:44.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:44 smithi103 ceph-mon[32753]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:44.578 INFO:teuthology.orchestra.run.smithi103.stdout:119 2024-08-02T18:47:44.578 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [119] 2024-08-02T18:47:44.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo stdin-killer -- python3 -c ' 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> import glob 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> import re 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> import os 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> import subprocess 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> def _find_admin_socket(client_name): 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> files = glob.glob(asok_path) 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> # Given a non-glob path, it better be there 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> if "*" not in asok_path: 2024-08-02T18:47:44.579 DEBUG:teuthology.orchestra.run.smithi103:> assert(len(files) == 1) 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> return files[0] 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> for f in files: 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> if os.path.exists("/proc/{0}".format(pid)): 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> contents = proc_f.read() 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> if mountpoint in contents: 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> return f 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> print(_find_admin_socket("client.admin")) 2024-08-02T18:47:44.580 DEBUG:teuthology.orchestra.run.smithi103:> ' 2024-08-02T18:47:44.697 INFO:teuthology.orchestra.run.smithi103.stdout:/var/run/ceph/ceph-client.admin.77618.asok 2024-08-02T18:47:44.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:44 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:47:44.708 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.77618.asok 2024-08-02T18:47:44.708 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:44.708 DEBUG:teuthology.orchestra.run.smithi103:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.77618.asok status 2024-08-02T18:47:44.721 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:44 smithi151 ceph-mon[37155]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:44.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:44 smithi121 ceph-mon[37236]: pgmap v276: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:44.843 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:47:44.843 INFO:teuthology.orchestra.run.smithi103.stdout: "metadata": { 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_sha1": "26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea", 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_version": "ceph version 19.1.0-1260-g26c3fb8e (26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea) squid (rc)", 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "entity_id": "admin", 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": "smithi103", 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "pid": "77618", 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "root": "/" 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_count": 0, 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "dentry_pinned_count": 0, 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 14745, 2024-08-02T18:47:44.844 INFO:teuthology.orchestra.run.smithi103.stdout: "inst": { 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "name": { 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "client", 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "num": 14745 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 929811780 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": { 2024-08-02T18:47:44.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "192.168.0.1:0", 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 929811780 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "inst_str": "client.14745 192.168.0.1:0/929811780", 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "addr_str": "192.168.0.1:0/929811780", 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "inode_count": 1, 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_epoch": 17, 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch": 87, 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_epoch_barrier": 0, 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "blocklisted": false, 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs" 2024-08-02T18:47:44.846 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:47:44.852 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:44.852 DEBUG:teuthology.orchestra.run.smithi103:> stat --file-system '--printf=%T 2024-08-02T18:47:44.852 DEBUG:teuthology.orchestra.run.smithi103:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-08-02T18:47:44.868 INFO:teuthology.orchestra.run.smithi103.stdout:fuseblk 2024-08-02T18:47:44.869 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-08-02T18:47:44.869 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:44.869 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-08-02T18:47:44.935 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-08-02T18:47:45.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-02T18:47:45.045 INFO:teuthology.orchestra.run.smithi103.stdout:# file: . 2024-08-02T18:47:45.045 INFO:teuthology.orchestra.run.smithi103.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-08-02T18:47:45.045 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:45.046 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:47:45.051 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:47:45.051 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-02T18:47:45.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd blocklist ls 2024-08-02T18:47:45.365 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 -- 172.21.15.103:0/3626654545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 msgr2=0x7fef50100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 --2- 172.21.15.103:0/3626654545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 0x7fef50100c10 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fef38009cd0 tx=0x7fef3802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 -- 172.21.15.103:0/3626654545 shutdown_connections 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 --2- 172.21.15.103:0/3626654545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef50101150 0x7fef5010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 --2- 172.21.15.103:0/3626654545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 0x7fef50100c10 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 --2- 172.21.15.103:0/3626654545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef501067b0 0x7fef50106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 -- 172.21.15.103:0/3626654545 >> 172.21.15.103:0/3626654545 conn(0x7fef500fc4d0 msgr2=0x7fef500fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 -- 172.21.15.103:0/3626654545 shutdown_connections 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.843+0000 7fef559fe640 1 -- 172.21.15.103:0/3626654545 wait complete. 2024-08-02T18:47:45.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef559fe640 1 Processor -- start 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef559fe640 1 -- start start 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef559fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 0x7fef50198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef559fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef50101150 0x7fef50198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef559fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef501067b0 0x7fef5019cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef559fe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fef50110d10 con 0x7fef501007b0 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef559fe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fef50110b90 con 0x7fef501067b0 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef559fe640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fef50110e90 con 0x7fef50101150 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef4effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 0x7fef50198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef4effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 0x7fef50198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49130/0 (socket says 172.21.15.103:49130) 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef4effd640 1 -- 172.21.15.103:0/1354475496 learned_addr learned my addr 172.21.15.103:0/1354475496 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.844+0000 7fef4e7fc640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef50101150 0x7fef50198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:45.888 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef4effd640 1 -- 172.21.15.103:0/1354475496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef50101150 msgr2=0x7fef50198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef4effd640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef50101150 0x7fef50198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef4f7fe640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef501067b0 0x7fef5019cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef4effd640 1 -- 172.21.15.103:0/1354475496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef501067b0 msgr2=0x7fef5019cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef4effd640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef501067b0 0x7fef5019cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef4effd640 1 -- 172.21.15.103:0/1354475496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef5019d2d0 con 0x7fef501007b0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef4effd640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 0x7fef50198320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef4800d950 tx=0x7fef4800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef549fc640 1 -- 172.21.15.103:0/1354475496 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef48017070 con 0x7fef501007b0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef549fc640 1 -- 172.21.15.103:0/1354475496 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fef48009c30 con 0x7fef501007b0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef5019d5c0 con 0x7fef501007b0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef549fc640 1 -- 172.21.15.103:0/1354475496 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef4800f740 con 0x7fef501007b0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.845+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef501a4ea0 con 0x7fef501007b0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.846+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef50100c10 con 0x7fef501007b0 2024-08-02T18:47:45.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.847+0000 7fef549fc640 1 -- 172.21.15.103:0/1354475496 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fef48010a80 con 0x7fef501007b0 2024-08-02T18:47:45.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.848+0000 7fef549fc640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fef3c0a2b80 0x7fef3c0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:45.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.848+0000 7fef4e7fc640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fef3c0a2b80 0x7fef3c0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:45.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.848+0000 7fef549fc640 1 -- 172.21.15.103:0/1354475496 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fef480cef10 con 0x7fef501007b0 2024-08-02T18:47:45.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.848+0000 7fef4e7fc640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fef3c0a2b80 0x7fef3c0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fef38006010 tx=0x7fef38031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:45.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:45.852+0000 7fef549fc640 1 -- 172.21.15.103:0/1354475496 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fef48009de0 con 0x7fef501007b0 2024-08-02T18:47:46.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.029+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fef50199680 con 0x7fef501007b0 2024-08-02T18:47:46.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.029+0000 7fef549fc640 1 -- 172.21.15.103:0/1354475496 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+599 (secure 0 0 0) 0x7fef4809bc30 con 0x7fef501007b0 2024-08-02T18:47:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2532430315 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/34686070 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1976977182 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:46.031 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3927889797 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2532430315 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/639519332 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1840770374 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2020700081 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2382390785 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:46.032 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2382390785 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:46.032 INFO:teuthology.orchestra.run.smithi103.stderr:listed 10 entries 2024-08-02T18:47:46.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.031+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fef3c0a2b80 msgr2=0x7fef3c0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:46.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.031+0000 7fef559fe640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fef3c0a2b80 0x7fef3c0a5040 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fef38006010 tx=0x7fef38031000 comp rx=0 tx=0).stop 2024-08-02T18:47:46.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.031+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 msgr2=0x7fef50198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:46.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.031+0000 7fef559fe640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 0x7fef50198320 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fef4800d950 tx=0x7fef4800de10 comp rx=0 tx=0).stop 2024-08-02T18:47:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.032+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 shutdown_connections 2024-08-02T18:47:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.032+0000 7fef559fe640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef501067b0 0x7fef5019cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.032+0000 7fef559fe640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fef3c0a2b80 0x7fef3c0a5040 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.032+0000 7fef559fe640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef50101150 0x7fef50198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.032+0000 7fef559fe640 1 --2- 172.21.15.103:0/1354475496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef501007b0 0x7fef50198320 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.032+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 >> 172.21.15.103:0/1354475496 conn(0x7fef500fc4d0 msgr2=0x7fef5006a760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.032+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 shutdown_connections 2024-08-02T18:47:46.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:46.032+0000 7fef559fe640 1 -- 172.21.15.103:0/1354475496 wait complete. 2024-08-02T18:47:46.708 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:46 smithi103 ceph-mon[32753]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:46.708 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:46 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1354475496' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T18:47:46.736 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:47:46.736 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-02T18:47:46.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:46 smithi121 ceph-mon[37236]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:46.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:46 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1354475496' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T18:47:46.753 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd blocklist ls 2024-08-02T18:47:46.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:46 smithi151 ceph-mon[37155]: pgmap v277: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:46.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:46 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1354475496' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T18:47:47.044 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 -- 172.21.15.103:0/191503858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 msgr2=0x7f3ddc10d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/191503858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 0x7f3ddc10d4d0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3dd4009cd0 tx=0x7f3dd402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 -- 172.21.15.103:0/191503858 shutdown_connections 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/191503858 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 0x7f3ddc10d4d0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/191503858 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ddc100600 0x7f3ddc100a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/191503858 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ddc106690 0x7f3ddc106a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 -- 172.21.15.103:0/191503858 >> 172.21.15.103:0/191503858 conn(0x7f3ddc0fc360 msgr2=0x7f3ddc0fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 -- 172.21.15.103:0/191503858 shutdown_connections 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 -- 172.21.15.103:0/191503858 wait complete. 2024-08-02T18:47:47.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 Processor -- start 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.499+0000 7f3de2d9d640 1 -- start start 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de2d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ddc100600 0x7f3ddc196d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 0x7f3ddc197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de2d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ddc106690 0x7f3ddc1977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de2d9d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc110b10 con 0x7f3ddc100fc0 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de2d9d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc110990 con 0x7f3ddc106690 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de2d9d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ddc110c90 con 0x7f3ddc100600 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 0x7f3ddc197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 0x7f3ddc197270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49148/0 (socket says 172.21.15.103:49148) 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 -- 172.21.15.103:0/1224230121 learned_addr learned my addr 172.21.15.103:0/1224230121 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de1d9b640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ddc100600 0x7f3ddc196d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de259c640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ddc106690 0x7f3ddc1977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:47.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 -- 172.21.15.103:0/1224230121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ddc100600 msgr2=0x7f3ddc196d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ddc100600 0x7f3ddc196d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 -- 172.21.15.103:0/1224230121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ddc106690 msgr2=0x7f3ddc1977b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ddc106690 0x7f3ddc1977b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 -- 172.21.15.103:0/1224230121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ddc1a65a0 con 0x7f3ddc100fc0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de159a640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 0x7f3ddc197270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000d770 tx=0x7f3dd000dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3dceffd640 1 -- 172.21.15.103:0/1224230121 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0017070 con 0x7f3ddc100fc0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ddc1a6890 con 0x7f3ddc100fc0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3dceffd640 1 -- 172.21.15.103:0/1224230121 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3dd0005520 con 0x7f3ddc100fc0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ddc1a6dd0 con 0x7f3ddc100fc0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.500+0000 7f3dceffd640 1 -- 172.21.15.103:0/1224230121 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3dd0010460 con 0x7f3ddc100fc0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.502+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3dc0005290 con 0x7f3ddc100fc0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.503+0000 7f3dceffd640 1 -- 172.21.15.103:0/1224230121 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3dd00046c0 con 0x7f3ddc100fc0 2024-08-02T18:47:47.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.503+0000 7f3dceffd640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3dc80a2c00 0x7f3dc80a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:47.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.503+0000 7f3de1d9b640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3dc80a2c00 0x7f3dc80a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:47.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.503+0000 7f3dceffd640 1 -- 172.21.15.103:0/1224230121 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f3dd00cec30 con 0x7f3ddc100fc0 2024-08-02T18:47:47.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.504+0000 7f3de1d9b640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3dc80a2c00 0x7f3dc80a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800bb60 tx=0x7f3dd800b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:47.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.507+0000 7f3dceffd640 1 -- 172.21.15.103:0/1224230121 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3dd009b950 con 0x7f3ddc100fc0 2024-08-02T18:47:47.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.687+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3dc0005580 con 0x7f3ddc100fc0 2024-08-02T18:47:47.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.688+0000 7f3dceffd640 1 -- 172.21.15.103:0/1224230121 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 10 entries v87) ==== 81+0+599 (secure 0 0 0) 0x7f3dd009b250 con 0x7f3ddc100fc0 2024-08-02T18:47:47.689 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2532430315 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:47.689 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/34686070 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:47.689 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1976977182 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:47.689 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3927889797 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:47.689 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2532430315 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:47.689 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/639519332 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:47.690 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1840770374 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:47.690 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2020700081 2024-08-03T18:41:05.260353+0000 2024-08-02T18:47:47.690 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2382390785 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:47.690 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2382390785 2024-08-03T18:40:42.170602+0000 2024-08-02T18:47:47.690 INFO:teuthology.orchestra.run.smithi103.stderr:listed 10 entries 2024-08-02T18:47:47.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3dc80a2c00 msgr2=0x7f3dc80a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:47.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3dc80a2c00 0x7f3dc80a50c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f3dd800bb60 tx=0x7f3dd800b390 comp rx=0 tx=0).stop 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 msgr2=0x7f3ddc197270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 0x7f3ddc197270 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f3dd000d770 tx=0x7f3dd000dc30 comp rx=0 tx=0).stop 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 shutdown_connections 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ddc106690 0x7f3ddc1977b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ddc100fc0 0x7f3ddc197270 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3dc80a2c00 0x7f3dc80a50c0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 --2- 172.21.15.103:0/1224230121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ddc100600 0x7f3ddc196d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 >> 172.21.15.103:0/1224230121 conn(0x7f3ddc0fc360 msgr2=0x7f3ddc0fd960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 shutdown_connections 2024-08-02T18:47:47.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:47.690+0000 7f3de2d9d640 1 -- 172.21.15.103:0/1224230121 wait complete. 2024-08-02T18:47:48.344 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi103.front.sepia.ceph.com... 2024-08-02T18:47:48.344 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:48.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-08-02T18:47:48.370 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi103.stderr:ceph-fuse[77618]: fuse finished with error 0 and tester_r 0 2024-08-02T18:47:48.371 INFO:teuthology.orchestra.run:waiting for 300 2024-08-02T18:47:48.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:48 smithi103 ceph-mon[32753]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:48.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:48 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1224230121' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T18:47:48.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:48 smithi121 ceph-mon[37236]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:48.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:48 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1224230121' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T18:47:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:48 smithi151 ceph-mon[37155]: pgmap v278: 129 pgs: 129 active+clean; 579 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:47:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:48 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1224230121' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T18:47:50.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:50 smithi121 ceph-mon[37236]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-02T18:47:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:50 smithi151 ceph-mon[37155]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-02T18:47:50.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:50 smithi103 ceph-mon[32753]: pgmap v279: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-02T18:47:52.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:52 smithi121 ceph-mon[37236]: pgmap v280: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-02T18:47:52.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:52 smithi151 ceph-mon[37155]: pgmap v280: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-02T18:47:52.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:52 smithi103 ceph-mon[32753]: pgmap v280: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 341 B/s wr, 0 op/s 2024-08-02T18:47:54.473 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:47:54.473 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:47:54.474 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-08-02T18:47:54.504 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:47:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:54 smithi121 ceph-mon[37236]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:54.804 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:54 smithi151 ceph-mon[37155]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:54 smithi103 ceph-mon[32753]: pgmap v281: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:55.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.317+0000 7f3581924640 1 -- 172.21.15.103:0/2722676481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c101130 msgr2=0x7f357c10d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:55.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.317+0000 7f3581924640 1 --2- 172.21.15.103:0/2722676481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c101130 0x7f357c10d660 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f3574009cd0 tx=0x7f357402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.317+0000 7f3581924640 1 -- 172.21.15.103:0/2722676481 shutdown_connections 2024-08-02T18:47:55.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.317+0000 7f3581924640 1 --2- 172.21.15.103:0/2722676481 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c101130 0x7f357c10d660 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.317+0000 7f3581924640 1 --2- 172.21.15.103:0/2722676481 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c100790 0x7f357c100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.317+0000 7f3581924640 1 --2- 172.21.15.103:0/2722676481 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c106790 0x7f357c106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.317+0000 7f3581924640 1 -- 172.21.15.103:0/2722676481 >> 172.21.15.103:0/2722676481 conn(0x7f357c0fc4b0 msgr2=0x7f357c0fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 -- 172.21.15.103:0/2722676481 shutdown_connections 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 -- 172.21.15.103:0/2722676481 wait complete. 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 Processor -- start 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 -- start start 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c100790 0x7f357c1990a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c101130 0x7f357c1995e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c106790 0x7f357c1a4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f357c110cb0 con 0x7f357c106790 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f357c110b30 con 0x7f357c101130 2024-08-02T18:47:55.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f3581924640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f357c110e30 con 0x7f357c100790 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f357b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c106790 0x7f357c1a4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f357b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c106790 0x7f357c1a4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47094/0 (socket says 172.21.15.103:47094) 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.318+0000 7f357b7fe640 1 -- 172.21.15.103:0/697426311 learned_addr learned my addr 172.21.15.103:0/697426311 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f3573fff640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c101130 0x7f357c1995e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f357affd640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c100790 0x7f357c1990a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f357b7fe640 1 -- 172.21.15.103:0/697426311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c100790 msgr2=0x7f357c1990a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f357b7fe640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c100790 0x7f357c1990a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f357b7fe640 1 -- 172.21.15.103:0/697426311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c101130 msgr2=0x7f357c1995e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f357b7fe640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c101130 0x7f357c1995e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f357b7fe640 1 -- 172.21.15.103:0/697426311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357c1a4660 con 0x7f357c106790 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f357affd640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c100790 0x7f357c1990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f357b7fe640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c106790 0x7f357c1a4120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3574009ca0 tx=0x7f3574003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f3580922640 1 -- 172.21.15.103:0/697426311 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574004040 con 0x7f357c106790 2024-08-02T18:47:55.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f3580922640 1 -- 172.21.15.103:0/697426311 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f35740046e0 con 0x7f357c106790 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357c1a4830 con 0x7f357c106790 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f3580922640 1 -- 172.21.15.103:0/697426311 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574046480 con 0x7f357c106790 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.319+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357c1a4d10 con 0x7f357c106790 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.320+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357c100bf0 con 0x7f357c106790 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.321+0000 7f3580922640 1 -- 172.21.15.103:0/697426311 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f35740305a0 con 0x7f357c106790 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.322+0000 7f3580922640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35680a2c00 0x7f35680a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.322+0000 7f357affd640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35680a2c00 0x7f35680a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.322+0000 7f3580922640 1 -- 172.21.15.103:0/697426311 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f357402e030 con 0x7f357c106790 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.323+0000 7f357affd640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35680a2c00 0x7f35680a50c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f356c005fd0 tx=0x7f356c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:55.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.326+0000 7f3580922640 1 -- 172.21.15.103:0/697426311 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f357404b060 con 0x7f357c106790 2024-08-02T18:47:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.498+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f357c02d5e0 con 0x7f357c106790 2024-08-02T18:47:55.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.499+0000 7f3580922640 1 -- 172.21.15.103:0/697426311 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24173 (secure 0 0 0) 0x7f35740bd6f0 con 0x7f357c106790 2024-08-02T18:47:55.501 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:55.501 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:47:31.020978+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35680a2c00 msgr2=0x7f35680a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35680a2c00 0x7f35680a50c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f356c005fd0 tx=0x7f356c005850 comp rx=0 tx=0).stop 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c106790 msgr2=0x7f357c1a4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c106790 0x7f357c1a4120 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f3574009ca0 tx=0x7f3574003f80 comp rx=0 tx=0).stop 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 shutdown_connections 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c106790 0x7f357c1a4120 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c101130 0x7f357c1995e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35680a2c00 0x7f35680a50c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 --2- 172.21.15.103:0/697426311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c100790 0x7f357c1990a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:55.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.501+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 >> 172.21.15.103:0/697426311 conn(0x7f357c0fc4b0 msgr2=0x7f357c0fdc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:55.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.502+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 shutdown_connections 2024-08-02T18:47:55.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:55.502+0000 7f3581924640 1 -- 172.21.15.103:0/697426311 wait complete. 2024-08-02T18:47:56.181 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:47:56.435 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:56.557 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:56 smithi103 ceph-mon[32753]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:56.557 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:56 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/697426311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:56.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:56 smithi121 ceph-mon[37236]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:56.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:56 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/697426311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:56.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:56 smithi151 ceph-mon[37155]: pgmap v282: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:56.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:56 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/697426311' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 -- 172.21.15.103:0/1419193230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 msgr2=0x7f386c102ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 --2- 172.21.15.103:0/1419193230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 0x7f386c102ef0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f3868009900 tx=0x7f386802a480 comp rx=0 tx=0).stop 2024-08-02T18:47:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 -- 172.21.15.103:0/1419193230 shutdown_connections 2024-08-02T18:47:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 --2- 172.21.15.103:0/1419193230 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f386c10beb0 0x7f386c10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 --2- 172.21.15.103:0/1419193230 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c103430 0x7f386c10b920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:56.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 --2- 172.21.15.103:0/1419193230 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 0x7f386c102ef0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 -- 172.21.15.103:0/1419193230 >> 172.21.15.103:0/1419193230 conn(0x7f386c0fc4d0 msgr2=0x7f386c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 -- 172.21.15.103:0/1419193230 shutdown_connections 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 -- 172.21.15.103:0/1419193230 wait complete. 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 Processor -- start 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 -- start start 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.926+0000 7f387466e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 0x7f386c100770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387466e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f386c103430 0x7f386c100cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387466e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c10beb0 0x7f386c1011f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387466e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f386c111e20 con 0x7f386c102b10 2024-08-02T18:47:56.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387466e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f386c111ca0 con 0x7f386c103430 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387466e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f386c111fa0 con 0x7f386c10beb0 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 0x7f386c100770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 0x7f386c100770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47112/0 (socket says 172.21.15.103:47112) 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 -- 172.21.15.103:0/644136121 learned_addr learned my addr 172.21.15.103:0/644136121 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f3871c09640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f386c103430 0x7f386c100cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f3872c0b640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c10beb0 0x7f386c1011f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 -- 172.21.15.103:0/644136121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c10beb0 msgr2=0x7f386c1011f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c10beb0 0x7f386c1011f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:56.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 -- 172.21.15.103:0/644136121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f386c103430 msgr2=0x7f386c100cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f386c103430 0x7f386c100cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 -- 172.21.15.103:0/644136121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f386c1a6830 con 0x7f386c102b10 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f3872c0b640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c10beb0 0x7f386c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387240a640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 0x7f386c100770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3868006010 tx=0x7f38680042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f38637fe640 1 -- 172.21.15.103:0/644136121 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386803f030 con 0x7f386c102b10 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f38637fe640 1 -- 172.21.15.103:0/644136121 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3868003d00 con 0x7f386c102b10 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f38637fe640 1 -- 172.21.15.103:0/644136121 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3868035070 con 0x7f386c102b10 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f386c1a6ac0 con 0x7f386c102b10 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.927+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f386c1a6ff0 con 0x7f386c102b10 2024-08-02T18:47:56.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.928+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f386c102ef0 con 0x7f386c102b10 2024-08-02T18:47:56.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.929+0000 7f38637fe640 1 -- 172.21.15.103:0/644136121 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f3868042030 con 0x7f386c102b10 2024-08-02T18:47:56.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.930+0000 7f38637fe640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f38580a2c00 0x7f38580a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:56.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.930+0000 7f3871c09640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f38580a2c00 0x7f38580a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:56.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.930+0000 7f38637fe640 1 -- 172.21.15.103:0/644136121 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f38680efb60 con 0x7f386c102b10 2024-08-02T18:47:56.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.930+0000 7f3871c09640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f38580a2c00 0x7f38580a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f386c0feb30 tx=0x7f385c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:56.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:56.933+0000 7f38637fe640 1 -- 172.21.15.103:0/644136121 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f38680bc880 con 0x7f386c102b10 2024-08-02T18:47:57.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.101+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f386c106f70 con 0x7f386c102b10 2024-08-02T18:47:57.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.104+0000 7f38637fe640 1 -- 172.21.15.103:0/644136121 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) ==== 74+0+24173 (secure 0 0 0) 0x7f38680bc180 con 0x7f386c102b10 2024-08-02T18:47:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:47:57.105 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":87,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:47:31.020978+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":79,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:47:57.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f38580a2c00 msgr2=0x7f38580a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:57.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f38580a2c00 0x7f38580a50c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f386c0feb30 tx=0x7f385c009110 comp rx=0 tx=0).stop 2024-08-02T18:47:57.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 msgr2=0x7f386c100770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:57.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 0x7f386c100770 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f3868006010 tx=0x7f38680042f0 comp rx=0 tx=0).stop 2024-08-02T18:47:57.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 shutdown_connections 2024-08-02T18:47:57.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f38580a2c00 0x7f38580a50c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:57.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f386c10beb0 0x7f386c1011f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:57.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f386c103430 0x7f386c100cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:57.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 --2- 172.21.15.103:0/644136121 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f386c102b10 0x7f386c100770 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:57.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 >> 172.21.15.103:0/644136121 conn(0x7f386c0fc4d0 msgr2=0x7f386c0fdc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:57.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 shutdown_connections 2024-08-02T18:47:57.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:57.106+0000 7f387466e640 1 -- 172.21.15.103:0/644136121 wait complete. 2024-08-02T18:47:57.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:57 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/644136121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:57.810 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:57 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/644136121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:57.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:57 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/644136121' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:47:57.841 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs set cephfs standby_count_wanted 0 2024-08-02T18:47:58.096 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:47:58.481 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:58 smithi103 ceph-mon[32753]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:58.574 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 -- 172.21.15.103:0/4005505591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81078b0 msgr2=0x7fd1c8107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/4005505591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81078b0 0x7fd1c8107c90 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8009cd0 tx=0x7fd1b802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 -- 172.21.15.103:0/4005505591 shutdown_connections 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/4005505591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c8102250 0x7fd1c810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/4005505591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1c81018b0 0x7fd1c8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/4005505591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81078b0 0x7fd1c8107c90 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 -- 172.21.15.103:0/4005505591 >> 172.21.15.103:0/4005505591 conn(0x7fd1c80fd5f0 msgr2=0x7fd1c80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 -- 172.21.15.103:0/4005505591 shutdown_connections 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.562+0000 7fd1cfa65640 1 -- 172.21.15.103:0/4005505591 wait complete. 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cfa65640 1 Processor -- start 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cfa65640 1 -- start start 2024-08-02T18:47:58.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cfa65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81018b0 0x7fd1c8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cfa65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c8102250 0x7fd1c81987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cfa65640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1c81078b0 0x7fd1c819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cfa65640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8111dd0 con 0x7fd1c81018b0 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cfa65640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8111c50 con 0x7fd1c8102250 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cfa65640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd1c8111f50 con 0x7fd1c81078b0 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cd801640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81018b0 0x7fd1c8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cd801640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81018b0 0x7fd1c8198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47122/0 (socket says 172.21.15.103:47122) 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.563+0000 7fd1cd801640 1 -- 172.21.15.103:0/3332630126 learned_addr learned my addr 172.21.15.103:0/3332630126 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cd000640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c8102250 0x7fd1c81987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cd801640 1 -- 172.21.15.103:0/3332630126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1c81078b0 msgr2=0x7fd1c819cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1ce002640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1c81078b0 0x7fd1c819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:58.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cd801640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1c81078b0 0x7fd1c819cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cd801640 1 -- 172.21.15.103:0/3332630126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c8102250 msgr2=0x7fd1c81987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cd801640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c8102250 0x7fd1c81987d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cd801640 1 -- 172.21.15.103:0/3332630126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd1c819d240 con 0x7fd1c81018b0 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cd000640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c8102250 0x7fd1c81987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1ce002640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1c81078b0 0x7fd1c819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cd801640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81018b0 0x7fd1c8198290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8031040 tx=0x7fd1b8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1c67fc640 1 -- 172.21.15.103:0/3332630126 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8032e60 con 0x7fd1c81018b0 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1c67fc640 1 -- 172.21.15.103:0/3332630126 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd1b8004540 con 0x7fd1c81018b0 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd1c819d4d0 con 0x7fd1c81018b0 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1c67fc640 1 -- 172.21.15.103:0/3332630126 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd1b803b400 con 0x7fd1c81018b0 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.564+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd1c81a4e10 con 0x7fd1c81018b0 2024-08-02T18:47:58.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.565+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd1c8101d10 con 0x7fd1c81018b0 2024-08-02T18:47:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.566+0000 7fd1c67fc640 1 -- 172.21.15.103:0/3332630126 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd1b80046f0 con 0x7fd1c81018b0 2024-08-02T18:47:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.567+0000 7fd1c67fc640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd1b00a2c00 0x7fd1b00a50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:47:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.567+0000 7fd1cd000640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd1b00a2c00 0x7fd1b00a50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:47:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.567+0000 7fd1c67fc640 1 -- 172.21.15.103:0/3332630126 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fd1b802e030 con 0x7fd1c81018b0 2024-08-02T18:47:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.567+0000 7fd1cd000640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd1b00a2c00 0x7fd1b00a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80ffbf0 tx=0x7fd1bc005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:47:58.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.571+0000 7fd1c67fc640 1 -- 172.21.15.103:0/3332630126 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd1b80bd0b0 con 0x7fd1c81018b0 2024-08-02T18:47:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:58 smithi121 ceph-mon[37236]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:58.775 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:58.773+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fd1c81995f0 con 0x7fd1c81018b0 2024-08-02T18:47:58.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:58 smithi151 ceph-mon[37155]: pgmap v283: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:47:59.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.421+0000 7fd1c67fc640 1 -- 172.21.15.103:0/3332630126 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) ==== 118+0+0 (secure 0 0 0) 0x7fd1b80098b0 con 0x7fd1c81018b0 2024-08-02T18:47:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd1b00a2c00 msgr2=0x7fd1b00a50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd1b00a2c00 0x7fd1b00a50c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fd1c80ffbf0 tx=0x7fd1bc005f90 comp rx=0 tx=0).stop 2024-08-02T18:47:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81018b0 msgr2=0x7fd1c8198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:47:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81018b0 0x7fd1c8198290 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fd1b8031040 tx=0x7fd1b8003f10 comp rx=0 tx=0).stop 2024-08-02T18:47:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 shutdown_connections 2024-08-02T18:47:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd1b00a2c00 0x7fd1b00a50c0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:59.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd1c81078b0 0x7fd1c819cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd1c8102250 0x7fd1c81987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 --2- 172.21.15.103:0/3332630126 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd1c81018b0 0x7fd1c8198290 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:47:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 >> 172.21.15.103:0/3332630126 conn(0x7fd1c80fd5f0 msgr2=0x7fd1c80fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:47:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 shutdown_connections 2024-08-02T18:47:59.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:47:59.424+0000 7fd1cfa65640 1 -- 172.21.15.103:0/3332630126 wait complete. 2024-08-02T18:47:59.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:47:59 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3332630126' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-02T18:47:59.752 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:47:59 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3332630126' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-02T18:47:59.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:47:59 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3332630126' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]: dispatch 2024-08-02T18:48:00.086 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 3, 'session_timeout': 300, 'standby_replay': True, 'subvols': {'create': 2}} 2024-08-02T18:48:00.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs set cephfs max_mds 3 2024-08-02T18:48:00.344 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:00 smithi121 ceph-mon[37236]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:48:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:00 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3332630126' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-02T18:48:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:00 smithi121 ceph-mon[37236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:48:00.773 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:00 smithi103 ceph-mon[32753]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:48:00.774 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:00 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3332630126' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-02T18:48:00.774 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:00 smithi103 ceph-mon[32753]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:48:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:00 smithi151 ceph-mon[37155]: pgmap v284: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 426 B/s wr, 0 op/s 2024-08-02T18:48:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:00 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3332630126' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]': finished 2024-08-02T18:48:00.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:00 smithi151 ceph-mon[37155]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:48:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.853+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2927264975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101530 msgr2=0x7fd0a0101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.853+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2927264975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101530 0x7fd0a0101910 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fd090009930 tx=0x7fd09002a420 comp rx=0 tx=0).stop 2024-08-02T18:48:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2927264975 shutdown_connections 2024-08-02T18:48:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2927264975 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0a0105b30 0x7fd0a010d6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2927264975 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0a0101ee0 0x7fd0a0105420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:00.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2927264975 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101530 0x7fd0a0101910 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2927264975 >> 172.21.15.103:0/2927264975 conn(0x7fd0a00fb7c0 msgr2=0x7fd0a00fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2927264975 shutdown_connections 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2927264975 wait complete. 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 Processor -- start 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.854+0000 7fd0a70f2640 1 -- start start 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a70f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0a0101530 0x7fd0a0199150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a70f2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101ee0 0x7fd0a0199690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a70f2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0a0105b30 0x7fd0a01a41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a70f2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a0110ca0 con 0x7fd0a0101ee0 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a70f2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a0110b20 con 0x7fd0a0101530 2024-08-02T18:48:00.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a70f2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd0a0110e20 con 0x7fd0a0105b30 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101ee0 0x7fd0a0199690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101ee0 0x7fd0a0199690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44396/0 (socket says 172.21.15.103:44396) 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 -- 172.21.15.103:0/2686568741 learned_addr learned my addr 172.21.15.103:0/2686568741 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a568f640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0a0105b30 0x7fd0a01a41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a4e8e640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0a0101530 0x7fd0a0199150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 -- 172.21.15.103:0/2686568741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0a0105b30 msgr2=0x7fd0a01a41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0a0105b30 0x7fd0a01a41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 -- 172.21.15.103:0/2686568741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0a0101530 msgr2=0x7fd0a0199150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0a0101530 0x7fd0a0199150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 -- 172.21.15.103:0/2686568741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd0a01a4710 con 0x7fd0a0101ee0 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09ffff640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101ee0 0x7fd0a0199690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd09400d770 tx=0x7fd09400dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09dffb640 1 -- 172.21.15.103:0/2686568741 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd094017070 con 0x7fd0a0101ee0 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09dffb640 1 -- 172.21.15.103:0/2686568741 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd094009c30 con 0x7fd0a0101ee0 2024-08-02T18:48:00.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd0a01a48e0 con 0x7fd0a0101ee0 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.855+0000 7fd09dffb640 1 -- 172.21.15.103:0/2686568741 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd09400f6b0 con 0x7fd0a0101ee0 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.856+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd0a01a4df0 con 0x7fd0a0101ee0 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.857+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd0a0101910 con 0x7fd0a0101ee0 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.858+0000 7fd09dffb640 1 -- 172.21.15.103:0/2686568741 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fd09401a070 con 0x7fd0a0101ee0 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.859+0000 7fd09dffb640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0880a2b80 0x7fd0880a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.859+0000 7fd09dffb640 1 -- 172.21.15.103:0/2686568741 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fd0940cedb0 con 0x7fd0a0101ee0 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.859+0000 7fd0a4e8e640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0880a2b80 0x7fd0880a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.859+0000 7fd0a4e8e640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0880a2b80 0x7fd0880a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd090000c00 tx=0x7fd090005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:00.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:00.862+0000 7fd09dffb640 1 -- 172.21.15.103:0/2686568741 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd094009de0 con 0x7fd0a0101ee0 2024-08-02T18:48:01.067 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.064+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"} v 0) -- 0x7fd0a0108d20 con 0x7fd0a0101ee0 2024-08-02T18:48:01.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.428+0000 7fd09dffb640 1 -- 172.21.15.103:0/2686568741 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]=0 v19) ==== 105+0+0 (secure 0 0 0) 0x7fd09409bad0 con 0x7fd0a0101ee0 2024-08-02T18:48:01.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0880a2b80 msgr2=0x7fd0880a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:01.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0880a2b80 0x7fd0880a5040 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fd090000c00 tx=0x7fd090005a20 comp rx=0 tx=0).stop 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101ee0 msgr2=0x7fd0a0199690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101ee0 0x7fd0a0199690 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fd09400d770 tx=0x7fd09400dc30 comp rx=0 tx=0).stop 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 shutdown_connections 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fd0880a2b80 0x7fd0880a5040 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd0a0105b30 0x7fd0a01a41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd0a0101ee0 0x7fd0a0199690 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 --2- 172.21.15.103:0/2686568741 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd0a0101530 0x7fd0a0199150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 >> 172.21.15.103:0/2686568741 conn(0x7fd0a00fb7c0 msgr2=0x7fd0a00fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 shutdown_connections 2024-08-02T18:48:01.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:01.431+0000 7fd0a70f2640 1 -- 172.21.15.103:0/2686568741 wait complete. 2024-08-02T18:48:01.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:01 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2686568741' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-02T18:48:01.753 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:01 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2686568741' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-02T18:48:01.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:01 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2686568741' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]: dispatch 2024-08-02T18:48:02.103 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs set cephfs allow_standby_replay true 2024-08-02T18:48:02.358 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:02 smithi121 ceph-mon[37236]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-08-02T18:48:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:02 smithi121 ceph-mon[37236]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-02T18:48:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:02 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2686568741' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-02T18:48:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:02 smithi121 ceph-mon[37236]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-02T18:48:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:02 smithi121 ceph-mon[37236]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:48:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:02 smithi121 ceph-mon[37236]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-02T18:48:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:02 smithi121 ceph-mon[37236]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-02T18:48:02.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:02 smithi103 ceph-mon[32753]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-08-02T18:48:02.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:02 smithi103 ceph-mon[32753]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-02T18:48:02.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:02 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2686568741' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-02T18:48:02.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:02 smithi103 ceph-mon[32753]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-02T18:48:02.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:02 smithi103 ceph-mon[32753]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:48:02.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:02 smithi103 ceph-mon[32753]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-02T18:48:02.767 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:02 smithi103 ceph-mon[32753]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-02T18:48:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:02 smithi151 ceph-mon[37155]: pgmap v285: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 85 B/s wr, 0 op/s 2024-08-02T18:48:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:02 smithi151 ceph-mon[37155]: Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-08-02T18:48:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:02 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2686568741' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "3"}]': finished 2024-08-02T18:48:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:02 smithi151 ceph-mon[37155]: daemon mds.i assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-08-02T18:48:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:02 smithi151 ceph-mon[37155]: fsmap cephfs:1 {0=b=up:active} 11 up:standby 2024-08-02T18:48:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:02 smithi151 ceph-mon[37155]: fsmap cephfs:2 {0=b=up:active,1=i=up:creating} 10 up:standby 2024-08-02T18:48:02.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:02 smithi151 ceph-mon[37155]: daemon mds.i is now active in filesystem cephfs as rank 1 2024-08-02T18:48:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 -- 172.21.15.103:0/1085831342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0108030 msgr2=0x7fb3c010e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 --2- 172.21.15.103:0/1085831342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0108030 0x7fb3c010e9a0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7fb3b8009cd0 tx=0x7fb3b802a8d0 comp rx=0 tx=0).stop 2024-08-02T18:48:02.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 -- 172.21.15.103:0/1085831342 shutdown_connections 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 --2- 172.21.15.103:0/1085831342 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0108030 0x7fb3c010e9a0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 --2- 172.21.15.103:0/1085831342 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3c01034b0 0x7fb3c01078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 --2- 172.21.15.103:0/1085831342 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0102b00 0x7fb3c0102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 -- 172.21.15.103:0/1085831342 >> 172.21.15.103:0/1085831342 conn(0x7fb3c00fc500 msgr2=0x7fb3c00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 -- 172.21.15.103:0/1085831342 shutdown_connections 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 -- 172.21.15.103:0/1085831342 wait complete. 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 Processor -- start 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.849+0000 7fb3c69de640 1 -- start start 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3c69de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0102b00 0x7fb3c0100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3c69de640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3c01034b0 0x7fb3c0100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3c69de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0108030 0x7fb3c01011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3c69de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0111f80 con 0x7fb3c0102b00 2024-08-02T18:48:02.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3c69de640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0111e00 con 0x7fb3c0108030 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3c69de640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb3c0112100 con 0x7fb3c01034b0 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0102b00 0x7fb3c0100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0102b00 0x7fb3c0100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44412/0 (socket says 172.21.15.103:44412) 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 -- 172.21.15.103:0/4139180280 learned_addr learned my addr 172.21.15.103:0/4139180280 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3b7fff640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3c01034b0 0x7fb3c0100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3c4f7b640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0108030 0x7fb3c01011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 -- 172.21.15.103:0/4139180280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3c01034b0 msgr2=0x7fb3c0100ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3c01034b0 0x7fb3c0100ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 -- 172.21.15.103:0/4139180280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0108030 msgr2=0x7fb3c01011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0108030 0x7fb3c01011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 -- 172.21.15.103:0/4139180280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3c01a6860 con 0x7fb3c0102b00 2024-08-02T18:48:02.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bffff640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0102b00 0x7fb3c0100760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000b4a0 tx=0x7fb3b000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bdffb640 1 -- 172.21.15.103:0/4139180280 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0014070 con 0x7fb3c0102b00 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bdffb640 1 -- 172.21.15.103:0/4139180280 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb3b0010b10 con 0x7fb3c0102b00 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3bdffb640 1 -- 172.21.15.103:0/4139180280 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3b0017d60 con 0x7fb3c0102b00 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.850+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3c01a6b50 con 0x7fb3c0102b00 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.851+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3c01a7090 con 0x7fb3c0102b00 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.852+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb3c006a4e0 con 0x7fb3c0102b00 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.853+0000 7fb3bdffb640 1 -- 172.21.15.103:0/4139180280 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7fb3b0017070 con 0x7fb3c0102b00 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.853+0000 7fb3bdffb640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb3ac0a2b80 0x7fb3ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.853+0000 7fb3b7fff640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb3ac0a2b80 0x7fb3ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.853+0000 7fb3bdffb640 1 -- 172.21.15.103:0/4139180280 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7fb3b00ce550 con 0x7fb3c0102b00 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.854+0000 7fb3b7fff640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb3ac0a2b80 0x7fb3ac0a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb3c01021f0 tx=0x7fb3a800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:02.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:02.857+0000 7fb3bdffb640 1 -- 172.21.15.103:0/4139180280 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb3b009ac20 con 0x7fb3c0102b00 2024-08-02T18:48:03.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.058+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"} v 0) -- 0x7fb3c01a72c0 con 0x7fb3c0102b00 2024-08-02T18:48:03.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.447+0000 7fb3bdffb640 1 -- 172.21.15.103:0/4139180280 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]=0 v23) ==== 121+0+0 (secure 0 0 0) 0x7fb3b009ef20 con 0x7fb3c0102b00 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb3ac0a2b80 msgr2=0x7fb3ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb3ac0a2b80 0x7fb3ac0a5040 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fb3c01021f0 tx=0x7fb3a800a2d0 comp rx=0 tx=0).stop 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0102b00 msgr2=0x7fb3c0100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0102b00 0x7fb3c0100760 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fb3b000b4a0 tx=0x7fb3b000b960 comp rx=0 tx=0).stop 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 shutdown_connections 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb3c0108030 0x7fb3c01011e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb3ac0a2b80 0x7fb3ac0a5040 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb3c01034b0 0x7fb3c0100ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 --2- 172.21.15.103:0/4139180280 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb3c0102b00 0x7fb3c0100760 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.449+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 >> 172.21.15.103:0/4139180280 conn(0x7fb3c00fc500 msgr2=0x7fb3c01059e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.450+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 shutdown_connections 2024-08-02T18:48:03.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:03.450+0000 7fb3c69de640 1 -- 172.21.15.103:0/4139180280 wait complete. 2024-08-02T18:48:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:03 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:active 2024-08-02T18:48:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:03 smithi121 ceph-mon[37236]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-02T18:48:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:03 smithi121 ceph-mon[37236]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-02T18:48:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:03 smithi121 ceph-mon[37236]: Cluster is now healthy 2024-08-02T18:48:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:03 smithi121 ceph-mon[37236]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-02T18:48:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:03 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-08-02T18:48:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:03 smithi121 ceph-mon[37236]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-02T18:48:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:03 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4139180280' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-02T18:48:03.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:03 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:active 2024-08-02T18:48:03.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:03 smithi151 ceph-mon[37155]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-02T18:48:03.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:03 smithi151 ceph-mon[37155]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:03 smithi151 ceph-mon[37155]: Cluster is now healthy 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:03 smithi151 ceph-mon[37155]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:03 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:03 smithi151 ceph-mon[37155]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:03 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4139180280' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:03 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:active 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:03 smithi103 ceph-mon[32753]: daemon mds.c assigned to filesystem cephfs as rank 2 (now has 3 ranks) 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:03 smithi103 ceph-mon[32753]: Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-08-02T18:48:03.821 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:03 smithi103 ceph-mon[32753]: Cluster is now healthy 2024-08-02T18:48:03.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:03 smithi103 ceph-mon[32753]: fsmap cephfs:2 {0=b=up:active,1=i=up:active} 10 up:standby 2024-08-02T18:48:03.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:03 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:creating} 9 up:standby 2024-08-02T18:48:03.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:03 smithi103 ceph-mon[32753]: daemon mds.c is now active in filesystem cephfs as rank 2 2024-08-02T18:48:03.822 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:03 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4139180280' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]: dispatch 2024-08-02T18:48:04.257 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs set cephfs session_timeout 300 2024-08-02T18:48:04.510 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:04 smithi121 ceph-mon[37236]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-08-02T18:48:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:04 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4139180280' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-02T18:48:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:04 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:active 2024-08-02T18:48:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:04 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-08-02T18:48:04.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:04 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:48:04.758 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:04 smithi103 ceph-mon[32753]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-08-02T18:48:04.758 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:04 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4139180280' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-02T18:48:04.758 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:04 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:active 2024-08-02T18:48:04.758 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:04 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-08-02T18:48:04.758 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:04 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:48:04.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:04 smithi151 ceph-mon[37155]: pgmap v286: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s wr, 1 op/s 2024-08-02T18:48:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:04 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4139180280' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "true"}]': finished 2024-08-02T18:48:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:04 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:active 2024-08-02T18:48:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:04 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 9 up:standby 2024-08-02T18:48:04.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:04 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:48:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 -- 172.21.15.103:0/3801666161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 msgr2=0x7f87bc106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/3801666161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 0x7f87bc106b90 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f87b0009930 tx=0x7f87b002a420 comp rx=0 tx=0).stop 2024-08-02T18:48:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 -- 172.21.15.103:0/3801666161 shutdown_connections 2024-08-02T18:48:05.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/3801666161 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc101150 0x7f87bc10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/3801666161 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87bc1007b0 0x7f87bc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/3801666161 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 0x7f87bc106b90 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 -- 172.21.15.103:0/3801666161 >> 172.21.15.103:0/3801666161 conn(0x7f87bc0fc4d0 msgr2=0x7f87bc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 -- 172.21.15.103:0/3801666161 shutdown_connections 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.998+0000 7f87c2c9a640 1 -- 172.21.15.103:0/3801666161 wait complete. 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c2c9a640 1 Processor -- start 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c2c9a640 1 -- start start 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c2c9a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc1007b0 0x7f87bc198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c2c9a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87bc101150 0x7f87bc1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c2c9a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 0x7f87bc19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c2c9a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc110d20 con 0x7f87bc1067b0 2024-08-02T18:48:05.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c2c9a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc110ba0 con 0x7f87bc1007b0 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c2c9a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f87bc110ea0 con 0x7f87bc101150 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c1237640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 0x7f87bc19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c1237640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 0x7f87bc19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44436/0 (socket says 172.21.15.103:44436) 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87c1237640 1 -- 172.21.15.103:0/796018302 learned_addr learned my addr 172.21.15.103:0/796018302 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:04.999+0000 7f87bbfff640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87bc101150 0x7f87bc1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c0a36640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc1007b0 0x7f87bc198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c1237640 1 -- 172.21.15.103:0/796018302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87bc101150 msgr2=0x7f87bc1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c1237640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87bc101150 0x7f87bc1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c1237640 1 -- 172.21.15.103:0/796018302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc1007b0 msgr2=0x7f87bc198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c1237640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc1007b0 0x7f87bc198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c1237640 1 -- 172.21.15.103:0/796018302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87bc19d220 con 0x7f87bc1067b0 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c0a36640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc1007b0 0x7f87bc198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:05.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c1237640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 0x7f87bc19cb40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87b400eaa0 tx=0x7f87b400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:05.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87b9ffb640 1 -- 172.21.15.103:0/796018302 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b400cdb0 con 0x7f87bc1067b0 2024-08-02T18:48:05.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87b9ffb640 1 -- 172.21.15.103:0/796018302 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87b4004b20 con 0x7f87bc1067b0 2024-08-02T18:48:05.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87bc19d510 con 0x7f87bc1067b0 2024-08-02T18:48:05.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87b9ffb640 1 -- 172.21.15.103:0/796018302 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87b4011760 con 0x7f87bc1067b0 2024-08-02T18:48:05.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.000+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87bc1a4df0 con 0x7f87bc1067b0 2024-08-02T18:48:05.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.001+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f87bc100c10 con 0x7f87bc1067b0 2024-08-02T18:48:05.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.002+0000 7f87b9ffb640 1 -- 172.21.15.103:0/796018302 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f87b4004cd0 con 0x7f87bc1067b0 2024-08-02T18:48:05.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.003+0000 7f87b9ffb640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87ac0a2b80 0x7f87ac0a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:05.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.003+0000 7f87c0a36640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87ac0a2b80 0x7f87ac0a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:05.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.003+0000 7f87b9ffb640 1 -- 172.21.15.103:0/796018302 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(87..87 src has 1..87) ==== 8802+0+0 (secure 0 0 0) 0x7f87b40cf490 con 0x7f87bc1067b0 2024-08-02T18:48:05.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.004+0000 7f87c0a36640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87ac0a2b80 0x7f87ac0a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f87b00315e0 tx=0x7f87b0005fd0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:05.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.007+0000 7f87b9ffb640 1 -- 172.21.15.103:0/796018302 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f87b4016030 con 0x7f87bc1067b0 2024-08-02T18:48:05.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.210+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7f87bc02d5e0 con 0x7f87bc1067b0 2024-08-02T18:48:05.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.456+0000 7f87b9ffb640 1 -- 172.21.15.103:0/796018302 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v25) ==== 115+0+0 (secure 0 0 0) 0x7f87b409c1b0 con 0x7f87bc1067b0 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87ac0a2b80 msgr2=0x7f87ac0a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87ac0a2b80 0x7f87ac0a5040 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f87b00315e0 tx=0x7f87b0005fd0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 msgr2=0x7f87bc19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 0x7f87bc19cb40 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f87b400eaa0 tx=0x7f87b400ef60 comp rx=0 tx=0).stop 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 shutdown_connections 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87bc1067b0 0x7f87bc19cb40 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87ac0a2b80 0x7f87ac0a5040 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87bc101150 0x7f87bc1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 --2- 172.21.15.103:0/796018302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87bc1007b0 0x7f87bc198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 >> 172.21.15.103:0/796018302 conn(0x7f87bc0fc4d0 msgr2=0x7f87bc06a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:05.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 shutdown_connections 2024-08-02T18:48:05.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:05.459+0000 7f87c2c9a640 1 -- 172.21.15.103:0/796018302 wait complete. 2024-08-02T18:48:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/796018302' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-02T18:48:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-08-02T18:48:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-08-02T18:48:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-08-02T18:48:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-08-02T18:48:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-08-02T18:48:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-08-02T18:48:05.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-08-02T18:48:05.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]: dispatch 2024-08-02T18:48:05.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-08-02T18:48:05.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:05 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-08-02T18:48:05.805 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/796018302' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-08-02T18:48:05.806 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:05 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-08-02T18:48:05.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/796018302' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]: dispatch 2024-08-02T18:48:05.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:05 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]: dispatch 2024-08-02T18:48:06.260 DEBUG:tasks.cephfs.filesystem:Creating {'create': 2} subvols for filesystem 'cephfs' 2024-08-02T18:48:06.260 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs subvolumegroup create cephfs qa 2024-08-02T18:48:06.527 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:06.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 255 B/s wr, 3 op/s 2024-08-02T18:48:06.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/796018302' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: osdmap e88: 12 total, 12 up, 12 in 2024-08-02T18:48:06.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:06 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:48:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 255 B/s wr, 3 op/s 2024-08-02T18:48:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/796018302' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-02T18:48:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-08-02T18:48:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-08-02T18:48:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-08-02T18:48:06.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-08-02T18:48:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-02T18:48:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-08-02T18:48:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-08-02T18:48:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-08-02T18:48:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-08-02T18:48:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-08-02T18:48:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: osdmap e88: 12 total, 12 up, 12 in 2024-08-02T18:48:06.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:06 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:48:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: pgmap v287: 129 pgs: 129 active+clean; 581 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 255 B/s rd, 255 B/s wr, 3 op/s 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/796018302' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.13", "id": [2, 11]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.1d", "id": [8, 11]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.6", "id": [4, 6]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1b", "id": [5, 9]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.1e", "id": [3, 9]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "3.3c", "id": [4, 9]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.e", "id": [9, 11]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.15", "id": [5, 10]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [9, 8]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1f", "id": [9, 8]}]': finished 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: osdmap e88: 12 total, 12 up, 12 in 2024-08-02T18:48:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:06 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:48:07.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.067+0000 7f18b14e2640 1 -- 172.21.15.103:0/2238814944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac106c80 msgr2=0x7f18ac10e820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:07.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.067+0000 7f18b14e2640 1 --2- 172.21.15.103:0/2238814944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac106c80 0x7f18ac10e820 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f18a4009930 tx=0x7f18a402a420 comp rx=0 tx=0).stop 2024-08-02T18:48:07.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.067+0000 7f18b14e2640 1 -- 172.21.15.103:0/2238814944 shutdown_connections 2024-08-02T18:48:07.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.067+0000 7f18b14e2640 1 --2- 172.21.15.103:0/2238814944 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac106c80 0x7f18ac10e820 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.067+0000 7f18b14e2640 1 --2- 172.21.15.103:0/2238814944 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ac1009d0 0x7f18ac106570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.067+0000 7f18b14e2640 1 --2- 172.21.15.103:0/2238814944 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18ac100020 0x7f18ac100400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.067+0000 7f18b14e2640 1 -- 172.21.15.103:0/2238814944 >> 172.21.15.103:0/2238814944 conn(0x7f18ac076f40 msgr2=0x7f18ac0fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.067+0000 7f18b14e2640 1 -- 172.21.15.103:0/2238814944 shutdown_connections 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 -- 172.21.15.103:0/2238814944 wait complete. 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 Processor -- start 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 -- start start 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18ac100020 0x7f18ac198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac1009d0 0x7f18ac198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ac106c80 0x7f18ac19cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac111e90 con 0x7f18ac1009d0 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac111d10 con 0x7f18ac106c80 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.068+0000 7f18b14e2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f18ac112010 con 0x7f18ac100020 2024-08-02T18:48:07.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac1009d0 0x7f18ac198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac1009d0 0x7f18ac198850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:44444/0 (socket says 172.21.15.103:44444) 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 -- 172.21.15.103:0/3403685634 learned_addr learned my addr 172.21.15.103:0/3403685634 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18ab7fe640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ac106c80 0x7f18ac19cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aaffd640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18ac100020 0x7f18ac198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 -- 172.21.15.103:0/3403685634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18ac100020 msgr2=0x7f18ac198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18ac100020 0x7f18ac198310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 -- 172.21.15.103:0/3403685634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ac106c80 msgr2=0x7f18ac19cbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ac106c80 0x7f18ac19cbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 -- 172.21.15.103:0/3403685634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18ac19d2c0 con 0x7f18ac1009d0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18aa7fc640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac1009d0 0x7f18ac198850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18a000b9c0 tx=0x7f18a000be80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f1893fff640 1 -- 172.21.15.103:0/3403685634 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a0019070 con 0x7f18ac1009d0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f1893fff640 1 -- 172.21.15.103:0/3403685634 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f18a000cba0 con 0x7f18ac1009d0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18ac19d5b0 con 0x7f18ac1009d0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f1893fff640 1 -- 172.21.15.103:0/3403685634 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18a00126d0 con 0x7f18ac1009d0 2024-08-02T18:48:07.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.069+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18ac1a4e90 con 0x7f18ac1009d0 2024-08-02T18:48:07.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.070+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f18ac100400 con 0x7f18ac1009d0 2024-08-02T18:48:07.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.071+0000 7f1893fff640 1 -- 172.21.15.103:0/3403685634 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 16) ==== 137834+0+0 (secure 0 0 0) 0x7f18a001c070 con 0x7f18ac1009d0 2024-08-02T18:48:07.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.072+0000 7f1893fff640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f18940a2b80 0x7f18940a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:07.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.072+0000 7f1893fff640 1 -- 172.21.15.103:0/3403685634 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f18a00ceff0 con 0x7f18ac1009d0 2024-08-02T18:48:07.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.072+0000 7f18aaffd640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f18940a2b80 0x7f18940a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:07.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.073+0000 7f18aaffd640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f18940a2b80 0x7f18940a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f189c005fd0 tx=0x7f189c005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:07.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.075+0000 7f1893fff640 1 -- 172.21.15.103:0/3403685634 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f18a009bbd0 con 0x7f18ac1009d0 2024-08-02T18:48:07.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.265+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7f18ac062360 con 0x7f18940a2b80 2024-08-02T18:48:07.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.289+0000 7f1893fff640 1 -- 172.21.15.103:0/3403685634 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7f18ac062360 con 0x7f18940a2b80 2024-08-02T18:48:07.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f18940a2b80 msgr2=0x7f18940a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:07.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f18940a2b80 0x7f18940a5040 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f189c005fd0 tx=0x7f189c005850 comp rx=0 tx=0).stop 2024-08-02T18:48:07.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac1009d0 msgr2=0x7f18ac198850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:07.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac1009d0 0x7f18ac198850 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f18a000b9c0 tx=0x7f18a000be80 comp rx=0 tx=0).stop 2024-08-02T18:48:07.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 shutdown_connections 2024-08-02T18:48:07.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f18ac106c80 0x7f18ac19cbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f18ac1009d0 0x7f18ac198850 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f18940a2b80 0x7f18940a5040 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.290+0000 7f18b14e2640 1 --2- 172.21.15.103:0/3403685634 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f18ac100020 0x7f18ac198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:07.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.291+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 >> 172.21.15.103:0/3403685634 conn(0x7f18ac076f40 msgr2=0x7f18ac105510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:07.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.291+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 shutdown_connections 2024-08-02T18:48:07.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:07.291+0000 7f18b14e2640 1 -- 172.21.15.103:0/3403685634 wait complete. 2024-08-02T18:48:07.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:07 smithi103 ceph-mon[32753]: osdmap e89: 12 total, 12 up, 12 in 2024-08-02T18:48:07.576 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:48:07 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:48:07.271+0000 7f7f5ec3e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:48:07.576 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:48:07 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:48:07.271+0000 7f7f5ec3e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:48:07.576 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:48:07 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:48:07.271+0000 7f7f5ec3e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:48:07.576 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:48:07 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:48:07.271+0000 7f7f5ec3e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:48:07.576 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:48:07 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:48:07.271+0000 7f7f5ec3e640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:48:07.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:07 smithi121 ceph-mon[37236]: osdmap e89: 12 total, 12 up, 12 in 2024-08-02T18:48:07.751 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 18:48:07 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b[67166]: 2024-08-02T18:48:07.394+0000 7f6aeaf58640 -1 mds.pinger is_rank_lagging: rank=2 was never sent ping request. 2024-08-02T18:48:07.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:07 smithi151 ceph-mon[37155]: osdmap e89: 12 total, 12 up, 12 in 2024-08-02T18:48:08.138 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs subvolume create cephfs sv_0 --group_name qa 2024-08-02T18:48:08.395 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:08 smithi121 ceph-mon[37236]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:08 smithi121 ceph-mon[37236]: pgmap v290: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-08-02T18:48:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:08 smithi121 ceph-mon[37236]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-02T18:48:08.796 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:08 smithi103 ceph-mon[32753]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:08.796 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:08 smithi103 ceph-mon[32753]: pgmap v290: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-08-02T18:48:08.796 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:08 smithi103 ceph-mon[32753]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-02T18:48:08.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:08 smithi151 ceph-mon[37155]: from='client.14799 -' entity='client.admin' cmd=[{"prefix": "fs subvolumegroup create", "vol_name": "cephfs", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:08.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:08 smithi151 ceph-mon[37155]: pgmap v290: 129 pgs: 4 peering, 125 active+clean; 584 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 3.0 KiB/s wr, 12 op/s 2024-08-02T18:48:08.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:08 smithi151 ceph-mon[37155]: mgrmap e17: x(active, since 7m), standbys: z, y 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 -- 172.21.15.103:0/983924364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec106790 msgr2=0x7ff3ec106b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 --2- 172.21.15.103:0/983924364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec106790 0x7ff3ec106b70 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc009930 tx=0x7ff3dc02a420 comp rx=0 tx=0).stop 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 -- 172.21.15.103:0/983924364 shutdown_connections 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 --2- 172.21.15.103:0/983924364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3ec101130 0x7ff3ec10d660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 --2- 172.21.15.103:0/983924364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3ec100790 0x7ff3ec100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 --2- 172.21.15.103:0/983924364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec106790 0x7ff3ec106b70 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 -- 172.21.15.103:0/983924364 >> 172.21.15.103:0/983924364 conn(0x7ff3ec0fc4b0 msgr2=0x7ff3ec0fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 -- 172.21.15.103:0/983924364 shutdown_connections 2024-08-02T18:48:08.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.879+0000 7ff3f1764640 1 -- 172.21.15.103:0/983924364 wait complete. 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3f1764640 1 Processor -- start 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3f1764640 1 -- start start 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3f1764640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3ec100790 0x7ff3ec1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3f1764640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec101130 0x7ff3ec199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3f1764640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3ec106790 0x7ff3ec1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3f1764640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec110cb0 con 0x7ff3ec101130 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3f1764640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec110b30 con 0x7ff3ec100790 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3f1764640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff3ec110e30 con 0x7ff3ec106790 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.880+0000 7ff3e27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec101130 0x7ff3ec199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:08.884 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec101130 0x7ff3ec199600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58228/0 (socket says 172.21.15.103:58228) 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e27fc640 1 -- 172.21.15.103:0/687533711 learned_addr learned my addr 172.21.15.103:0/687533711 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3eb7fe640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3ec106790 0x7ff3ec1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3eaffd640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3ec100790 0x7ff3ec1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e27fc640 1 -- 172.21.15.103:0/687533711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3ec106790 msgr2=0x7ff3ec1a4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e27fc640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3ec106790 0x7ff3ec1a4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e27fc640 1 -- 172.21.15.103:0/687533711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3ec100790 msgr2=0x7ff3ec1990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e27fc640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3ec100790 0x7ff3ec1990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e27fc640 1 -- 172.21.15.103:0/687533711 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff3ec1a4680 con 0x7ff3ec101130 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3eaffd640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3ec100790 0x7ff3ec1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e27fc640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec101130 0x7ff3ec199600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400d950 tx=0x7ff3d400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e8ff9640 1 -- 172.21.15.103:0/687533711 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d4017070 con 0x7ff3ec101130 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e8ff9640 1 -- 172.21.15.103:0/687533711 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff3d4009c30 con 0x7ff3ec101130 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff3ec1a4850 con 0x7ff3ec101130 2024-08-02T18:48:08.885 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3e8ff9640 1 -- 172.21.15.103:0/687533711 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff3d400f740 con 0x7ff3ec101130 2024-08-02T18:48:08.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.881+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3ec1a4d60 con 0x7ff3ec101130 2024-08-02T18:48:08.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.882+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff3ec100bf0 con 0x7ff3ec101130 2024-08-02T18:48:08.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.883+0000 7ff3e8ff9640 1 -- 172.21.15.103:0/687533711 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff3d4010a80 con 0x7ff3ec101130 2024-08-02T18:48:08.886 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.884+0000 7ff3e8ff9640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff3d80a2c10 0x7ff3d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:08.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.884+0000 7ff3eaffd640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff3d80a2c10 0x7ff3d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:08.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.884+0000 7ff3e8ff9640 1 -- 172.21.15.103:0/687533711 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff3d40cf5a0 con 0x7ff3ec101130 2024-08-02T18:48:08.887 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.885+0000 7ff3eaffd640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff3d80a2c10 0x7ff3d80a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc000c00 tx=0x7ff3dc032c80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:08.889 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:08.888+0000 7ff3e8ff9640 1 -- 172.21.15.103:0/687533711 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff3d4009de0 con 0x7ff3ec101130 2024-08-02T18:48:09.083 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.082+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7ff3ec062360 con 0x7ff3d80a2c10 2024-08-02T18:48:09.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.107+0000 7ff3e8ff9640 1 -- 172.21.15.103:0/687533711 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7ff3ec062360 con 0x7ff3d80a2c10 2024-08-02T18:48:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff3d80a2c10 msgr2=0x7ff3d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff3d80a2c10 0x7ff3d80a50d0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7ff3dc000c00 tx=0x7ff3dc032c80 comp rx=0 tx=0).stop 2024-08-02T18:48:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec101130 msgr2=0x7ff3ec199600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec101130 0x7ff3ec199600 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7ff3d400d950 tx=0x7ff3d400de10 comp rx=0 tx=0).stop 2024-08-02T18:48:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 shutdown_connections 2024-08-02T18:48:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff3d80a2c10 0x7ff3d80a50d0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:09.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3ec106790 0x7ff3ec1a4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff3ec101130 0x7ff3ec199600 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 --2- 172.21.15.103:0/687533711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3ec100790 0x7ff3ec1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 >> 172.21.15.103:0/687533711 conn(0x7ff3ec0fc4b0 msgr2=0x7ff3ec0fcd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 shutdown_connections 2024-08-02T18:48:09.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:09.110+0000 7ff3f1764640 1 -- 172.21.15.103:0/687533711 wait complete. 2024-08-02T18:48:09.806 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_0 2024-08-02T18:48:10.058 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 -- 172.21.15.103:0/2895424743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 msgr2=0x7f385010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:10.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 --2- 172.21.15.103:0/2895424743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 0x7f385010d680 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3848009cd0 tx=0x7f384802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 -- 172.21.15.103:0/2895424743 shutdown_connections 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 --2- 172.21.15.103:0/2895424743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 0x7f385010d680 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 --2- 172.21.15.103:0/2895424743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38501007b0 0x7f3850100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 --2- 172.21.15.103:0/2895424743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38501067b0 0x7f3850106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 -- 172.21.15.103:0/2895424743 >> 172.21.15.103:0/2895424743 conn(0x7f38500fc4d0 msgr2=0x7f38500fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 -- 172.21.15.103:0/2895424743 shutdown_connections 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 -- 172.21.15.103:0/2895424743 wait complete. 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 Processor -- start 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.562+0000 7f3858164640 1 -- start start 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3858164640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38501007b0 0x7f38501981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3858164640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 0x7f38501986e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:10.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3858164640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38501067b0 0x7f385019ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3858164640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3850110d10 con 0x7f3850101150 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3858164640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3850110b90 con 0x7f38501067b0 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3858164640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3850110e90 con 0x7f38501007b0 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 0x7f38501986e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 0x7f38501986e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58250/0 (socket says 172.21.15.103:58250) 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 -- 172.21.15.103:0/1056361048 learned_addr learned my addr 172.21.15.103:0/1056361048 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3856701640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38501067b0 0x7f385019ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3855f00640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38501007b0 0x7f38501981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 -- 172.21.15.103:0/1056361048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38501007b0 msgr2=0x7f38501981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38501007b0 0x7f38501981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 -- 172.21.15.103:0/1056361048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38501067b0 msgr2=0x7f385019ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:10.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38501067b0 0x7f385019ca70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 -- 172.21.15.103:0/1056361048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f385019d150 con 0x7f3850101150 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3855f00640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38501007b0 0x7f38501981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f38556ff640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 0x7f38501986e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f384000c920 tx=0x7f384000cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3846ffd640 1 -- 172.21.15.103:0/1056361048 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840007c70 con 0x7f3850101150 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3846ffd640 1 -- 172.21.15.103:0/1056361048 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3840007e10 con 0x7f3850101150 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f385019d440 con 0x7f3850101150 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3846ffd640 1 -- 172.21.15.103:0/1056361048 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3840018940 con 0x7f3850101150 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.563+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f38501a4d20 con 0x7f3850101150 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.565+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3850100c10 con 0x7f3850101150 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.566+0000 7f3846ffd640 1 -- 172.21.15.103:0/1056361048 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3840018b20 con 0x7f3850101150 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.566+0000 7f3846ffd640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f383c0a2c10 0x7f383c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:10.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.566+0000 7f3855f00640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f383c0a2c10 0x7f383c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.566+0000 7f3846ffd640 1 -- 172.21.15.103:0/1056361048 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f38400cf6b0 con 0x7f3850101150 2024-08-02T18:48:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.567+0000 7f3855f00640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f383c0a2c10 0x7f383c0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f384c006fd0 tx=0x7f384c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:10.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.570+0000 7f3846ffd640 1 -- 172.21.15.103:0/1056361048 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3840014030 con 0x7f3850101150 2024-08-02T18:48:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:10 smithi121 ceph-mon[37236]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:10.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:10 smithi121 ceph-mon[37236]: pgmap v291: 129 pgs: 4 peering, 125 active+clean; 590 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-08-02T18:48:10.766 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.765+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}) -- 0x7f38501044c0 con 0x7f383c0a2c10 2024-08-02T18:48:10.766 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:10 smithi103 ceph-mon[32753]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:10.766 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:10 smithi103 ceph-mon[32753]: pgmap v291: 129 pgs: 4 peering, 125 active+clean; 590 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-08-02T18:48:10.770 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.769+0000 7f3846ffd640 1 -- 172.21.15.103:0/1056361048 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f38501044c0 con 0x7f383c0a2c10 2024-08-02T18:48:10.771 INFO:teuthology.orchestra.run.smithi103.stdout:/volumes/qa/sv_0/e20773e4-4d6a-404f-afb4-5ed569417df2 2024-08-02T18:48:10.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f383c0a2c10 msgr2=0x7f383c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f383c0a2c10 0x7f383c0a50d0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f384c006fd0 tx=0x7f384c008040 comp rx=0 tx=0).stop 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 msgr2=0x7f38501986e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 0x7f38501986e0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f384000c920 tx=0x7f384000cde0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 shutdown_connections 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f38501067b0 0x7f385019ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3850101150 0x7f38501986e0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f383c0a2c10 0x7f383c0a50d0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 --2- 172.21.15.103:0/1056361048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f38501007b0 0x7f38501981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 >> 172.21.15.103:0/1056361048 conn(0x7f38500fc4d0 msgr2=0x7f38500fe170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 shutdown_connections 2024-08-02T18:48:10.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:10.771+0000 7f3858164640 1 -- 172.21.15.103:0/1056361048 wait complete. 2024-08-02T18:48:10.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:10 smithi151 ceph-mon[37155]: from='client.14811 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_0", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:10.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:10 smithi151 ceph-mon[37155]: pgmap v291: 129 pgs: 4 peering, 125 active+clean; 590 KiB data, 362 MiB used, 1.0 TiB / 1.0 TiB avail; 5.1 KiB/s rd, 4.2 KiB/s wr, 15 op/s 2024-08-02T18:48:11.516 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs subvolume create cephfs sv_1 --group_name qa 2024-08-02T18:48:11.769 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 -- 172.21.15.103:0/2584179560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc107fd0 msgr2=0x7fb7cc10e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2584179560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc107fd0 0x7fb7cc10e970 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb7c4009930 tx=0x7fb7c402a420 comp rx=0 tx=0).stop 2024-08-02T18:48:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 -- 172.21.15.103:0/2584179560 shutdown_connections 2024-08-02T18:48:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2584179560 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc107fd0 0x7fb7cc10e970 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2584179560 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc103410 0x7fb7cc1078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2584179560 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7cc102a60 0x7fb7cc102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 -- 172.21.15.103:0/2584179560 >> 172.21.15.103:0/2584179560 conn(0x7fb7cc0fc500 msgr2=0x7fb7cc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:12.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 -- 172.21.15.103:0/2584179560 shutdown_connections 2024-08-02T18:48:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 -- 172.21.15.103:0/2584179560 wait complete. 2024-08-02T18:48:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.232+0000 7fb7d1607640 1 Processor -- start 2024-08-02T18:48:12.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7d1607640 1 -- start start 2024-08-02T18:48:12.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7d1607640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc102a60 0x7fb7cc1006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7d1607640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc103410 0x7fb7cc100c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7d1607640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7cc107fd0 0x7fb7cc101140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7d1607640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc111f10 con 0x7fb7cc102a60 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7d1607640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc111d90 con 0x7fb7cc103410 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7d1607640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb7cc112090 con 0x7fb7cc107fd0 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc102a60 0x7fb7cc1006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc102a60 0x7fb7cc1006c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58260/0 (socket says 172.21.15.103:58260) 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 -- 172.21.15.103:0/2786908478 learned_addr learned my addr 172.21.15.103:0/2786908478 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7cb7fe640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7cc107fd0 0x7fb7cc101140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7ca7fc640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc103410 0x7fb7cc100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:12.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 -- 172.21.15.103:0/2786908478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7cc107fd0 msgr2=0x7fb7cc101140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7cc107fd0 0x7fb7cc101140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 -- 172.21.15.103:0/2786908478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc103410 msgr2=0x7fb7cc100c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc103410 0x7fb7cc100c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 -- 172.21.15.103:0/2786908478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7cc1a6810 con 0x7fb7cc102a60 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.233+0000 7fb7caffd640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc102a60 0x7fb7cc1006c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00ea80 tx=0x7fb7bc00ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.234+0000 7fb7c3fff640 1 -- 172.21.15.103:0/2786908478 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc00ce40 con 0x7fb7cc102a60 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.234+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb7cc1a6b00 con 0x7fb7cc102a60 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.234+0000 7fb7c3fff640 1 -- 172.21.15.103:0/2786908478 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb7bc004b20 con 0x7fb7cc102a60 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.234+0000 7fb7c3fff640 1 -- 172.21.15.103:0/2786908478 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7bc011830 con 0x7fb7cc102a60 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.234+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7cc1a7040 con 0x7fb7cc102a60 2024-08-02T18:48:12.238 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.235+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb7cc102e40 con 0x7fb7cc102a60 2024-08-02T18:48:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.236+0000 7fb7c3fff640 1 -- 172.21.15.103:0/2786908478 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb7bc0119d0 con 0x7fb7cc102a60 2024-08-02T18:48:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.236+0000 7fb7c3fff640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7b80a2c10 0x7fb7b80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.236+0000 7fb7ca7fc640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7b80a2c10 0x7fb7b80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:12.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.236+0000 7fb7c3fff640 1 -- 172.21.15.103:0/2786908478 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb7bc0cfb80 con 0x7fb7cc102a60 2024-08-02T18:48:12.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.237+0000 7fb7ca7fc640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7b80a2c10 0x7fb7b80a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4005e00 tx=0x7fb7b4005c50 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:12.242 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.241+0000 7fb7c3fff640 1 -- 172.21.15.103:0/2786908478 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb7bc016030 con 0x7fb7cc102a60 2024-08-02T18:48:12.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.431+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}) -- 0x7fb7cc1070f0 con 0x7fb7b80a2c10 2024-08-02T18:48:12.455 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.453+0000 7fb7c3fff640 1 -- 172.21.15.103:0/2786908478 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+0 (secure 0 0 0) 0x7fb7cc1070f0 con 0x7fb7b80a2c10 2024-08-02T18:48:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7b80a2c10 msgr2=0x7fb7b80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7b80a2c10 0x7fb7b80a50d0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7fb7b4005e00 tx=0x7fb7b4005c50 comp rx=0 tx=0).stop 2024-08-02T18:48:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc102a60 msgr2=0x7fb7cc1006c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc102a60 0x7fb7cc1006c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7fb7bc00ea80 tx=0x7fb7bc00ef40 comp rx=0 tx=0).stop 2024-08-02T18:48:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 shutdown_connections 2024-08-02T18:48:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7b80a2c10 0x7fb7b80a50d0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb7cc107fd0 0x7fb7cc101140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb7cc103410 0x7fb7cc100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 --2- 172.21.15.103:0/2786908478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb7cc102a60 0x7fb7cc1006c0 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.455+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 >> 172.21.15.103:0/2786908478 conn(0x7fb7cc0fc500 msgr2=0x7fb7cc1059d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.456+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 shutdown_connections 2024-08-02T18:48:12.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:12.456+0000 7fb7d1607640 1 -- 172.21.15.103:0/2786908478 wait complete. 2024-08-02T18:48:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:12 smithi121 ceph-mon[37236]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:12.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:12 smithi121 ceph-mon[37236]: pgmap v292: 129 pgs: 129 active+clean; 590 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:12.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:12 smithi151 ceph-mon[37155]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:12.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:12 smithi151 ceph-mon[37155]: pgmap v292: 129 pgs: 129 active+clean; 590 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:12.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:12 smithi103 ceph-mon[32753]: from='client.14817 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_0", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:12.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:12 smithi103 ceph-mon[32753]: pgmap v292: 129 pgs: 129 active+clean; 590 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 4.0 KiB/s wr, 14 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:13.250 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs subvolume getpath cephfs --group_name qa sv_1 2024-08-02T18:48:13.504 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:13.749 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:13 smithi103 ceph-mon[32753]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:13.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:13 smithi121 ceph-mon[37236]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:13 smithi151 ceph-mon[37155]: from='client.14823 -' entity='client.admin' cmd=[{"prefix": "fs subvolume create", "vol_name": "cephfs", "sub_name": "sv_1", "group_name": "qa", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 -- 172.21.15.103:0/2911119517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2030101150 msgr2=0x7f203010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 --2- 172.21.15.103:0/2911119517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2030101150 0x7f203010d680 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f2028009cd0 tx=0x7f202802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 -- 172.21.15.103:0/2911119517 shutdown_connections 2024-08-02T18:48:13.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 --2- 172.21.15.103:0/2911119517 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2030101150 0x7f203010d680 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 --2- 172.21.15.103:0/2911119517 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20301007b0 0x7f2030100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 --2- 172.21.15.103:0/2911119517 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f20301067b0 0x7f2030106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 -- 172.21.15.103:0/2911119517 >> 172.21.15.103:0/2911119517 conn(0x7f20300fc4d0 msgr2=0x7f20300fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 -- 172.21.15.103:0/2911119517 shutdown_connections 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.975+0000 7f203683b640 1 -- 172.21.15.103:0/2911119517 wait complete. 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f203683b640 1 Processor -- start 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f203683b640 1 -- start start 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f203683b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20301007b0 0x7f20300fca20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f203683b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2030101150 0x7f20300fcf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:13.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f203683b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20301067b0 0x7f20300fd4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f203683b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2030110cd0 con 0x7f20301007b0 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f203683b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2030110b50 con 0x7f2030101150 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f203683b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2030110e50 con 0x7f20301067b0 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f202ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20301007b0 0x7f20300fca20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f202ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20301007b0 0x7f20300fca20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58282/0 (socket says 172.21.15.103:58282) 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f202ffff640 1 -- 172.21.15.103:0/171420456 learned_addr learned my addr 172.21.15.103:0/171420456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f202ffff640 1 -- 172.21.15.103:0/171420456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20301067b0 msgr2=0x7f20300fd4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f202ffff640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20301067b0 0x7f20300fd4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f202ffff640 1 -- 172.21.15.103:0/171420456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2030101150 msgr2=0x7f20300fcf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f202ffff640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2030101150 0x7f20300fcf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.976+0000 7f202ffff640 1 -- 172.21.15.103:0/171420456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f20301a66c0 con 0x7f20301007b0 2024-08-02T18:48:13.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.977+0000 7f202ffff640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20301007b0 0x7f20300fca20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f202000d950 tx=0x7f202000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.977+0000 7f202d7fa640 1 -- 172.21.15.103:0/171420456 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020017030 con 0x7f20301007b0 2024-08-02T18:48:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.977+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f20301a69b0 con 0x7f20301007b0 2024-08-02T18:48:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.977+0000 7f202d7fa640 1 -- 172.21.15.103:0/171420456 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2020004020 con 0x7f20301007b0 2024-08-02T18:48:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.977+0000 7f202d7fa640 1 -- 172.21.15.103:0/171420456 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2020004a00 con 0x7f20301007b0 2024-08-02T18:48:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.977+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20301a6ef0 con 0x7f20301007b0 2024-08-02T18:48:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.978+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2030100c10 con 0x7f20301007b0 2024-08-02T18:48:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.979+0000 7f202d7fa640 1 -- 172.21.15.103:0/171420456 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f20200041d0 con 0x7f20301007b0 2024-08-02T18:48:13.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.979+0000 7f202d7fa640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f201c0a2c10 0x7f201c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.980+0000 7f202f7fe640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f201c0a2c10 0x7f201c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.980+0000 7f202d7fa640 1 -- 172.21.15.103:0/171420456 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f20200cefb0 con 0x7f20301007b0 2024-08-02T18:48:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.980+0000 7f202f7fe640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f201c0a2c10 0x7f201c0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2018005fd0 tx=0x7f2018005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:13.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:13.984+0000 7f202d7fa640 1 -- 172.21.15.103:0/171420456 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f202009ba50 con 0x7f20301007b0 2024-08-02T18:48:14.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.179+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}) -- 0x7f2030062360 con 0x7f201c0a2c10 2024-08-02T18:48:14.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.185+0000 7f202d7fa640 1 -- 172.21.15.103:0/171420456 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+54 (secure 0 0 0) 0x7f2030062360 con 0x7f201c0a2c10 2024-08-02T18:48:14.186 INFO:teuthology.orchestra.run.smithi103.stdout:/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 2024-08-02T18:48:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f201c0a2c10 msgr2=0x7f201c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f201c0a2c10 0x7f201c0a50d0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f2018005fd0 tx=0x7f2018005850 comp rx=0 tx=0).stop 2024-08-02T18:48:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20301007b0 msgr2=0x7f20300fca20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20301007b0 0x7f20300fca20 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f202000d950 tx=0x7f202000de10 comp rx=0 tx=0).stop 2024-08-02T18:48:14.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 shutdown_connections 2024-08-02T18:48:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f201c0a2c10 0x7f201c0a50d0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f20301067b0 0x7f20300fd4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2030101150 0x7f20300fcf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 --2- 172.21.15.103:0/171420456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f20301007b0 0x7f20300fca20 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 >> 172.21.15.103:0/171420456 conn(0x7f20300fc4d0 msgr2=0x7f203006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 shutdown_connections 2024-08-02T18:48:14.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:14.187+0000 7f203683b640 1 -- 172.21.15.103:0/171420456 wait complete. 2024-08-02T18:48:14.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:14 smithi121 ceph-mon[37236]: pgmap v293: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 16 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:14.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:14 smithi151 ceph-mon[37155]: pgmap v293: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 16 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:14.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:14 smithi103 ceph-mon[32753]: pgmap v293: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 11 KiB/s rd, 8.5 KiB/s wr, 16 op/s; 4 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:14.942 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:48:15.196 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:15.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:15 smithi103 ceph-mon[32753]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 -- 172.21.15.103:0/1814301395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe81022a0 msgr2=0x7f4fe81026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1814301395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe81022a0 0x7f4fe81026e0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f4fdc009900 tx=0x7f4fdc02a480 comp rx=0 tx=0).stop 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 -- 172.21.15.103:0/1814301395 shutdown_connections 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1814301395 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fe8102c20 0x7f4fe810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1814301395 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe81022a0 0x7f4fe81026e0 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1814301395 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe8100b50 0x7f4fe8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 -- 172.21.15.103:0/1814301395 >> 172.21.15.103:0/1814301395 conn(0x7f4fe80fc500 msgr2=0x7f4fe80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 -- 172.21.15.103:0/1814301395 shutdown_connections 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.704+0000 7f4fefba2640 1 -- 172.21.15.103:0/1814301395 wait complete. 2024-08-02T18:48:15.711 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fefba2640 1 Processor -- start 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fefba2640 1 -- start start 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fefba2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe8100b50 0x7f4fe8197200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fefba2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fe81022a0 0x7f4fe8197740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fefba2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe8102c20 0x7f4fe819bad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fefba2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe8110da0 con 0x7f4fe8102c20 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fefba2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe8110c20 con 0x7f4fe8100b50 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fefba2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4fe8110f20 con 0x7f4fe81022a0 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe8102c20 0x7f4fe819bad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe8102c20 0x7f4fe819bad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58292/0 (socket says 172.21.15.103:58292) 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 -- 172.21.15.103:0/1800957089 learned_addr learned my addr 172.21.15.103:0/1800957089 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fed13d640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fe81022a0 0x7f4fe8197740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fed93e640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe8100b50 0x7f4fe8197200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 -- 172.21.15.103:0/1800957089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fe81022a0 msgr2=0x7f4fe8197740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:15.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fe81022a0 0x7f4fe8197740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 -- 172.21.15.103:0/1800957089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe8100b50 msgr2=0x7f4fe8197200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe8100b50 0x7f4fe8197200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 -- 172.21.15.103:0/1800957089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4fe819c1b0 con 0x7f4fe8102c20 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fed93e640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe8100b50 0x7f4fe8197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fee13f640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe8102c20 0x7f4fe819bad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800eaa0 tx=0x7f4fd800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.705+0000 7f4fe6ffd640 1 -- 172.21.15.103:0/1800957089 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd800cdb0 con 0x7f4fe8102c20 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.706+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4fe819c4a0 con 0x7f4fe8102c20 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.706+0000 7f4fe6ffd640 1 -- 172.21.15.103:0/1800957089 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4fd8004b20 con 0x7f4fe8102c20 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.706+0000 7f4fe6ffd640 1 -- 172.21.15.103:0/1800957089 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4fd8011760 con 0x7f4fe8102c20 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.706+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4fe81a3d80 con 0x7f4fe8102c20 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.707+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4fe8100f30 con 0x7f4fe8102c20 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.708+0000 7f4fe6ffd640 1 -- 172.21.15.103:0/1800957089 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4fd8004cd0 con 0x7f4fe8102c20 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.708+0000 7f4fe6ffd640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4fd00a2c10 0x7f4fd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:15.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.708+0000 7f4fed93e640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4fd00a2c10 0x7f4fd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:15.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.709+0000 7f4fe6ffd640 1 -- 172.21.15.103:0/1800957089 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f4fd80cf740 con 0x7f4fe8102c20 2024-08-02T18:48:15.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.709+0000 7f4fed93e640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4fd00a2c10 0x7f4fd00a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0005d00 tx=0x7f4fe0005c70 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:15.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.713+0000 7f4fe6ffd640 1 -- 172.21.15.103:0/1800957089 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4fd8016030 con 0x7f4fe8102c20 2024-08-02T18:48:15.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:15 smithi121 ceph-mon[37236]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:15.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:15 smithi151 ceph-mon[37155]: from='client.14829 -' entity='client.admin' cmd=[{"prefix": "fs subvolume getpath", "vol_name": "cephfs", "group_name": "qa", "sub_name": "sv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:48:15.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.913+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f4fe81a3f50 con 0x7f4fe8102c20 2024-08-02T18:48:15.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.914+0000 7f4fe6ffd640 1 -- 172.21.15.103:0/1800957089 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7f4fd809c1e0 con 0x7f4fe8102c20 2024-08-02T18:48:15.916 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:48:15.916 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-08-02T18:48:05:450957+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:48:05.212257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T18:48:15.916 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-08-02T18:48:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4fd00a2c10 msgr2=0x7f4fd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4fd00a2c10 0x7f4fd00a50d0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4fe0005d00 tx=0x7f4fe0005c70 comp rx=0 tx=0).stop 2024-08-02T18:48:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe8102c20 msgr2=0x7f4fe819bad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe8102c20 0x7f4fe819bad0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f4fd800eaa0 tx=0x7f4fd800ef60 comp rx=0 tx=0).stop 2024-08-02T18:48:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 shutdown_connections 2024-08-02T18:48:15.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4fe8102c20 0x7f4fe819bad0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4fd00a2c10 0x7f4fd00a50d0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4fe81022a0 0x7f4fe8197740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 --2- 172.21.15.103:0/1800957089 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4fe8100b50 0x7f4fe8197200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.916+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 >> 172.21.15.103:0/1800957089 conn(0x7f4fe80fc500 msgr2=0x7f4fe81065d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.917+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 shutdown_connections 2024-08-02T18:48:15.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:15.917+0000 7f4fefba2640 1 -- 172.21.15.103:0/1800957089 wait complete. 2024-08-02T18:48:16.704 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:48:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:16 smithi121 ceph-mon[37236]: pgmap v294: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 KiB/s wr, 12 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:16.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:16 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1800957089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:48:16.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:16 smithi151 ceph-mon[37155]: pgmap v294: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 KiB/s wr, 12 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:16.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:16 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1800957089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:48:16.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:16 smithi103 ceph-mon[32753]: pgmap v294: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 9.1 KiB/s rd, 7.1 KiB/s wr, 12 op/s; 3 B/s, 2 keys/s, 0 objects/s recovering 2024-08-02T18:48:16.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:16 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1800957089' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:48:16.957 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 -- 172.21.15.103:0/1386816615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa84102260 msgr2=0x7ffa8410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/1386816615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa84102260 0x7ffa8410e790 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7ffa7c009cd0 tx=0x7ffa7c02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 -- 172.21.15.103:0/1386816615 shutdown_connections 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/1386816615 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa84102260 0x7ffa8410e790 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/1386816615 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa841018c0 0x7ffa84101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/1386816615 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa841078c0 0x7ffa84107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 -- 172.21.15.103:0/1386816615 >> 172.21.15.103:0/1386816615 conn(0x7ffa840fd5e0 msgr2=0x7ffa840ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 -- 172.21.15.103:0/1386816615 shutdown_connections 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.431+0000 7ffa8b91e640 1 -- 172.21.15.103:0/1386816615 wait complete. 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa8b91e640 1 Processor -- start 2024-08-02T18:48:17.445 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa8b91e640 1 -- start start 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa8b91e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa841018c0 0x7ffa841981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa8b91e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa84102260 0x7ffa84198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa8b91e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa841078c0 0x7ffa8419ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa8b91e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffa84111de0 con 0x7ffa841018c0 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa8b91e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffa84111c60 con 0x7ffa84102260 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa8b91e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffa84111f60 con 0x7ffa841078c0 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa896ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa841018c0 0x7ffa841981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa896ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa841018c0 0x7ffa841981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:58316/0 (socket says 172.21.15.103:58316) 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.432+0000 7ffa896ba640 1 -- 172.21.15.103:0/3583867645 learned_addr learned my addr 172.21.15.103:0/3583867645 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa89ebb640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa841078c0 0x7ffa8419ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa88eb9640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa84102260 0x7ffa84198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:17.446 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa896ba640 1 -- 172.21.15.103:0/3583867645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa841078c0 msgr2=0x7ffa8419ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa896ba640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa841078c0 0x7ffa8419ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa896ba640 1 -- 172.21.15.103:0/3583867645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa84102260 msgr2=0x7ffa84198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa896ba640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa84102260 0x7ffa84198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa896ba640 1 -- 172.21.15.103:0/3583867645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffa8419d170 con 0x7ffa841018c0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa896ba640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa841018c0 0x7ffa841981c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e9f0 tx=0x7ffa7400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa7a7fc640 1 -- 172.21.15.103:0/3583867645 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa7400cd80 con 0x7ffa841018c0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa7a7fc640 1 -- 172.21.15.103:0/3583867645 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffa74005520 con 0x7ffa841018c0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffa8419d460 con 0x7ffa841018c0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa7a7fc640 1 -- 172.21.15.103:0/3583867645 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffa74010690 con 0x7ffa841018c0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.433+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffa841a4d40 con 0x7ffa841018c0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.434+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffa84101d20 con 0x7ffa841018c0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.435+0000 7ffa7a7fc640 1 -- 172.21.15.103:0/3583867645 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ffa740046c0 con 0x7ffa841018c0 2024-08-02T18:48:17.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.436+0000 7ffa7a7fc640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa700a2c10 0x7ffa700a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:17.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.436+0000 7ffa88eb9640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa700a2c10 0x7ffa700a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:17.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.436+0000 7ffa7a7fc640 1 -- 172.21.15.103:0/3583867645 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ffa740cfa30 con 0x7ffa841018c0 2024-08-02T18:48:17.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.437+0000 7ffa88eb9640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa700a2c10 0x7ffa700a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa840ffb70 tx=0x7ffa80005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:17.448 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.440+0000 7ffa7a7fc640 1 -- 172.21.15.103:0/3583867645 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ffa7409c4d0 con 0x7ffa841018c0 2024-08-02T18:48:17.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.607+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ffa84199520 con 0x7ffa841018c0 2024-08-02T18:48:17.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.609+0000 7ffa7a7fc640 1 -- 172.21.15.103:0/3583867645 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24703 (secure 0 0 0) 0x7ffa7409bdd0 con 0x7ffa841018c0 2024-08-02T18:48:17.611 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:48:17.611 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:48:06.458748+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa700a2c10 msgr2=0x7ffa700a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa700a2c10 0x7ffa700a50d0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7ffa840ffb70 tx=0x7ffa80005f90 comp rx=0 tx=0).stop 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa841018c0 msgr2=0x7ffa841981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa841018c0 0x7ffa841981c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7ffa7400e9f0 tx=0x7ffa7400edf0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 shutdown_connections 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffa700a2c10 0x7ffa700a50d0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffa841078c0 0x7ffa8419ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffa84102260 0x7ffa84198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 --2- 172.21.15.103:0/3583867645 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffa841018c0 0x7ffa841981c0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.611+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 >> 172.21.15.103:0/3583867645 conn(0x7ffa840fd5e0 msgr2=0x7ffa840fdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.612+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 shutdown_connections 2024-08-02T18:48:17.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:17.612+0000 7ffa8b91e640 1 -- 172.21.15.103:0/3583867645 wait complete. 2024-08-02T18:48:18.391 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-02T18:48:18.391 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-02T18:48:18.672 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:18.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:18 smithi121 ceph-mon[37236]: pgmap v295: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:18.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:18 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3583867645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:18.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:18 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:48:18.794 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:18 smithi103 ceph-mon[32753]: pgmap v295: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:18.794 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:18 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3583867645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:18.795 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:18 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:48:18.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:18 smithi151 ceph-mon[37155]: pgmap v295: 129 pgs: 129 active+clean; 623 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 4.7 KiB/s wr, 8 op/s; 3 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:18.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:18 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3583867645' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:18.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:18 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:48:19.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 -- 172.21.15.103:0/2704274568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad8101150 msgr2=0x7ffad810d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:19.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 --2- 172.21.15.103:0/2704274568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad8101150 0x7ffad810d680 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009cd0 tx=0x7ffad002a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 -- 172.21.15.103:0/2704274568 shutdown_connections 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 --2- 172.21.15.103:0/2704274568 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad8101150 0x7ffad810d680 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 --2- 172.21.15.103:0/2704274568 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffad81007b0 0x7ffad8100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 --2- 172.21.15.103:0/2704274568 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad81067b0 0x7ffad8106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 -- 172.21.15.103:0/2704274568 >> 172.21.15.103:0/2704274568 conn(0x7ffad80fc4d0 msgr2=0x7ffad80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 -- 172.21.15.103:0/2704274568 shutdown_connections 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.183+0000 7ffadee19640 1 -- 172.21.15.103:0/2704274568 wait complete. 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadee19640 1 Processor -- start 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadee19640 1 -- start start 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadee19640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad81007b0 0x7ffad8199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadee19640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffad8101150 0x7ffad81995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadee19640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad81067b0 0x7ffad81a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:19.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadee19640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffad8110cd0 con 0x7ffad81067b0 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadee19640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffad8110b50 con 0x7ffad8101150 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadee19640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffad8110e50 con 0x7ffad81007b0 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadd3b6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad81067b0 0x7ffad81a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadd3b6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad81067b0 0x7ffad81a40e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56094/0 (socket says 172.21.15.103:56094) 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadd3b6640 1 -- 172.21.15.103:0/3437571422 learned_addr learned my addr 172.21.15.103:0/3437571422 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffad7fff640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffad8101150 0x7ffad81995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.184+0000 7ffadcbb5640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad81007b0 0x7ffad8199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffadd3b6640 1 -- 172.21.15.103:0/3437571422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad81007b0 msgr2=0x7ffad8199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffadd3b6640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad81007b0 0x7ffad8199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffadd3b6640 1 -- 172.21.15.103:0/3437571422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffad8101150 msgr2=0x7ffad81995a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:19.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffadd3b6640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffad8101150 0x7ffad81995a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffadd3b6640 1 -- 172.21.15.103:0/3437571422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffad81a4620 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffadd3b6640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad81067b0 0x7ffad81a40e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffad0006010 tx=0x7ffad0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffad5ffb640 1 -- 172.21.15.103:0/3437571422 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0004040 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffad81a47f0 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffad5ffb640 1 -- 172.21.15.103:0/3437571422 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad00046e0 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffad5ffb640 1 -- 172.21.15.103:0/3437571422 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0046480 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.185+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffad81a4cd0 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.186+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffad8100c10 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.187+0000 7ffad5ffb640 1 -- 172.21.15.103:0/3437571422 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ffad0030630 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.188+0000 7ffad5ffb640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffac80a2c10 0x7ffac80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.188+0000 7ffad5ffb640 1 -- 172.21.15.103:0/3437571422 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ffad002e030 con 0x7ffad81067b0 2024-08-02T18:48:19.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.188+0000 7ffadcbb5640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffac80a2c10 0x7ffac80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:19.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.189+0000 7ffadcbb5640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffac80a2c10 0x7ffac80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffacc005fd0 tx=0x7ffacc00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:19.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.191+0000 7ffad5ffb640 1 -- 172.21.15.103:0/3437571422 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ffad004b060 con 0x7ffad81067b0 2024-08-02T18:48:19.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.364+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ffad80fd1f0 con 0x7ffac80a2c10 2024-08-02T18:48:19.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.374+0000 7ffad5ffb640 1 -- 172.21.15.103:0/3437571422 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340377 (secure 0 0 0) 0x7ffad80fd1f0 con 0x7ffac80a2c10 2024-08-02T18:48:19.381 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:48:19.384 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:48:19.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffac80a2c10 msgr2=0x7ffac80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:19.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffac80a2c10 0x7ffac80a50d0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7ffacc005fd0 tx=0x7ffacc00b390 comp rx=0 tx=0).stop 2024-08-02T18:48:19.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad81067b0 msgr2=0x7ffad81a40e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:19.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad81067b0 0x7ffad81a40e0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7ffad0006010 tx=0x7ffad0003f10 comp rx=0 tx=0).stop 2024-08-02T18:48:19.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 shutdown_connections 2024-08-02T18:48:19.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffad81067b0 0x7ffad81a40e0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffad8101150 0x7ffad81995a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ffac80a2c10 0x7ffac80a50d0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 --2- 172.21.15.103:0/3437571422 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffad81007b0 0x7ffad8199060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:19.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.377+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 >> 172.21.15.103:0/3437571422 conn(0x7ffad80fc4d0 msgr2=0x7ffad80fcae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:19.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.378+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 shutdown_connections 2024-08-02T18:48:19.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:19.378+0000 7ffadee19640 1 -- 172.21.15.103:0/3437571422 wait complete. 2024-08-02T18:48:20.663 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-08-02T18:48:19.345259+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653257,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":242,"num_read_kb":239,"num_write":347,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375576,"kb_used_data":13924,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566248,"statfs":{"total":1151940427776,"available":1151555837952,"internally_reserved":0,"allocated":14258176,"data_stored":7916629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":55438,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":-6,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":82,"num_read_kb":101,"num_write":37,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002982"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467259+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:48:06.467259+0000","last_peered":"2024-08-02T18:48:06.467259+0000","last_clean":"2024-08-02T18:48:06.467259+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:48:06.467259+0000","last_undegraded":"2024-08-02T18:48:06.467259+0000","last_fullsized":"2024-08-02T18:48:06.467259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.479265+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:48:06.479265+0000","last_peered":"2024-08-02T18:48:06.479265+0000","last_clean":"2024-08-02T18:48:06.479265+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:48:06.479265+0000","last_undegraded":"2024-08-02T18:48:06.479265+0000","last_fullsized":"2024-08-02T18:48:06.479265+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466753+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:48:06.466753+0000","last_peered":"2024-08-02T18:48:06.466753+0000","last_clean":"2024-08-02T18:48:06.466753+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:48:06.466753+0000","last_undegraded":"2024-08-02T18:48:06.466753+0000","last_fullsized":"2024-08-02T18:48:06.466753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471873+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:48:06.471873+0000","last_peered":"2024-08-02T18:48:06.471873+0000","last_clean":"2024-08-02T18:48:06.471873+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:48:06.471873+0000","last_undegraded":"2024-08-02T18:48:06.471873+0000","last_fullsized":"2024-08-02T18:48:06.471873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470243+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:48:06.470243+0000","last_peered":"2024-08-02T18:48:06.470243+0000","last_clean":"2024-08-02T18:48:06.470243+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:48:06.470243+0000","last_undegraded":"2024-08-02T18:48:06.470243+0000","last_fullsized":"2024-08-02T18:48:06.470243+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468214+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:48:06.468214+0000","last_peered":"2024-08-02T18:48:06.468214+0000","last_clean":"2024-08-02T18:48:06.468214+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:48:06.468214+0000","last_undegraded":"2024-08-02T18:48:06.468214+0000","last_fullsized":"2024-08-02T18:48:06.468214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478787+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:48:06.478787+0000","last_peered":"2024-08-02T18:48:06.478787+0000","last_clean":"2024-08-02T18:48:06.478787+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:48:06.478787+0000","last_undegraded":"2024-08-02T18:48:06.478787+0000","last_fullsized":"2024-08-02T18:48:06.478787+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857372+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:48:06.857372+0000","last_peered":"2024-08-02T18:48:06.857372+0000","last_clean":"2024-08-02T18:48:06.857372+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:48:06.857372+0000","last_undegraded":"2024-08-02T18:48:06.857372+0000","last_fullsized":"2024-08-02T18:48:06.857372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468363+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:48:06.468363+0000","last_peered":"2024-08-02T18:48:06.468363+0000","last_clean":"2024-08-02T18:48:06.468363+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:48:06.468363+0000","last_undegraded":"2024-08-02T18:48:06.468363+0000","last_fullsized":"2024-08-02T18:48:06.468363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472850+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:48:06.472850+0000","last_peered":"2024-08-02T18:48:06.472850+0000","last_clean":"2024-08-02T18:48:06.472850+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:48:06.472850+0000","last_undegraded":"2024-08-02T18:48:06.472850+0000","last_fullsized":"2024-08-02T18:48:06.472850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476328+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:48:06.476328+0000","last_peered":"2024-08-02T18:48:06.476328+0000","last_clean":"2024-08-02T18:48:06.476328+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:48:06.476328+0000","last_undegraded":"2024-08-02T18:48:06.476328+0000","last_fullsized":"2024-08-02T18:48:06.476328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469154+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:48:06.469154+0000","last_peered":"2024-08-02T18:48:06.469154+0000","last_clean":"2024-08-02T18:48:06.469154+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:48:06.469154+0000","last_undegraded":"2024-08-02T18:48:06.469154+0000","last_fullsized":"2024-08-02T18:48:06.469154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466908+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:48:06.466908+0000","last_peered":"2024-08-02T18:48:06.466908+0000","last_clean":"2024-08-02T18:48:06.466908+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:48:06.466908+0000","last_undegraded":"2024-08-02T18:48:06.466908+0000","last_fullsized":"2024-08-02T18:48:06.466908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472334+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:48:06.472334+0000","last_peered":"2024-08-02T18:48:06.472334+0000","last_clean":"2024-08-02T18:48:06.472334+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:48:06.472334+0000","last_undegraded":"2024-08-02T18:48:06.472334+0000","last_fullsized":"2024-08-02T18:48:06.472334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468348+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:48:06.468348+0000","last_peered":"2024-08-02T18:48:06.468348+0000","last_clean":"2024-08-02T18:48:06.468348+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:48:06.468348+0000","last_undegraded":"2024-08-02T18:48:06.468348+0000","last_fullsized":"2024-08-02T18:48:06.468348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471227+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:48:06.471227+0000","last_peered":"2024-08-02T18:48:06.471227+0000","last_clean":"2024-08-02T18:48:06.471227+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:48:06.471227+0000","last_undegraded":"2024-08-02T18:48:06.471227+0000","last_fullsized":"2024-08-02T18:48:06.471227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467420+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:48:06.467420+0000","last_peered":"2024-08-02T18:48:06.467420+0000","last_clean":"2024-08-02T18:48:06.467420+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:48:06.467420+0000","last_undegraded":"2024-08-02T18:48:06.467420+0000","last_fullsized":"2024-08-02T18:48:06.467420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468674+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:48:06.468674+0000","last_peered":"2024-08-02T18:48:06.468674+0000","last_clean":"2024-08-02T18:48:06.468674+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:48:06.468674+0000","last_undegraded":"2024-08-02T18:48:06.468674+0000","last_fullsized":"2024-08-02T18:48:06.468674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468642+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:48:06.468642+0000","last_peered":"2024-08-02T18:48:06.468642+0000","last_clean":"2024-08-02T18:48:06.468642+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:48:06.468642+0000","last_undegraded":"2024-08-02T18:48:06.468642+0000","last_fullsized":"2024-08-02T18:48:06.468642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471807+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:48:06.471807+0000","last_peered":"2024-08-02T18:48:06.471807+0000","last_clean":"2024-08-02T18:48:06.471807+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:48:06.471807+0000","last_undegraded":"2024-08-02T18:48:06.471807+0000","last_fullsized":"2024-08-02T18:48:06.471807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466974+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:48:06.466974+0000","last_peered":"2024-08-02T18:48:06.466974+0000","last_clean":"2024-08-02T18:48:06.466974+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:48:06.466974+0000","last_undegraded":"2024-08-02T18:48:06.466974+0000","last_fullsized":"2024-08-02T18:48:06.466974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472170+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:48:06.472170+0000","last_peered":"2024-08-02T18:48:06.472170+0000","last_clean":"2024-08-02T18:48:06.472170+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:48:06.472170+0000","last_undegraded":"2024-08-02T18:48:06.472170+0000","last_fullsized":"2024-08-02T18:48:06.472170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857187+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:48:06.857187+0000","last_peered":"2024-08-02T18:48:06.857187+0000","last_clean":"2024-08-02T18:48:06.857187+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:48:06.857187+0000","last_undegraded":"2024-08-02T18:48:06.857187+0000","last_fullsized":"2024-08-02T18:48:06.857187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478332+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:48:06.478332+0000","last_peered":"2024-08-02T18:48:06.478332+0000","last_clean":"2024-08-02T18:48:06.478332+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:48:06.478332+0000","last_undegraded":"2024-08-02T18:48:06.478332+0000","last_fullsized":"2024-08-02T18:48:06.478332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475960+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:48:06.475960+0000","last_peered":"2024-08-02T18:48:06.475960+0000","last_clean":"2024-08-02T18:48:06.475960+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:48:06.475960+0000","last_undegraded":"2024-08-02T18:48:06.475960+0000","last_fullsized":"2024-08-02T18:48:06.475960+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469266+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:48:06.469266+0000","last_peered":"2024-08-02T18:48:06.469266+0000","last_clean":"2024-08-02T18:48:06.469266+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:48:06.469266+0000","last_undegraded":"2024-08-02T18:48:06.469266+0000","last_fullsized":"2024-08-02T18:48:06.469266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467032+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:48:06.467032+0000","last_peered":"2024-08-02T18:48:06.467032+0000","last_clean":"2024-08-02T18:48:06.467032+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:48:06.467032+0000","last_undegraded":"2024-08-02T18:48:06.467032+0000","last_fullsized":"2024-08-02T18:48:06.467032+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471463+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:48:06.471463+0000","last_peered":"2024-08-02T18:48:06.471463+0000","last_clean":"2024-08-02T18:48:06.471463+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:48:06.471463+0000","last_undegraded":"2024-08-02T18:48:06.471463+0000","last_fullsized":"2024-08-02T18:48:06.471463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:17.329689+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:48:17.329689+0000","last_peered":"2024-08-02T18:48:17.329689+0000","last_clean":"2024-08-02T18:48:17.329689+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:48:17.329689+0000","last_undegraded":"2024-08-02T18:48:17.329689+0000","last_fullsized":"2024-08-02T18:48:17.329689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471002+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:48:06.471002+0000","last_peered":"2024-08-02T18:48:06.471002+0000","last_clean":"2024-08-02T18:48:06.471002+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:48:06.471002+0000","last_undegraded":"2024-08-02T18:48:06.471002+0000","last_fullsized":"2024-08-02T18:48:06.471002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475418+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:48:06.475418+0000","last_peered":"2024-08-02T18:48:06.475418+0000","last_clean":"2024-08-02T18:48:06.475418+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:48:06.475418+0000","last_undegraded":"2024-08-02T18:48:06.475418+0000","last_fullsized":"2024-08-02T18:48:06.475418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472995+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:48:06.472995+0000","last_peered":"2024-08-02T18:48:06.472995+0000","last_clean":"2024-08-02T18:48:06.472995+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:48:06.472995+0000","last_undegraded":"2024-08-02T18:48:06.472995+0000","last_fullsized":"2024-08-02T18:48:06.472995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469428+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:48:06.469428+0000","last_peered":"2024-08-02T18:48:06.469428+0000","last_clean":"2024-08-02T18:48:06.469428+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:48:06.469428+0000","last_undegraded":"2024-08-02T18:48:06.469428+0000","last_fullsized":"2024-08-02T18:48:06.469428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470281+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:48:06.470281+0000","last_peered":"2024-08-02T18:48:06.470281+0000","last_clean":"2024-08-02T18:48:06.470281+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:48:06.470281+0000","last_undegraded":"2024-08-02T18:48:06.470281+0000","last_fullsized":"2024-08-02T18:48:06.470281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466380+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:48:06.466380+0000","last_peered":"2024-08-02T18:48:06.466380+0000","last_clean":"2024-08-02T18:48:06.466380+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:48:06.466380+0000","last_undegraded":"2024-08-02T18:48:06.466380+0000","last_fullsized":"2024-08-02T18:48:06.466380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472334+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:48:06.472334+0000","last_peered":"2024-08-02T18:48:06.472334+0000","last_clean":"2024-08-02T18:48:06.472334+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:48:06.472334+0000","last_undegraded":"2024-08-02T18:48:06.472334+0000","last_fullsized":"2024-08-02T18:48:06.472334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470170+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:48:06.470170+0000","last_peered":"2024-08-02T18:48:06.470170+0000","last_clean":"2024-08-02T18:48:06.470170+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:48:06.470170+0000","last_undegraded":"2024-08-02T18:48:06.470170+0000","last_fullsized":"2024-08-02T18:48:06.470170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467096+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:48:06.467096+0000","last_peered":"2024-08-02T18:48:06.467096+0000","last_clean":"2024-08-02T18:48:06.467096+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:48:06.467096+0000","last_undegraded":"2024-08-02T18:48:06.467096+0000","last_fullsized":"2024-08-02T18:48:06.467096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475268+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:48:06.475268+0000","last_peered":"2024-08-02T18:48:06.475268+0000","last_clean":"2024-08-02T18:48:06.475268+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:48:06.475268+0000","last_undegraded":"2024-08-02T18:48:06.475268+0000","last_fullsized":"2024-08-02T18:48:06.475268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476482+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:48:06.476482+0000","last_peered":"2024-08-02T18:48:06.476482+0000","last_clean":"2024-08-02T18:48:06.476482+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:48:06.476482+0000","last_undegraded":"2024-08-02T18:48:06.476482+0000","last_fullsized":"2024-08-02T18:48:06.476482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:13.485028+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:48:13.485028+0000","last_peered":"2024-08-02T18:48:13.485028+0000","last_clean":"2024-08-02T18:48:13.485028+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:48:13.485028+0000","last_undegraded":"2024-08-02T18:48:13.485028+0000","last_fullsized":"2024-08-02T18:48:13.485028+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475578+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:48:06.475578+0000","last_peered":"2024-08-02T18:48:06.475578+0000","last_clean":"2024-08-02T18:48:06.475578+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:48:06.475578+0000","last_undegraded":"2024-08-02T18:48:06.475578+0000","last_fullsized":"2024-08-02T18:48:06.475578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474772+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:48:06.474772+0000","last_peered":"2024-08-02T18:48:06.474772+0000","last_clean":"2024-08-02T18:48:06.474772+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:48:06.474772+0000","last_undegraded":"2024-08-02T18:48:06.474772+0000","last_fullsized":"2024-08-02T18:48:06.474772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466844+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:48:06.466844+0000","last_peered":"2024-08-02T18:48:06.466844+0000","last_clean":"2024-08-02T18:48:06.466844+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:48:06.466844+0000","last_undegraded":"2024-08-02T18:48:06.466844+0000","last_fullsized":"2024-08-02T18:48:06.466844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476640+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:48:06.476640+0000","last_peered":"2024-08-02T18:48:06.476640+0000","last_clean":"2024-08-02T18:48:06.476640+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:48:06.476640+0000","last_undegraded":"2024-08-02T18:48:06.476640+0000","last_fullsized":"2024-08-02T18:48:06.476640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471153+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:48:06.471153+0000","last_peered":"2024-08-02T18:48:06.471153+0000","last_clean":"2024-08-02T18:48:06.471153+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:48:06.471153+0000","last_undegraded":"2024-08-02T18:48:06.471153+0000","last_fullsized":"2024-08-02T18:48:06.471153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468846+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:48:06.468846+0000","last_peered":"2024-08-02T18:48:06.468846+0000","last_clean":"2024-08-02T18:48:06.468846+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:48:06.468846+0000","last_undegraded":"2024-08-02T18:48:06.468846+0000","last_fullsized":"2024-08-02T18:48:06.468846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466987+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:48:06.466987+0000","last_peered":"2024-08-02T18:48:06.466987+0000","last_clean":"2024-08-02T18:48:06.466987+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:48:06.466987+0000","last_undegraded":"2024-08-02T18:48:06.466987+0000","last_fullsized":"2024-08-02T18:48:06.466987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467297+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:48:06.467297+0000","last_peered":"2024-08-02T18:48:06.467297+0000","last_clean":"2024-08-02T18:48:06.467297+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:48:06.467297+0000","last_undegraded":"2024-08-02T18:48:06.467297+0000","last_fullsized":"2024-08-02T18:48:06.467297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467403+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:48:06.467403+0000","last_peered":"2024-08-02T18:48:06.467403+0000","last_clean":"2024-08-02T18:48:06.467403+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:48:06.467403+0000","last_undegraded":"2024-08-02T18:48:06.467403+0000","last_fullsized":"2024-08-02T18:48:06.467403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468158+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:48:06.468158+0000","last_peered":"2024-08-02T18:48:06.468158+0000","last_clean":"2024-08-02T18:48:06.468158+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:48:06.468158+0000","last_undegraded":"2024-08-02T18:48:06.468158+0000","last_fullsized":"2024-08-02T18:48:06.468158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857189+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:48:06.857189+0000","last_peered":"2024-08-02T18:48:06.857189+0000","last_clean":"2024-08-02T18:48:06.857189+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:48:06.857189+0000","last_undegraded":"2024-08-02T18:48:06.857189+0000","last_fullsized":"2024-08-02T18:48:06.857189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467131+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:48:06.467131+0000","last_peered":"2024-08-02T18:48:06.467131+0000","last_clean":"2024-08-02T18:48:06.467131+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:48:06.467131+0000","last_undegraded":"2024-08-02T18:48:06.467131+0000","last_fullsized":"2024-08-02T18:48:06.467131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476651+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:48:06.476651+0000","last_peered":"2024-08-02T18:48:06.476651+0000","last_clean":"2024-08-02T18:48:06.476651+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:48:06.476651+0000","last_undegraded":"2024-08-02T18:48:06.476651+0000","last_fullsized":"2024-08-02T18:48:06.476651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469891+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:48:06.469891+0000","last_peered":"2024-08-02T18:48:06.469891+0000","last_clean":"2024-08-02T18:48:06.469891+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:48:06.469891+0000","last_undegraded":"2024-08-02T18:48:06.469891+0000","last_fullsized":"2024-08-02T18:48:06.469891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467502+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:48:06.467502+0000","last_peered":"2024-08-02T18:48:06.467502+0000","last_clean":"2024-08-02T18:48:06.467502+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:48:06.467502+0000","last_undegraded":"2024-08-02T18:48:06.467502+0000","last_fullsized":"2024-08-02T18:48:06.467502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475786+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:48:06.475786+0000","last_peered":"2024-08-02T18:48:06.475786+0000","last_clean":"2024-08-02T18:48:06.475786+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:48:06.475786+0000","last_undegraded":"2024-08-02T18:48:06.475786+0000","last_fullsized":"2024-08-02T18:48:06.475786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475721+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:48:06.475721+0000","last_peered":"2024-08-02T18:48:06.475721+0000","last_clean":"2024-08-02T18:48:06.475721+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:48:06.475721+0000","last_undegraded":"2024-08-02T18:48:06.475721+0000","last_fullsized":"2024-08-02T18:48:06.475721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468919+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:48:06.468919+0000","last_peered":"2024-08-02T18:48:06.468919+0000","last_clean":"2024-08-02T18:48:06.468919+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:48:06.468919+0000","last_undegraded":"2024-08-02T18:48:06.468919+0000","last_fullsized":"2024-08-02T18:48:06.468919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473065+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:48:06.473065+0000","last_peered":"2024-08-02T18:48:06.473065+0000","last_clean":"2024-08-02T18:48:06.473065+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:48:06.473065+0000","last_undegraded":"2024-08-02T18:48:06.473065+0000","last_fullsized":"2024-08-02T18:48:06.473065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475791+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:48:06.475791+0000","last_peered":"2024-08-02T18:48:06.475791+0000","last_clean":"2024-08-02T18:48:06.475791+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:48:06.475791+0000","last_undegraded":"2024-08-02T18:48:06.475791+0000","last_fullsized":"2024-08-02T18:48:06.475791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475922+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:48:06.475922+0000","last_peered":"2024-08-02T18:48:06.475922+0000","last_clean":"2024-08-02T18:48:06.475922+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:48:06.475922+0000","last_undegraded":"2024-08-02T18:48:06.475922+0000","last_fullsized":"2024-08-02T18:48:06.475922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472152+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:48:06.472152+0000","last_peered":"2024-08-02T18:48:06.472152+0000","last_clean":"2024-08-02T18:48:06.472152+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:48:06.472152+0000","last_undegraded":"2024-08-02T18:48:06.472152+0000","last_fullsized":"2024-08-02T18:48:06.472152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475691+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:48:06.475691+0000","last_peered":"2024-08-02T18:48:06.475691+0000","last_clean":"2024-08-02T18:48:06.475691+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:48:06.475691+0000","last_undegraded":"2024-08-02T18:48:06.475691+0000","last_fullsized":"2024-08-02T18:48:06.475691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466616+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:48:06.466616+0000","last_peered":"2024-08-02T18:48:06.466616+0000","last_clean":"2024-08-02T18:48:06.466616+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:48:06.466616+0000","last_undegraded":"2024-08-02T18:48:06.466616+0000","last_fullsized":"2024-08-02T18:48:06.466616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'3","reported_seq":50,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:13.485520+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:48:13.485520+0000","last_peered":"2024-08-02T18:48:13.485520+0000","last_clean":"2024-08-02T18:48:13.485520+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:48:13.485520+0000","last_undegraded":"2024-08-02T18:48:13.485520+0000","last_fullsized":"2024-08-02T18:48:13.485520+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467063+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:48:06.467063+0000","last_peered":"2024-08-02T18:48:06.467063+0000","last_clean":"2024-08-02T18:48:06.467063+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:48:06.467063+0000","last_undegraded":"2024-08-02T18:48:06.467063+0000","last_fullsized":"2024-08-02T18:48:06.467063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467254+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:48:06.467254+0000","last_peered":"2024-08-02T18:48:06.467254+0000","last_clean":"2024-08-02T18:48:06.467254+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:48:06.467254+0000","last_undegraded":"2024-08-02T18:48:06.467254+0000","last_fullsized":"2024-08-02T18:48:06.467254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476845+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:48:06.476845+0000","last_peered":"2024-08-02T18:48:06.476845+0000","last_clean":"2024-08-02T18:48:06.476845+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:48:06.476845+0000","last_undegraded":"2024-08-02T18:48:06.476845+0000","last_fullsized":"2024-08-02T18:48:06.476845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468624+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:48:06.468624+0000","last_peered":"2024-08-02T18:48:06.468624+0000","last_clean":"2024-08-02T18:48:06.468624+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:48:06.468624+0000","last_undegraded":"2024-08-02T18:48:06.468624+0000","last_fullsized":"2024-08-02T18:48:06.468624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474919+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:48:06.474919+0000","last_peered":"2024-08-02T18:48:06.474919+0000","last_clean":"2024-08-02T18:48:06.474919+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:48:06.474919+0000","last_undegraded":"2024-08-02T18:48:06.474919+0000","last_fullsized":"2024-08-02T18:48:06.474919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.485388+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:48:06.485388+0000","last_peered":"2024-08-02T18:48:06.485388+0000","last_clean":"2024-08-02T18:48:06.485388+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:48:06.485388+0000","last_undegraded":"2024-08-02T18:48:06.485388+0000","last_fullsized":"2024-08-02T18:48:06.485388+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476167+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:48:06.476167+0000","last_peered":"2024-08-02T18:48:06.476167+0000","last_clean":"2024-08-02T18:48:06.476167+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:48:06.476167+0000","last_undegraded":"2024-08-02T18:48:06.476167+0000","last_fullsized":"2024-08-02T18:48:06.476167+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472835+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:48:06.472835+0000","last_peered":"2024-08-02T18:48:06.472835+0000","last_clean":"2024-08-02T18:48:06.472835+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:48:06.472835+0000","last_undegraded":"2024-08-02T18:48:06.472835+0000","last_fullsized":"2024-08-02T18:48:06.472835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'30","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:17.497665+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:48:17.497665+0000","last_peered":"2024-08-02T18:48:17.497665+0000","last_clean":"2024-08-02T18:48:17.497665+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:48:17.497665+0000","last_undegraded":"2024-08-02T18:48:17.497665+0000","last_fullsized":"2024-08-02T18:48:17.497665+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58655,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":75,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465906+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:48:06.465906+0000","last_peered":"2024-08-02T18:48:06.465906+0000","last_clean":"2024-08-02T18:48:06.465906+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:48:06.465906+0000","last_undegraded":"2024-08-02T18:48:06.465906+0000","last_fullsized":"2024-08-02T18:48:06.465906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857426+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:48:06.857426+0000","last_peered":"2024-08-02T18:48:06.857426+0000","last_clean":"2024-08-02T18:48:06.857426+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:48:06.857426+0000","last_undegraded":"2024-08-02T18:48:06.857426+0000","last_fullsized":"2024-08-02T18:48:06.857426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476504+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:48:06.476504+0000","last_peered":"2024-08-02T18:48:06.476504+0000","last_clean":"2024-08-02T18:48:06.476504+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:48:06.476504+0000","last_undegraded":"2024-08-02T18:48:06.476504+0000","last_fullsized":"2024-08-02T18:48:06.476504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468616+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:48:06.468616+0000","last_peered":"2024-08-02T18:48:06.468616+0000","last_clean":"2024-08-02T18:48:06.468616+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:48:06.468616+0000","last_undegraded":"2024-08-02T18:48:06.468616+0000","last_fullsized":"2024-08-02T18:48:06.468616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470496+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:48:06.470496+0000","last_peered":"2024-08-02T18:48:06.470496+0000","last_clean":"2024-08-02T18:48:06.470496+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:48:06.470496+0000","last_undegraded":"2024-08-02T18:48:06.470496+0000","last_fullsized":"2024-08-02T18:48:06.470496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467216+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:48:06.467216+0000","last_peered":"2024-08-02T18:48:06.467216+0000","last_clean":"2024-08-02T18:48:06.467216+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:48:06.467216+0000","last_undegraded":"2024-08-02T18:48:06.467216+0000","last_fullsized":"2024-08-02T18:48:06.467216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465752+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:48:06.465752+0000","last_peered":"2024-08-02T18:48:06.465752+0000","last_clean":"2024-08-02T18:48:06.465752+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:48:06.465752+0000","last_undegraded":"2024-08-02T18:48:06.465752+0000","last_fullsized":"2024-08-02T18:48:06.465752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857610+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:48:06.857610+0000","last_peered":"2024-08-02T18:48:06.857610+0000","last_clean":"2024-08-02T18:48:06.857610+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:48:06.857610+0000","last_undegraded":"2024-08-02T18:48:06.857610+0000","last_fullsized":"2024-08-02T18:48:06.857610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:16.493013+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:48:16.493013+0000","last_peered":"2024-08-02T18:48:16.493013+0000","last_clean":"2024-08-02T18:48:16.493013+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:48:16.493013+0000","last_undegraded":"2024-08-02T18:48:16.493013+0000","last_fullsized":"2024-08-02T18:48:16.493013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471007+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:48:06.471007+0000","last_peered":"2024-08-02T18:48:06.471007+0000","last_clean":"2024-08-02T18:48:06.471007+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:48:06.471007+0000","last_undegraded":"2024-08-02T18:48:06.471007+0000","last_fullsized":"2024-08-02T18:48:06.471007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469865+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:48:06.469865+0000","last_peered":"2024-08-02T18:48:06.469865+0000","last_clean":"2024-08-02T18:48:06.469865+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:48:06.469865+0000","last_undegraded":"2024-08-02T18:48:06.469865+0000","last_fullsized":"2024-08-02T18:48:06.469865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465865+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:48:06.465865+0000","last_peered":"2024-08-02T18:48:06.465865+0000","last_clean":"2024-08-02T18:48:06.465865+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:48:06.465865+0000","last_undegraded":"2024-08-02T18:48:06.465865+0000","last_fullsized":"2024-08-02T18:48:06.465865+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476710+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:48:06.476710+0000","last_peered":"2024-08-02T18:48:06.476710+0000","last_clean":"2024-08-02T18:48:06.476710+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:48:06.476710+0000","last_undegraded":"2024-08-02T18:48:06.476710+0000","last_fullsized":"2024-08-02T18:48:06.476710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474720+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:48:06.474720+0000","last_peered":"2024-08-02T18:48:06.474720+0000","last_clean":"2024-08-02T18:48:06.474720+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:48:06.474720+0000","last_undegraded":"2024-08-02T18:48:06.474720+0000","last_fullsized":"2024-08-02T18:48:06.474720+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471153+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:48:06.471153+0000","last_peered":"2024-08-02T18:48:06.471153+0000","last_clean":"2024-08-02T18:48:06.471153+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:48:06.471153+0000","last_undegraded":"2024-08-02T18:48:06.471153+0000","last_fullsized":"2024-08-02T18:48:06.471153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474786+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:48:06.474786+0000","last_peered":"2024-08-02T18:48:06.474786+0000","last_clean":"2024-08-02T18:48:06.474786+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:48:06.474786+0000","last_undegraded":"2024-08-02T18:48:06.474786+0000","last_fullsized":"2024-08-02T18:48:06.474786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470163+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:48:06.470163+0000","last_peered":"2024-08-02T18:48:06.470163+0000","last_clean":"2024-08-02T18:48:06.470163+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:48:06.470163+0000","last_undegraded":"2024-08-02T18:48:06.470163+0000","last_fullsized":"2024-08-02T18:48:06.470163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473185+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:48:06.473185+0000","last_peered":"2024-08-02T18:48:06.473185+0000","last_clean":"2024-08-02T18:48:06.473185+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:48:06.473185+0000","last_undegraded":"2024-08-02T18:48:06.473185+0000","last_fullsized":"2024-08-02T18:48:06.473185+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478161+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:48:06.478161+0000","last_peered":"2024-08-02T18:48:06.478161+0000","last_clean":"2024-08-02T18:48:06.478161+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:48:06.478161+0000","last_undegraded":"2024-08-02T18:48:06.478161+0000","last_fullsized":"2024-08-02T18:48:06.478161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:14.490850+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:48:14.490850+0000","last_peered":"2024-08-02T18:48:14.490850+0000","last_clean":"2024-08-02T18:48:14.490850+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:48:14.490850+0000","last_undegraded":"2024-08-02T18:48:14.490850+0000","last_fullsized":"2024-08-02T18:48:14.490850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472468+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:48:06.472468+0000","last_peered":"2024-08-02T18:48:06.472468+0000","last_clean":"2024-08-02T18:48:06.472468+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:48:06.472468+0000","last_undegraded":"2024-08-02T18:48:06.472468+0000","last_fullsized":"2024-08-02T18:48:06.472468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467180+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:48:06.467180+0000","last_peered":"2024-08-02T18:48:06.467180+0000","last_clean":"2024-08-02T18:48:06.467180+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:48:06.467180+0000","last_undegraded":"2024-08-02T18:48:06.467180+0000","last_fullsized":"2024-08-02T18:48:06.467180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468760+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:48:06.468760+0000","last_peered":"2024-08-02T18:48:06.468760+0000","last_clean":"2024-08-02T18:48:06.468760+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:48:06.468760+0000","last_undegraded":"2024-08-02T18:48:06.468760+0000","last_fullsized":"2024-08-02T18:48:06.468760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467581+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:48:06.467581+0000","last_peered":"2024-08-02T18:48:06.467581+0000","last_clean":"2024-08-02T18:48:06.467581+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:48:06.467581+0000","last_undegraded":"2024-08-02T18:48:06.467581+0000","last_fullsized":"2024-08-02T18:48:06.467581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467303+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:48:06.467303+0000","last_peered":"2024-08-02T18:48:06.467303+0000","last_clean":"2024-08-02T18:48:06.467303+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:48:06.467303+0000","last_undegraded":"2024-08-02T18:48:06.467303+0000","last_fullsized":"2024-08-02T18:48:06.467303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469987+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:48:06.469987+0000","last_peered":"2024-08-02T18:48:06.469987+0000","last_clean":"2024-08-02T18:48:06.469987+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:48:06.469987+0000","last_undegraded":"2024-08-02T18:48:06.469987+0000","last_fullsized":"2024-08-02T18:48:06.469987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475366+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:48:06.475366+0000","last_peered":"2024-08-02T18:48:06.475366+0000","last_clean":"2024-08-02T18:48:06.475366+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:48:06.475366+0000","last_undegraded":"2024-08-02T18:48:06.475366+0000","last_fullsized":"2024-08-02T18:48:06.475366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470004+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:48:06.470004+0000","last_peered":"2024-08-02T18:48:06.470004+0000","last_clean":"2024-08-02T18:48:06.470004+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:48:06.470004+0000","last_undegraded":"2024-08-02T18:48:06.470004+0000","last_fullsized":"2024-08-02T18:48:06.470004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468267+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:48:06.468267+0000","last_peered":"2024-08-02T18:48:06.468267+0000","last_clean":"2024-08-02T18:48:06.468267+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:48:06.468267+0000","last_undegraded":"2024-08-02T18:48:06.468267+0000","last_fullsized":"2024-08-02T18:48:06.468267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471381+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:48:06.471381+0000","last_peered":"2024-08-02T18:48:06.471381+0000","last_clean":"2024-08-02T18:48:06.471381+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:48:06.471381+0000","last_undegraded":"2024-08-02T18:48:06.471381+0000","last_fullsized":"2024-08-02T18:48:06.471381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476371+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:48:06.476371+0000","last_peered":"2024-08-02T18:48:06.476371+0000","last_clean":"2024-08-02T18:48:06.476371+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:48:06.476371+0000","last_undegraded":"2024-08-02T18:48:06.476371+0000","last_fullsized":"2024-08-02T18:48:06.476371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471171+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:48:06.471171+0000","last_peered":"2024-08-02T18:48:06.471171+0000","last_clean":"2024-08-02T18:48:06.471171+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:48:06.471171+0000","last_undegraded":"2024-08-02T18:48:06.471171+0000","last_fullsized":"2024-08-02T18:48:06.471171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857311+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:48:06.857311+0000","last_peered":"2024-08-02T18:48:06.857311+0000","last_clean":"2024-08-02T18:48:06.857311+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:48:06.857311+0000","last_undegraded":"2024-08-02T18:48:06.857311+0000","last_fullsized":"2024-08-02T18:48:06.857311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475156+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:48:06.475156+0000","last_peered":"2024-08-02T18:48:06.475156+0000","last_clean":"2024-08-02T18:48:06.475156+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:48:06.475156+0000","last_undegraded":"2024-08-02T18:48:06.475156+0000","last_fullsized":"2024-08-02T18:48:06.475156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468795+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:48:06.468795+0000","last_peered":"2024-08-02T18:48:06.468795+0000","last_clean":"2024-08-02T18:48:06.468795+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:48:06.468795+0000","last_undegraded":"2024-08-02T18:48:06.468795+0000","last_fullsized":"2024-08-02T18:48:06.468795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467620+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:48:06.467620+0000","last_peered":"2024-08-02T18:48:06.467620+0000","last_clean":"2024-08-02T18:48:06.467620+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:48:06.467620+0000","last_undegraded":"2024-08-02T18:48:06.467620+0000","last_fullsized":"2024-08-02T18:48:06.467620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466617+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:48:06.466617+0000","last_peered":"2024-08-02T18:48:06.466617+0000","last_clean":"2024-08-02T18:48:06.466617+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:48:06.466617+0000","last_undegraded":"2024-08-02T18:48:06.466617+0000","last_fullsized":"2024-08-02T18:48:06.466617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469489+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:48:06.469489+0000","last_peered":"2024-08-02T18:48:06.469489+0000","last_clean":"2024-08-02T18:48:06.469489+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:48:06.469489+0000","last_undegraded":"2024-08-02T18:48:06.469489+0000","last_fullsized":"2024-08-02T18:48:06.469489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857053+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:48:06.857053+0000","last_peered":"2024-08-02T18:48:06.857053+0000","last_clean":"2024-08-02T18:48:06.857053+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:48:06.857053+0000","last_undegraded":"2024-08-02T18:48:06.857053+0000","last_fullsized":"2024-08-02T18:48:06.857053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470006+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:48:06.470006+0000","last_peered":"2024-08-02T18:48:06.470006+0000","last_clean":"2024-08-02T18:48:06.470006+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:48:06.470006+0000","last_undegraded":"2024-08-02T18:48:06.470006+0000","last_fullsized":"2024-08-02T18:48:06.470006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469719+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:48:06.469719+0000","last_peered":"2024-08-02T18:48:06.469719+0000","last_clean":"2024-08-02T18:48:06.469719+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:48:06.469719+0000","last_undegraded":"2024-08-02T18:48:06.469719+0000","last_fullsized":"2024-08-02T18:48:06.469719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475155+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:48:06.475155+0000","last_peered":"2024-08-02T18:48:06.475155+0000","last_clean":"2024-08-02T18:48:06.475155+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:48:06.475155+0000","last_undegraded":"2024-08-02T18:48:06.475155+0000","last_fullsized":"2024-08-02T18:48:06.475155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468906+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:48:06.468906+0000","last_peered":"2024-08-02T18:48:06.468906+0000","last_clean":"2024-08-02T18:48:06.468906+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:48:06.468906+0000","last_undegraded":"2024-08-02T18:48:06.468906+0000","last_fullsized":"2024-08-02T18:48:06.468906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467663+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:48:06.467663+0000","last_peered":"2024-08-02T18:48:06.467663+0000","last_clean":"2024-08-02T18:48:06.467663+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:48:06.467663+0000","last_undegraded":"2024-08-02T18:48:06.467663+0000","last_fullsized":"2024-08-02T18:48:06.467663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470984+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:48:06.470984+0000","last_peered":"2024-08-02T18:48:06.470984+0000","last_clean":"2024-08-02T18:48:06.470984+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:48:06.470984+0000","last_undegraded":"2024-08-02T18:48:06.470984+0000","last_fullsized":"2024-08-02T18:48:06.470984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857678+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:48:06.857678+0000","last_peered":"2024-08-02T18:48:06.857678+0000","last_clean":"2024-08-02T18:48:06.857678+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:48:06.857678+0000","last_undegraded":"2024-08-02T18:48:06.857678+0000","last_fullsized":"2024-08-02T18:48:06.857678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471116+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:48:06.471116+0000","last_peered":"2024-08-02T18:48:06.471116+0000","last_clean":"2024-08-02T18:48:06.471116+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:48:06.471116+0000","last_undegraded":"2024-08-02T18:48:06.471116+0000","last_fullsized":"2024-08-02T18:48:06.471116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466723+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:48:06.466723+0000","last_peered":"2024-08-02T18:48:06.466723+0000","last_clean":"2024-08-02T18:48:06.466723+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:48:06.466723+0000","last_undegraded":"2024-08-02T18:48:06.466723+0000","last_fullsized":"2024-08-02T18:48:06.466723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470038+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:48:06.470038+0000","last_peered":"2024-08-02T18:48:06.470038+0000","last_clean":"2024-08-02T18:48:06.470038+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:48:06.470038+0000","last_undegraded":"2024-08-02T18:48:06.470038+0000","last_fullsized":"2024-08-02T18:48:06.470038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472226+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:48:06.472226+0000","last_peered":"2024-08-02T18:48:06.472226+0000","last_clean":"2024-08-02T18:48:06.472226+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:48:06.472226+0000","last_undegraded":"2024-08-02T18:48:06.472226+0000","last_fullsized":"2024-08-02T18:48:06.472226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473958+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:48:06.473958+0000","last_peered":"2024-08-02T18:48:06.473958+0000","last_clean":"2024-08-02T18:48:06.473958+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:48:06.473958+0000","last_undegraded":"2024-08-02T18:48:06.473958+0000","last_fullsized":"2024-08-02T18:48:06.473958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469763+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:48:06.469763+0000","last_peered":"2024-08-02T18:48:06.469763+0000","last_clean":"2024-08-02T18:48:06.469763+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:48:06.469763+0000","last_undegraded":"2024-08-02T18:48:06.469763+0000","last_fullsized":"2024-08-02T18:48:06.469763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469968+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:48:06.469968+0000","last_peered":"2024-08-02T18:48:06.469968+0000","last_clean":"2024-08-02T18:48:06.469968+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:48:06.469968+0000","last_undegraded":"2024-08-02T18:48:06.469968+0000","last_fullsized":"2024-08-02T18:48:06.469968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469411+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:48:06.469411+0000","last_peered":"2024-08-02T18:48:06.469411+0000","last_clean":"2024-08-02T18:48:06.469411+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:48:06.469411+0000","last_undegraded":"2024-08-02T18:48:06.469411+0000","last_fullsized":"2024-08-02T18:48:06.469411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62655,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":106,"num_read_kb":120,"num_write":164,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":401408,"data_stored":172649,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547224,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":499721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776156,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1699840,"data_stored":1145610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939680,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":504019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168614,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":499843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397547,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1622016,"data_stored":1095751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561071,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":495099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822707,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1630208,"data_stored":1091339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986232,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":499749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215164,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":495293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411393,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36388,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708764,"statfs":{"total":95995035648,"available":95957774336,"internally_reserved":0,"allocated":1077248,"data_stored":540054,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":553664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":496487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":45045,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:48:20.670 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-02T18:48:20.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:20 smithi121 ceph-mon[37236]: pgmap v296: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.8 KiB/s wr, 9 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:20.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:20 smithi121 ceph-mon[37236]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:48:20.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:20.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:20.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:20.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:20 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:20.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:20 smithi151 ceph-mon[37155]: pgmap v296: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.8 KiB/s wr, 9 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:20.998 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:20 smithi151 ceph-mon[37155]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:48:20.998 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:20.998 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:20.998 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:20.998 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:20 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:20.999 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:20 smithi103 ceph-mon[32753]: pgmap v296: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 8.4 KiB/s rd, 5.8 KiB/s wr, 9 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:20.999 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:20 smithi103 ceph-mon[32753]: from='client.14847 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:48:21.000 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:21.000 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:21.000 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:21.000 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:20 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:21.000 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 -- 172.21.15.103:0/588423655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 msgr2=0x7f6d20107cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 --2- 172.21.15.103:0/588423655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 0x7f6d20107cc0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009930 tx=0x7f6d1002a420 comp rx=0 tx=0).stop 2024-08-02T18:48:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 -- 172.21.15.103:0/588423655 shutdown_connections 2024-08-02T18:48:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 --2- 172.21.15.103:0/588423655 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d20102280 0x7f6d2010e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 --2- 172.21.15.103:0/588423655 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d201018e0 0x7f6d20101d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 --2- 172.21.15.103:0/588423655 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 0x7f6d20107cc0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 -- 172.21.15.103:0/588423655 >> 172.21.15.103:0/588423655 conn(0x7f6d200fd600 msgr2=0x7f6d200ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:21.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 -- 172.21.15.103:0/588423655 shutdown_connections 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.481+0000 7f6d28536640 1 -- 172.21.15.103:0/588423655 wait complete. 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d28536640 1 Processor -- start 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d28536640 1 -- start start 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d28536640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d201018e0 0x7f6d20074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d28536640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d20102280 0x7f6d20074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d28536640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 0x7f6d20074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d28536640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20111e00 con 0x7f6d201078e0 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d28536640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20111c80 con 0x7f6d201018e0 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d28536640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6d20111f80 con 0x7f6d20102280 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 0x7f6d20074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 0x7f6d20074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56100/0 (socket says 172.21.15.103:56100) 2024-08-02T18:48:21.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 -- 172.21.15.103:0/1814579802 learned_addr learned my addr 172.21.15.103:0/1814579802 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d262d2640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d201018e0 0x7f6d20074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d25ad1640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d20102280 0x7f6d20074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 -- 172.21.15.103:0/1814579802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d20102280 msgr2=0x7f6d20074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d20102280 0x7f6d20074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 -- 172.21.15.103:0/1814579802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d201018e0 msgr2=0x7f6d20074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d201018e0 0x7f6d20074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 -- 172.21.15.103:0/1814579802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d201a67a0 con 0x7f6d201078e0 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d25ad1640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d20102280 0x7f6d20074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.482+0000 7f6d26ad3640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 0x7f6d20074ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009fd0 tx=0x7f6d1800b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.483+0000 7f6d177fe640 1 -- 172.21.15.103:0/1814579802 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d18017070 con 0x7f6d201078e0 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.483+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d201a6a90 con 0x7f6d201078e0 2024-08-02T18:48:21.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.483+0000 7f6d177fe640 1 -- 172.21.15.103:0/1814579802 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6d18004020 con 0x7f6d201078e0 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.483+0000 7f6d177fe640 1 -- 172.21.15.103:0/1814579802 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d180106c0 con 0x7f6d201078e0 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.483+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d201a6f80 con 0x7f6d201078e0 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.484+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d20101d40 con 0x7f6d201078e0 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.485+0000 7f6d177fe640 1 -- 172.21.15.103:0/1814579802 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6d180041d0 con 0x7f6d201078e0 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.485+0000 7f6d177fe640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d0c0a2c10 0x7f6d0c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.486+0000 7f6d262d2640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d0c0a2c10 0x7f6d0c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.486+0000 7f6d177fe640 1 -- 172.21.15.103:0/1814579802 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6d180cf1c0 con 0x7f6d201078e0 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.486+0000 7f6d262d2640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d0c0a2c10 0x7f6d0c0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009900 tx=0x7f6d100058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:21.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.489+0000 7f6d177fe640 1 -- 172.21.15.103:0/1814579802 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6d1809bc60 con 0x7f6d201078e0 2024-08-02T18:48:21.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.667+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6d20109ec0 con 0x7f6d0c0a2c10 2024-08-02T18:48:21.669 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:21 smithi103 ceph-mon[32753]: pgmap v297: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 8 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:21.669 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:21.669 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:21 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:21.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.677+0000 7f6d177fe640 1 -- 172.21.15.103:0/1814579802 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340376 (secure 0 0 0) 0x7f6d10031640 con 0x7f6d0c0a2c10 2024-08-02T18:48:21.681 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:48:21.683 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:48:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d0c0a2c10 msgr2=0x7f6d0c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d0c0a2c10 0x7f6d0c0a50d0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f6d10009900 tx=0x7f6d100058d0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 msgr2=0x7f6d20074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 0x7f6d20074ca0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f6d18009fd0 tx=0x7f6d1800b260 comp rx=0 tx=0).stop 2024-08-02T18:48:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 shutdown_connections 2024-08-02T18:48:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6d201078e0 0x7f6d20074ca0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6d0c0a2c10 0x7f6d0c0a50d0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6d20102280 0x7f6d20074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 --2- 172.21.15.103:0/1814579802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6d201018e0 0x7f6d20074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:21.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 >> 172.21.15.103:0/1814579802 conn(0x7f6d200fd600 msgr2=0x7f6d200fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:21.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 shutdown_connections 2024-08-02T18:48:21.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:21.680+0000 7f6d28536640 1 -- 172.21.15.103:0/1814579802 wait complete. 2024-08-02T18:48:22.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:21 smithi121 ceph-mon[37236]: pgmap v297: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 8 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:22.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:22.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:21 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:22.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:21 smithi151 ceph-mon[37155]: pgmap v297: 129 pgs: 129 active+clean; 638 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.0 KiB/s rd, 5.0 KiB/s wr, 8 op/s; 2 B/s, 1 keys/s, 0 objects/s recovering 2024-08-02T18:48:22.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:22.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:21 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:22.519 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":297,"stamp":"2024-08-02T18:48:21.345812+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":653257,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":252,"num_read_kb":244,"num_write":347,"num_write_kb":3051,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":279,"ondisk_log_size":279,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375592,"kb_used_data":13940,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566232,"statfs":{"total":1151940427776,"available":1151555821568,"internally_reserved":0,"allocated":14274560,"data_stored":7931945,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":48839,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":-6,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":74,"num_read_kb":84,"num_write":31,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003145"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467259+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:48:06.467259+0000","last_peered":"2024-08-02T18:48:06.467259+0000","last_clean":"2024-08-02T18:48:06.467259+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:48:06.467259+0000","last_undegraded":"2024-08-02T18:48:06.467259+0000","last_fullsized":"2024-08-02T18:48:06.467259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.479265+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:48:06.479265+0000","last_peered":"2024-08-02T18:48:06.479265+0000","last_clean":"2024-08-02T18:48:06.479265+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:48:06.479265+0000","last_undegraded":"2024-08-02T18:48:06.479265+0000","last_fullsized":"2024-08-02T18:48:06.479265+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466753+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:48:06.466753+0000","last_peered":"2024-08-02T18:48:06.466753+0000","last_clean":"2024-08-02T18:48:06.466753+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:48:06.466753+0000","last_undegraded":"2024-08-02T18:48:06.466753+0000","last_fullsized":"2024-08-02T18:48:06.466753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471873+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:48:06.471873+0000","last_peered":"2024-08-02T18:48:06.471873+0000","last_clean":"2024-08-02T18:48:06.471873+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:48:06.471873+0000","last_undegraded":"2024-08-02T18:48:06.471873+0000","last_fullsized":"2024-08-02T18:48:06.471873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470243+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:48:06.470243+0000","last_peered":"2024-08-02T18:48:06.470243+0000","last_clean":"2024-08-02T18:48:06.470243+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:48:06.470243+0000","last_undegraded":"2024-08-02T18:48:06.470243+0000","last_fullsized":"2024-08-02T18:48:06.470243+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468214+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:48:06.468214+0000","last_peered":"2024-08-02T18:48:06.468214+0000","last_clean":"2024-08-02T18:48:06.468214+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:48:06.468214+0000","last_undegraded":"2024-08-02T18:48:06.468214+0000","last_fullsized":"2024-08-02T18:48:06.468214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478787+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:48:06.478787+0000","last_peered":"2024-08-02T18:48:06.478787+0000","last_clean":"2024-08-02T18:48:06.478787+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:48:06.478787+0000","last_undegraded":"2024-08-02T18:48:06.478787+0000","last_fullsized":"2024-08-02T18:48:06.478787+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857372+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:48:06.857372+0000","last_peered":"2024-08-02T18:48:06.857372+0000","last_clean":"2024-08-02T18:48:06.857372+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:48:06.857372+0000","last_undegraded":"2024-08-02T18:48:06.857372+0000","last_fullsized":"2024-08-02T18:48:06.857372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468363+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:48:06.468363+0000","last_peered":"2024-08-02T18:48:06.468363+0000","last_clean":"2024-08-02T18:48:06.468363+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:48:06.468363+0000","last_undegraded":"2024-08-02T18:48:06.468363+0000","last_fullsized":"2024-08-02T18:48:06.468363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472850+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:48:06.472850+0000","last_peered":"2024-08-02T18:48:06.472850+0000","last_clean":"2024-08-02T18:48:06.472850+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:48:06.472850+0000","last_undegraded":"2024-08-02T18:48:06.472850+0000","last_fullsized":"2024-08-02T18:48:06.472850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476328+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:48:06.476328+0000","last_peered":"2024-08-02T18:48:06.476328+0000","last_clean":"2024-08-02T18:48:06.476328+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:48:06.476328+0000","last_undegraded":"2024-08-02T18:48:06.476328+0000","last_fullsized":"2024-08-02T18:48:06.476328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469154+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:48:06.469154+0000","last_peered":"2024-08-02T18:48:06.469154+0000","last_clean":"2024-08-02T18:48:06.469154+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:48:06.469154+0000","last_undegraded":"2024-08-02T18:48:06.469154+0000","last_fullsized":"2024-08-02T18:48:06.469154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466908+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:48:06.466908+0000","last_peered":"2024-08-02T18:48:06.466908+0000","last_clean":"2024-08-02T18:48:06.466908+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:48:06.466908+0000","last_undegraded":"2024-08-02T18:48:06.466908+0000","last_fullsized":"2024-08-02T18:48:06.466908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472334+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:48:06.472334+0000","last_peered":"2024-08-02T18:48:06.472334+0000","last_clean":"2024-08-02T18:48:06.472334+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:48:06.472334+0000","last_undegraded":"2024-08-02T18:48:06.472334+0000","last_fullsized":"2024-08-02T18:48:06.472334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468348+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:48:06.468348+0000","last_peered":"2024-08-02T18:48:06.468348+0000","last_clean":"2024-08-02T18:48:06.468348+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:48:06.468348+0000","last_undegraded":"2024-08-02T18:48:06.468348+0000","last_fullsized":"2024-08-02T18:48:06.468348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471227+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:48:06.471227+0000","last_peered":"2024-08-02T18:48:06.471227+0000","last_clean":"2024-08-02T18:48:06.471227+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:48:06.471227+0000","last_undegraded":"2024-08-02T18:48:06.471227+0000","last_fullsized":"2024-08-02T18:48:06.471227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467420+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:48:06.467420+0000","last_peered":"2024-08-02T18:48:06.467420+0000","last_clean":"2024-08-02T18:48:06.467420+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:48:06.467420+0000","last_undegraded":"2024-08-02T18:48:06.467420+0000","last_fullsized":"2024-08-02T18:48:06.467420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468674+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:48:06.468674+0000","last_peered":"2024-08-02T18:48:06.468674+0000","last_clean":"2024-08-02T18:48:06.468674+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:48:06.468674+0000","last_undegraded":"2024-08-02T18:48:06.468674+0000","last_fullsized":"2024-08-02T18:48:06.468674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468642+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:48:06.468642+0000","last_peered":"2024-08-02T18:48:06.468642+0000","last_clean":"2024-08-02T18:48:06.468642+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:48:06.468642+0000","last_undegraded":"2024-08-02T18:48:06.468642+0000","last_fullsized":"2024-08-02T18:48:06.468642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471807+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:48:06.471807+0000","last_peered":"2024-08-02T18:48:06.471807+0000","last_clean":"2024-08-02T18:48:06.471807+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:48:06.471807+0000","last_undegraded":"2024-08-02T18:48:06.471807+0000","last_fullsized":"2024-08-02T18:48:06.471807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466974+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:48:06.466974+0000","last_peered":"2024-08-02T18:48:06.466974+0000","last_clean":"2024-08-02T18:48:06.466974+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:48:06.466974+0000","last_undegraded":"2024-08-02T18:48:06.466974+0000","last_fullsized":"2024-08-02T18:48:06.466974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472170+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:48:06.472170+0000","last_peered":"2024-08-02T18:48:06.472170+0000","last_clean":"2024-08-02T18:48:06.472170+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:48:06.472170+0000","last_undegraded":"2024-08-02T18:48:06.472170+0000","last_fullsized":"2024-08-02T18:48:06.472170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857187+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:48:06.857187+0000","last_peered":"2024-08-02T18:48:06.857187+0000","last_clean":"2024-08-02T18:48:06.857187+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:48:06.857187+0000","last_undegraded":"2024-08-02T18:48:06.857187+0000","last_fullsized":"2024-08-02T18:48:06.857187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478332+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:48:06.478332+0000","last_peered":"2024-08-02T18:48:06.478332+0000","last_clean":"2024-08-02T18:48:06.478332+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:48:06.478332+0000","last_undegraded":"2024-08-02T18:48:06.478332+0000","last_fullsized":"2024-08-02T18:48:06.478332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475960+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:48:06.475960+0000","last_peered":"2024-08-02T18:48:06.475960+0000","last_clean":"2024-08-02T18:48:06.475960+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:48:06.475960+0000","last_undegraded":"2024-08-02T18:48:06.475960+0000","last_fullsized":"2024-08-02T18:48:06.475960+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469266+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:48:06.469266+0000","last_peered":"2024-08-02T18:48:06.469266+0000","last_clean":"2024-08-02T18:48:06.469266+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:48:06.469266+0000","last_undegraded":"2024-08-02T18:48:06.469266+0000","last_fullsized":"2024-08-02T18:48:06.469266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467032+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:48:06.467032+0000","last_peered":"2024-08-02T18:48:06.467032+0000","last_clean":"2024-08-02T18:48:06.467032+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:48:06.467032+0000","last_undegraded":"2024-08-02T18:48:06.467032+0000","last_fullsized":"2024-08-02T18:48:06.467032+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471463+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:48:06.471463+0000","last_peered":"2024-08-02T18:48:06.471463+0000","last_clean":"2024-08-02T18:48:06.471463+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:48:06.471463+0000","last_undegraded":"2024-08-02T18:48:06.471463+0000","last_fullsized":"2024-08-02T18:48:06.471463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'11","reported_seq":45,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:17.329689+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:48:17.329689+0000","last_peered":"2024-08-02T18:48:17.329689+0000","last_clean":"2024-08-02T18:48:17.329689+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:48:17.329689+0000","last_undegraded":"2024-08-02T18:48:17.329689+0000","last_fullsized":"2024-08-02T18:48:17.329689+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471002+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:48:06.471002+0000","last_peered":"2024-08-02T18:48:06.471002+0000","last_clean":"2024-08-02T18:48:06.471002+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:48:06.471002+0000","last_undegraded":"2024-08-02T18:48:06.471002+0000","last_fullsized":"2024-08-02T18:48:06.471002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475418+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:48:06.475418+0000","last_peered":"2024-08-02T18:48:06.475418+0000","last_clean":"2024-08-02T18:48:06.475418+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:48:06.475418+0000","last_undegraded":"2024-08-02T18:48:06.475418+0000","last_fullsized":"2024-08-02T18:48:06.475418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472995+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:48:06.472995+0000","last_peered":"2024-08-02T18:48:06.472995+0000","last_clean":"2024-08-02T18:48:06.472995+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:48:06.472995+0000","last_undegraded":"2024-08-02T18:48:06.472995+0000","last_fullsized":"2024-08-02T18:48:06.472995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469428+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:48:06.469428+0000","last_peered":"2024-08-02T18:48:06.469428+0000","last_clean":"2024-08-02T18:48:06.469428+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:48:06.469428+0000","last_undegraded":"2024-08-02T18:48:06.469428+0000","last_fullsized":"2024-08-02T18:48:06.469428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470281+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:48:06.470281+0000","last_peered":"2024-08-02T18:48:06.470281+0000","last_clean":"2024-08-02T18:48:06.470281+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:48:06.470281+0000","last_undegraded":"2024-08-02T18:48:06.470281+0000","last_fullsized":"2024-08-02T18:48:06.470281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466380+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:48:06.466380+0000","last_peered":"2024-08-02T18:48:06.466380+0000","last_clean":"2024-08-02T18:48:06.466380+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:48:06.466380+0000","last_undegraded":"2024-08-02T18:48:06.466380+0000","last_fullsized":"2024-08-02T18:48:06.466380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472334+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:48:06.472334+0000","last_peered":"2024-08-02T18:48:06.472334+0000","last_clean":"2024-08-02T18:48:06.472334+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:48:06.472334+0000","last_undegraded":"2024-08-02T18:48:06.472334+0000","last_fullsized":"2024-08-02T18:48:06.472334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470170+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:48:06.470170+0000","last_peered":"2024-08-02T18:48:06.470170+0000","last_clean":"2024-08-02T18:48:06.470170+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:48:06.470170+0000","last_undegraded":"2024-08-02T18:48:06.470170+0000","last_fullsized":"2024-08-02T18:48:06.470170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467096+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:48:06.467096+0000","last_peered":"2024-08-02T18:48:06.467096+0000","last_clean":"2024-08-02T18:48:06.467096+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:48:06.467096+0000","last_undegraded":"2024-08-02T18:48:06.467096+0000","last_fullsized":"2024-08-02T18:48:06.467096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475268+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:48:06.475268+0000","last_peered":"2024-08-02T18:48:06.475268+0000","last_clean":"2024-08-02T18:48:06.475268+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:48:06.475268+0000","last_undegraded":"2024-08-02T18:48:06.475268+0000","last_fullsized":"2024-08-02T18:48:06.475268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476482+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:48:06.476482+0000","last_peered":"2024-08-02T18:48:06.476482+0000","last_clean":"2024-08-02T18:48:06.476482+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:48:06.476482+0000","last_undegraded":"2024-08-02T18:48:06.476482+0000","last_fullsized":"2024-08-02T18:48:06.476482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":54,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:18.491322+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:48:18.491322+0000","last_peered":"2024-08-02T18:48:18.491322+0000","last_clean":"2024-08-02T18:48:18.491322+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:48:18.491322+0000","last_undegraded":"2024-08-02T18:48:18.491322+0000","last_fullsized":"2024-08-02T18:48:18.491322+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":17,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475578+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:48:06.475578+0000","last_peered":"2024-08-02T18:48:06.475578+0000","last_clean":"2024-08-02T18:48:06.475578+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:48:06.475578+0000","last_undegraded":"2024-08-02T18:48:06.475578+0000","last_fullsized":"2024-08-02T18:48:06.475578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474772+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:48:06.474772+0000","last_peered":"2024-08-02T18:48:06.474772+0000","last_clean":"2024-08-02T18:48:06.474772+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:48:06.474772+0000","last_undegraded":"2024-08-02T18:48:06.474772+0000","last_fullsized":"2024-08-02T18:48:06.474772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466844+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:48:06.466844+0000","last_peered":"2024-08-02T18:48:06.466844+0000","last_clean":"2024-08-02T18:48:06.466844+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:48:06.466844+0000","last_undegraded":"2024-08-02T18:48:06.466844+0000","last_fullsized":"2024-08-02T18:48:06.466844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476640+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:48:06.476640+0000","last_peered":"2024-08-02T18:48:06.476640+0000","last_clean":"2024-08-02T18:48:06.476640+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:48:06.476640+0000","last_undegraded":"2024-08-02T18:48:06.476640+0000","last_fullsized":"2024-08-02T18:48:06.476640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471153+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:48:06.471153+0000","last_peered":"2024-08-02T18:48:06.471153+0000","last_clean":"2024-08-02T18:48:06.471153+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:48:06.471153+0000","last_undegraded":"2024-08-02T18:48:06.471153+0000","last_fullsized":"2024-08-02T18:48:06.471153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468846+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:48:06.468846+0000","last_peered":"2024-08-02T18:48:06.468846+0000","last_clean":"2024-08-02T18:48:06.468846+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:48:06.468846+0000","last_undegraded":"2024-08-02T18:48:06.468846+0000","last_fullsized":"2024-08-02T18:48:06.468846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466987+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:48:06.466987+0000","last_peered":"2024-08-02T18:48:06.466987+0000","last_clean":"2024-08-02T18:48:06.466987+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:48:06.466987+0000","last_undegraded":"2024-08-02T18:48:06.466987+0000","last_fullsized":"2024-08-02T18:48:06.466987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467297+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:48:06.467297+0000","last_peered":"2024-08-02T18:48:06.467297+0000","last_clean":"2024-08-02T18:48:06.467297+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:48:06.467297+0000","last_undegraded":"2024-08-02T18:48:06.467297+0000","last_fullsized":"2024-08-02T18:48:06.467297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467403+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:48:06.467403+0000","last_peered":"2024-08-02T18:48:06.467403+0000","last_clean":"2024-08-02T18:48:06.467403+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:48:06.467403+0000","last_undegraded":"2024-08-02T18:48:06.467403+0000","last_fullsized":"2024-08-02T18:48:06.467403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468158+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:48:06.468158+0000","last_peered":"2024-08-02T18:48:06.468158+0000","last_clean":"2024-08-02T18:48:06.468158+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:48:06.468158+0000","last_undegraded":"2024-08-02T18:48:06.468158+0000","last_fullsized":"2024-08-02T18:48:06.468158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857189+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:48:06.857189+0000","last_peered":"2024-08-02T18:48:06.857189+0000","last_clean":"2024-08-02T18:48:06.857189+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:48:06.857189+0000","last_undegraded":"2024-08-02T18:48:06.857189+0000","last_fullsized":"2024-08-02T18:48:06.857189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467131+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:48:06.467131+0000","last_peered":"2024-08-02T18:48:06.467131+0000","last_clean":"2024-08-02T18:48:06.467131+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:48:06.467131+0000","last_undegraded":"2024-08-02T18:48:06.467131+0000","last_fullsized":"2024-08-02T18:48:06.467131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476651+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:48:06.476651+0000","last_peered":"2024-08-02T18:48:06.476651+0000","last_clean":"2024-08-02T18:48:06.476651+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:48:06.476651+0000","last_undegraded":"2024-08-02T18:48:06.476651+0000","last_fullsized":"2024-08-02T18:48:06.476651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469891+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:48:06.469891+0000","last_peered":"2024-08-02T18:48:06.469891+0000","last_clean":"2024-08-02T18:48:06.469891+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:48:06.469891+0000","last_undegraded":"2024-08-02T18:48:06.469891+0000","last_fullsized":"2024-08-02T18:48:06.469891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467502+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:48:06.467502+0000","last_peered":"2024-08-02T18:48:06.467502+0000","last_clean":"2024-08-02T18:48:06.467502+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:48:06.467502+0000","last_undegraded":"2024-08-02T18:48:06.467502+0000","last_fullsized":"2024-08-02T18:48:06.467502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475786+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:48:06.475786+0000","last_peered":"2024-08-02T18:48:06.475786+0000","last_clean":"2024-08-02T18:48:06.475786+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:48:06.475786+0000","last_undegraded":"2024-08-02T18:48:06.475786+0000","last_fullsized":"2024-08-02T18:48:06.475786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475721+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:48:06.475721+0000","last_peered":"2024-08-02T18:48:06.475721+0000","last_clean":"2024-08-02T18:48:06.475721+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:48:06.475721+0000","last_undegraded":"2024-08-02T18:48:06.475721+0000","last_fullsized":"2024-08-02T18:48:06.475721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468919+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:48:06.468919+0000","last_peered":"2024-08-02T18:48:06.468919+0000","last_clean":"2024-08-02T18:48:06.468919+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:48:06.468919+0000","last_undegraded":"2024-08-02T18:48:06.468919+0000","last_fullsized":"2024-08-02T18:48:06.468919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473065+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:48:06.473065+0000","last_peered":"2024-08-02T18:48:06.473065+0000","last_clean":"2024-08-02T18:48:06.473065+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:48:06.473065+0000","last_undegraded":"2024-08-02T18:48:06.473065+0000","last_fullsized":"2024-08-02T18:48:06.473065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475791+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:48:06.475791+0000","last_peered":"2024-08-02T18:48:06.475791+0000","last_clean":"2024-08-02T18:48:06.475791+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:48:06.475791+0000","last_undegraded":"2024-08-02T18:48:06.475791+0000","last_fullsized":"2024-08-02T18:48:06.475791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475922+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:48:06.475922+0000","last_peered":"2024-08-02T18:48:06.475922+0000","last_clean":"2024-08-02T18:48:06.475922+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:48:06.475922+0000","last_undegraded":"2024-08-02T18:48:06.475922+0000","last_fullsized":"2024-08-02T18:48:06.475922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472152+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:48:06.472152+0000","last_peered":"2024-08-02T18:48:06.472152+0000","last_clean":"2024-08-02T18:48:06.472152+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:48:06.472152+0000","last_undegraded":"2024-08-02T18:48:06.472152+0000","last_fullsized":"2024-08-02T18:48:06.472152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475691+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:48:06.475691+0000","last_peered":"2024-08-02T18:48:06.475691+0000","last_clean":"2024-08-02T18:48:06.475691+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:48:06.475691+0000","last_undegraded":"2024-08-02T18:48:06.475691+0000","last_fullsized":"2024-08-02T18:48:06.475691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466616+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:48:06.466616+0000","last_peered":"2024-08-02T18:48:06.466616+0000","last_clean":"2024-08-02T18:48:06.466616+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:48:06.466616+0000","last_undegraded":"2024-08-02T18:48:06.466616+0000","last_fullsized":"2024-08-02T18:48:06.466616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'3","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:18.491878+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:48:18.491878+0000","last_peered":"2024-08-02T18:48:18.491878+0000","last_clean":"2024-08-02T18:48:18.491878+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:48:18.491878+0000","last_undegraded":"2024-08-02T18:48:18.491878+0000","last_fullsized":"2024-08-02T18:48:18.491878+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":20,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467063+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:48:06.467063+0000","last_peered":"2024-08-02T18:48:06.467063+0000","last_clean":"2024-08-02T18:48:06.467063+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:48:06.467063+0000","last_undegraded":"2024-08-02T18:48:06.467063+0000","last_fullsized":"2024-08-02T18:48:06.467063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467254+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:48:06.467254+0000","last_peered":"2024-08-02T18:48:06.467254+0000","last_clean":"2024-08-02T18:48:06.467254+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:48:06.467254+0000","last_undegraded":"2024-08-02T18:48:06.467254+0000","last_fullsized":"2024-08-02T18:48:06.467254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476845+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:48:06.476845+0000","last_peered":"2024-08-02T18:48:06.476845+0000","last_clean":"2024-08-02T18:48:06.476845+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:48:06.476845+0000","last_undegraded":"2024-08-02T18:48:06.476845+0000","last_fullsized":"2024-08-02T18:48:06.476845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468624+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:48:06.468624+0000","last_peered":"2024-08-02T18:48:06.468624+0000","last_clean":"2024-08-02T18:48:06.468624+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:48:06.468624+0000","last_undegraded":"2024-08-02T18:48:06.468624+0000","last_fullsized":"2024-08-02T18:48:06.468624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474919+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:48:06.474919+0000","last_peered":"2024-08-02T18:48:06.474919+0000","last_clean":"2024-08-02T18:48:06.474919+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:48:06.474919+0000","last_undegraded":"2024-08-02T18:48:06.474919+0000","last_fullsized":"2024-08-02T18:48:06.474919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.485388+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:48:06.485388+0000","last_peered":"2024-08-02T18:48:06.485388+0000","last_clean":"2024-08-02T18:48:06.485388+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:48:06.485388+0000","last_undegraded":"2024-08-02T18:48:06.485388+0000","last_fullsized":"2024-08-02T18:48:06.485388+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476167+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:48:06.476167+0000","last_peered":"2024-08-02T18:48:06.476167+0000","last_clean":"2024-08-02T18:48:06.476167+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:48:06.476167+0000","last_undegraded":"2024-08-02T18:48:06.476167+0000","last_fullsized":"2024-08-02T18:48:06.476167+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472835+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:48:06.472835+0000","last_peered":"2024-08-02T18:48:06.472835+0000","last_clean":"2024-08-02T18:48:06.472835+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:48:06.472835+0000","last_undegraded":"2024-08-02T18:48:06.472835+0000","last_fullsized":"2024-08-02T18:48:06.472835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'30","reported_seq":99,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:17.497665+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:48:17.497665+0000","last_peered":"2024-08-02T18:48:17.497665+0000","last_clean":"2024-08-02T18:48:17.497665+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:48:17.497665+0000","last_undegraded":"2024-08-02T18:48:17.497665+0000","last_fullsized":"2024-08-02T18:48:17.497665+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58655,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":36,"num_read_kb":75,"num_write":31,"num_write_kb":70,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465906+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:48:06.465906+0000","last_peered":"2024-08-02T18:48:06.465906+0000","last_clean":"2024-08-02T18:48:06.465906+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:48:06.465906+0000","last_undegraded":"2024-08-02T18:48:06.465906+0000","last_fullsized":"2024-08-02T18:48:06.465906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857426+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:48:06.857426+0000","last_peered":"2024-08-02T18:48:06.857426+0000","last_clean":"2024-08-02T18:48:06.857426+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:48:06.857426+0000","last_undegraded":"2024-08-02T18:48:06.857426+0000","last_fullsized":"2024-08-02T18:48:06.857426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476504+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:48:06.476504+0000","last_peered":"2024-08-02T18:48:06.476504+0000","last_clean":"2024-08-02T18:48:06.476504+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:48:06.476504+0000","last_undegraded":"2024-08-02T18:48:06.476504+0000","last_fullsized":"2024-08-02T18:48:06.476504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468616+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:48:06.468616+0000","last_peered":"2024-08-02T18:48:06.468616+0000","last_clean":"2024-08-02T18:48:06.468616+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:48:06.468616+0000","last_undegraded":"2024-08-02T18:48:06.468616+0000","last_fullsized":"2024-08-02T18:48:06.468616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470496+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:48:06.470496+0000","last_peered":"2024-08-02T18:48:06.470496+0000","last_clean":"2024-08-02T18:48:06.470496+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:48:06.470496+0000","last_undegraded":"2024-08-02T18:48:06.470496+0000","last_fullsized":"2024-08-02T18:48:06.470496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467216+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:48:06.467216+0000","last_peered":"2024-08-02T18:48:06.467216+0000","last_clean":"2024-08-02T18:48:06.467216+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:48:06.467216+0000","last_undegraded":"2024-08-02T18:48:06.467216+0000","last_fullsized":"2024-08-02T18:48:06.467216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465752+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:48:06.465752+0000","last_peered":"2024-08-02T18:48:06.465752+0000","last_clean":"2024-08-02T18:48:06.465752+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:48:06.465752+0000","last_undegraded":"2024-08-02T18:48:06.465752+0000","last_fullsized":"2024-08-02T18:48:06.465752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857610+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:48:06.857610+0000","last_peered":"2024-08-02T18:48:06.857610+0000","last_clean":"2024-08-02T18:48:06.857610+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:48:06.857610+0000","last_undegraded":"2024-08-02T18:48:06.857610+0000","last_fullsized":"2024-08-02T18:48:06.857610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":51,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:16.493013+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:48:16.493013+0000","last_peered":"2024-08-02T18:48:16.493013+0000","last_clean":"2024-08-02T18:48:16.493013+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:48:16.493013+0000","last_undegraded":"2024-08-02T18:48:16.493013+0000","last_fullsized":"2024-08-02T18:48:16.493013+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471007+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:48:06.471007+0000","last_peered":"2024-08-02T18:48:06.471007+0000","last_clean":"2024-08-02T18:48:06.471007+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:48:06.471007+0000","last_undegraded":"2024-08-02T18:48:06.471007+0000","last_fullsized":"2024-08-02T18:48:06.471007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469865+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:48:06.469865+0000","last_peered":"2024-08-02T18:48:06.469865+0000","last_clean":"2024-08-02T18:48:06.469865+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:48:06.469865+0000","last_undegraded":"2024-08-02T18:48:06.469865+0000","last_fullsized":"2024-08-02T18:48:06.469865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465865+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:48:06.465865+0000","last_peered":"2024-08-02T18:48:06.465865+0000","last_clean":"2024-08-02T18:48:06.465865+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:48:06.465865+0000","last_undegraded":"2024-08-02T18:48:06.465865+0000","last_fullsized":"2024-08-02T18:48:06.465865+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476710+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:48:06.476710+0000","last_peered":"2024-08-02T18:48:06.476710+0000","last_clean":"2024-08-02T18:48:06.476710+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:48:06.476710+0000","last_undegraded":"2024-08-02T18:48:06.476710+0000","last_fullsized":"2024-08-02T18:48:06.476710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474720+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:48:06.474720+0000","last_peered":"2024-08-02T18:48:06.474720+0000","last_clean":"2024-08-02T18:48:06.474720+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:48:06.474720+0000","last_undegraded":"2024-08-02T18:48:06.474720+0000","last_fullsized":"2024-08-02T18:48:06.474720+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471153+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:48:06.471153+0000","last_peered":"2024-08-02T18:48:06.471153+0000","last_clean":"2024-08-02T18:48:06.471153+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:48:06.471153+0000","last_undegraded":"2024-08-02T18:48:06.471153+0000","last_fullsized":"2024-08-02T18:48:06.471153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474786+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:48:06.474786+0000","last_peered":"2024-08-02T18:48:06.474786+0000","last_clean":"2024-08-02T18:48:06.474786+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:48:06.474786+0000","last_undegraded":"2024-08-02T18:48:06.474786+0000","last_fullsized":"2024-08-02T18:48:06.474786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470163+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:48:06.470163+0000","last_peered":"2024-08-02T18:48:06.470163+0000","last_clean":"2024-08-02T18:48:06.470163+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:48:06.470163+0000","last_undegraded":"2024-08-02T18:48:06.470163+0000","last_fullsized":"2024-08-02T18:48:06.470163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473185+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:48:06.473185+0000","last_peered":"2024-08-02T18:48:06.473185+0000","last_clean":"2024-08-02T18:48:06.473185+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:48:06.473185+0000","last_undegraded":"2024-08-02T18:48:06.473185+0000","last_fullsized":"2024-08-02T18:48:06.473185+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478161+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:48:06.478161+0000","last_peered":"2024-08-02T18:48:06.478161+0000","last_clean":"2024-08-02T18:48:06.478161+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:48:06.478161+0000","last_undegraded":"2024-08-02T18:48:06.478161+0000","last_fullsized":"2024-08-02T18:48:06.478161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":55,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:14.490850+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:48:14.490850+0000","last_peered":"2024-08-02T18:48:14.490850+0000","last_clean":"2024-08-02T18:48:14.490850+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:48:14.490850+0000","last_undegraded":"2024-08-02T18:48:14.490850+0000","last_fullsized":"2024-08-02T18:48:14.490850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":16,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472468+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:48:06.472468+0000","last_peered":"2024-08-02T18:48:06.472468+0000","last_clean":"2024-08-02T18:48:06.472468+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:48:06.472468+0000","last_undegraded":"2024-08-02T18:48:06.472468+0000","last_fullsized":"2024-08-02T18:48:06.472468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467180+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:48:06.467180+0000","last_peered":"2024-08-02T18:48:06.467180+0000","last_clean":"2024-08-02T18:48:06.467180+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:48:06.467180+0000","last_undegraded":"2024-08-02T18:48:06.467180+0000","last_fullsized":"2024-08-02T18:48:06.467180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468760+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:48:06.468760+0000","last_peered":"2024-08-02T18:48:06.468760+0000","last_clean":"2024-08-02T18:48:06.468760+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:48:06.468760+0000","last_undegraded":"2024-08-02T18:48:06.468760+0000","last_fullsized":"2024-08-02T18:48:06.468760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467581+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:48:06.467581+0000","last_peered":"2024-08-02T18:48:06.467581+0000","last_clean":"2024-08-02T18:48:06.467581+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:48:06.467581+0000","last_undegraded":"2024-08-02T18:48:06.467581+0000","last_fullsized":"2024-08-02T18:48:06.467581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467303+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:48:06.467303+0000","last_peered":"2024-08-02T18:48:06.467303+0000","last_clean":"2024-08-02T18:48:06.467303+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:48:06.467303+0000","last_undegraded":"2024-08-02T18:48:06.467303+0000","last_fullsized":"2024-08-02T18:48:06.467303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469987+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:48:06.469987+0000","last_peered":"2024-08-02T18:48:06.469987+0000","last_clean":"2024-08-02T18:48:06.469987+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:48:06.469987+0000","last_undegraded":"2024-08-02T18:48:06.469987+0000","last_fullsized":"2024-08-02T18:48:06.469987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475366+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:48:06.475366+0000","last_peered":"2024-08-02T18:48:06.475366+0000","last_clean":"2024-08-02T18:48:06.475366+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:48:06.475366+0000","last_undegraded":"2024-08-02T18:48:06.475366+0000","last_fullsized":"2024-08-02T18:48:06.475366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470004+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:48:06.470004+0000","last_peered":"2024-08-02T18:48:06.470004+0000","last_clean":"2024-08-02T18:48:06.470004+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:48:06.470004+0000","last_undegraded":"2024-08-02T18:48:06.470004+0000","last_fullsized":"2024-08-02T18:48:06.470004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468267+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:48:06.468267+0000","last_peered":"2024-08-02T18:48:06.468267+0000","last_clean":"2024-08-02T18:48:06.468267+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:48:06.468267+0000","last_undegraded":"2024-08-02T18:48:06.468267+0000","last_fullsized":"2024-08-02T18:48:06.468267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471381+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:48:06.471381+0000","last_peered":"2024-08-02T18:48:06.471381+0000","last_clean":"2024-08-02T18:48:06.471381+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:48:06.471381+0000","last_undegraded":"2024-08-02T18:48:06.471381+0000","last_fullsized":"2024-08-02T18:48:06.471381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476371+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:48:06.476371+0000","last_peered":"2024-08-02T18:48:06.476371+0000","last_clean":"2024-08-02T18:48:06.476371+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:48:06.476371+0000","last_undegraded":"2024-08-02T18:48:06.476371+0000","last_fullsized":"2024-08-02T18:48:06.476371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471171+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:48:06.471171+0000","last_peered":"2024-08-02T18:48:06.471171+0000","last_clean":"2024-08-02T18:48:06.471171+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:48:06.471171+0000","last_undegraded":"2024-08-02T18:48:06.471171+0000","last_fullsized":"2024-08-02T18:48:06.471171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857311+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:48:06.857311+0000","last_peered":"2024-08-02T18:48:06.857311+0000","last_clean":"2024-08-02T18:48:06.857311+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:48:06.857311+0000","last_undegraded":"2024-08-02T18:48:06.857311+0000","last_fullsized":"2024-08-02T18:48:06.857311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475156+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:48:06.475156+0000","last_peered":"2024-08-02T18:48:06.475156+0000","last_clean":"2024-08-02T18:48:06.475156+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:48:06.475156+0000","last_undegraded":"2024-08-02T18:48:06.475156+0000","last_fullsized":"2024-08-02T18:48:06.475156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468795+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:48:06.468795+0000","last_peered":"2024-08-02T18:48:06.468795+0000","last_clean":"2024-08-02T18:48:06.468795+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:48:06.468795+0000","last_undegraded":"2024-08-02T18:48:06.468795+0000","last_fullsized":"2024-08-02T18:48:06.468795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467620+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:48:06.467620+0000","last_peered":"2024-08-02T18:48:06.467620+0000","last_clean":"2024-08-02T18:48:06.467620+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:48:06.467620+0000","last_undegraded":"2024-08-02T18:48:06.467620+0000","last_fullsized":"2024-08-02T18:48:06.467620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466617+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:48:06.466617+0000","last_peered":"2024-08-02T18:48:06.466617+0000","last_clean":"2024-08-02T18:48:06.466617+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:48:06.466617+0000","last_undegraded":"2024-08-02T18:48:06.466617+0000","last_fullsized":"2024-08-02T18:48:06.466617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469489+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:48:06.469489+0000","last_peered":"2024-08-02T18:48:06.469489+0000","last_clean":"2024-08-02T18:48:06.469489+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:48:06.469489+0000","last_undegraded":"2024-08-02T18:48:06.469489+0000","last_fullsized":"2024-08-02T18:48:06.469489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857053+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:48:06.857053+0000","last_peered":"2024-08-02T18:48:06.857053+0000","last_clean":"2024-08-02T18:48:06.857053+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:48:06.857053+0000","last_undegraded":"2024-08-02T18:48:06.857053+0000","last_fullsized":"2024-08-02T18:48:06.857053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470006+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:48:06.470006+0000","last_peered":"2024-08-02T18:48:06.470006+0000","last_clean":"2024-08-02T18:48:06.470006+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:48:06.470006+0000","last_undegraded":"2024-08-02T18:48:06.470006+0000","last_fullsized":"2024-08-02T18:48:06.470006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469719+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:48:06.469719+0000","last_peered":"2024-08-02T18:48:06.469719+0000","last_clean":"2024-08-02T18:48:06.469719+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:48:06.469719+0000","last_undegraded":"2024-08-02T18:48:06.469719+0000","last_fullsized":"2024-08-02T18:48:06.469719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475155+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:48:06.475155+0000","last_peered":"2024-08-02T18:48:06.475155+0000","last_clean":"2024-08-02T18:48:06.475155+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:48:06.475155+0000","last_undegraded":"2024-08-02T18:48:06.475155+0000","last_fullsized":"2024-08-02T18:48:06.475155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468906+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:48:06.468906+0000","last_peered":"2024-08-02T18:48:06.468906+0000","last_clean":"2024-08-02T18:48:06.468906+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:48:06.468906+0000","last_undegraded":"2024-08-02T18:48:06.468906+0000","last_fullsized":"2024-08-02T18:48:06.468906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467663+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:48:06.467663+0000","last_peered":"2024-08-02T18:48:06.467663+0000","last_clean":"2024-08-02T18:48:06.467663+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:48:06.467663+0000","last_undegraded":"2024-08-02T18:48:06.467663+0000","last_fullsized":"2024-08-02T18:48:06.467663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470984+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:48:06.470984+0000","last_peered":"2024-08-02T18:48:06.470984+0000","last_clean":"2024-08-02T18:48:06.470984+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:48:06.470984+0000","last_undegraded":"2024-08-02T18:48:06.470984+0000","last_fullsized":"2024-08-02T18:48:06.470984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857678+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:48:06.857678+0000","last_peered":"2024-08-02T18:48:06.857678+0000","last_clean":"2024-08-02T18:48:06.857678+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:48:06.857678+0000","last_undegraded":"2024-08-02T18:48:06.857678+0000","last_fullsized":"2024-08-02T18:48:06.857678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471116+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:48:06.471116+0000","last_peered":"2024-08-02T18:48:06.471116+0000","last_clean":"2024-08-02T18:48:06.471116+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:48:06.471116+0000","last_undegraded":"2024-08-02T18:48:06.471116+0000","last_fullsized":"2024-08-02T18:48:06.471116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466723+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:48:06.466723+0000","last_peered":"2024-08-02T18:48:06.466723+0000","last_clean":"2024-08-02T18:48:06.466723+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:48:06.466723+0000","last_undegraded":"2024-08-02T18:48:06.466723+0000","last_fullsized":"2024-08-02T18:48:06.466723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470038+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:48:06.470038+0000","last_peered":"2024-08-02T18:48:06.470038+0000","last_clean":"2024-08-02T18:48:06.470038+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:48:06.470038+0000","last_undegraded":"2024-08-02T18:48:06.470038+0000","last_fullsized":"2024-08-02T18:48:06.470038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472226+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:48:06.472226+0000","last_peered":"2024-08-02T18:48:06.472226+0000","last_clean":"2024-08-02T18:48:06.472226+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:48:06.472226+0000","last_undegraded":"2024-08-02T18:48:06.472226+0000","last_fullsized":"2024-08-02T18:48:06.472226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473958+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:48:06.473958+0000","last_peered":"2024-08-02T18:48:06.473958+0000","last_clean":"2024-08-02T18:48:06.473958+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:48:06.473958+0000","last_undegraded":"2024-08-02T18:48:06.473958+0000","last_fullsized":"2024-08-02T18:48:06.473958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469763+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:48:06.469763+0000","last_peered":"2024-08-02T18:48:06.469763+0000","last_clean":"2024-08-02T18:48:06.469763+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:48:06.469763+0000","last_undegraded":"2024-08-02T18:48:06.469763+0000","last_fullsized":"2024-08-02T18:48:06.469763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469968+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:48:06.469968+0000","last_peered":"2024-08-02T18:48:06.469968+0000","last_clean":"2024-08-02T18:48:06.469968+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:48:06.469968+0000","last_undegraded":"2024-08-02T18:48:06.469968+0000","last_fullsized":"2024-08-02T18:48:06.469968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469411+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:48:06.469411+0000","last_peered":"2024-08-02T18:48:06.469411+0000","last_clean":"2024-08-02T18:48:06.469411+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:48:06.469411+0000","last_undegraded":"2024-08-02T18:48:06.469411+0000","last_fullsized":"2024-08-02T18:48:06.469411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":62655,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":116,"num_read_kb":125,"num_write":164,"num_write_kb":111,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":187965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":140,"ondisk_log_size":140,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547225,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":499721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776156,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28676,"kb_used_data":1660,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716476,"statfs":{"total":95995035648,"available":95965671424,"internally_reserved":0,"allocated":1699840,"data_stored":1145610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939680,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":504019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168615,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":499843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397547,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1622016,"data_stored":1095751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561072,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":495099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822707,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1630208,"data_stored":1091339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986233,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":499749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215164,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":495293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411394,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36404,"kb_used_data":1068,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708748,"statfs":{"total":95995035648,"available":95957757952,"internally_reserved":0,"allocated":1093632,"data_stored":555370,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28064,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717088,"statfs":{"total":95995035648,"available":95966298112,"internally_reserved":0,"allocated":1073152,"data_stored":553664,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738442,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":496487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":69632,"data_stored":58655,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":60361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":60233,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:48:22.526 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-02T18:48:22.527 INFO:tasks.cephadm:Setting up client nodes... 2024-08-02T18:48:22.527 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-08-02T18:48:22.781 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:22.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:22 smithi103 ceph-mon[32753]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:48:22.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:48:22.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:48:22.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:23.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:22 smithi121 ceph-mon[37236]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:48:23.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:22 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:48:23.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:22 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:48:23.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:22 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:22 smithi151 ceph-mon[37155]: from='client.14853 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:48:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:22 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:48:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:22 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:48:23.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:22 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:48:23.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.279+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3301220943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 msgr2=0x7f0d28108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:23.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.279+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3301220943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 0x7f0d28108c50 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f0d20009ca0 tx=0x7f0d2002a8c0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.279+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3301220943 shutdown_connections 2024-08-02T18:48:23.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.279+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3301220943 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 0x7f0d28108c50 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3301220943 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d28101a00 0x7f0d28101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3301220943 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d28100800 0x7f0d28100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3301220943 >> 172.21.15.103:0/3301220943 conn(0x7f0d280fbfb0 msgr2=0x7f0d280fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3301220943 shutdown_connections 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3301220943 wait complete. 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 Processor -- start 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 -- start start 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d28100800 0x7f0d2806a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d28101a00 0x7f0d2819c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.280+0000 7f0d2dc95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 0x7f0d2819efe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d2dc95640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2810c5c0 con 0x7f0d281023c0 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d2dc95640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2810c440 con 0x7f0d28100800 2024-08-02T18:48:23.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d2dc95640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2810c740 con 0x7f0d28101a00 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 0x7f0d2819efe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 0x7f0d2819efe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56106/0 (socket says 172.21.15.103:56106) 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 -- 172.21.15.103:0/3782353891 learned_addr learned my addr 172.21.15.103:0/3782353891 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d277fe640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d28100800 0x7f0d2806a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d26ffd640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d28101a00 0x7f0d2819c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 -- 172.21.15.103:0/3782353891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d28101a00 msgr2=0x7f0d2819c9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d28101a00 0x7f0d2819c9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 -- 172.21.15.103:0/3782353891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d28100800 msgr2=0x7f0d2806a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d28100800 0x7f0d2806a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 -- 172.21.15.103:0/3782353891 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2819f8f0 con 0x7f0d281023c0 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d277fe640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d28100800 0x7f0d2806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:23.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d27fff640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 0x7f0d2819efe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0d20031ae0 tx=0x7f0d20031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d24ff9640 1 -- 172.21.15.103:0/3782353891 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d2002fae0 con 0x7f0d281023c0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d2819fb20 con 0x7f0d281023c0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d24ff9640 1 -- 172.21.15.103:0/3782353891 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0d2002fc80 con 0x7f0d281023c0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d24ff9640 1 -- 172.21.15.103:0/3782353891 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d200468a0 con 0x7f0d281023c0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.281+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d281a00b0 con 0x7f0d281023c0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.283+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d28107b30 con 0x7f0d281023c0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.284+0000 7f0d24ff9640 1 -- 172.21.15.103:0/3782353891 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0d20046a40 con 0x7f0d281023c0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.284+0000 7f0d24ff9640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0d100a2c10 0x7f0d100a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.284+0000 7f0d277fe640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0d100a2c10 0x7f0d100a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.284+0000 7f0d24ff9640 1 -- 172.21.15.103:0/3782353891 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f0d200f09d0 con 0x7f0d281023c0 2024-08-02T18:48:23.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.285+0000 7f0d277fe640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0d100a2c10 0x7f0d100a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d28101860 tx=0x7f0d18005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:23.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.292+0000 7f0d24ff9640 1 -- 172.21.15.103:0/3782353891 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0d2004e350 con 0x7f0d281023c0 2024-08-02T18:48:23.549 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.547+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) -- 0x7f0d2802d5e0 con 0x7f0d281023c0 2024-08-02T18:48:23.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.551+0000 7f0d24ff9640 1 -- 172.21.15.103:0/3782353891 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v32) ==== 170+0+59 (secure 0 0 0) 0x7f0d200bd580 con 0x7f0d281023c0 2024-08-02T18:48:23.552 INFO:teuthology.orchestra.run.smithi103.stdout:[client.0] 2024-08-02T18:48:23.552 INFO:teuthology.orchestra.run.smithi103.stdout: key = AQD3Ka1mISyzIBAAZLY2oNheXkVj0tm9ogobjQ== 2024-08-02T18:48:23.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0d100a2c10 msgr2=0x7f0d100a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:23.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0d100a2c10 0x7f0d100a50d0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f0d28101860 tx=0x7f0d18005f90 comp rx=0 tx=0).stop 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 msgr2=0x7f0d2819efe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 0x7f0d2819efe0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f0d20031ae0 tx=0x7f0d20031ee0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 shutdown_connections 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0d281023c0 0x7f0d2819efe0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0d100a2c10 0x7f0d100a50d0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0d28101a00 0x7f0d2819c9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 --2- 172.21.15.103:0/3782353891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0d28100800 0x7f0d2806a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 >> 172.21.15.103:0/3782353891 conn(0x7f0d280fbfb0 msgr2=0x7f0d28104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 shutdown_connections 2024-08-02T18:48:23.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:23.554+0000 7f0d2dc95640 1 -- 172.21.15.103:0/3782353891 wait complete. 2024-08-02T18:48:23.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:23 smithi103 ceph-mon[32753]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.4 KiB/s wr, 9 op/s 2024-08-02T18:48:23.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:23 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3782353891' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-02T18:48:23.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:23 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3782353891' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-02T18:48:24.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:23 smithi121 ceph-mon[37236]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.4 KiB/s wr, 9 op/s 2024-08-02T18:48:24.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:23 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3782353891' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-02T18:48:24.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:23 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3782353891' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-02T18:48:24.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:23 smithi151 ceph-mon[37155]: pgmap v298: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 7.8 KiB/s rd, 5.4 KiB/s wr, 9 op/s 2024-08-02T18:48:24.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:23 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3782353891' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-08-02T18:48:24.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:23 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3782353891' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-08-02T18:48:24.258 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:48:24.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-08-02T18:48:24.258 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-08-02T18:48:24.297 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-08-02T18:48:24.297 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-08-02T18:48:24.298 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph mgr dump --format=json 2024-08-02T18:48:24.592 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:25.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 -- 172.21.15.103:0/3335252729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8290102250 msgr2=0x7f829010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:25.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3335252729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8290102250 0x7f829010e780 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f8288009cd0 tx=0x7f828802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 -- 172.21.15.103:0/3335252729 shutdown_connections 2024-08-02T18:48:25.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3335252729 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8290102250 0x7f829010e780 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3335252729 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82901018b0 0x7f8290101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3335252729 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f82901078b0 0x7f8290107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 -- 172.21.15.103:0/3335252729 >> 172.21.15.103:0/3335252729 conn(0x7f82900fd5f0 msgr2=0x7f82900ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 -- 172.21.15.103:0/3335252729 shutdown_connections 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 -- 172.21.15.103:0/3335252729 wait complete. 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 Processor -- start 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.122+0000 7f8296c2c640 1 -- start start 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f8296c2c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82901018b0 0x7f8290198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f8296c2c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8290102250 0x7f82901987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f8296c2c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82901078b0 0x7f829019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f8296c2c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8290111dd0 con 0x7f82901018b0 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f8296c2c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8290111c50 con 0x7f8290102250 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f8296c2c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8290111f50 con 0x7f82901078b0 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82901018b0 0x7f8290198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82901018b0 0x7f8290198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56118/0 (socket says 172.21.15.103:56118) 2024-08-02T18:48:25.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 -- 172.21.15.103:0/3883130811 learned_addr learned my addr 172.21.15.103:0/3883130811 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f828ffff640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8290102250 0x7f82901987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82951c9640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82901078b0 0x7f829019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 -- 172.21.15.103:0/3883130811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82901078b0 msgr2=0x7f829019cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82901078b0 0x7f829019cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 -- 172.21.15.103:0/3883130811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8290102250 msgr2=0x7f82901987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8290102250 0x7f82901987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 -- 172.21.15.103:0/3883130811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f829019d220 con 0x7f82901018b0 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f828ffff640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8290102250 0x7f82901987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f82949c8640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82901018b0 0x7f8290198270 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f828400d950 tx=0x7f828400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f828dffb640 1 -- 172.21.15.103:0/3883130811 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8284017070 con 0x7f82901018b0 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f829019d510 con 0x7f82901018b0 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f828dffb640 1 -- 172.21.15.103:0/3883130811 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8284009c30 con 0x7f82901018b0 2024-08-02T18:48:25.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.123+0000 7f828dffb640 1 -- 172.21.15.103:0/3883130811 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f828400f740 con 0x7f82901018b0 2024-08-02T18:48:25.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.124+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82901a4df0 con 0x7f82901018b0 2024-08-02T18:48:25.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.125+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8290101d10 con 0x7f82901018b0 2024-08-02T18:48:25.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.126+0000 7f828dffb640 1 -- 172.21.15.103:0/3883130811 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f8284010a80 con 0x7f82901018b0 2024-08-02T18:48:25.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.126+0000 7f828dffb640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f82800a2c10 0x7f82800a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:25.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.127+0000 7f828ffff640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f82800a2c10 0x7f82800a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:25.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.127+0000 7f828dffb640 1 -- 172.21.15.103:0/3883130811 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f82840cf1c0 con 0x7f82901018b0 2024-08-02T18:48:25.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.127+0000 7f828ffff640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f82800a2c10 0x7f82800a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f82900ffb60 tx=0x7f827c005ec0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:25.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.131+0000 7f828dffb640 1 -- 172.21.15.103:0/3883130811 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f8284009de0 con 0x7f82901018b0 2024-08-02T18:48:25.346 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.345+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f8290109e20 con 0x7f82901018b0 2024-08-02T18:48:25.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.349+0000 7f828dffb640 1 -- 172.21.15.103:0/3883130811 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v17) ==== 74+0+263206 (secure 0 0 0) 0x7f828409bc60 con 0x7f82901018b0 2024-08-02T18:48:25.354 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f82800a2c10 msgr2=0x7f82800a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f82800a2c10 0x7f82800a50d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f82900ffb60 tx=0x7f827c005ec0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82901018b0 msgr2=0x7f8290198270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82901018b0 0x7f8290198270 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f828400d950 tx=0x7f828400de10 comp rx=0 tx=0).stop 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 shutdown_connections 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f82800a2c10 0x7f82800a50d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f82901078b0 0x7f829019cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8290102250 0x7f82901987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 --2- 172.21.15.103:0/3883130811 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f82901018b0 0x7f8290198270 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:25.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 >> 172.21.15.103:0/3883130811 conn(0x7f82900fd5f0 msgr2=0x7f82900fdde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:25.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 shutdown_connections 2024-08-02T18:48:25.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:25.352+0000 7f8296c2c640 1 -- 172.21.15.103:0/3883130811 wait complete. 2024-08-02T18:48:25.750 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:25 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3883130811' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-02T18:48:25.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:25 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3883130811' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-02T18:48:25.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:25 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3883130811' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-08-02T18:48:26.167 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":17,"flags":0,"active_gid":14150,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6800","nonce":3303960029},{"type":"v1","addr":"172.21.15.103:6801","nonce":3303960029}]},"active_addr":"172.21.15.103:6801/3303960029","active_change":"2024-08-02T18:41:05.260489+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":24109,"name":"z","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]},{"gid":24113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.5","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.103:8443/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":3,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":592081832}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":433411047}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":15319849}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":2738010911}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.103:0","nonce":3551371096}]}]} 2024-08-02T18:48:26.173 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-08-02T18:48:26.173 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-08-02T18:48:26.173 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:48:26.410 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:26 smithi103 ceph-mon[32753]: pgmap v299: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-08-02T18:48:26.426 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:26.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:26 smithi121 ceph-mon[37236]: pgmap v299: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-08-02T18:48:26.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:26 smithi151 ceph-mon[37155]: pgmap v299: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.3 KiB/s wr, 7 op/s 2024-08-02T18:48:27.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 -- 172.21.15.103:0/3887781536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba8100b50 msgr2=0x7f4ba8100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:27.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 --2- 172.21.15.103:0/3887781536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba8100b50 0x7f4ba8100f30 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f4b98009900 tx=0x7f4b9802a480 comp rx=0 tx=0).stop 2024-08-02T18:48:27.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 -- 172.21.15.103:0/3887781536 shutdown_connections 2024-08-02T18:48:27.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 --2- 172.21.15.103:0/3887781536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ba8102c20 0x7f4ba810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 --2- 172.21.15.103:0/3887781536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba81022a0 0x7f4ba81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 --2- 172.21.15.103:0/3887781536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba8100b50 0x7f4ba8100f30 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 -- 172.21.15.103:0/3887781536 >> 172.21.15.103:0/3887781536 conn(0x7f4ba80fc500 msgr2=0x7f4ba80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:27.112 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 -- 172.21.15.103:0/3887781536 shutdown_connections 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 -- 172.21.15.103:0/3887781536 wait complete. 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.038+0000 7f4bafd86640 1 Processor -- start 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bafd86640 1 -- start start 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bafd86640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ba8100b50 0x7f4ba81991c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bafd86640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba81022a0 0x7f4ba8199700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bafd86640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8102c20 0x7f4ba81a4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bafd86640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8110dd0 con 0x7f4ba81022a0 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bafd86640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8110c50 con 0x7f4ba8100b50 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bafd86640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4ba8110f50 con 0x7f4ba8102c20 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba81022a0 0x7f4ba8199700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba81022a0 0x7f4ba8199700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56128/0 (socket says 172.21.15.103:56128) 2024-08-02T18:48:27.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 -- 172.21.15.103:0/237855047 learned_addr learned my addr 172.21.15.103:0/237855047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4badb22640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ba8100b50 0x7f4ba81991c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bae323640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8102c20 0x7f4ba81a4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 -- 172.21.15.103:0/237855047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8102c20 msgr2=0x7f4ba81a4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8102c20 0x7f4ba81a4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 -- 172.21.15.103:0/237855047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ba8100b50 msgr2=0x7f4ba81991c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ba8100b50 0x7f4ba81991c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 -- 172.21.15.103:0/237855047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4ba81a4780 con 0x7f4ba81022a0 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4badb22640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ba8100b50 0x7f4ba81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.039+0000 7f4bad321640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba81022a0 0x7f4ba8199700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c890 tx=0x7f4ba400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.040+0000 7f4b9effd640 1 -- 172.21.15.103:0/237855047 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4004220 con 0x7f4ba81022a0 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.040+0000 7f4b9effd640 1 -- 172.21.15.103:0/237855047 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ba40043c0 con 0x7f4ba81022a0 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.040+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4ba81a4950 con 0x7f4ba81022a0 2024-08-02T18:48:27.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.040+0000 7f4b9effd640 1 -- 172.21.15.103:0/237855047 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ba4004b10 con 0x7f4ba81022a0 2024-08-02T18:48:27.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.040+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4ba81a4e60 con 0x7f4ba81022a0 2024-08-02T18:48:27.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.041+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4ba8100f30 con 0x7f4ba81022a0 2024-08-02T18:48:27.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.043+0000 7f4b9effd640 1 -- 172.21.15.103:0/237855047 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4ba40051b0 con 0x7f4ba81022a0 2024-08-02T18:48:27.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.043+0000 7f4b9effd640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4b940a2c10 0x7f4b940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:27.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.043+0000 7f4badb22640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4b940a2c10 0x7f4b940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:27.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.043+0000 7f4b9effd640 1 -- 172.21.15.103:0/237855047 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f4ba40cf690 con 0x7f4ba81022a0 2024-08-02T18:48:27.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.044+0000 7f4badb22640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4b940a2c10 0x7f4b940a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b98005ab0 tx=0x7f4b98005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:27.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.047+0000 7f4b9effd640 1 -- 172.21.15.103:0/237855047 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4ba4014030 con 0x7f4ba81022a0 2024-08-02T18:48:27.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.215+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4ba806a290 con 0x7f4ba81022a0 2024-08-02T18:48:27.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.217+0000 7f4b9effd640 1 -- 172.21.15.103:0/237855047 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24703 (secure 0 0 0) 0x7f4ba806a290 con 0x7f4ba81022a0 2024-08-02T18:48:27.219 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:48:27.219 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:48:06.458748+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:48:27.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4b940a2c10 msgr2=0x7f4b940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4b940a2c10 0x7f4b940a50d0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f4b98005ab0 tx=0x7f4b98005a20 comp rx=0 tx=0).stop 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba81022a0 msgr2=0x7f4ba8199700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba81022a0 0x7f4ba8199700 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4ba400c890 tx=0x7f4ba400cd50 comp rx=0 tx=0).stop 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 shutdown_connections 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f4b940a2c10 0x7f4b940a50d0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4ba8102c20 0x7f4ba81a4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4ba81022a0 0x7f4ba8199700 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 --2- 172.21.15.103:0/237855047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4ba8100b50 0x7f4ba81991c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 >> 172.21.15.103:0/237855047 conn(0x7f4ba80fc500 msgr2=0x7f4ba80fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 shutdown_connections 2024-08-02T18:48:27.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:27.219+0000 7f4bafd86640 1 -- 172.21.15.103:0/237855047 wait complete. 2024-08-02T18:48:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:27 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/237855047' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:27.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:27 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/237855047' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:27.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:27 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/237855047' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:27.978 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-08-02T18:48:27.979 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:48:28.229 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:28.639 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:28 smithi103 ceph-mon[32753]: pgmap v300: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-08-02T18:48:28.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 -- 172.21.15.103:0/1037977284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 msgr2=0x7ff888100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:28.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 --2- 172.21.15.103:0/1037977284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 0x7ff888100c10 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7ff874009930 tx=0x7ff87402a420 comp rx=0 tx=0).stop 2024-08-02T18:48:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 -- 172.21.15.103:0/1037977284 shutdown_connections 2024-08-02T18:48:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 --2- 172.21.15.103:0/1037977284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff888101150 0x7ff88810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 --2- 172.21.15.103:0/1037977284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 0x7ff888100c10 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 --2- 172.21.15.103:0/1037977284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8881067b0 0x7ff888106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 -- 172.21.15.103:0/1037977284 >> 172.21.15.103:0/1037977284 conn(0x7ff8880fc4d0 msgr2=0x7ff8880fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:28.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 -- 172.21.15.103:0/1037977284 shutdown_connections 2024-08-02T18:48:28.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.716+0000 7ff88f089640 1 -- 172.21.15.103:0/1037977284 wait complete. 2024-08-02T18:48:28.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88f089640 1 Processor -- start 2024-08-02T18:48:28.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88f089640 1 -- start start 2024-08-02T18:48:28.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88f089640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 0x7ff888198360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:28.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88f089640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff888101150 0x7ff8881988a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:28.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88f089640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8881067b0 0x7ff88819cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88f089640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff888110d90 con 0x7ff8881007b0 2024-08-02T18:48:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88f089640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff888110c10 con 0x7ff8881067b0 2024-08-02T18:48:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88f089640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff888110f10 con 0x7ff888101150 2024-08-02T18:48:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88ce25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 0x7ff888198360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:28.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88ce25640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 0x7ff888198360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56148/0 (socket says 172.21.15.103:56148) 2024-08-02T18:48:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88ce25640 1 -- 172.21.15.103:0/3905646241 learned_addr learned my addr 172.21.15.103:0/3905646241 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:28.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88d626640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8881067b0 0x7ff88819cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88ce25640 1 -- 172.21.15.103:0/3905646241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff888101150 msgr2=0x7ff8881988a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff887fff640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff888101150 0x7ff8881988a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:28.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88ce25640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff888101150 0x7ff8881988a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88ce25640 1 -- 172.21.15.103:0/3905646241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8881067b0 msgr2=0x7ff88819cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:28.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88ce25640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8881067b0 0x7ff88819cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88ce25640 1 -- 172.21.15.103:0/3905646241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff88819d310 con 0x7ff8881007b0 2024-08-02T18:48:28.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.717+0000 7ff88d626640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8881067b0 0x7ff88819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:28.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.718+0000 7ff88ce25640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 0x7ff888198360 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00b4a0 tx=0x7ff87c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:28.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.718+0000 7ff885ffb640 1 -- 172.21.15.103:0/3905646241 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c014070 con 0x7ff8881007b0 2024-08-02T18:48:28.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.718+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff88819d600 con 0x7ff8881007b0 2024-08-02T18:48:28.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.718+0000 7ff885ffb640 1 -- 172.21.15.103:0/3905646241 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff87c010b10 con 0x7ff8881007b0 2024-08-02T18:48:28.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.718+0000 7ff885ffb640 1 -- 172.21.15.103:0/3905646241 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff87c017d60 con 0x7ff8881007b0 2024-08-02T18:48:28.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.718+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8881a4ee0 con 0x7ff8881007b0 2024-08-02T18:48:28.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.719+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff888100c90 con 0x7ff8881007b0 2024-08-02T18:48:28.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.720+0000 7ff885ffb640 1 -- 172.21.15.103:0/3905646241 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff87c017070 con 0x7ff8881007b0 2024-08-02T18:48:28.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.721+0000 7ff885ffb640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8780a2c10 0x7ff8780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:28.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.721+0000 7ff887fff640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8780a2c10 0x7ff8780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:28.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.721+0000 7ff885ffb640 1 -- 172.21.15.103:0/3905646241 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff87c0ce850 con 0x7ff8881007b0 2024-08-02T18:48:28.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.721+0000 7ff887fff640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8780a2c10 0x7ff8780a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff874006010 tx=0x7ff874000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:28.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.725+0000 7ff885ffb640 1 -- 172.21.15.103:0/3905646241 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff87c09b400 con 0x7ff8881007b0 2024-08-02T18:48:28.756 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:28 smithi121 ceph-mon[37236]: pgmap v300: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-08-02T18:48:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:28 smithi151 ceph-mon[37155]: pgmap v300: 129 pgs: 129 active+clean; 642 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 2.1 KiB/s wr, 7 op/s 2024-08-02T18:48:28.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.891+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff8881097c0 con 0x7ff8881007b0 2024-08-02T18:48:28.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.893+0000 7ff885ffb640 1 -- 172.21.15.103:0/3905646241 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24703 (secure 0 0 0) 0x7ff87c09ad00 con 0x7ff8881007b0 2024-08-02T18:48:28.894 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:48:28.895 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:48:06.458748+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:48:28.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8780a2c10 msgr2=0x7ff8780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:28.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8780a2c10 0x7ff8780a50d0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7ff874006010 tx=0x7ff874000bc0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 msgr2=0x7ff888198360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 0x7ff888198360 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7ff87c00b4a0 tx=0x7ff87c00b960 comp rx=0 tx=0).stop 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 shutdown_connections 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8881067b0 0x7ff88819cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8780a2c10 0x7ff8780a50d0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff888101150 0x7ff8881988a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 --2- 172.21.15.103:0/3905646241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8881007b0 0x7ff888198360 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 >> 172.21.15.103:0/3905646241 conn(0x7ff8880fc4d0 msgr2=0x7ff88806a740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 shutdown_connections 2024-08-02T18:48:28.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:28.895+0000 7ff88f089640 1 -- 172.21.15.103:0/3905646241 wait complete. 2024-08-02T18:48:29.622 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-08-02T18:48:29.623 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-08-02T18:48:29.623 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-08-02T18:48:29.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-08-02T18:48:29.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-08-02T18:48:29.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-08-02T18:48:29.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-08-02T18:48:29.625 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-08-02T18:48:29.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.8 flush_pg_stats 2024-08-02T18:48:29.626 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.9 flush_pg_stats 2024-08-02T18:48:29.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.10 flush_pg_stats 2024-08-02T18:48:29.627 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell osd.11 flush_pg_stats 2024-08-02T18:48:29.660 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:29 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3905646241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:29.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:29 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3905646241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:29.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:29 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3905646241' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:48:30.331 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:30.344 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:30.353 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:30.683 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:30 smithi103 ceph-mon[32753]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-08-02T18:48:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:30 smithi121 ceph-mon[37236]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-08-02T18:48:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:30 smithi151 ceph-mon[37155]: pgmap v301: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 2.2 KiB/s wr, 7 op/s 2024-08-02T18:48:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/3791972318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 msgr2=0x7ff8e8107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 --2- 172.21.15.103:0/3791972318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 0x7ff8e8107c90 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009930 tx=0x7ff8dc02a420 comp rx=0 tx=0).stop 2024-08-02T18:48:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/3791972318 shutdown_connections 2024-08-02T18:48:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 --2- 172.21.15.103:0/3791972318 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8e8102250 0x7ff8e810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 --2- 172.21.15.103:0/3791972318 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e81018b0 0x7ff8e8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 --2- 172.21.15.103:0/3791972318 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 0x7ff8e8107c90 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/3791972318 >> 172.21.15.103:0/3791972318 conn(0x7ff8e80fd5f0 msgr2=0x7ff8e80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/3791972318 shutdown_connections 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.131+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/3791972318 wait complete. 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ef1ee640 1 Processor -- start 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ef1ee640 1 -- start start 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ef1ee640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8e81018b0 0x7ff8e8198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ef1ee640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e8102250 0x7ff8e81987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ef1ee640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 0x7ff8e819cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ef1ee640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8111dd0 con 0x7ff8e81078b0 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ef1ee640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8111c50 con 0x7ff8e81018b0 2024-08-02T18:48:31.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ef1ee640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff8e8111f50 con 0x7ff8e8102250 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ed78b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 0x7ff8e819cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ed78b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 0x7ff8e819cb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43678/0 (socket says 172.21.15.103:43678) 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ed78b640 1 -- 172.21.15.103:0/2307719666 learned_addr learned my addr 172.21.15.103:0/2307719666 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ecf8a640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8e81018b0 0x7ff8e8198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ed78b640 1 -- 172.21.15.103:0/2307719666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e8102250 msgr2=0x7ff8e81987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8e7fff640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e8102250 0x7ff8e81987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ed78b640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff8e8102250 0x7ff8e81987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.132+0000 7ff8ed78b640 1 -- 172.21.15.103:0/2307719666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8e81018b0 msgr2=0x7ff8e8198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.133+0000 7ff8ed78b640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff8e81018b0 0x7ff8e8198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.133+0000 7ff8ed78b640 1 -- 172.21.15.103:0/2307719666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff8e819d240 con 0x7ff8e81078b0 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.133+0000 7ff8ed78b640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 0x7ff8e819cb60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000eaa0 tx=0x7ff8e000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.133+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e000cdb0 con 0x7ff8e81078b0 2024-08-02T18:48:31.155 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.133+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff8e0004b20 con 0x7ff8e81078b0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.133+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff8e819d530 con 0x7ff8e81078b0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.133+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff8e0011760 con 0x7ff8e81078b0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.133+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff8e81a4e10 con 0x7ff8e81078b0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.134+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff8e80626b0 con 0x7ff8e81078b0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.135+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff8e0011900 con 0x7ff8e81078b0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.136+0000 7ff8e5ffb640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8d80a2c10 0x7ff8d80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.136+0000 7ff8ecf8a640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8d80a2c10 0x7ff8d80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.136+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff8e00cfae0 con 0x7ff8e81078b0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.136+0000 7ff8e5ffb640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] conn(0x7ff8d80adde0 0x7ff8d80b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.136+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 --> [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff8e0014ec0 con 0x7ff8d80adde0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.136+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ff8e00cff30 con 0x7ff8e81078b0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.136+0000 7ff8ecf8a640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8d80a2c10 0x7ff8d80a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009900 tx=0x7ff8dc0058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.136+0000 7ff8e7fff640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] conn(0x7ff8d80adde0 0x7ff8d80b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.137+0000 7ff8e7fff640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] conn(0x7ff8d80adde0 0x7ff8d80b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.137+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 <== osd.4 v2:172.21.15.121:6808/3147928372 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff8e0014ec0 con 0x7ff8d80adde0 2024-08-02T18:48:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.151+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 --> [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff8e8062b30 con 0x7ff8d80adde0 2024-08-02T18:48:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.151+0000 7ff8e5ffb640 1 -- 172.21.15.103:0/2307719666 <== osd.4 v2:172.21.15.121:6808/3147928372 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff8e8062b30 con 0x7ff8d80adde0 2024-08-02T18:48:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 >> [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] conn(0x7ff8d80adde0 msgr2=0x7ff8d80b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] conn(0x7ff8d80adde0 0x7ff8d80b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8d80a2c10 msgr2=0x7ff8d80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:31.158 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff8d80a2c10 0x7ff8d80a50d0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7ff8dc009900 tx=0x7ff8dc0058d0 comp rx=0 tx=0).stop 2024-08-02T18:48:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 msgr2=0x7ff8e819cb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 --2- 172.21.15.103:0/2307719666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff8e81078b0 0x7ff8e819cb60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7ff8e000eaa0 tx=0x7ff8e000ef60 comp rx=0 tx=0).stop 2024-08-02T18:48:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ed78b640 1 -- 172.21.15.103:0/2307719666 reap_dead start 2024-08-02T18:48:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 shutdown_connections 2024-08-02T18:48:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 >> 172.21.15.103:0/2307719666 conn(0x7ff8e80fd5f0 msgr2=0x7ff8e80fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 shutdown_connections 2024-08-02T18:48:31.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:31.152+0000 7ff8ef1ee640 1 -- 172.21.15.103:0/2307719666 wait complete. 2024-08-02T18:48:31.894 INFO:teuthology.orchestra.run.smithi103.stdout:133143986236 2024-08-02T18:48:31.895 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-08-02T18:48:32.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.073+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/3095227368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d38101150 msgr2=0x7f2d3810d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:32.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.073+0000 7f2d3ec8f640 1 --2- 172.21.15.103:0/3095227368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d38101150 0x7f2d3810d680 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f2d30009cd0 tx=0x7f2d3002a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:32.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/3095227368 shutdown_connections 2024-08-02T18:48:32.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 --2- 172.21.15.103:0/3095227368 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d38101150 0x7f2d3810d680 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:32.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 --2- 172.21.15.103:0/3095227368 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d381007b0 0x7f2d38100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:32.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 --2- 172.21.15.103:0/3095227368 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d381067b0 0x7f2d38106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:32.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/3095227368 >> 172.21.15.103:0/3095227368 conn(0x7f2d380fc4d0 msgr2=0x7f2d380fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:32.075 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/3095227368 shutdown_connections 2024-08-02T18:48:32.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/3095227368 wait complete. 2024-08-02T18:48:32.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 Processor -- start 2024-08-02T18:48:32.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 -- start start 2024-08-02T18:48:32.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d381007b0 0x7f2d3810e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:32.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d38101150 0x7f2d3810e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:32.077 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.074+0000 7f2d3ec8f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d381067b0 0x7f2d3810eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ec8f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38111df0 con 0x7f2d381007b0 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ec8f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38111c70 con 0x7f2d38101150 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ec8f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2d38111f70 con 0x7f2d381067b0 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d381007b0 0x7f2d3810e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d381007b0 0x7f2d3810e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43682/0 (socket says 172.21.15.103:43682) 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 -- 172.21.15.103:0/2472741657 learned_addr learned my addr 172.21.15.103:0/2472741657 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3d22c640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d381067b0 0x7f2d3810eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d37fff640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d38101150 0x7f2d3810e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 -- 172.21.15.103:0/2472741657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d381067b0 msgr2=0x7f2d3810eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2d381067b0 0x7f2d3810eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 -- 172.21.15.103:0/2472741657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d38101150 msgr2=0x7f2d3810e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2d38101150 0x7f2d3810e650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:32.078 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 -- 172.21.15.103:0/2472741657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2d381a6610 con 0x7f2d381007b0 2024-08-02T18:48:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d3ca2b640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d381007b0 0x7f2d3810e110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c890 tx=0x7f2d2c00cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.075+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c004220 con 0x7f2d381007b0 2024-08-02T18:48:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.076+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2d381a6900 con 0x7f2d381007b0 2024-08-02T18:48:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.076+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2d2c0043c0 con 0x7f2d381007b0 2024-08-02T18:48:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.076+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2d2c004a00 con 0x7f2d381007b0 2024-08-02T18:48:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.076+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2d381a6e90 con 0x7f2d381007b0 2024-08-02T18:48:32.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.077+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f2d380fd410 con 0x7f2d381007b0 2024-08-02T18:48:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.078+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f2d2c004c60 con 0x7f2d381007b0 2024-08-02T18:48:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.079+0000 7f2d35ffb640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2d280a2c10 0x7f2d280a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.079+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f2d2c0cf620 con 0x7f2d381007b0 2024-08-02T18:48:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.079+0000 7f2d37fff640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2d280a2c10 0x7f2d280a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.079+0000 7f2d35ffb640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] conn(0x7f2d280adde0 0x7f2d280b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.079+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 --> [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f2d2c012ec0 con 0x7f2d280adde0 2024-08-02T18:48:32.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.079+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f2d2c0cfa70 con 0x7f2d381007b0 2024-08-02T18:48:32.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.079+0000 7f2d3d22c640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] conn(0x7f2d280adde0 0x7f2d280b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:32.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.079+0000 7f2d3d22c640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] conn(0x7f2d280adde0 0x7f2d280b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:32.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.080+0000 7f2d37fff640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2d280a2c10 0x7f2d280a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d3810fba0 tx=0x7f2d2400a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:32.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.080+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 <== osd.6 v2:172.21.15.103:6818/3191321050 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f2d2c012ec0 con 0x7f2d280adde0 2024-08-02T18:48:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.098+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 --> [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f2d38101ef0 con 0x7f2d280adde0 2024-08-02T18:48:32.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d35ffb640 1 -- 172.21.15.103:0/2472741657 <== osd.6 v2:172.21.15.103:6818/3191321050 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f2d38101ef0 con 0x7f2d280adde0 2024-08-02T18:48:32.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] conn(0x7f2d280adde0 msgr2=0x7f2d280b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:32.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] conn(0x7f2d280adde0 0x7f2d280b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:32.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2d280a2c10 msgr2=0x7f2d280a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:32.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2d280a2c10 0x7f2d280a50d0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f2d3810fba0 tx=0x7f2d2400a2d0 comp rx=0 tx=0).stop 2024-08-02T18:48:32.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d381007b0 msgr2=0x7f2d3810e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:32.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 --2- 172.21.15.103:0/2472741657 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2d381007b0 0x7f2d3810e110 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f2d2c00c890 tx=0x7f2d2c00cc90 comp rx=0 tx=0).stop 2024-08-02T18:48:32.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3d22c640 1 -- 172.21.15.103:0/2472741657 reap_dead start 2024-08-02T18:48:32.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 shutdown_connections 2024-08-02T18:48:32.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 >> 172.21.15.103:0/2472741657 conn(0x7f2d380fc4d0 msgr2=0x7f2d380fca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:32.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 shutdown_connections 2024-08-02T18:48:32.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:32.099+0000 7f2d3ec8f640 1 -- 172.21.15.103:0/2472741657 wait complete. 2024-08-02T18:48:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:32 smithi121 ceph-mon[37236]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-02T18:48:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:32 smithi151 ceph-mon[37155]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-02T18:48:32.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:32 smithi103 ceph-mon[32753]: pgmap v302: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 682 B/s wr, 6 op/s 2024-08-02T18:48:32.859 INFO:teuthology.orchestra.run.smithi103.stdout:188978561075 2024-08-02T18:48:32.860 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-08-02T18:48:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 -- 172.21.15.103:0/956639989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368103420 msgr2=0x7f736810b910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 --2- 172.21.15.103:0/956639989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368103420 0x7f736810b910 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f7350009900 tx=0x7f735002a480 comp rx=0 tx=0).stop 2024-08-02T18:48:33.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 -- 172.21.15.103:0/956639989 shutdown_connections 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 --2- 172.21.15.103:0/956639989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f736810bea0 0x7f736810e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 --2- 172.21.15.103:0/956639989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368103420 0x7f736810b910 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 --2- 172.21.15.103:0/956639989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7368102b00 0x7f7368102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 -- 172.21.15.103:0/956639989 >> 172.21.15.103:0/956639989 conn(0x7f73680fc4c0 msgr2=0x7f73680fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 -- 172.21.15.103:0/956639989 shutdown_connections 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.399+0000 7f736d1b4640 1 -- 172.21.15.103:0/956639989 wait complete. 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.400+0000 7f736d1b4640 1 Processor -- start 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.400+0000 7f736d1b4640 1 -- start start 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.400+0000 7f736d1b4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368102b00 0x7f73681981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.400+0000 7f736d1b4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7368103420 0x7f7368198720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:33.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.400+0000 7f736d1b4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f736810bea0 0x7f736819cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.400+0000 7f736d1b4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7368111db0 con 0x7f7368102b00 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.400+0000 7f736d1b4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7368111c30 con 0x7f736810bea0 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.400+0000 7f736d1b4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7368111f30 con 0x7f7368103420 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368102b00 0x7f73681981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368102b00 0x7f73681981e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43700/0 (socket says 172.21.15.103:43700) 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 -- 172.21.15.103:0/767495028 learned_addr learned my addr 172.21.15.103:0/767495028 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f735e59c640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7368103420 0x7f7368198720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f736759e640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f736810bea0 0x7f736819cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 -- 172.21.15.103:0/767495028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7368103420 msgr2=0x7f7368198720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7368103420 0x7f7368198720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 -- 172.21.15.103:0/767495028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f736810bea0 msgr2=0x7f736819cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:33.412 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f736810bea0 0x7f736819cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 -- 172.21.15.103:0/767495028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f736819d190 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7366d9d640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368102b00 0x7f73681981e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f735800d770 tx=0x7f735800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358017070 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7358005520 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f736819d480 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7358010460 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.401+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f73681a4d60 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.402+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f73680626b0 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.404+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7358004ea0 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.404+0000 7f7364d99640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f73540a2c10 0x7f73540a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.404+0000 7f735e59c640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f73540a2c10 0x7f73540a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.404+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f73580cf300 con 0x7f7368102b00 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.405+0000 7f7364d99640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] conn(0x7f73540adde0 0x7f73540b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:33.413 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.405+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 --> [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7358001d30 con 0x7f73540adde0 2024-08-02T18:48:33.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.405+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f73580cf7e0 con 0x7f7368102b00 2024-08-02T18:48:33.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.405+0000 7f735e59c640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f73540a2c10 0x7f73540a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7350009230 tx=0x7f73500058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:33.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.405+0000 7f736759e640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] conn(0x7f73540adde0 0x7f73540b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:33.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.405+0000 7f736759e640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] conn(0x7f73540adde0 0x7f73540b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:33.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.406+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 <== osd.1 v2:172.21.15.121:6800/427937936 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7358001d30 con 0x7f73540adde0 2024-08-02T18:48:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 --> [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7368062b30 con 0x7f73540adde0 2024-08-02T18:48:33.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f7364d99640 1 -- 172.21.15.103:0/767495028 <== osd.1 v2:172.21.15.121:6800/427937936 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7368062b30 con 0x7f73540adde0 2024-08-02T18:48:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 >> [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] conn(0x7f73540adde0 msgr2=0x7f73540b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f736d1b4640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] conn(0x7f73540adde0 0x7f73540b0280 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f73540a2c10 msgr2=0x7f73540a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f736d1b4640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f73540a2c10 0x7f73540a50d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f7350009230 tx=0x7f73500058d0 comp rx=0 tx=0).stop 2024-08-02T18:48:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368102b00 msgr2=0x7f73681981e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f736d1b4640 1 --2- 172.21.15.103:0/767495028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7368102b00 0x7f73681981e0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f735800d770 tx=0x7f735800dc30 comp rx=0 tx=0).stop 2024-08-02T18:48:33.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.420+0000 7f736759e640 1 -- 172.21.15.103:0/767495028 reap_dead start 2024-08-02T18:48:33.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.421+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 shutdown_connections 2024-08-02T18:48:33.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.421+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 >> 172.21.15.103:0/767495028 conn(0x7f73680fc4c0 msgr2=0x7f73680fdbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:33.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.421+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 shutdown_connections 2024-08-02T18:48:33.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:33.421+0000 7f736d1b4640 1 -- 172.21.15.103:0/767495028 wait complete. 2024-08-02T18:48:33.674 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:33.678 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:33.679 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:33.679 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:33.679 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:33.680 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:33.680 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:33.685 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:33.685 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:34.143 INFO:teuthology.orchestra.run.smithi103.stdout:55834574920 2024-08-02T18:48:34.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-08-02T18:48:34.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:34 smithi103 ceph-mon[32753]: pgmap v303: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-02T18:48:34.704 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:34.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:34 smithi121 ceph-mon[37236]: pgmap v303: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-02T18:48:34.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:34 smithi151 ceph-mon[37155]: pgmap v303: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 682 B/s wr, 7 op/s 2024-08-02T18:48:34.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1030044978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 msgr2=0x7f9b48107c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:34.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 --2- 172.21.15.103:0/1030044978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 0x7f9b48107c80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009930 tx=0x7f9b3802a420 comp rx=0 tx=0).stop 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1030044978 shutdown_connections 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 --2- 172.21.15.103:0/1030044978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b48102240 0x7f9b4810e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 --2- 172.21.15.103:0/1030044978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b481018a0 0x7f9b48101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 --2- 172.21.15.103:0/1030044978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 0x7f9b48107c80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1030044978 >> 172.21.15.103:0/1030044978 conn(0x7f9b480fd5e0 msgr2=0x7f9b480ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1030044978 shutdown_connections 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.947+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1030044978 wait complete. 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b4d4c8640 1 Processor -- start 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b4d4c8640 1 -- start start 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b4d4c8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b481018a0 0x7f9b481982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:34.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b4d4c8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b48102240 0x7f9b48198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b4d4c8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 0x7f9b4819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b4d4c8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48111dc0 con 0x7f9b481078a0 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b4d4c8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48111c40 con 0x7f9b481018a0 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b4d4c8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9b48111f40 con 0x7f9b48102240 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b477fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 0x7f9b4819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b46ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b481018a0 0x7f9b481982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b477fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 0x7f9b4819cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43724/0 (socket says 172.21.15.103:43724) 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.948+0000 7f9b477fe640 1 -- 172.21.15.103:0/1549324830 learned_addr learned my addr 172.21.15.103:0/1549324830 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b3ffff640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b48102240 0x7f9b48198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b477fe640 1 -- 172.21.15.103:0/1549324830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b48102240 msgr2=0x7f9b48198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b477fe640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9b48102240 0x7f9b48198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b477fe640 1 -- 172.21.15.103:0/1549324830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b481018a0 msgr2=0x7f9b481982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:34.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b477fe640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9b481018a0 0x7f9b481982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b477fe640 1 -- 172.21.15.103:0/1549324830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b4819d290 con 0x7f9b481078a0 2024-08-02T18:48:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b477fe640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 0x7f9b4819cbb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009fd0 tx=0x7f9b4000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b40017070 con 0x7f9b481078a0 2024-08-02T18:48:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9b40004020 con 0x7f9b481078a0 2024-08-02T18:48:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b4819d580 con 0x7f9b481078a0 2024-08-02T18:48:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b400106c0 con 0x7f9b481078a0 2024-08-02T18:48:34.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.949+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b48074150 con 0x7f9b481078a0 2024-08-02T18:48:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.950+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9b480626b0 con 0x7f9b481078a0 2024-08-02T18:48:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.952+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f9b400041d0 con 0x7f9b481078a0 2024-08-02T18:48:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.953+0000 7f9b44ff9640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9b340a2c10 0x7f9b340a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.953+0000 7f9b46ffd640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9b340a2c10 0x7f9b340a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:34.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.953+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f9b400cf1d0 con 0x7f9b481078a0 2024-08-02T18:48:34.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.953+0000 7f9b44ff9640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] conn(0x7f9b340adde0 0x7f9b340b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:34.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.953+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 --> [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9b340b0950 con 0x7f9b340adde0 2024-08-02T18:48:34.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.953+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f9b400d6050 con 0x7f9b481078a0 2024-08-02T18:48:34.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.953+0000 7f9b3ffff640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] conn(0x7f9b340adde0 0x7f9b340b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:34.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.953+0000 7f9b46ffd640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9b340a2c10 0x7f9b340a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009900 tx=0x7f9b3803c040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:34.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.954+0000 7f9b3ffff640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] conn(0x7f9b340adde0 0x7f9b340b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.10 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:34.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.954+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 <== osd.10 v2:172.21.15.121:6824/1207550526 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9b340b0950 con 0x7f9b340adde0 2024-08-02T18:48:34.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.968+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 --> [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9b48062b30 con 0x7f9b340adde0 2024-08-02T18:48:34.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b44ff9640 1 -- 172.21.15.103:0/1549324830 <== osd.10 v2:172.21.15.121:6824/1207550526 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f9b48062b30 con 0x7f9b340adde0 2024-08-02T18:48:34.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 >> [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] conn(0x7f9b340adde0 msgr2=0x7f9b340b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] conn(0x7f9b340adde0 0x7f9b340b0280 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9b340a2c10 msgr2=0x7f9b340a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f9b340a2c10 0x7f9b340a50d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f9b38009900 tx=0x7f9b3803c040 comp rx=0 tx=0).stop 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 msgr2=0x7f9b4819cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 --2- 172.21.15.103:0/1549324830 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9b481078a0 0x7f9b4819cbb0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f9b40009fd0 tx=0x7f9b4000b260 comp rx=0 tx=0).stop 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b477fe640 1 -- 172.21.15.103:0/1549324830 reap_dead start 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 shutdown_connections 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 >> 172.21.15.103:0/1549324830 conn(0x7f9b480fd5e0 msgr2=0x7f9b480fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 shutdown_connections 2024-08-02T18:48:34.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:34.969+0000 7f9b4d4c8640 1 -- 172.21.15.103:0/1549324830 wait complete. 2024-08-02T18:48:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 -- 172.21.15.103:0/96519695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 msgr2=0x7f87e410e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 --2- 172.21.15.103:0/96519695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 0x7f87e410e780 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f87dc009cd0 tx=0x7f87dc02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 -- 172.21.15.103:0/96519695 shutdown_connections 2024-08-02T18:48:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 --2- 172.21.15.103:0/96519695 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 0x7f87e410e780 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 --2- 172.21.15.103:0/96519695 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41018b0 0x7f87e4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 --2- 172.21.15.103:0/96519695 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41078b0 0x7f87e4107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 -- 172.21.15.103:0/96519695 >> 172.21.15.103:0/96519695 conn(0x7f87e40fd5f0 msgr2=0x7f87e40ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 -- 172.21.15.103:0/96519695 shutdown_connections 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.586+0000 7f87ebefc640 1 -- 172.21.15.103:0/96519695 wait complete. 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ebefc640 1 Processor -- start 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ebefc640 1 -- start start 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ebefc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41018b0 0x7f87e4198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ebefc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 0x7f87e4198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ebefc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41078b0 0x7f87e419cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ebefc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f87e4111dd0 con 0x7f87e4102250 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ebefc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f87e4111c50 con 0x7f87e41078b0 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ebefc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f87e4111f50 con 0x7f87e41018b0 2024-08-02T18:48:35.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9497640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 0x7f87e4198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9497640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 0x7f87e4198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43746/0 (socket says 172.21.15.103:43746) 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9497640 1 -- 172.21.15.103:0/1562145524 learned_addr learned my addr 172.21.15.103:0/1562145524 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87ea499640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41078b0 0x7f87e419cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9c98640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41018b0 0x7f87e4198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9497640 1 -- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41018b0 msgr2=0x7f87e4198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9497640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41018b0 0x7f87e4198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9497640 1 -- 172.21.15.103:0/1562145524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41078b0 msgr2=0x7f87e419cad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9497640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f87e41078b0 0x7f87e419cad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.587+0000 7f87e9497640 1 -- 172.21.15.103:0/1562145524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87e419d1b0 con 0x7f87e4102250 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.588+0000 7f87e9c98640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f87e41018b0 0x7f87e4198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.588+0000 7f87e9497640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 0x7f87e4198740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e9f0 tx=0x7f87e000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.588+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e000cd80 con 0x7f87e4102250 2024-08-02T18:48:35.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.588+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87e419d4a0 con 0x7f87e4102250 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.588+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f87e0010930 con 0x7f87e4102250 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.588+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87e0018b00 con 0x7f87e4102250 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.588+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87e41a4d80 con 0x7f87e4102250 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.589+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f87e40fe790 con 0x7f87e4102250 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.590+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f87e0018ca0 con 0x7f87e4102250 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.590+0000 7f87d6ffd640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87d00a2c10 0x7f87d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.591+0000 7f87e9c98640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87d00a2c10 0x7f87d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.591+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f87e00cff40 con 0x7f87e4102250 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.591+0000 7f87d6ffd640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] conn(0x7f87d00adde0 0x7f87d00b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.591+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 --> [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f87d00b0950 con 0x7f87d00adde0 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.591+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f87e00d0390 con 0x7f87e4102250 2024-08-02T18:48:35.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.591+0000 7f87e9c98640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87d00a2c10 0x7f87d00a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005fd0 tx=0x7f87d80094d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:35.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.591+0000 7f87ea499640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] conn(0x7f87d00adde0 0x7f87d00b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:35.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.591+0000 7f87ea499640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] conn(0x7f87d00adde0 0x7f87d00b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:35.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.592+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 <== osd.2 v2:172.21.15.151:6800/352420773 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f87d00b0950 con 0x7f87d00adde0 2024-08-02T18:48:35.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.606+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 --> [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f87e4102ff0 con 0x7f87d00adde0 2024-08-02T18:48:35.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.606+0000 7f87d6ffd640 1 -- 172.21.15.103:0/1562145524 <== osd.2 v2:172.21.15.151:6800/352420773 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f87e4102ff0 con 0x7f87d00adde0 2024-08-02T18:48:35.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] conn(0x7f87d00adde0 msgr2=0x7f87d00b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:35.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] conn(0x7f87d00adde0 0x7f87d00b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87d00a2c10 msgr2=0x7f87d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:35.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f87d00a2c10 0x7f87d00a50d0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f87d8005fd0 tx=0x7f87d80094d0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 msgr2=0x7f87e4198740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:35.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 --2- 172.21.15.103:0/1562145524 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f87e4102250 0x7f87e4198740 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f87e000e9f0 tx=0x7f87e000eeb0 comp rx=0 tx=0).stop 2024-08-02T18:48:35.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ea499640 1 -- 172.21.15.103:0/1562145524 reap_dead start 2024-08-02T18:48:35.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 shutdown_connections 2024-08-02T18:48:35.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 >> 172.21.15.103:0/1562145524 conn(0x7f87e40fd5f0 msgr2=0x7f87e40fdd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:35.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 shutdown_connections 2024-08-02T18:48:35.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:35.607+0000 7f87ebefc640 1 -- 172.21.15.103:0/1562145524 wait complete. 2024-08-02T18:48:36.464 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:36 smithi103 ceph-mon[32753]: pgmap v304: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:36.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:36 smithi121 ceph-mon[37236]: pgmap v304: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:36.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:36 smithi151 ceph-mon[37155]: pgmap v304: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 -- 172.21.15.103:0/2870321474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac0742f0 msgr2=0x7ff0ac0746d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 --2- 172.21.15.103:0/2870321474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac0742f0 0x7ff0ac0746d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8009900 tx=0x7ff0a802a480 comp rx=0 tx=0).stop 2024-08-02T18:48:36.918 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 -- 172.21.15.103:0/2870321474 shutdown_connections 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 --2- 172.21.15.103:0/2870321474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0ac10e150 0x7ff0ac110540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 --2- 172.21.15.103:0/2870321474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0ac074c10 0x7ff0ac10dc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 --2- 172.21.15.103:0/2870321474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac0742f0 0x7ff0ac0746d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 -- 172.21.15.103:0/2870321474 >> 172.21.15.103:0/2870321474 conn(0x7ff0ac0fd5f0 msgr2=0x7ff0ac0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 -- 172.21.15.103:0/2870321474 shutdown_connections 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.908+0000 7ff0b411a640 1 -- 172.21.15.103:0/2870321474 wait complete. 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b411a640 1 Processor -- start 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b411a640 1 -- start start 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b411a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0ac0742f0 0x7ff0ac19a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b411a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0ac074c10 0x7ff0ac19aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b411a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac10e150 0x7ff0ac19ed90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:36.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b411a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac113fc0 con 0x7ff0ac10e150 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b411a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac113e40 con 0x7ff0ac0742f0 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b411a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff0ac114140 con 0x7ff0ac074c10 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b26b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac10e150 0x7ff0ac19ed90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b26b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac10e150 0x7ff0ac19ed90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43774/0 (socket says 172.21.15.103:43774) 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b26b7640 1 -- 172.21.15.103:0/161936457 learned_addr learned my addr 172.21.15.103:0/161936457 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b1eb6640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0ac0742f0 0x7ff0ac19a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b16b5640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0ac074c10 0x7ff0ac19aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b26b7640 1 -- 172.21.15.103:0/161936457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0ac074c10 msgr2=0x7ff0ac19aa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b26b7640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff0ac074c10 0x7ff0ac19aa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b26b7640 1 -- 172.21.15.103:0/161936457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0ac0742f0 msgr2=0x7ff0ac19a4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b26b7640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0ac0742f0 0x7ff0ac19a4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:36.920 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b26b7640 1 -- 172.21.15.103:0/161936457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff0ac19f470 con 0x7ff0ac10e150 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.909+0000 7ff0b1eb6640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff0ac0742f0 0x7ff0ac19a4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.910+0000 7ff0b26b7640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac10e150 0x7ff0ac19ed90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400eb40 tx=0x7ff0a400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.910+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a4004b20 con 0x7ff0ac10e150 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.910+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff0a4004cc0 con 0x7ff0ac10e150 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.910+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0ac19f760 con 0x7ff0ac10e150 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.910+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff0a40108f0 con 0x7ff0ac10e150 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.910+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff0ac1a7040 con 0x7ff0ac10e150 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.911+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7ff0ac062630 con 0x7ff0ac10e150 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.912+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff0a4005000 con 0x7ff0ac10e150 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.913+0000 7ff0a2ffd640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0980a2c10 0x7ff0980a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.913+0000 7ff0b1eb6640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0980a2c10 0x7ff0980a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:36.921 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.913+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff0a40cfef0 con 0x7ff0ac10e150 2024-08-02T18:48:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.913+0000 7ff0a2ffd640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] conn(0x7ff0980adde0 0x7ff0980b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.913+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 --> [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7ff0a401ee50 con 0x7ff0980adde0 2024-08-02T18:48:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.913+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7ff0a40d0340 con 0x7ff0ac10e150 2024-08-02T18:48:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.913+0000 7ff0b16b5640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] conn(0x7ff0980adde0 0x7ff0980b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.913+0000 7ff0b1eb6640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0980a2c10 0x7ff0980a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8005ab0 tx=0x7ff0a8005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.914+0000 7ff0b16b5640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] conn(0x7ff0980adde0 0x7ff0980b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:36.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.914+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 <== osd.3 v2:172.21.15.103:6810/3894858705 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7ff0a401ee50 con 0x7ff0980adde0 2024-08-02T18:48:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.928+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 --> [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7ff0ac062ab0 con 0x7ff0980adde0 2024-08-02T18:48:36.929 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.928+0000 7ff0a2ffd640 1 -- 172.21.15.103:0/161936457 <== osd.3 v2:172.21.15.103:6810/3894858705 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7ff0ac062ab0 con 0x7ff0980adde0 2024-08-02T18:48:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.928+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] conn(0x7ff0980adde0 msgr2=0x7ff0980b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.928+0000 7ff0b411a640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] conn(0x7ff0980adde0 0x7ff0980b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:36.930 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0980a2c10 msgr2=0x7ff0980a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b411a640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff0980a2c10 0x7ff0980a50d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7ff0a8005ab0 tx=0x7ff0a8005a20 comp rx=0 tx=0).stop 2024-08-02T18:48:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac10e150 msgr2=0x7ff0ac19ed90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b411a640 1 --2- 172.21.15.103:0/161936457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff0ac10e150 0x7ff0ac19ed90 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7ff0a400eb40 tx=0x7ff0a400c2d0 comp rx=0 tx=0).stop 2024-08-02T18:48:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b26b7640 1 -- 172.21.15.103:0/161936457 reap_dead start 2024-08-02T18:48:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 shutdown_connections 2024-08-02T18:48:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 >> 172.21.15.103:0/161936457 conn(0x7ff0ac0fd5f0 msgr2=0x7ff0ac0fe290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 shutdown_connections 2024-08-02T18:48:36.931 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.929+0000 7ff0b411a640 1 -- 172.21.15.103:0/161936457 wait complete. 2024-08-02T18:48:37.576 INFO:teuthology.orchestra.run.smithi103.stdout:103079215169 2024-08-02T18:48:37.576 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-08-02T18:48:37.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 -- 172.21.15.103:0/559272094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 msgr2=0x7f3550106ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 --2- 172.21.15.103:0/559272094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 0x7f3550106ba0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f3544009930 tx=0x7f354402a420 comp rx=0 tx=0).stop 2024-08-02T18:48:37.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 -- 172.21.15.103:0/559272094 shutdown_connections 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 --2- 172.21.15.103:0/559272094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3550101160 0x7f355010d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 --2- 172.21.15.103:0/559272094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f35501007c0 0x7f3550100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 --2- 172.21.15.103:0/559272094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 0x7f3550106ba0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 -- 172.21.15.103:0/559272094 >> 172.21.15.103:0/559272094 conn(0x7f35500fc500 msgr2=0x7f35500fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 -- 172.21.15.103:0/559272094 shutdown_connections 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 -- 172.21.15.103:0/559272094 wait complete. 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 Processor -- start 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.732+0000 7f35571b8640 1 -- start start 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f35571b8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35501007c0 0x7f35501982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f35571b8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3550101160 0x7f3550198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f35571b8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 0x7f355019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f35571b8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3550110ca0 con 0x7f35501067c0 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f35571b8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3550110b20 con 0x7f3550101160 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f35571b8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3550110e20 con 0x7f35501007c0 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 0x7f355019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 0x7f355019cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43788/0 (socket says 172.21.15.103:43788) 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 -- 172.21.15.103:0/2583608375 learned_addr learned my addr 172.21.15.103:0/2583608375 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3554f54640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35501007c0 0x7f35501982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f354ffff640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3550101160 0x7f3550198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 -- 172.21.15.103:0/2583608375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35501007c0 msgr2=0x7f35501982c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f35501007c0 0x7f35501982c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 -- 172.21.15.103:0/2583608375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3550101160 msgr2=0x7f3550198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3550101160 0x7f3550198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 -- 172.21.15.103:0/2583608375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f355019d270 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.733+0000 7f3555755640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 0x7f355019cb90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f354800cad0 tx=0x7f354800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.734+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354800ae20 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.734+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f355019d560 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.734+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3548004b20 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.734+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f354800f780 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.734+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35501a4e40 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.735+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3550062630 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.736+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f354800f920 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.736+0000 7f354dffb640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35400a2c10 0x7f35400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.737+0000 7f3554f54640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35400a2c10 0x7f35400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.737+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f35480cf830 con 0x7f35501067c0 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.737+0000 7f354dffb640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] conn(0x7f35400adde0 0x7f35400b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.737+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 --> [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35400b0950 con 0x7f35400adde0 2024-08-02T18:48:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.737+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f35480cfc80 con 0x7f35501067c0 2024-08-02T18:48:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.737+0000 7f354ffff640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] conn(0x7f35400adde0 0x7f35400b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.737+0000 7f3554f54640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35400a2c10 0x7f35400a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3544009900 tx=0x7f35440058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.737+0000 7f354ffff640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] conn(0x7f35400adde0 0x7f35400b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.9 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.738+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 <== osd.9 v2:172.21.15.103:6826/2790635350 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35400b0950 con 0x7f35400adde0 2024-08-02T18:48:37.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.751+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 --> [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f3550062ab0 con 0x7f35400adde0 2024-08-02T18:48:37.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f354dffb640 1 -- 172.21.15.103:0/2583608375 <== osd.9 v2:172.21.15.103:6826/2790635350 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f3550062ab0 con 0x7f35400adde0 2024-08-02T18:48:37.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] conn(0x7f35400adde0 msgr2=0x7f35400b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f35571b8640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] conn(0x7f35400adde0 0x7f35400b0280 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35400a2c10 msgr2=0x7f35400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f35571b8640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f35400a2c10 0x7f35400a50d0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3544009900 tx=0x7f35440058d0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 msgr2=0x7f355019cb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f35571b8640 1 --2- 172.21.15.103:0/2583608375 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f35501067c0 0x7f355019cb90 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f354800cad0 tx=0x7f354800cf90 comp rx=0 tx=0).stop 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f3555755640 1 -- 172.21.15.103:0/2583608375 reap_dead start 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 shutdown_connections 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.752+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 >> 172.21.15.103:0/2583608375 conn(0x7f35500fc500 msgr2=0x7f355006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.753+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 shutdown_connections 2024-08-02T18:48:37.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:37.753+0000 7f35571b8640 1 -- 172.21.15.103:0/2583608375 wait complete. 2024-08-02T18:48:37.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 -- 172.21.15.103:0/1326939435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81067b0 msgr2=0x7fedf8106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 --2- 172.21.15.103:0/1326939435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81067b0 0x7fedf8106b90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fedec009930 tx=0x7fedec02a420 comp rx=0 tx=0).stop 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 -- 172.21.15.103:0/1326939435 shutdown_connections 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 --2- 172.21.15.103:0/1326939435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedf8101150 0x7fedf810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 --2- 172.21.15.103:0/1326939435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf81007b0 0x7fedf8100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 --2- 172.21.15.103:0/1326939435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81067b0 0x7fedf8106b90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 -- 172.21.15.103:0/1326939435 >> 172.21.15.103:0/1326939435 conn(0x7fedf80fc4d0 msgr2=0x7fedf80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 -- 172.21.15.103:0/1326939435 shutdown_connections 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 -- 172.21.15.103:0/1326939435 wait complete. 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.804+0000 7fee00585640 1 Processor -- start 2024-08-02T18:48:37.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fee00585640 1 -- start start 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fee00585640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81007b0 0x7fedf81983a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fee00585640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf8101150 0x7fedf81988e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fee00585640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedf81067b0 0x7fedf819cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fee00585640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fedf8110d90 con 0x7fedf81007b0 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fee00585640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fedf8110c10 con 0x7fedf81067b0 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fee00585640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fedf8110f10 con 0x7fedf8101150 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81007b0 0x7fedf81983a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81007b0 0x7fedf81983a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:43760/0 (socket says 172.21.15.103:43760) 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 -- 172.21.15.103:0/1729282061 learned_addr learned my addr 172.21.15.103:0/1729282061 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfdb20640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf8101150 0x7fedf81988e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfeb22640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedf81067b0 0x7fedf819cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 -- 172.21.15.103:0/1729282061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf8101150 msgr2=0x7fedf81988e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fedf8101150 0x7fedf81988e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 -- 172.21.15.103:0/1729282061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedf81067b0 msgr2=0x7fedf819cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fedf81067b0 0x7fedf819cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 -- 172.21.15.103:0/1729282061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedf819d350 con 0x7fedf81007b0 2024-08-02T18:48:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedfe321640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81007b0 0x7fedf81983a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fedec009a50 tx=0x7fedec004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:37.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.805+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec03f030 con 0x7fedf81007b0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.806+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fedec003af0 con 0x7fedf81007b0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.806+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedf819d5e0 con 0x7fedf81007b0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.806+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedec035070 con 0x7fedf81007b0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.806+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedf81a4f20 con 0x7fedf81007b0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.806+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fedf80fcde0 con 0x7fedf81007b0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.808+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fedec042030 con 0x7fedf81007b0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.808+0000 7fedeb7fe640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fede40a2c10 0x7fede40a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.808+0000 7fedfdb20640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fede40a2c10 0x7fede40a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.808+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fedec0f0220 con 0x7fedf81007b0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.809+0000 7fedeb7fe640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] conn(0x7fede40addd0 0x7fede40b0270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.809+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 --> [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fede40b0940 con 0x7fede40addd0 2024-08-02T18:48:37.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.809+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7fedec0f0670 con 0x7fedf81007b0 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.809+0000 7fedfdb20640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fede40a2c10 0x7fede40a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fedf806b510 tx=0x7fedf4009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.809+0000 7fedfeb22640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] conn(0x7fede40addd0 0x7fede40b0270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.809+0000 7fedfeb22640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] conn(0x7fede40addd0 0x7fede40b0270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.810+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 <== osd.7 v2:172.21.15.121:6816/2205509035 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fede40b0940 con 0x7fede40addd0 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.823+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 --> [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fedf8101ef0 con 0x7fede40addd0 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.824+0000 7fedeb7fe640 1 -- 172.21.15.103:0/1729282061 <== osd.7 v2:172.21.15.121:6816/2205509035 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7fedf8101ef0 con 0x7fede40addd0 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 >> [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] conn(0x7fede40addd0 msgr2=0x7fede40b0270 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] conn(0x7fede40addd0 0x7fede40b0270 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fede40a2c10 msgr2=0x7fede40a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fede40a2c10 0x7fede40a50d0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fedf806b510 tx=0x7fedf4009110 comp rx=0 tx=0).stop 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81007b0 msgr2=0x7fedf81983a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 --2- 172.21.15.103:0/1729282061 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fedf81007b0 0x7fedf81983a0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fedec009a50 tx=0x7fedec004270 comp rx=0 tx=0).stop 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fedfeb22640 1 -- 172.21.15.103:0/1729282061 reap_dead start 2024-08-02T18:48:37.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 shutdown_connections 2024-08-02T18:48:37.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 >> 172.21.15.103:0/1729282061 conn(0x7fedf80fc4d0 msgr2=0x7fedf8104600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:37.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 shutdown_connections 2024-08-02T18:48:37.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:36.825+0000 7fee00585640 1 -- 172.21.15.103:0/1729282061 wait complete. 2024-08-02T18:48:38.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:38 smithi103 ceph-mon[32753]: pgmap v305: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:38.583 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:38.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:38 smithi121 ceph-mon[37236]: pgmap v305: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:38.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:38 smithi151 ceph-mon[37155]: pgmap v305: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:39.663 INFO:teuthology.orchestra.run.smithi103.stdout:77309411398 2024-08-02T18:48:39.664 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-08-02T18:48:40.541 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:40 smithi103 ceph-mon[32753]: pgmap v306: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:40.541 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:40 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3872003027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.539+0000 7f0e15648640 1 -- 172.21.15.103:0/2383517457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102250 msgr2=0x7f0e1010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.539+0000 7f0e15648640 1 --2- 172.21.15.103:0/2383517457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102250 0x7f0e1010e780 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f0e08009cd0 tx=0x7f0e0802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 -- 172.21.15.103:0/2383517457 shutdown_connections 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 --2- 172.21.15.103:0/2383517457 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e10102250 0x7f0e1010e780 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 --2- 172.21.15.103:0/2383517457 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e101018b0 0x7f0e10101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 --2- 172.21.15.103:0/2383517457 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e101078b0 0x7f0e10107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 -- 172.21.15.103:0/2383517457 >> 172.21.15.103:0/2383517457 conn(0x7f0e100fd5f0 msgr2=0x7f0e100ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 -- 172.21.15.103:0/2383517457 shutdown_connections 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 -- 172.21.15.103:0/2383517457 wait complete. 2024-08-02T18:48:40.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 Processor -- start 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 -- start start 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e101018b0 0x7f0e10074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e10102250 0x7f0e10074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.540+0000 7f0e15648640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e101078b0 0x7f0e10074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e15648640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e10111e90 con 0x7f0e101018b0 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e15648640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0e10111d10 con 0x7f0e101078b0 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e15648640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e10112010 con 0x7f0e10102250 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e101018b0 0x7f0e10074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e101018b0 0x7f0e10074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59562/0 (socket says 172.21.15.103:59562) 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 -- 172.21.15.103:0/3168605147 learned_addr learned my addr 172.21.15.103:0/3168605147 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e07fff640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e10102250 0x7f0e10074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:40.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0f7fe640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e101078b0 0x7f0e10074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 -- 172.21.15.103:0/3168605147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e10102250 msgr2=0x7f0e10074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e10102250 0x7f0e10074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 -- 172.21.15.103:0/3168605147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e101078b0 msgr2=0x7f0e10074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e101078b0 0x7f0e10074ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 -- 172.21.15.103:0/3168605147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e101a6850 con 0x7f0e101018b0 2024-08-02T18:48:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0effd640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e101018b0 0x7f0e10074220 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000b4a0 tx=0x7f0e0000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e00014070 con 0x7f0e101018b0 2024-08-02T18:48:40.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e101a6b40 con 0x7f0e101018b0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e00010b10 con 0x7f0e101018b0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e00017d60 con 0x7f0e101018b0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.541+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e101a7080 con 0x7f0e101018b0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.542+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f0e100625f0 con 0x7f0e101018b0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.543+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f0e00017070 con 0x7f0e101018b0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.544+0000 7f0e0cff9640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.544+0000 7f0e07fff640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.544+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f0e000ce850 con 0x7f0e101018b0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.544+0000 7f0e0cff9640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] conn(0x7f0dfc0adde0 0x7f0dfc0b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.544+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 --> [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0e00012e80 con 0x7f0dfc0adde0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.544+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f0e000d32c0 con 0x7f0e101018b0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.545+0000 7f0e0f7fe640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] conn(0x7f0dfc0adde0 0x7f0dfc0b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:40.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.545+0000 7f0e07fff640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e10075cb0 tx=0x7f0df8008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.545+0000 7f0e0f7fe640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] conn(0x7f0dfc0adde0 0x7f0dfc0b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.546+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 <== osd.0 v2:172.21.15.103:6802/683162835 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0e00012e80 con 0x7f0dfc0adde0 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.559+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 --> [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f0e10062a20 con 0x7f0dfc0adde0 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.559+0000 7f0e0cff9640 1 -- 172.21.15.103:0/3168605147 <== osd.0 v2:172.21.15.103:6802/683162835 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f0e10062a20 con 0x7f0dfc0adde0 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] conn(0x7f0dfc0adde0 msgr2=0x7f0dfc0b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] conn(0x7f0dfc0adde0 0x7f0dfc0b0280 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0dfc0a2c10 msgr2=0x7f0dfc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f0dfc0a2c10 0x7f0dfc0a50d0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f0e10075cb0 tx=0x7f0df8008040 comp rx=0 tx=0).stop 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e101018b0 msgr2=0x7f0e10074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 --2- 172.21.15.103:0/3168605147 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e101018b0 0x7f0e10074220 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f0e0000b4a0 tx=0x7f0e0000b960 comp rx=0 tx=0).stop 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e0f7fe640 1 -- 172.21.15.103:0/3168605147 reap_dead start 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 shutdown_connections 2024-08-02T18:48:40.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 >> 172.21.15.103:0/3168605147 conn(0x7f0e100fd5f0 msgr2=0x7f0e100fdd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:40.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 shutdown_connections 2024-08-02T18:48:40.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:40.560+0000 7f0e15648640 1 -- 172.21.15.103:0/3168605147 wait complete. 2024-08-02T18:48:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:40 smithi121 ceph-mon[37236]: pgmap v306: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:40.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:40 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3872003027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-02T18:48:40.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:40 smithi151 ceph-mon[37155]: pgmap v306: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 KiB/s rd, 255 B/s wr, 6 op/s 2024-08-02T18:48:40.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:40 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3872003027' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-08-02T18:48:41.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 -- 172.21.15.103:0/1104294649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 msgr2=0x7fe718101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/1104294649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 0x7fe718101d10 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe704009930 tx=0x7fe70402a420 comp rx=0 tx=0).stop 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 -- 172.21.15.103:0/1104294649 shutdown_connections 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/1104294649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe718102250 0x7fe71810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/1104294649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 0x7fe718101d10 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/1104294649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe7181078b0 0x7fe718107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 -- 172.21.15.103:0/1104294649 >> 172.21.15.103:0/1104294649 conn(0x7fe7180fd5f0 msgr2=0x7fe7180ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 -- 172.21.15.103:0/1104294649 shutdown_connections 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.169+0000 7fe71ee6a640 1 -- 172.21.15.103:0/1104294649 wait complete. 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71ee6a640 1 Processor -- start 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71ee6a640 1 -- start start 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71ee6a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 0x7fe718198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71ee6a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe718102250 0x7fe7181987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71ee6a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181078b0 0x7fe71819cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71ee6a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe718111da0 con 0x7fe7181018b0 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71ee6a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe718111c20 con 0x7fe718102250 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71ee6a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe718111f20 con 0x7fe7181078b0 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71cc06640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 0x7fe718198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71cc06640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 0x7fe718198280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59580/0 (socket says 172.21.15.103:59580) 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71cc06640 1 -- 172.21.15.103:0/3697572351 learned_addr learned my addr 172.21.15.103:0/3697572351 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe717fff640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe718102250 0x7fe7181987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71cc06640 1 -- 172.21.15.103:0/3697572351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181078b0 msgr2=0x7fe71819cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71cc06640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181078b0 0x7fe71819cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71cc06640 1 -- 172.21.15.103:0/3697572351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe718102250 msgr2=0x7fe7181987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.170+0000 7fe71cc06640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe718102250 0x7fe7181987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.171+0000 7fe71cc06640 1 -- 172.21.15.103:0/3697572351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe71819d230 con 0x7fe7181018b0 2024-08-02T18:48:41.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.171+0000 7fe717fff640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe718102250 0x7fe7181987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.171+0000 7fe71cc06640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 0x7fe718198280 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d950 tx=0x7fe70c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.171+0000 7fe715ffb640 1 -- 172.21.15.103:0/3697572351 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c017070 con 0x7fe7181018b0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.171+0000 7fe715ffb640 1 -- 172.21.15.103:0/3697572351 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe70c009c30 con 0x7fe7181018b0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.171+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe71819d520 con 0x7fe7181018b0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.171+0000 7fe715ffb640 1 -- 172.21.15.103:0/3697572351 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe70c00f740 con 0x7fe7181018b0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.171+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe7181a4e00 con 0x7fe7181018b0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.172+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe718101d10 con 0x7fe7181018b0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.173+0000 7fe715ffb640 1 -- 172.21.15.103:0/3697572351 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe70c010a80 con 0x7fe7181018b0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.174+0000 7fe715ffb640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe7080a2c10 0x7fe7080a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.174+0000 7fe717fff640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe7080a2c10 0x7fe7080a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.174+0000 7fe715ffb640 1 -- 172.21.15.103:0/3697572351 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe70c0cf1c0 con 0x7fe7181018b0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.174+0000 7fe717fff640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe7080a2c10 0x7fe7080a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe704000c00 tx=0x7fe704005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:41.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.178+0000 7fe715ffb640 1 -- 172.21.15.103:0/3697572351 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe70c009de0 con 0x7fe7181018b0 2024-08-02T18:48:41.214 INFO:teuthology.orchestra.run.smithi103.stdout:210453397551 2024-08-02T18:48:41.214 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-08-02T18:48:41.333 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 -- 172.21.15.103:0/4132988185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac1078c0 msgr2=0x7f6eac107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 --2- 172.21.15.103:0/4132988185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac1078c0 0x7f6eac107ca0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c009930 tx=0x7f6e9c02a420 comp rx=0 tx=0).stop 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 -- 172.21.15.103:0/4132988185 shutdown_connections 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 --2- 172.21.15.103:0/4132988185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac102260 0x7f6eac10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 --2- 172.21.15.103:0/4132988185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eac1018c0 0x7f6eac101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 --2- 172.21.15.103:0/4132988185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac1078c0 0x7f6eac107ca0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 -- 172.21.15.103:0/4132988185 >> 172.21.15.103:0/4132988185 conn(0x7f6eac0fd620 msgr2=0x7f6eac0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 -- 172.21.15.103:0/4132988185 shutdown_connections 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.851+0000 7f6eb11c0640 1 -- 172.21.15.103:0/4132988185 wait complete. 2024-08-02T18:48:41.334 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eb11c0640 1 Processor -- start 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eb11c0640 1 -- start start 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eb11c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eac1018c0 0x7f6eac1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eb11c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac102260 0x7f6eac1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eb11c0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac1078c0 0x7f6eac19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eb11c0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac111e30 con 0x7f6eac102260 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eb11c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac111cb0 con 0x7f6eac1018c0 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eb11c0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6eac111fb0 con 0x7f6eac1078c0 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eaa59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac102260 0x7f6eac1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eaa59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac102260 0x7f6eac1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59546/0 (socket says 172.21.15.103:59546) 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eaa59c640 1 -- 172.21.15.103:0/1859620647 learned_addr learned my addr 172.21.15.103:0/1859620647 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.852+0000 7f6eaad9d640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eac1018c0 0x7f6eac1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eab59e640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac1078c0 0x7f6eac19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:41.335 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eaa59c640 1 -- 172.21.15.103:0/1859620647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac1078c0 msgr2=0x7f6eac19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eaa59c640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6eac1078c0 0x7f6eac19cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eaa59c640 1 -- 172.21.15.103:0/1859620647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eac1018c0 msgr2=0x7f6eac1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eaa59c640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eac1018c0 0x7f6eac1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eaa59c640 1 -- 172.21.15.103:0/1859620647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6eac19d260 con 0x7f6eac102260 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eaad9d640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6eac1018c0 0x7f6eac1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eaa59c640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac102260 0x7f6eac1987f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000d950 tx=0x7f6ea000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea0017070 con 0x7f6eac102260 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6eac19d550 con 0x7f6eac102260 2024-08-02T18:48:41.336 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ea0009c30 con 0x7f6eac102260 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ea000f740 con 0x7f6eac102260 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.853+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6eac074150 con 0x7f6eac102260 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.854+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6eac0fe780 con 0x7f6eac102260 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.855+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6ea0010a80 con 0x7f6eac102260 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.856+0000 7f6e93fff640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e940a2c10 0x7f6e940a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.856+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6ea00cf5a0 con 0x7f6eac102260 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.856+0000 7f6eaad9d640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e940a2c10 0x7f6e940a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.856+0000 7f6e93fff640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] conn(0x7f6e940adde0 0x7f6e940b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.856+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 --> [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6e940b0950 con 0x7f6e940adde0 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.856+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f6ea00d6050 con 0x7f6eac102260 2024-08-02T18:48:41.337 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.857+0000 7f6eaad9d640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e940a2c10 0x7f6e940a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c006010 tx=0x7f6e9c005a20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.857+0000 7f6eab59e640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] conn(0x7f6e940adde0 0x7f6e940b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.857+0000 7f6eab59e640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] conn(0x7f6e940adde0 0x7f6e940b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.8 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.858+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 <== osd.8 v2:172.21.15.151:6816/931243122 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6e940b0950 con 0x7f6e940adde0 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.871+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 --> [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6eac103000 con 0x7f6e940adde0 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6e93fff640 1 -- 172.21.15.103:0/1859620647 <== osd.8 v2:172.21.15.151:6816/931243122 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f6eac103000 con 0x7f6e940adde0 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 >> [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] conn(0x7f6e940adde0 msgr2=0x7f6e940b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] conn(0x7f6e940adde0 0x7f6e940b0280 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e940a2c10 msgr2=0x7f6e940a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6e940a2c10 0x7f6e940a50d0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f6e9c006010 tx=0x7f6e9c005a20 comp rx=0 tx=0).stop 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac102260 msgr2=0x7f6eac1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 --2- 172.21.15.103:0/1859620647 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6eac102260 0x7f6eac1987f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f6ea000d950 tx=0x7f6ea000de10 comp rx=0 tx=0).stop 2024-08-02T18:48:41.338 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eab59e640 1 -- 172.21.15.103:0/1859620647 reap_dead start 2024-08-02T18:48:41.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 shutdown_connections 2024-08-02T18:48:41.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 >> 172.21.15.103:0/1859620647 conn(0x7f6eac0fd620 msgr2=0x7f6eac0fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:41.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 shutdown_connections 2024-08-02T18:48:41.339 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.872+0000 7f6eb11c0640 1 -- 172.21.15.103:0/1859620647 wait complete. 2024-08-02T18:48:41.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.359+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7fe7181098b0 con 0x7fe7181018b0 2024-08-02T18:48:41.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.360+0000 7fe715ffb640 1 -- 172.21.15.103:0/3697572351 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe70c09bc60 con 0x7fe7181018b0 2024-08-02T18:48:41.362 INFO:teuthology.orchestra.run.smithi103.stdout:188978561076 2024-08-02T18:48:41.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe7080a2c10 msgr2=0x7fe7080a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe7080a2c10 0x7fe7080a50d0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fe704000c00 tx=0x7fe704005a20 comp rx=0 tx=0).stop 2024-08-02T18:48:41.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 msgr2=0x7fe718198280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:41.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 0x7fe718198280 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fe70c00d950 tx=0x7fe70c00de10 comp rx=0 tx=0).stop 2024-08-02T18:48:41.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 shutdown_connections 2024-08-02T18:48:41.364 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe7080a2c10 0x7fe7080a50d0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe7181078b0 0x7fe71819cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe718102250 0x7fe7181987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 --2- 172.21.15.103:0/3697572351 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe7181018b0 0x7fe718198280 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:41.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 >> 172.21.15.103:0/3697572351 conn(0x7fe7180fd5f0 msgr2=0x7fe7180fdd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:41.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 shutdown_connections 2024-08-02T18:48:41.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:41.362+0000 7fe71ee6a640 1 -- 172.21.15.103:0/3697572351 wait complete. 2024-08-02T18:48:41.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:41 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3697572351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-02T18:48:41.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:41 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3697572351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-02T18:48:41.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:41 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3697572351' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-08-02T18:48:41.965 INFO:teuthology.orchestra.run.smithi103.stdout:240518168619 2024-08-02T18:48:41.965 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.8 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 -- 172.21.15.103:0/3225687031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce101007b0 msgr2=0x7fce10100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3225687031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce101007b0 0x7fce10100c10 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009930 tx=0x7fcdfc02a420 comp rx=0 tx=0).stop 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 -- 172.21.15.103:0/3225687031 shutdown_connections 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3225687031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce10101150 0x7fce1010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3225687031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce101007b0 0x7fce10100c10 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3225687031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101067b0 0x7fce10106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 -- 172.21.15.103:0/3225687031 >> 172.21.15.103:0/3225687031 conn(0x7fce100fc4d0 msgr2=0x7fce100fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 -- 172.21.15.103:0/3225687031 shutdown_connections 2024-08-02T18:48:42.149 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.297+0000 7fce16d2a640 1 -- 172.21.15.103:0/3225687031 wait complete. 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce16d2a640 1 Processor -- start 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce16d2a640 1 -- start start 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce16d2a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce101007b0 0x7fce101972b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce16d2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce10101150 0x7fce101977f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce16d2a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101067b0 0x7fce1019bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce16d2a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fce10110d90 con 0x7fce10101150 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce16d2a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fce10110c10 con 0x7fce101007b0 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce16d2a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fce10110f10 con 0x7fce101067b0 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce0ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce10101150 0x7fce101977f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce0ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce10101150 0x7fce101977f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59516/0 (socket says 172.21.15.103:59516) 2024-08-02T18:48:42.150 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce0ffff640 1 -- 172.21.15.103:0/3872003027 learned_addr learned my addr 172.21.15.103:0/3872003027 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:42.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce152c7640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101067b0 0x7fce1019bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:42.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce14ac6640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce101007b0 0x7fce101972b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:42.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce0ffff640 1 -- 172.21.15.103:0/3872003027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101067b0 msgr2=0x7fce1019bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:42.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce0ffff640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101067b0 0x7fce1019bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.151 INFO:teuthology.orchestra.run.smithi103.stdout:133143986237 2024-08-02T18:48:42.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce0ffff640 1 -- 172.21.15.103:0/3872003027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce101007b0 msgr2=0x7fce101972b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce0ffff640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce101007b0 0x7fce101972b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce0ffff640 1 -- 172.21.15.103:0/3872003027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fce1019c260 con 0x7fce10101150 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.298+0000 7fce14ac6640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce101007b0 0x7fce101972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.299+0000 7fce0ffff640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce10101150 0x7fce101977f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009a50 tx=0x7fcdfc004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.299+0000 7fce0dffb640 1 -- 172.21.15.103:0/3872003027 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc03f030 con 0x7fce10101150 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.299+0000 7fce0dffb640 1 -- 172.21.15.103:0/3872003027 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcdfc003af0 con 0x7fce10101150 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.299+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fce1019c4f0 con 0x7fce10101150 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.299+0000 7fce0dffb640 1 -- 172.21.15.103:0/3872003027 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcdfc035070 con 0x7fce10101150 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.299+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fce101a3e30 con 0x7fce10101150 2024-08-02T18:48:42.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.300+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fce10101ef0 con 0x7fce10101150 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.301+0000 7fce0dffb640 1 -- 172.21.15.103:0/3872003027 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fcdfc042030 con 0x7fce10101150 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.302+0000 7fce0dffb640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fce000a2c10 0x7fce000a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.302+0000 7fce14ac6640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fce000a2c10 0x7fce000a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.302+0000 7fce0dffb640 1 -- 172.21.15.103:0/3872003027 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fcdfc0efeb0 con 0x7fce10101150 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.302+0000 7fce14ac6640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fce000a2c10 0x7fce000a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fce04006fd0 tx=0x7fce04008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.306+0000 7fce0dffb640 1 -- 172.21.15.103:0/3872003027 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcdfc0bc950 con 0x7fce10101150 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.483+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7fce10108d40 con 0x7fce10101150 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.483+0000 7fce0dffb640 1 -- 172.21.15.103:0/3872003027 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fcdfc0bc250 con 0x7fce10101150 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fce000a2c10 msgr2=0x7fce000a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:42.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fce000a2c10 0x7fce000a50d0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fce04006fd0 tx=0x7fce04008040 comp rx=0 tx=0).stop 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce10101150 msgr2=0x7fce101977f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce10101150 0x7fce101977f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fcdfc009a50 tx=0x7fcdfc004270 comp rx=0 tx=0).stop 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 shutdown_connections 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fce000a2c10 0x7fce000a50d0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fce101067b0 0x7fce1019bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fce10101150 0x7fce101977f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 --2- 172.21.15.103:0/3872003027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fce101007b0 0x7fce101972b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 >> 172.21.15.103:0/3872003027 conn(0x7fce100fc4d0 msgr2=0x7fce100fcc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 shutdown_connections 2024-08-02T18:48:42.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:39.486+0000 7fce16d2a640 1 -- 172.21.15.103:0/3872003027 wait complete. 2024-08-02T18:48:42.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:42 smithi121 ceph-mon[37236]: pgmap v307: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:42.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:42 smithi151 ceph-mon[37155]: pgmap v307: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:42.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:42 smithi103 ceph-mon[32753]: pgmap v307: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:43.241 INFO:tasks.cephadm.ceph_manager.ceph:need seq 188978561075 got 188978561076 for osd.6 2024-08-02T18:48:43.241 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:43.375 INFO:teuthology.orchestra.run.smithi103.stdout:292057776160 2024-08-02T18:48:43.375 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.10 2024-08-02T18:48:43.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 -- 172.21.15.103:0/3109138435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 msgr2=0x7f1c5010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:43.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 --2- 172.21.15.103:0/3109138435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 0x7f1c5010d680 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f1c48009cd0 tx=0x7f1c4802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:43.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 -- 172.21.15.103:0/3109138435 shutdown_connections 2024-08-02T18:48:43.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 --2- 172.21.15.103:0/3109138435 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 0x7f1c5010d680 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:43.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 --2- 172.21.15.103:0/3109138435 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c501007b0 0x7f1c50100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:43.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 --2- 172.21.15.103:0/3109138435 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c501067b0 0x7f1c50106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 -- 172.21.15.103:0/3109138435 >> 172.21.15.103:0/3109138435 conn(0x7f1c500fc4d0 msgr2=0x7f1c500fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 -- 172.21.15.103:0/3109138435 shutdown_connections 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.683+0000 7f1c56a95640 1 -- 172.21.15.103:0/3109138435 wait complete. 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c56a95640 1 Processor -- start 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c56a95640 1 -- start start 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c56a95640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c501007b0 0x7f1c50199060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c56a95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 0x7f1c501995a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c56a95640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c501067b0 0x7f1c501a40e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c56a95640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50110cd0 con 0x7f1c50101150 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c56a95640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50110b50 con 0x7f1c501067b0 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c56a95640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1c50110e50 con 0x7f1c501007b0 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c4ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 0x7f1c501995a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:43.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c4ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 0x7f1c501995a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59594/0 (socket says 172.21.15.103:59594) 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c4ffff640 1 -- 172.21.15.103:0/1894711512 learned_addr learned my addr 172.21.15.103:0/1894711512 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c54831640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c501007b0 0x7f1c50199060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c55032640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c501067b0 0x7f1c501a40e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c4ffff640 1 -- 172.21.15.103:0/1894711512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c501007b0 msgr2=0x7f1c50199060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c4ffff640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1c501007b0 0x7f1c50199060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c4ffff640 1 -- 172.21.15.103:0/1894711512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c501067b0 msgr2=0x7f1c501a40e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c4ffff640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1c501067b0 0x7f1c501a40e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.684+0000 7f1c4ffff640 1 -- 172.21.15.103:0/1894711512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1c501a4620 con 0x7f1c50101150 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.685+0000 7f1c4ffff640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 0x7f1c501995a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00d770 tx=0x7f1c3c00dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.685+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c017070 con 0x7f1c50101150 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.685+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1c3c005520 con 0x7f1c50101150 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.685+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1c501a47f0 con 0x7f1c50101150 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.685+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1c3c010460 con 0x7f1c50101150 2024-08-02T18:48:43.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.685+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1c501a4cb0 con 0x7f1c50101150 2024-08-02T18:48:43.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.686+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f1c500fd510 con 0x7f1c50101150 2024-08-02T18:48:43.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.687+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1c3c004ea0 con 0x7f1c50101150 2024-08-02T18:48:43.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.688+0000 7f1c4dffb640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1c400a2c10 0x7f1c400a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:43.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.688+0000 7f1c54831640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1c400a2c10 0x7f1c400a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:43.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.688+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1c3c0cf470 con 0x7f1c50101150 2024-08-02T18:48:43.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.688+0000 7f1c4dffb640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] conn(0x7f1c400adde0 0x7f1c400b0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:43.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.688+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 --> [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1c3c001d30 con 0x7f1c400adde0 2024-08-02T18:48:43.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.688+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f1c3c0cf8c0 con 0x7f1c50101150 2024-08-02T18:48:43.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.688+0000 7f1c54831640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1c400a2c10 0x7f1c400a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1c44005d00 tx=0x7f1c4400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:43.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.688+0000 7f1c55032640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] conn(0x7f1c400adde0 0x7f1c400b0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:43.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.689+0000 7f1c55032640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] conn(0x7f1c400adde0 0x7f1c400b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:43.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.689+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 <== osd.5 v2:172.21.15.151:6808/2549009973 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1c3c001d30 con 0x7f1c400adde0 2024-08-02T18:48:43.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.703+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 --> [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1c50101ef0 con 0x7f1c400adde0 2024-08-02T18:48:43.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c4dffb640 1 -- 172.21.15.103:0/1894711512 <== osd.5 v2:172.21.15.151:6808/2549009973 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1c50101ef0 con 0x7f1c400adde0 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 >> [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] conn(0x7f1c400adde0 msgr2=0x7f1c400b0280 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] conn(0x7f1c400adde0 0x7f1c400b0280 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1c400a2c10 msgr2=0x7f1c400a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1c400a2c10 0x7f1c400a50d0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f1c44005d00 tx=0x7f1c4400b410 comp rx=0 tx=0).stop 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 msgr2=0x7f1c501995a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 --2- 172.21.15.103:0/1894711512 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1c50101150 0x7f1c501995a0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f1c3c00d770 tx=0x7f1c3c00dc30 comp rx=0 tx=0).stop 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c55032640 1 -- 172.21.15.103:0/1894711512 reap_dead start 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 shutdown_connections 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 >> 172.21.15.103:0/1894711512 conn(0x7f1c500fc4d0 msgr2=0x7f1c500fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 shutdown_connections 2024-08-02T18:48:43.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:43.704+0000 7f1c56a95640 1 -- 172.21.15.103:0/1894711512 wait complete. 2024-08-02T18:48:44.688 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986236 got 133143986237 for osd.4 2024-08-02T18:48:44.688 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:44.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:44 smithi121 ceph-mon[37236]: pgmap v308: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:48:44.778 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:44 smithi103 ceph-mon[32753]: pgmap v308: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:48:44.805 INFO:teuthology.orchestra.run.smithi103.stdout:154618822713 2024-08-02T18:48:44.806 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-08-02T18:48:44.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:44 smithi151 ceph-mon[37155]: pgmap v308: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:48:45.353 INFO:teuthology.orchestra.run.smithi103.stdout:270582939684 2024-08-02T18:48:45.353 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.9 2024-08-02T18:48:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.544+0000 7f140f941640 1 -- 172.21.15.103:0/2085870380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408108030 msgr2=0x7f140810e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 --2- 172.21.15.103:0/2085870380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408108030 0x7f140810e9a0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f1400009cd0 tx=0x7f140002a8d0 comp rx=0 tx=0).stop 2024-08-02T18:48:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 -- 172.21.15.103:0/2085870380 shutdown_connections 2024-08-02T18:48:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 --2- 172.21.15.103:0/2085870380 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408108030 0x7f140810e9a0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 --2- 172.21.15.103:0/2085870380 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14081034b0 0x7f14081078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 --2- 172.21.15.103:0/2085870380 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408102b00 0x7f1408102ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:45.561 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 -- 172.21.15.103:0/2085870380 >> 172.21.15.103:0/2085870380 conn(0x7f14080fc500 msgr2=0x7f14080fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 -- 172.21.15.103:0/2085870380 shutdown_connections 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 -- 172.21.15.103:0/2085870380 wait complete. 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.545+0000 7f140f941640 1 Processor -- start 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140f941640 1 -- start start 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140f941640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408102b00 0x7f1408100760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140f941640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14081034b0 0x7f1408100ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140f941640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408108030 0x7f14081011e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140f941640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1408111f20 con 0x7f1408102b00 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140f941640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1408111da0 con 0x7f14081034b0 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140f941640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f14081120a0 con 0x7f1408108030 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140d6dd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408102b00 0x7f1408100760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:45.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140d6dd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408102b00 0x7f1408100760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59622/0 (socket says 172.21.15.103:59622) 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140d6dd640 1 -- 172.21.15.103:0/55331534 learned_addr learned my addr 172.21.15.103:0/55331534 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140dede640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408108030 0x7f14081011e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.546+0000 7f140cedc640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14081034b0 0x7f1408100ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f140d6dd640 1 -- 172.21.15.103:0/55331534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408108030 msgr2=0x7f14081011e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f140d6dd640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1408108030 0x7f14081011e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f140d6dd640 1 -- 172.21.15.103:0/55331534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14081034b0 msgr2=0x7f1408100ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f140d6dd640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f14081034b0 0x7f1408100ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f140d6dd640 1 -- 172.21.15.103:0/55331534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14081a6870 con 0x7f1408102b00 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f140d6dd640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408102b00 0x7f1408100760 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f140400e9f0 tx=0x7f140400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140400cd80 con 0x7f1408102b00 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1404005520 con 0x7f1408102b00 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f140f941640 1 -- 172.21.15.103:0/55331534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14081a6b60 con 0x7f1408102b00 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1404010690 con 0x7f1408102b00 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.547+0000 7f140f941640 1 -- 172.21.15.103:0/55331534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14081a70a0 con 0x7f1408102b00 2024-08-02T18:48:45.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.548+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f14080625b0 con 0x7f1408102b00 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.550+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f14040046c0 con 0x7f1408102b00 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.550+0000 7f13fe7fc640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f13f40a2c90 0x7f13f40a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.551+0000 7f140cedc640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f13f40a2c90 0x7f13f40a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.551+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f14040cfdd0 con 0x7f1408102b00 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.551+0000 7f13fe7fc640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] conn(0x7f13f40ade60 0x7f13f40b0300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.551+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 --> [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f1404004470 con 0x7f13f40ade60 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.551+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_get_version_reply(handle=1 version=89) ==== 24+0+0 (secure 0 0 0) 0x7f14040d0180 con 0x7f1408102b00 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.551+0000 7f140cedc640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f13f40a2c90 0x7f13f40a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005d90 tx=0x7f13f8005d20 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.551+0000 7f140dede640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] conn(0x7f13f40ade60 0x7f13f40b0300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.551+0000 7f140dede640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] conn(0x7f13f40ade60 0x7f13f40b0300 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.11 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:45.564 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.552+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 <== osd.11 v2:172.21.15.151:6824/3221128949 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f1404004470 con 0x7f13f40ade60 2024-08-02T18:48:45.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 --> [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f1408062a30 con 0x7f13f40ade60 2024-08-02T18:48:45.567 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f13fe7fc640 1 -- 172.21.15.103:0/55331534 <== osd.11 v2:172.21.15.151:6824/3221128949 2 ==== command_reply(tid 2: 0 ) ==== 8+0+12 (crc 0 0 0) 0x7f1408062a30 con 0x7f13f40ade60 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 >> [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] conn(0x7f13f40ade60 msgr2=0x7f13f40b0300 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f13f3fff640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] conn(0x7f13f40ade60 0x7f13f40b0300 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f13f40a2c90 msgr2=0x7f13f40a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f13f3fff640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f13f40a2c90 0x7f13f40a5150 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f13f8005d90 tx=0x7f13f8005d20 comp rx=0 tx=0).stop 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408102b00 msgr2=0x7f1408100760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f13f3fff640 1 --2- 172.21.15.103:0/55331534 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1408102b00 0x7f1408100760 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f140400e9f0 tx=0x7f140400edf0 comp rx=0 tx=0).stop 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.566+0000 7f140dede640 1 -- 172.21.15.103:0/55331534 reap_dead start 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.567+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 shutdown_connections 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.567+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 >> 172.21.15.103:0/55331534 conn(0x7f14080fc500 msgr2=0x7f14081060e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.567+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 shutdown_connections 2024-08-02T18:48:45.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:45.567+0000 7f13f3fff640 1 -- 172.21.15.103:0/55331534 wait complete. 2024-08-02T18:48:46.355 INFO:teuthology.orchestra.run.smithi103.stdout:34359738447 2024-08-02T18:48:46.355 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-08-02T18:48:46.371 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:46.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:46 smithi103 ceph-mon[32753]: pgmap v309: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-02T18:48:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:46 smithi121 ceph-mon[37236]: pgmap v309: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-02T18:48:46.797 INFO:teuthology.orchestra.run.smithi103.stdout:322122547230 2024-08-02T18:48:46.797 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd last-stat-seq osd.11 2024-08-02T18:48:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:46.806 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:46.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:46 smithi151 ceph-mon[37155]: pgmap v309: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 5 op/s 2024-08-02T18:48:47.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 -- 172.21.15.103:0/1455561311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1007b0 msgr2=0x7fb45c100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 --2- 172.21.15.103:0/1455561311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1007b0 0x7fb45c100c10 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb458009930 tx=0x7fb45802a420 comp rx=0 tx=0).stop 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 -- 172.21.15.103:0/1455561311 shutdown_connections 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 --2- 172.21.15.103:0/1455561311 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c101150 0x7fb45c10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 --2- 172.21.15.103:0/1455561311 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1007b0 0x7fb45c100c10 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 --2- 172.21.15.103:0/1455561311 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb45c1067b0 0x7fb45c106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 -- 172.21.15.103:0/1455561311 >> 172.21.15.103:0/1455561311 conn(0x7fb45c0fc4d0 msgr2=0x7fb45c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 -- 172.21.15.103:0/1455561311 shutdown_connections 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.564+0000 7fb4646a6640 1 -- 172.21.15.103:0/1455561311 wait complete. 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb4646a6640 1 Processor -- start 2024-08-02T18:48:47.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb4646a6640 1 -- start start 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb4646a6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb45c1007b0 0x7fb45c1990c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb4646a6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c101150 0x7fb45c199600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb4646a6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1067b0 0x7fb45c1a4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb4646a6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c110cd0 con 0x7fb45c1067b0 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb4646a6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c110b50 con 0x7fb45c101150 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb4646a6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb45c110e50 con 0x7fb45c1007b0 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb462c43640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1067b0 0x7fb45c1a4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb462c43640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1067b0 0x7fb45c1a4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59628/0 (socket says 172.21.15.103:59628) 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb462c43640 1 -- 172.21.15.103:0/3949540331 learned_addr learned my addr 172.21.15.103:0/3949540331 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.565+0000 7fb461c41640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c101150 0x7fb45c199600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:47.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb462442640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb45c1007b0 0x7fb45c1990c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb462c43640 1 -- 172.21.15.103:0/3949540331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb45c1007b0 msgr2=0x7fb45c1990c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb462c43640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb45c1007b0 0x7fb45c1990c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb462c43640 1 -- 172.21.15.103:0/3949540331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c101150 msgr2=0x7fb45c199600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb462c43640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c101150 0x7fb45c199600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb462c43640 1 -- 172.21.15.103:0/3949540331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb45c1a4680 con 0x7fb45c1067b0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb461c41640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c101150 0x7fb45c199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb462c43640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1067b0 0x7fb45c1a4140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb45400eaa0 tx=0x7fb45400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb4537fe640 1 -- 172.21.15.103:0/3949540331 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45400cdb0 con 0x7fb45c1067b0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb45c1a4850 con 0x7fb45c1067b0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb4537fe640 1 -- 172.21.15.103:0/3949540331 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb454004b20 con 0x7fb45c1067b0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb4537fe640 1 -- 172.21.15.103:0/3949540331 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb454011760 con 0x7fb45c1067b0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.566+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb45c1a4d10 con 0x7fb45c1067b0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.567+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb45c100c10 con 0x7fb45c1067b0 2024-08-02T18:48:47.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.568+0000 7fb4537fe640 1 -- 172.21.15.103:0/3949540331 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb454004cd0 con 0x7fb45c1067b0 2024-08-02T18:48:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.569+0000 7fb4537fe640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb4480a2c10 0x7fb4480a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.569+0000 7fb462442640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb4480a2c10 0x7fb4480a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.569+0000 7fb4537fe640 1 -- 172.21.15.103:0/3949540331 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb4540cf850 con 0x7fb45c1067b0 2024-08-02T18:48:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.569+0000 7fb462442640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb4480a2c10 0x7fb4480a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005d70 tx=0x7fb44c005d00 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:47.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.573+0000 7fb4537fe640 1 -- 172.21.15.103:0/3949540331 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb454016030 con 0x7fb45c1067b0 2024-08-02T18:48:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.743+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb45c1a4fd0 con 0x7fb45c1067b0 2024-08-02T18:48:47.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.744+0000 7fb4537fe640 1 -- 172.21.15.103:0/3949540331 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fb45409c2f0 con 0x7fb45c1067b0 2024-08-02T18:48:47.745 INFO:teuthology.orchestra.run.smithi103.stdout:154618822714 2024-08-02T18:48:47.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb4480a2c10 msgr2=0x7fb4480a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:47.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb4480a2c10 0x7fb4480a50d0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7fb44c005d70 tx=0x7fb44c005d00 comp rx=0 tx=0).stop 2024-08-02T18:48:47.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1067b0 msgr2=0x7fb45c1a4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1067b0 0x7fb45c1a4140 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb45400eaa0 tx=0x7fb45400ef60 comp rx=0 tx=0).stop 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 shutdown_connections 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb45c1067b0 0x7fb45c1a4140 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb45c101150 0x7fb45c199600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb4480a2c10 0x7fb4480a50d0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 --2- 172.21.15.103:0/3949540331 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb45c1007b0 0x7fb45c1990c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 >> 172.21.15.103:0/3949540331 conn(0x7fb45c0fc4d0 msgr2=0x7fb45c0fcb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 shutdown_connections 2024-08-02T18:48:47.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:47.746+0000 7fb4646a6640 1 -- 172.21.15.103:0/3949540331 wait complete. 2024-08-02T18:48:48.470 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:48 smithi103 ceph-mon[32753]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-08-02T18:48:48.470 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:48 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3949540331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-02T18:48:48.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 -- 172.21.15.103:0/3887543364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101018b0 msgr2=0x7f5310101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:48.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 --2- 172.21.15.103:0/3887543364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101018b0 0x7f5310101d10 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f5300009930 tx=0x7f530002a420 comp rx=0 tx=0).stop 2024-08-02T18:48:48.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 -- 172.21.15.103:0/3887543364 shutdown_connections 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 --2- 172.21.15.103:0/3887543364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5310102250 0x7f531010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 --2- 172.21.15.103:0/3887543364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101018b0 0x7f5310101d10 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 --2- 172.21.15.103:0/3887543364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f53101078b0 0x7f5310107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 -- 172.21.15.103:0/3887543364 >> 172.21.15.103:0/3887543364 conn(0x7f53100fd5f0 msgr2=0x7f53100ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 -- 172.21.15.103:0/3887543364 shutdown_connections 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 -- 172.21.15.103:0/3887543364 wait complete. 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.287+0000 7f5317c8c640 1 Processor -- start 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5317c8c640 1 -- start start 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5317c8c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53101018b0 0x7f53101982d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5317c8c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5310102250 0x7f5310198810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5317c8c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101078b0 0x7f531019cba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5317c8c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5310111e30 con 0x7f53101078b0 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5317c8c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5310111cb0 con 0x7f5310102250 2024-08-02T18:48:48.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5317c8c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5310111fb0 con 0x7f53101018b0 2024-08-02T18:48:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101078b0 0x7f531019cba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101078b0 0x7f531019cba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59638/0 (socket says 172.21.15.103:59638) 2024-08-02T18:48:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 -- 172.21.15.103:0/171717190 learned_addr learned my addr 172.21.15.103:0/171717190 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5315227640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5310102250 0x7f5310198810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:48.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5315a28640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53101018b0 0x7f53101982d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:48.689 INFO:teuthology.orchestra.run.smithi103.stdout:55834574923 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 -- 172.21.15.103:0/171717190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53101018b0 msgr2=0x7f53101982d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53101018b0 0x7f53101982d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 -- 172.21.15.103:0/171717190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5310102250 msgr2=0x7f5310198810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5310102250 0x7f5310198810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 -- 172.21.15.103:0/171717190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f531019d280 con 0x7f53101078b0 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5315227640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5310102250 0x7f5310198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.288+0000 7f5316229640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101078b0 0x7f531019cba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f530800eaa0 tx=0x7f530800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.289+0000 7f5306ffd640 1 -- 172.21.15.103:0/171717190 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f530800cdb0 con 0x7f53101078b0 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.289+0000 7f5306ffd640 1 -- 172.21.15.103:0/171717190 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5308004b20 con 0x7f53101078b0 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.289+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f531019d570 con 0x7f53101078b0 2024-08-02T18:48:48.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.289+0000 7f5306ffd640 1 -- 172.21.15.103:0/171717190 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5308011760 con 0x7f53101078b0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.289+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53101a4e50 con 0x7f53101078b0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.290+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5310101d10 con 0x7f53101078b0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.291+0000 7f5306ffd640 1 -- 172.21.15.103:0/171717190 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5308011900 con 0x7f53101078b0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.292+0000 7f5306ffd640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52fc0a2c90 0x7f52fc0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.292+0000 7f5315a28640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52fc0a2c90 0x7f52fc0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.292+0000 7f5306ffd640 1 -- 172.21.15.103:0/171717190 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f53080cfb20 con 0x7f53101078b0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.292+0000 7f5315a28640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52fc0a2c90 0x7f52fc0a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f530c009890 tx=0x7f530c008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.295+0000 7f5306ffd640 1 -- 172.21.15.103:0/171717190 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5308016030 con 0x7f53101078b0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.468+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f53101a5150 con 0x7f53101078b0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.469+0000 7f5306ffd640 1 -- 172.21.15.103:0/171717190 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f530809c640 con 0x7f53101078b0 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52fc0a2c90 msgr2=0x7f52fc0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52fc0a2c90 0x7f52fc0a5150 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f530c009890 tx=0x7f530c008040 comp rx=0 tx=0).stop 2024-08-02T18:48:48.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101078b0 msgr2=0x7f531019cba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101078b0 0x7f531019cba0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f530800eaa0 tx=0x7f530800ef60 comp rx=0 tx=0).stop 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 shutdown_connections 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f53101078b0 0x7f531019cba0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5310102250 0x7f5310198810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f52fc0a2c90 0x7f52fc0a5150 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 --2- 172.21.15.103:0/171717190 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f53101018b0 0x7f53101982d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 >> 172.21.15.103:0/171717190 conn(0x7f53100fd5f0 msgr2=0x7f53100fdd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 shutdown_connections 2024-08-02T18:48:48.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:48.471+0000 7f5317c8c640 1 -- 172.21.15.103:0/171717190 wait complete. 2024-08-02T18:48:48.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:48 smithi121 ceph-mon[37236]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-08-02T18:48:48.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:48 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3949540331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-02T18:48:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:48 smithi151 ceph-mon[37155]: pgmap v310: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.2 KiB/s rd, 5 op/s 2024-08-02T18:48:48.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:48 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3949540331' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-08-02T18:48:49.023 INFO:tasks.cephadm.ceph_manager.ceph:need seq 154618822713 got 154618822714 for osd.5 2024-08-02T18:48:49.023 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:49.439 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574920 got 55834574923 for osd.1 2024-08-02T18:48:49.439 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:49.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1569974144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 msgr2=0x7f3ee810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1569974144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 0x7f3ee810e780 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f3ee0009cd0 tx=0x7f3ee002a8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1569974144 shutdown_connections 2024-08-02T18:48:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1569974144 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 0x7f3ee810e780 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1569974144 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee81018b0 0x7f3ee8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1569974144 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee81078b0 0x7f3ee8107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1569974144 >> 172.21.15.103:0/1569974144 conn(0x7f3ee80fd5f0 msgr2=0x7f3ee80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1569974144 shutdown_connections 2024-08-02T18:48:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.624+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1569974144 wait complete. 2024-08-02T18:48:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3eed6e1640 1 Processor -- start 2024-08-02T18:48:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3eed6e1640 1 -- start start 2024-08-02T18:48:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3eed6e1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee81018b0 0x7f3ee8198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:49.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3eed6e1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 0x7f3ee81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3eed6e1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee81078b0 0x7f3ee819ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3eed6e1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8111dd0 con 0x7f3ee8102250 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3eed6e1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8111c50 con 0x7f3ee81078b0 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3eed6e1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3ee8111f50 con 0x7f3ee81018b0 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3ee67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 0x7f3ee81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.625+0000 7f3ee67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 0x7f3ee81986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60480/0 (socket says 172.21.15.103:60480) 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee67fc640 1 -- 172.21.15.103:0/1795131608 learned_addr learned my addr 172.21.15.103:0/1795131608 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee6ffd640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee81018b0 0x7f3ee8198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee77fe640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee81078b0 0x7f3ee819ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee67fc640 1 -- 172.21.15.103:0/1795131608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee81018b0 msgr2=0x7f3ee8198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee67fc640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee81018b0 0x7f3ee8198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee67fc640 1 -- 172.21.15.103:0/1795131608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee81078b0 msgr2=0x7f3ee819ca40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee67fc640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee81078b0 0x7f3ee819ca40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee67fc640 1 -- 172.21.15.103:0/1795131608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3ee819d120 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ee67fc640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 0x7f3ee81986b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00d950 tx=0x7f3edc00dd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ecffff640 1 -- 172.21.15.103:0/1795131608 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc017070 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ecffff640 1 -- 172.21.15.103:0/1795131608 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3edc00de80 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3ee819d410 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3ecffff640 1 -- 172.21.15.103:0/1795131608 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3edc00f620 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.626+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3ee81a4cf0 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.627+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3ee8101d10 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.629+0000 7f3ecffff640 1 -- 172.21.15.103:0/1795131608 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3edc009c30 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.630+0000 7f3ecffff640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.630+0000 7f3ee6ffd640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.630+0000 7f3ecffff640 1 -- 172.21.15.103:0/1795131608 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3edc0cf260 con 0x7f3ee8102250 2024-08-02T18:48:49.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.630+0000 7f3ee6ffd640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ab60 tx=0x7f3ed800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:49.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.633+0000 7f3ecffff640 1 -- 172.21.15.103:0/1795131608 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3edc09bd00 con 0x7f3ee8102250 2024-08-02T18:48:49.657 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:49.657 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:49.657 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:49.658 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:49.658 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:49.660 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:49.715 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:49 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/171717190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-02T18:48:49.801 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:49 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/171717190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-02T18:48:49.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:49 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/171717190' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-08-02T18:48:49.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.845+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 10} v 0) -- 0x7f3ee81a5020 con 0x7f3ee8102250 2024-08-02T18:48:49.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.845+0000 7f3ecffff640 1 -- 172.21.15.103:0/1795131608 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 10}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f3edc09b600 con 0x7f3ee8102250 2024-08-02T18:48:49.846 INFO:teuthology.orchestra.run.smithi103.stdout:292057776163 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ed00a2c10 msgr2=0x7f3ed00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f3ed800ab60 tx=0x7f3ed800a2d0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 msgr2=0x7f3ee81986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 0x7f3ee81986b0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f3edc00d950 tx=0x7f3edc00dd50 comp rx=0 tx=0).stop 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 shutdown_connections 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3ee81078b0 0x7f3ee819ca40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3ee8102250 0x7f3ee81986b0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ed00a2c10 0x7f3ed00a50d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 --2- 172.21.15.103:0/1795131608 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3ee81018b0 0x7f3ee8198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.847+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 >> 172.21.15.103:0/1795131608 conn(0x7f3ee80fd5f0 msgr2=0x7f3ee80fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:49.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.848+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 shutdown_connections 2024-08-02T18:48:49.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:49.848+0000 7f3eed6e1640 1 -- 172.21.15.103:0/1795131608 wait complete. 2024-08-02T18:48:50.663 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:50 smithi103 ceph-mon[32753]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-02T18:48:50.663 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:50 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1795131608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-02T18:48:50.693 INFO:tasks.cephadm.ceph_manager.ceph:need seq 292057776160 got 292057776163 for osd.10 2024-08-02T18:48:50.693 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:50.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:50 smithi121 ceph-mon[37236]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-02T18:48:50.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:50 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1795131608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-02T18:48:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:50 smithi151 ceph-mon[37155]: pgmap v311: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 5 op/s 2024-08-02T18:48:50.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:50 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1795131608' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 10}]: dispatch 2024-08-02T18:48:51.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 -- 172.21.15.103:0/3487599810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 msgr2=0x7f5e4010b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:51.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 --2- 172.21.15.103:0/3487599810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 0x7f5e4010b880 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c009900 tx=0x7f5e3c02a480 comp rx=0 tx=0).stop 2024-08-02T18:48:51.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 -- 172.21.15.103:0/3487599810 shutdown_connections 2024-08-02T18:48:51.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 --2- 172.21.15.103:0/3487599810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e4010bea0 0x7f5e4010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 --2- 172.21.15.103:0/3487599810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 0x7f5e4010b880 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 --2- 172.21.15.103:0/3487599810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e40102a70 0x7f5e40102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 -- 172.21.15.103:0/3487599810 >> 172.21.15.103:0/3487599810 conn(0x7f5e400fc4d0 msgr2=0x7f5e400fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:51.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 -- 172.21.15.103:0/3487599810 shutdown_connections 2024-08-02T18:48:51.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 -- 172.21.15.103:0/3487599810 wait complete. 2024-08-02T18:48:51.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.247+0000 7f5e478c4640 1 Processor -- start 2024-08-02T18:48:51.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e478c4640 1 -- start start 2024-08-02T18:48:51.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e478c4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e40102a70 0x7f5e40198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e478c4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 0x7f5e401987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e478c4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4010bea0 0x7f5e4019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e478c4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40111e10 con 0x7f5e40103390 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e478c4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40111c90 con 0x7f5e40102a70 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e478c4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5e40111f90 con 0x7f5e4010bea0 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 0x7f5e401987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 0x7f5e401987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60490/0 (socket says 172.21.15.103:60490) 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 -- 172.21.15.103:0/70225965 learned_addr learned my addr 172.21.15.103:0/70225965 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e45e61640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4010bea0 0x7f5e4019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:51.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e45660640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e40102a70 0x7f5e40198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 -- 172.21.15.103:0/70225965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4010bea0 msgr2=0x7f5e4019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4010bea0 0x7f5e4019cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 -- 172.21.15.103:0/70225965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e40102a70 msgr2=0x7f5e40198290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e40102a70 0x7f5e40198290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 -- 172.21.15.103:0/70225965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5e4019d240 con 0x7f5e40103390 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e45e61640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4010bea0 0x7f5e4019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e44e5f640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 0x7f5e401987d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c006010 tx=0x7f5e3c032c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.248+0000 7f5e367fc640 1 -- 172.21.15.103:0/70225965 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c03f030 con 0x7f5e40103390 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.249+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5e4019d4d0 con 0x7f5e40103390 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.249+0000 7f5e367fc640 1 -- 172.21.15.103:0/70225965 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5e3c003af0 con 0x7f5e40103390 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.249+0000 7f5e367fc640 1 -- 172.21.15.103:0/70225965 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5e3c035070 con 0x7f5e40103390 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.249+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5e401a4e10 con 0x7f5e40103390 2024-08-02T18:48:51.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.249+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5e4006ada0 con 0x7f5e40103390 2024-08-02T18:48:51.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.251+0000 7f5e367fc640 1 -- 172.21.15.103:0/70225965 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5e3c042030 con 0x7f5e40103390 2024-08-02T18:48:51.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.251+0000 7f5e367fc640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5e2c0a2c10 0x7f5e2c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:51.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.251+0000 7f5e45660640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5e2c0a2c10 0x7f5e2c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:51.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.251+0000 7f5e367fc640 1 -- 172.21.15.103:0/70225965 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5e3c0efae0 con 0x7f5e40103390 2024-08-02T18:48:51.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.252+0000 7f5e45660640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5e2c0a2c10 0x7f5e2c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5e300058c0 tx=0x7f5e3000a4c0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:51.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.255+0000 7f5e367fc640 1 -- 172.21.15.103:0/70225965 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5e3c0bc580 con 0x7f5e40103390 2024-08-02T18:48:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.430+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 11} v 0) -- 0x7f5e40106f10 con 0x7f5e40103390 2024-08-02T18:48:51.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.430+0000 7f5e367fc640 1 -- 172.21.15.103:0/70225965 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 11}]=0 v0) ==== 75+0+13 (secure 0 0 0) 0x7f5e3c0bbe80 con 0x7f5e40103390 2024-08-02T18:48:51.724 INFO:teuthology.orchestra.run.smithi103.stdout:322122547231 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5e2c0a2c10 msgr2=0x7f5e2c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5e2c0a2c10 0x7f5e2c0a50d0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f5e300058c0 tx=0x7f5e3000a4c0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 msgr2=0x7f5e401987d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 0x7f5e401987d0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f5e3c006010 tx=0x7f5e3c032c70 comp rx=0 tx=0).stop 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 shutdown_connections 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5e2c0a2c10 0x7f5e2c0a50d0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5e4010bea0 0x7f5e4019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5e40103390 0x7f5e401987d0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 --2- 172.21.15.103:0/70225965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5e40102a70 0x7f5e40198290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 >> 172.21.15.103:0/70225965 conn(0x7f5e400fc4d0 msgr2=0x7f5e400fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:51.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 shutdown_connections 2024-08-02T18:48:51.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:51.432+0000 7f5e478c4640 1 -- 172.21.15.103:0/70225965 wait complete. 2024-08-02T18:48:51.726 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:51 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/70225965' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-02T18:48:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:51 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/70225965' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-02T18:48:51.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:51 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/70225965' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 11}]: dispatch 2024-08-02T18:48:52.132 INFO:tasks.cephadm.ceph_manager.ceph:need seq 322122547230 got 322122547231 for osd.11 2024-08-02T18:48:52.133 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:52.630 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:52 smithi103 ceph-mon[32753]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:52.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:52 smithi121 ceph-mon[37236]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 -- 172.21.15.103:0/2018530893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8102ae0 msgr2=0x7fe6e8102ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 --2- 172.21.15.103:0/2018530893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8102ae0 0x7fe6e8102ec0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009930 tx=0x7fe6d802a440 comp rx=0 tx=0).stop 2024-08-02T18:48:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 -- 172.21.15.103:0/2018530893 shutdown_connections 2024-08-02T18:48:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 --2- 172.21.15.103:0/2018530893 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6e8108010 0x7fe6e810e980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 --2- 172.21.15.103:0/2018530893 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6e8103490 0x7fe6e81078d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 --2- 172.21.15.103:0/2018530893 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8102ae0 0x7fe6e8102ec0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 -- 172.21.15.103:0/2018530893 >> 172.21.15.103:0/2018530893 conn(0x7fe6e80fc500 msgr2=0x7fe6e80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:52.792 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 -- 172.21.15.103:0/2018530893 shutdown_connections 2024-08-02T18:48:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.484+0000 7fe6ede75640 1 -- 172.21.15.103:0/2018530893 wait complete. 2024-08-02T18:48:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6ede75640 1 Processor -- start 2024-08-02T18:48:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6ede75640 1 -- start start 2024-08-02T18:48:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6ede75640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6e8102ae0 0x7fe6e8198480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6ede75640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8103490 0x7fe6e81989c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6ede75640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6e8108010 0x7fe6e819cd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:52.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6ede75640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e8111fe0 con 0x7fe6e8103490 2024-08-02T18:48:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6ede75640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e8111e60 con 0x7fe6e8102ae0 2024-08-02T18:48:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6ede75640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe6e8112160 con 0x7fe6e8108010 2024-08-02T18:48:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6e6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8103490 0x7fe6e81989c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6e6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8103490 0x7fe6e81989c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60502/0 (socket says 172.21.15.103:60502) 2024-08-02T18:48:52.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6e6ffd640 1 -- 172.21.15.103:0/3219243730 learned_addr learned my addr 172.21.15.103:0/3219243730 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:52.795 INFO:teuthology.orchestra.run.smithi103.stdout:240518168622 2024-08-02T18:48:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6e77fe640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6e8102ae0 0x7fe6e8198480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6e7fff640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6e8108010 0x7fe6e819cd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.485+0000 7fe6e6ffd640 1 -- 172.21.15.103:0/3219243730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6e8108010 msgr2=0x7fe6e819cd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6e6ffd640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6e8108010 0x7fe6e819cd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6e6ffd640 1 -- 172.21.15.103:0/3219243730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6e8102ae0 msgr2=0x7fe6e8198480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:52.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6e6ffd640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6e8102ae0 0x7fe6e8198480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6e6ffd640 1 -- 172.21.15.103:0/3219243730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe6e819d430 con 0x7fe6e8103490 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6e6ffd640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8103490 0x7fe6e81989c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006fd0 tx=0x7fe6dc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6e4ff9640 1 -- 172.21.15.103:0/3219243730 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc011830 con 0x7fe6e8103490 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6e4ff9640 1 -- 172.21.15.103:0/3219243730 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe6dc016070 con 0x7fe6e8103490 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe6e819d720 con 0x7fe6e8103490 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6e4ff9640 1 -- 172.21.15.103:0/3219243730 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe6dc00f2e0 con 0x7fe6e8103490 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.486+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe6e81a5000 con 0x7fe6e8103490 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.487+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe6e806a500 con 0x7fe6e8103490 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.488+0000 7fe6e4ff9640 1 -- 172.21.15.103:0/3219243730 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fe6dc0119d0 con 0x7fe6e8103490 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.489+0000 7fe6e4ff9640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe6d00a2c90 0x7fe6d00a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.489+0000 7fe6e77fe640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe6d00a2c90 0x7fe6d00a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:52.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.489+0000 7fe6e4ff9640 1 -- 172.21.15.103:0/3219243730 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fe6dc0ce9f0 con 0x7fe6e8103490 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.489+0000 7fe6e77fe640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe6d00a2c90 0x7fe6d00a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009900 tx=0x7fe6d80058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.493+0000 7fe6e4ff9640 1 -- 172.21.15.103:0/3219243730 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe6dc09b5a0 con 0x7fe6e8103490 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.665+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 8} v 0) -- 0x7fe6e8109ff0 con 0x7fe6e8103490 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.666+0000 7fe6e4ff9640 1 -- 172.21.15.103:0/3219243730 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 8}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7fe6dc09aea0 con 0x7fe6e8103490 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe6d00a2c90 msgr2=0x7fe6d00a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe6d00a2c90 0x7fe6d00a5150 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fe6d8009900 tx=0x7fe6d80058d0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8103490 msgr2=0x7fe6e81989c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8103490 0x7fe6e81989c0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7fe6dc006fd0 tx=0x7fe6dc00b8e0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 shutdown_connections 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fe6d00a2c90 0x7fe6d00a5150 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe6e8108010 0x7fe6e819cd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe6e8103490 0x7fe6e81989c0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 --2- 172.21.15.103:0/3219243730 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe6e8102ae0 0x7fe6e8198480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 >> 172.21.15.103:0/3219243730 conn(0x7fe6e80fc500 msgr2=0x7fe6e81060c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 shutdown_connections 2024-08-02T18:48:52.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:52.668+0000 7fe6ede75640 1 -- 172.21.15.103:0/3219243730 wait complete. 2024-08-02T18:48:52.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:52 smithi151 ceph-mon[37155]: pgmap v312: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:53.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 -- 172.21.15.103:0/1261172353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74281078b0 msgr2=0x7f7428107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 --2- 172.21.15.103:0/1261172353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74281078b0 0x7f7428107c90 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7418009930 tx=0x7f741802a420 comp rx=0 tx=0).stop 2024-08-02T18:48:53.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 -- 172.21.15.103:0/1261172353 shutdown_connections 2024-08-02T18:48:53.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 --2- 172.21.15.103:0/1261172353 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7428102250 0x7f742810e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 --2- 172.21.15.103:0/1261172353 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74281018b0 0x7f7428101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 --2- 172.21.15.103:0/1261172353 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74281078b0 0x7f7428107c90 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 -- 172.21.15.103:0/1261172353 >> 172.21.15.103:0/1261172353 conn(0x7f74280fd5f0 msgr2=0x7f74280ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 -- 172.21.15.103:0/1261172353 shutdown_connections 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.139+0000 7f742db15640 1 -- 172.21.15.103:0/1261172353 wait complete. 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f742db15640 1 Processor -- start 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f742db15640 1 -- start start 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f742db15640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74281018b0 0x7f7428074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f742db15640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7428102250 0x7f7428074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f742db15640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74281078b0 0x7f7428074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f742db15640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7428111e30 con 0x7f7428102250 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f742db15640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7428111cb0 con 0x7f74281018b0 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f742db15640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7428111fb0 con 0x7f74281078b0 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f741effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7428102250 0x7f7428074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:53.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f741effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7428102250 0x7f7428074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60516/0 (socket says 172.21.15.103:60516) 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.140+0000 7f741effd640 1 -- 172.21.15.103:0/1713591770 learned_addr learned my addr 172.21.15.103:0/1713591770 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f74277fe640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74281018b0 0x7f7428074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f741effd640 1 -- 172.21.15.103:0/1713591770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74281078b0 msgr2=0x7f7428074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f741effd640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74281078b0 0x7f7428074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f741effd640 1 -- 172.21.15.103:0/1713591770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74281018b0 msgr2=0x7f7428074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f741effd640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74281018b0 0x7f7428074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f741effd640 1 -- 172.21.15.103:0/1713591770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74281a67e0 con 0x7f7428102250 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f74277fe640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74281018b0 0x7f7428074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f741effd640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7428102250 0x7f7428074760 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f741000b4a0 tx=0x7f741000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f74257fa640 1 -- 172.21.15.103:0/1713591770 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410014070 con 0x7f7428102250 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74281a6ad0 con 0x7f7428102250 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f74257fa640 1 -- 172.21.15.103:0/1713591770 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7410010b10 con 0x7f7428102250 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f74257fa640 1 -- 172.21.15.103:0/1713591770 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7410017d60 con 0x7f7428102250 2024-08-02T18:48:53.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.141+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74281a7010 con 0x7f7428102250 2024-08-02T18:48:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.142+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7428101d10 con 0x7f7428102250 2024-08-02T18:48:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.143+0000 7f74257fa640 1 -- 172.21.15.103:0/1713591770 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f7410017070 con 0x7f7428102250 2024-08-02T18:48:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.144+0000 7f74257fa640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f74140a2c10 0x7f74140a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.144+0000 7f74277fe640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f74140a2c10 0x7f74140a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.144+0000 7f74257fa640 1 -- 172.21.15.103:0/1713591770 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f74100cecc0 con 0x7f7428102250 2024-08-02T18:48:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.144+0000 7f74277fe640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f74140a2c10 0x7f74140a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f7418032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:53.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.147+0000 7f74257fa640 1 -- 172.21.15.103:0/1713591770 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f741009b810 con 0x7f7428102250 2024-08-02T18:48:53.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.318+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f7428075750 con 0x7f7428102250 2024-08-02T18:48:53.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.318+0000 7f74257fa640 1 -- 172.21.15.103:0/1713591770 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f741009b110 con 0x7f7428102250 2024-08-02T18:48:53.320 INFO:teuthology.orchestra.run.smithi103.stdout:103079215171 2024-08-02T18:48:53.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f74140a2c10 msgr2=0x7f74140a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f74140a2c10 0x7f74140a50d0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f7418000c00 tx=0x7f7418032d60 comp rx=0 tx=0).stop 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7428102250 msgr2=0x7f7428074760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7428102250 0x7f7428074760 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f741000b4a0 tx=0x7f741000b960 comp rx=0 tx=0).stop 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 shutdown_connections 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f74140a2c10 0x7f74140a50d0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74281078b0 0x7f7428074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7428102250 0x7f7428074760 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 --2- 172.21.15.103:0/1713591770 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74281018b0 0x7f7428074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 >> 172.21.15.103:0/1713591770 conn(0x7f74280fd5f0 msgr2=0x7f74280fde70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 shutdown_connections 2024-08-02T18:48:53.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.320+0000 7f742db15640 1 -- 172.21.15.103:0/1713591770 wait complete. 2024-08-02T18:48:53.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 -- 172.21.15.103:0/1053461155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600100b50 msgr2=0x7fb600100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 --2- 172.21.15.103:0/1053461155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600100b50 0x7fb600100f30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4009900 tx=0x7fb5f402a480 comp rx=0 tx=0).stop 2024-08-02T18:48:53.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 -- 172.21.15.103:0/1053461155 shutdown_connections 2024-08-02T18:48:53.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 --2- 172.21.15.103:0/1053461155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb600102c20 0x7fb60010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.438 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 --2- 172.21.15.103:0/1053461155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6001022a0 0x7fb6001026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 --2- 172.21.15.103:0/1053461155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600100b50 0x7fb600100f30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 -- 172.21.15.103:0/1053461155 >> 172.21.15.103:0/1053461155 conn(0x7fb6000fc500 msgr2=0x7fb6000fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 -- 172.21.15.103:0/1053461155 shutdown_connections 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 -- 172.21.15.103:0/1053461155 wait complete. 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.422+0000 7fb60795c640 1 Processor -- start 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb60795c640 1 -- start start 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb60795c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb600100b50 0x7fb600198310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb60795c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001022a0 0x7fb600198850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb60795c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600102c20 0x7fb60019cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb60795c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb600110df0 con 0x7fb600102c20 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb60795c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb600110c70 con 0x7fb600100b50 2024-08-02T18:48:53.439 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb60795c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb600110f70 con 0x7fb6001022a0 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600102c20 0x7fb60019cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600102c20 0x7fb60019cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60536/0 (socket says 172.21.15.103:60536) 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 -- 172.21.15.103:0/1954413942 learned_addr learned my addr 172.21.15.103:0/1954413942 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb6056f8640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb600100b50 0x7fb600198310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb604ef7640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001022a0 0x7fb600198850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 -- 172.21.15.103:0/1954413942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001022a0 msgr2=0x7fb600198850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001022a0 0x7fb600198850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 -- 172.21.15.103:0/1954413942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb600100b50 msgr2=0x7fb600198310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb600100b50 0x7fb600198310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 -- 172.21.15.103:0/1954413942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb60019d2c0 con 0x7fb600102c20 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb604ef7640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001022a0 0x7fb600198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.423+0000 7fb605ef9640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600102c20 0x7fb60019cbe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800eaa0 tx=0x7fb5f800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.424+0000 7fb5f27fc640 1 -- 172.21.15.103:0/1954413942 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f800cdb0 con 0x7fb600102c20 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.424+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb60019d5b0 con 0x7fb600102c20 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.424+0000 7fb5f27fc640 1 -- 172.21.15.103:0/1954413942 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb5f8004b20 con 0x7fb600102c20 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.424+0000 7fb5f27fc640 1 -- 172.21.15.103:0/1954413942 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5f8011760 con 0x7fb600102c20 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.424+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6001a4e90 con 0x7fb600102c20 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.425+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb600100f30 con 0x7fb600102c20 2024-08-02T18:48:53.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.426+0000 7fb5f27fc640 1 -- 172.21.15.103:0/1954413942 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fb5f8004cd0 con 0x7fb600102c20 2024-08-02T18:48:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.427+0000 7fb5f27fc640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb5ec0a2c10 0x7fb5ec0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.427+0000 7fb6056f8640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb5ec0a2c10 0x7fb5ec0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.427+0000 7fb5f27fc640 1 -- 172.21.15.103:0/1954413942 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb5f80cf7a0 con 0x7fb600102c20 2024-08-02T18:48:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.427+0000 7fb6056f8640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb5ec0a2c10 0x7fb5ec0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4000c00 tx=0x7fb5f4005e80 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:53.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.431+0000 7fb5f27fc640 1 -- 172.21.15.103:0/1954413942 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb5f8016030 con 0x7fb600102c20 2024-08-02T18:48:53.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:53 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3219243730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-02T18:48:53.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:53 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1713591770' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-02T18:48:53.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.610+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fb600109dd0 con 0x7fb600102c20 2024-08-02T18:48:53.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.610+0000 7fb5f27fc640 1 -- 172.21.15.103:0/1954413942 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb5f809c240 con 0x7fb600102c20 2024-08-02T18:48:53.613 INFO:teuthology.orchestra.run.smithi103.stdout:34359738450 2024-08-02T18:48:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb5ec0a2c10 msgr2=0x7fb5ec0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb5ec0a2c10 0x7fb5ec0a50d0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fb5f4000c00 tx=0x7fb5f4005e80 comp rx=0 tx=0).stop 2024-08-02T18:48:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600102c20 msgr2=0x7fb60019cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:53.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600102c20 0x7fb60019cbe0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fb5f800eaa0 tx=0x7fb5f800ef60 comp rx=0 tx=0).stop 2024-08-02T18:48:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 shutdown_connections 2024-08-02T18:48:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb600102c20 0x7fb60019cbe0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb5ec0a2c10 0x7fb5ec0a50d0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6001022a0 0x7fb600198850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 --2- 172.21.15.103:0/1954413942 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb600100b50 0x7fb600198310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:53.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.612+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 >> 172.21.15.103:0/1954413942 conn(0x7fb6000fc500 msgr2=0x7fb600069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.613+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 shutdown_connections 2024-08-02T18:48:53.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:53.613+0000 7fb60795c640 1 -- 172.21.15.103:0/1954413942 wait complete. 2024-08-02T18:48:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:53 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3219243730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-02T18:48:53.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:53 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1713591770' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-02T18:48:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:53 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3219243730' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 8}]: dispatch 2024-08-02T18:48:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:53 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1713591770' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-08-02T18:48:54.348 INFO:tasks.cephadm.ceph_manager.ceph:need seq 240518168619 got 240518168622 for osd.8 2024-08-02T18:48:54.348 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:54.572 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:54 smithi103 ceph-mon[32753]: pgmap v313: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:48:54.572 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:54 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1954413942' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-02T18:48:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:54 smithi121 ceph-mon[37236]: pgmap v313: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:48:54.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:54 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1954413942' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-02T18:48:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:54 smithi151 ceph-mon[37155]: pgmap v313: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:48:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:54 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1954413942' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-08-02T18:48:55.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 -- 172.21.15.103:0/3873660413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008102a60 msgr2=0x7f3008102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 --2- 172.21.15.103:0/3873660413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008102a60 0x7f3008102e40 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc009930 tx=0x7f2ffc02a440 comp rx=0 tx=0).stop 2024-08-02T18:48:55.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 -- 172.21.15.103:0/3873660413 shutdown_connections 2024-08-02T18:48:55.068 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 --2- 172.21.15.103:0/3873660413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3008107fd0 0x7f300810e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 --2- 172.21.15.103:0/3873660413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3008103410 0x7f30081078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 --2- 172.21.15.103:0/3873660413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008102a60 0x7f3008102e40 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 -- 172.21.15.103:0/3873660413 >> 172.21.15.103:0/3873660413 conn(0x7f30080fc500 msgr2=0x7f30080fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 -- 172.21.15.103:0/3873660413 shutdown_connections 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 -- 172.21.15.103:0/3873660413 wait complete. 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 Processor -- start 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.064+0000 7f300f51b640 1 -- start start 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300f51b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3008102a60 0x7f30081006c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300f51b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3008103410 0x7f3008100c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300f51b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008107fd0 0x7f3008101140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300f51b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3008111f50 con 0x7f3008107fd0 2024-08-02T18:48:55.069 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300f51b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3008111dd0 con 0x7f3008102a60 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300f51b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f30081120d0 con 0x7f3008103410 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008107fd0 0x7f3008101140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008107fd0 0x7f3008101140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60558/0 (socket says 172.21.15.103:60558) 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 -- 172.21.15.103:0/99756765 learned_addr learned my addr 172.21.15.103:0/99756765 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300d2b7640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3008102a60 0x7f30081006c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300cab6640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3008103410 0x7f3008100c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 -- 172.21.15.103:0/99756765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3008103410 msgr2=0x7f3008100c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3008103410 0x7f3008100c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 -- 172.21.15.103:0/99756765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3008102a60 msgr2=0x7f30081006c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3008102a60 0x7f30081006c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 -- 172.21.15.103:0/99756765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f30081a68d0 con 0x7f3008107fd0 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300d2b7640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3008102a60 0x7f30081006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:55.070 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300cab6640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3008103410 0x7f3008100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:55.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300dab8640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008107fd0 0x7f3008101140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f300000eaa0 tx=0x7f300000ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:55.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f30067fc640 1 -- 172.21.15.103:0/99756765 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f300000cdb0 con 0x7f3008107fd0 2024-08-02T18:48:55.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f30067fc640 1 -- 172.21.15.103:0/99756765 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3000004b20 con 0x7f3008107fd0 2024-08-02T18:48:55.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f30067fc640 1 -- 172.21.15.103:0/99756765 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3000011760 con 0x7f3008107fd0 2024-08-02T18:48:55.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f30081a6bc0 con 0x7f3008107fd0 2024-08-02T18:48:55.071 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.065+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f30081a70b0 con 0x7f3008107fd0 2024-08-02T18:48:55.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.066+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f300806a580 con 0x7f3008107fd0 2024-08-02T18:48:55.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.068+0000 7f30067fc640 1 -- 172.21.15.103:0/99756765 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3000004cd0 con 0x7f3008107fd0 2024-08-02T18:48:55.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.068+0000 7f30067fc640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2ff00a2c10 0x7f2ff00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:55.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.068+0000 7f30067fc640 1 -- 172.21.15.103:0/99756765 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f30000cf8f0 con 0x7f3008107fd0 2024-08-02T18:48:55.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.068+0000 7f300d2b7640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2ff00a2c10 0x7f2ff00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:55.072 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.069+0000 7f300d2b7640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2ff00a2c10 0x7f2ff00a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc005ec0 tx=0x7f2ffc009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:55.074 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.072+0000 7f30067fc640 1 -- 172.21.15.103:0/99756765 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3000016030 con 0x7f3008107fd0 2024-08-02T18:48:55.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.243+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f3008102e40 con 0x7f3008107fd0 2024-08-02T18:48:55.246 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.244+0000 7f30067fc640 1 -- 172.21.15.103:0/99756765 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f300009c330 con 0x7f3008107fd0 2024-08-02T18:48:55.246 INFO:teuthology.orchestra.run.smithi103.stdout:210453397555 2024-08-02T18:48:55.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2ff00a2c10 msgr2=0x7f2ff00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2ff00a2c10 0x7f2ff00a50d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f2ffc005ec0 tx=0x7f2ffc009680 comp rx=0 tx=0).stop 2024-08-02T18:48:55.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008107fd0 msgr2=0x7f3008101140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008107fd0 0x7f3008101140 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f300000eaa0 tx=0x7f300000ef60 comp rx=0 tx=0).stop 2024-08-02T18:48:55.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 shutdown_connections 2024-08-02T18:48:55.248 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3008107fd0 0x7f3008101140 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f2ff00a2c10 0x7f2ff00a50d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3008103410 0x7f3008100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 --2- 172.21.15.103:0/99756765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3008102a60 0x7f30081006c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 >> 172.21.15.103:0/99756765 conn(0x7f30080fc500 msgr2=0x7f3008105ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:55.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 shutdown_connections 2024-08-02T18:48:55.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.246+0000 7f300f51b640 1 -- 172.21.15.103:0/99756765 wait complete. 2024-08-02T18:48:55.498 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:55 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/99756765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-02T18:48:55.525 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738447 got 34359738450 for osd.0 2024-08-02T18:48:55.526 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.725+0000 7f57ac3de640 1 -- 172.21.15.103:0/1976290379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 msgr2=0x7f57a4102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.725+0000 7f57ac3de640 1 --2- 172.21.15.103:0/1976290379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 0x7f57a4102e50 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009900 tx=0x7f57a002a480 comp rx=0 tx=0).stop 2024-08-02T18:48:55.732 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 -- 172.21.15.103:0/1976290379 shutdown_connections 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 --2- 172.21.15.103:0/1976290379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57a410bea0 0x7f57a410e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 --2- 172.21.15.103:0/1976290379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57a4103390 0x7f57a410b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 --2- 172.21.15.103:0/1976290379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 0x7f57a4102e50 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 -- 172.21.15.103:0/1976290379 >> 172.21.15.103:0/1976290379 conn(0x7f57a40fc4d0 msgr2=0x7f57a40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 -- 172.21.15.103:0/1976290379 shutdown_connections 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 -- 172.21.15.103:0/1976290379 wait complete. 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 Processor -- start 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 -- start start 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 0x7f57a41982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57a4103390 0x7f57a4198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57a410bea0 0x7f57a419cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:55.733 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4111e20 con 0x7f57a4102a70 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4111ca0 con 0x7f57a410bea0 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57ac3de640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f57a4111fa0 con 0x7f57a4103390 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57aa17a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 0x7f57a41982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57aa17a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 0x7f57a41982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60574/0 (socket says 172.21.15.103:60574) 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.726+0000 7f57aa17a640 1 -- 172.21.15.103:0/464729452 learned_addr learned my addr 172.21.15.103:0/464729452 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57a9979640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57a4103390 0x7f57a4198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57aa17a640 1 -- 172.21.15.103:0/464729452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57a4103390 msgr2=0x7f57a4198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57aa17a640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57a4103390 0x7f57a4198800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57aa17a640 1 -- 172.21.15.103:0/464729452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57a410bea0 msgr2=0x7f57a419cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57aa17a640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57a410bea0 0x7f57a419cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57aa17a640 1 -- 172.21.15.103:0/464729452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f57a419d270 con 0x7f57a4102a70 2024-08-02T18:48:55.734 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57aa17a640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 0x7f57a41982c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57a0006010 tx=0x7f57a00042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f579b7fe640 1 -- 172.21.15.103:0/464729452 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a003f030 con 0x7f57a4102a70 2024-08-02T18:48:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f57a419d500 con 0x7f57a4102a70 2024-08-02T18:48:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f579b7fe640 1 -- 172.21.15.103:0/464729452 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f57a0003d00 con 0x7f57a4102a70 2024-08-02T18:48:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f579b7fe640 1 -- 172.21.15.103:0/464729452 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f57a0035070 con 0x7f57a4102a70 2024-08-02T18:48:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.727+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f57a41a4e40 con 0x7f57a4102a70 2024-08-02T18:48:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.728+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f57a406ada0 con 0x7f57a4102a70 2024-08-02T18:48:55.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.729+0000 7f579b7fe640 1 -- 172.21.15.103:0/464729452 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f57a0042030 con 0x7f57a4102a70 2024-08-02T18:48:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.730+0000 7f579b7fe640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f57900a2c10 0x7f57900a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.731+0000 7f579b7fe640 1 -- 172.21.15.103:0/464729452 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f57a00efed0 con 0x7f57a4102a70 2024-08-02T18:48:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.731+0000 7f57a9979640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f57900a2c10 0x7f57900a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:55.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.731+0000 7f57a9979640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f57900a2c10 0x7f57900a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f57a410d2c0 tx=0x7f5794009060 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:55.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.735+0000 7f579b7fe640 1 -- 172.21.15.103:0/464729452 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f57a00bc970 con 0x7f57a4102a70 2024-08-02T18:48:55.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:55 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/99756765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-02T18:48:55.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:55 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/99756765' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-08-02T18:48:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.908+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 9} v 0) -- 0x7f57a4106f10 con 0x7f57a4102a70 2024-08-02T18:48:55.911 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.909+0000 7f579b7fe640 1 -- 172.21.15.103:0/464729452 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 9}]=0 v0) ==== 74+0+13 (secure 0 0 0) 0x7f57a00bc270 con 0x7f57a4102a70 2024-08-02T18:48:55.912 INFO:teuthology.orchestra.run.smithi103.stdout:270582939688 2024-08-02T18:48:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f57900a2c10 msgr2=0x7f57900a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f57900a2c10 0x7f57900a50d0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f57a410d2c0 tx=0x7f5794009060 comp rx=0 tx=0).stop 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 msgr2=0x7f57a41982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 0x7f57a41982c0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f57a0006010 tx=0x7f57a00042f0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 shutdown_connections 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f57a410bea0 0x7f57a419cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f57900a2c10 0x7f57900a50d0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f57a4103390 0x7f57a4198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 --2- 172.21.15.103:0/464729452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f57a4102a70 0x7f57a41982c0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 >> 172.21.15.103:0/464729452 conn(0x7f57a40fc4d0 msgr2=0x7f57a40fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 shutdown_connections 2024-08-02T18:48:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:55.911+0000 7f57ac3de640 1 -- 172.21.15.103:0/464729452 wait complete. 2024-08-02T18:48:56.246 INFO:tasks.cephadm.ceph_manager.ceph:need seq 103079215169 got 103079215171 for osd.3 2024-08-02T18:48:56.246 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:56.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:56 smithi121 ceph-mon[37236]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:56.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:56 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/464729452' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-02T18:48:56.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:56 smithi151 ceph-mon[37155]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:56.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:56 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/464729452' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-02T18:48:56.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:56 smithi103 ceph-mon[32753]: pgmap v314: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:48:56.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:56 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/464729452' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 9}]: dispatch 2024-08-02T18:48:56.926 INFO:tasks.cephadm.ceph_manager.ceph:need seq 270582939684 got 270582939688 for osd.9 2024-08-02T18:48:56.926 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.042+0000 7f125571e640 1 -- 172.21.15.103:0/546729532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501067b0 msgr2=0x7f1250106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.042+0000 7f125571e640 1 --2- 172.21.15.103:0/546729532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501067b0 0x7f1250106b90 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1240009930 tx=0x7f124002a420 comp rx=0 tx=0).stop 2024-08-02T18:48:57.060 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.042+0000 7f125571e640 1 -- 172.21.15.103:0/546729532 shutdown_connections 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.042+0000 7f125571e640 1 --2- 172.21.15.103:0/546729532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1250101150 0x7f125010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.042+0000 7f125571e640 1 --2- 172.21.15.103:0/546729532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12501007b0 0x7f1250100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.042+0000 7f125571e640 1 --2- 172.21.15.103:0/546729532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501067b0 0x7f1250106b90 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.043+0000 7f125571e640 1 -- 172.21.15.103:0/546729532 >> 172.21.15.103:0/546729532 conn(0x7f12500fc4d0 msgr2=0x7f12500fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.043+0000 7f125571e640 1 -- 172.21.15.103:0/546729532 shutdown_connections 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.043+0000 7f125571e640 1 -- 172.21.15.103:0/546729532 wait complete. 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.043+0000 7f125571e640 1 Processor -- start 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.043+0000 7f125571e640 1 -- start start 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f125571e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501007b0 0x7f12501981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f125571e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1250101150 0x7f1250198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:57.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f125571e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501067b0 0x7f125019ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f125571e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1250110c90 con 0x7f12501007b0 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f125571e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1250110b10 con 0x7f1250101150 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f125571e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1250110e10 con 0x7f12501067b0 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501007b0 0x7f12501981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501007b0 0x7f12501981c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60590/0 (socket says 172.21.15.103:60590) 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 -- 172.21.15.103:0/1292624566 learned_addr learned my addr 172.21.15.103:0/1292624566 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f12467fc640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1250101150 0x7f1250198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124f7fe640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501067b0 0x7f125019ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 -- 172.21.15.103:0/1292624566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501067b0 msgr2=0x7f125019ca90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:57.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501067b0 0x7f125019ca90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 -- 172.21.15.103:0/1292624566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1250101150 msgr2=0x7f1250198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1250101150 0x7f1250198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 -- 172.21.15.103:0/1292624566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f125019d170 con 0x7f12501007b0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.044+0000 7f124effd640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501007b0 0x7f12501981c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1240009a50 tx=0x7f1240004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.045+0000 7f124cff9640 1 -- 172.21.15.103:0/1292624566 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f124003f030 con 0x7f12501007b0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.045+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f125019d400 con 0x7f12501007b0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.045+0000 7f124cff9640 1 -- 172.21.15.103:0/1292624566 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1240003af0 con 0x7f12501007b0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.045+0000 7f124cff9640 1 -- 172.21.15.103:0/1292624566 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1240035070 con 0x7f12501007b0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.045+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12501a4d40 con 0x7f12501007b0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.046+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1250101ef0 con 0x7f12501007b0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.047+0000 7f124cff9640 1 -- 172.21.15.103:0/1292624566 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1240042030 con 0x7f12501007b0 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.048+0000 7f124cff9640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f123c0a2c10 0x7f123c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:57.063 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.048+0000 7f12467fc640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f123c0a2c10 0x7f123c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:57.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.048+0000 7f124cff9640 1 -- 172.21.15.103:0/1292624566 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f12400f01f0 con 0x7f12501007b0 2024-08-02T18:48:57.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.049+0000 7f12467fc640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f123c0a2c10 0x7f123c0a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f12501046a0 tx=0x7f123800a2d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:57.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.051+0000 7f124cff9640 1 -- 172.21.15.103:0/1292624566 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f12400bcc90 con 0x7f12501007b0 2024-08-02T18:48:57.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.222+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f1250100c10 con 0x7f12501007b0 2024-08-02T18:48:57.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.222+0000 7f124cff9640 1 -- 172.21.15.103:0/1292624566 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f12400bc590 con 0x7f12501007b0 2024-08-02T18:48:57.225 INFO:teuthology.orchestra.run.smithi103.stdout:77309411401 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f123c0a2c10 msgr2=0x7f123c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f123c0a2c10 0x7f123c0a50d0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f12501046a0 tx=0x7f123800a2d0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501007b0 msgr2=0x7f12501981c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501007b0 0x7f12501981c0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f1240009a50 tx=0x7f1240004270 comp rx=0 tx=0).stop 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 shutdown_connections 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f123c0a2c10 0x7f123c0a50d0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12501067b0 0x7f125019ca90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1250101150 0x7f1250198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 --2- 172.21.15.103:0/1292624566 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12501007b0 0x7f12501981c0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 >> 172.21.15.103:0/1292624566 conn(0x7f12500fc4d0 msgr2=0x7f125006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 shutdown_connections 2024-08-02T18:48:57.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:57.224+0000 7f125571e640 1 -- 172.21.15.103:0/1292624566 wait complete. 2024-08-02T18:48:57.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:57 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1292624566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-02T18:48:57.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:57 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1292624566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-02T18:48:57.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:57 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1292624566' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-08-02T18:48:57.859 INFO:tasks.cephadm.ceph_manager.ceph:need seq 210453397551 got 210453397555 for osd.7 2024-08-02T18:48:57.859 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:58.539 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411398 got 77309411401 for osd.2 2024-08-02T18:48:58.539 DEBUG:teuthology.parallel:result is None 2024-08-02T18:48:58.539 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-02T18:48:58.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-02T18:48:58.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:48:58 smithi121 ceph-mon[37236]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:48:58.798 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:48:58.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:48:58 smithi151 ceph-mon[37155]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:48:58.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:48:58 smithi103 ceph-mon[32753]: pgmap v315: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 -- 172.21.15.103:0/122551366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4102ac0 msgr2=0x7ff7a4102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/122551366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4102ac0 0x7ff7a4102ea0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7ff794009930 tx=0x7ff79402a420 comp rx=0 tx=0).stop 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 -- 172.21.15.103:0/122551366 shutdown_connections 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/122551366 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7a4107fc0 0x7ff7a410e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/122551366 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7a4103470 0x7ff7a41078b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/122551366 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4102ac0 0x7ff7a4102ea0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 -- 172.21.15.103:0/122551366 >> 172.21.15.103:0/122551366 conn(0x7ff7a40fc500 msgr2=0x7ff7a40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 -- 172.21.15.103:0/122551366 shutdown_connections 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.276+0000 7ff7a99fd640 1 -- 172.21.15.103:0/122551366 wait complete. 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.277+0000 7ff7a99fd640 1 Processor -- start 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.277+0000 7ff7a99fd640 1 -- start start 2024-08-02T18:48:59.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.277+0000 7ff7a99fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7a4102ac0 0x7ff7a419a740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.277+0000 7ff7a99fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4103470 0x7ff7a419ac80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.277+0000 7ff7a99fd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7a4107fc0 0x7ff7a419f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.277+0000 7ff7a99fd640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4111fc0 con 0x7ff7a4103470 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.277+0000 7ff7a99fd640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4111e40 con 0x7ff7a4102ac0 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.277+0000 7ff7a99fd640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff7a4112140 con 0x7ff7a4107fc0 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4103470 0x7ff7a419ac80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4103470 0x7ff7a419ac80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53188/0 (socket says 172.21.15.103:53188) 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 -- 172.21.15.103:0/3369406689 learned_addr learned my addr 172.21.15.103:0/3369406689 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a37fe640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7a4107fc0 0x7ff7a419f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a2ffd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7a4102ac0 0x7ff7a419a740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 -- 172.21.15.103:0/3369406689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7a4107fc0 msgr2=0x7ff7a419f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:59.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7a4107fc0 0x7ff7a419f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 -- 172.21.15.103:0/3369406689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7a4102ac0 msgr2=0x7ff7a419a740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7a4102ac0 0x7ff7a419a740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 -- 172.21.15.103:0/3369406689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff7a419f6f0 con 0x7ff7a4103470 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a2ffd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7a4102ac0 0x7ff7a419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a27fc640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4103470 0x7ff7a419ac80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff79800b450 tx=0x7ff79800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a89fb640 1 -- 172.21.15.103:0/3369406689 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff798015020 con 0x7ff7a4103470 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a89fb640 1 -- 172.21.15.103:0/3369406689 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff798011d90 con 0x7ff7a4103470 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a89fb640 1 -- 172.21.15.103:0/3369406689 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff79800f340 con 0x7ff7a4103470 2024-08-02T18:48:59.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff7a419f9e0 con 0x7ff7a4103470 2024-08-02T18:48:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.278+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff7a41a72c0 con 0x7ff7a4103470 2024-08-02T18:48:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.279+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff7a4102f20 con 0x7ff7a4103470 2024-08-02T18:48:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.281+0000 7ff7a89fb640 1 -- 172.21.15.103:0/3369406689 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7ff798018020 con 0x7ff7a4103470 2024-08-02T18:48:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.281+0000 7ff7a89fb640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff78c0a2c10 0x7ff78c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:48:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.281+0000 7ff7a89fb640 1 -- 172.21.15.103:0/3369406689 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7ff7980cf3f0 con 0x7ff7a4103470 2024-08-02T18:48:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.281+0000 7ff7a2ffd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff78c0a2c10 0x7ff78c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:48:59.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.282+0000 7ff7a2ffd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff78c0a2c10 0x7ff78c0a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff794000c00 tx=0x7ff794032d60 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:48:59.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.284+0000 7ff7a89fb640 1 -- 172.21.15.103:0/3369406689 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff79801f020 con 0x7ff7a4103470 2024-08-02T18:48:59.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.448+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff7a410c010 con 0x7ff78c0a2c10 2024-08-02T18:48:59.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.457+0000 7ff7a89fb640 1 -- 172.21.15.103:0/3369406689 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340370 (secure 0 0 0) 0x7ff7a410c010 con 0x7ff78c0a2c10 2024-08-02T18:48:59.463 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:48:59.465 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:48:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff78c0a2c10 msgr2=0x7ff78c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff78c0a2c10 0x7ff78c0a50d0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7ff794000c00 tx=0x7ff794032d60 comp rx=0 tx=0).stop 2024-08-02T18:48:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4103470 msgr2=0x7ff7a419ac80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:48:59.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4103470 0x7ff7a419ac80 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7ff79800b450 tx=0x7ff79800b910 comp rx=0 tx=0).stop 2024-08-02T18:48:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 shutdown_connections 2024-08-02T18:48:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7ff78c0a2c10 0x7ff78c0a50d0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff7a4107fc0 0x7ff7a419f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff7a4103470 0x7ff7a419ac80 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 --2- 172.21.15.103:0/3369406689 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff7a4102ac0 0x7ff7a419a740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:48:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 >> 172.21.15.103:0/3369406689 conn(0x7ff7a40fc500 msgr2=0x7ff7a4100ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:48:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 shutdown_connections 2024-08-02T18:48:59.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:48:59.460+0000 7ff7a99fd640 1 -- 172.21.15.103:0/3369406689 wait complete. 2024-08-02T18:49:00.192 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-08-02T18:48:59.355988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658660,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":484,"num_read_kb":366,"num_write":352,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375604,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566220,"statfs":{"total":1151940427776,"available":1151555809280,"internally_reserved":0,"allocated":14286848,"data_stored":7948154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003209"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467259+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:48:06.467259+0000","last_peered":"2024-08-02T18:48:06.467259+0000","last_clean":"2024-08-02T18:48:06.467259+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:48:06.467259+0000","last_undegraded":"2024-08-02T18:48:06.467259+0000","last_fullsized":"2024-08-02T18:48:06.467259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.479265+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:48:06.479265+0000","last_peered":"2024-08-02T18:48:06.479265+0000","last_clean":"2024-08-02T18:48:06.479265+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:48:06.479265+0000","last_undegraded":"2024-08-02T18:48:06.479265+0000","last_fullsized":"2024-08-02T18:48:06.479265+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466753+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:48:06.466753+0000","last_peered":"2024-08-02T18:48:06.466753+0000","last_clean":"2024-08-02T18:48:06.466753+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:48:06.466753+0000","last_undegraded":"2024-08-02T18:48:06.466753+0000","last_fullsized":"2024-08-02T18:48:06.466753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471873+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:48:06.471873+0000","last_peered":"2024-08-02T18:48:06.471873+0000","last_clean":"2024-08-02T18:48:06.471873+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:48:06.471873+0000","last_undegraded":"2024-08-02T18:48:06.471873+0000","last_fullsized":"2024-08-02T18:48:06.471873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470243+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:48:06.470243+0000","last_peered":"2024-08-02T18:48:06.470243+0000","last_clean":"2024-08-02T18:48:06.470243+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:48:06.470243+0000","last_undegraded":"2024-08-02T18:48:06.470243+0000","last_fullsized":"2024-08-02T18:48:06.470243+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468214+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:48:06.468214+0000","last_peered":"2024-08-02T18:48:06.468214+0000","last_clean":"2024-08-02T18:48:06.468214+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:48:06.468214+0000","last_undegraded":"2024-08-02T18:48:06.468214+0000","last_fullsized":"2024-08-02T18:48:06.468214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478787+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:48:06.478787+0000","last_peered":"2024-08-02T18:48:06.478787+0000","last_clean":"2024-08-02T18:48:06.478787+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:48:06.478787+0000","last_undegraded":"2024-08-02T18:48:06.478787+0000","last_fullsized":"2024-08-02T18:48:06.478787+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857372+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:48:06.857372+0000","last_peered":"2024-08-02T18:48:06.857372+0000","last_clean":"2024-08-02T18:48:06.857372+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:48:06.857372+0000","last_undegraded":"2024-08-02T18:48:06.857372+0000","last_fullsized":"2024-08-02T18:48:06.857372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468363+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:48:06.468363+0000","last_peered":"2024-08-02T18:48:06.468363+0000","last_clean":"2024-08-02T18:48:06.468363+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:48:06.468363+0000","last_undegraded":"2024-08-02T18:48:06.468363+0000","last_fullsized":"2024-08-02T18:48:06.468363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472850+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:48:06.472850+0000","last_peered":"2024-08-02T18:48:06.472850+0000","last_clean":"2024-08-02T18:48:06.472850+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:48:06.472850+0000","last_undegraded":"2024-08-02T18:48:06.472850+0000","last_fullsized":"2024-08-02T18:48:06.472850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476328+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:48:06.476328+0000","last_peered":"2024-08-02T18:48:06.476328+0000","last_clean":"2024-08-02T18:48:06.476328+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:48:06.476328+0000","last_undegraded":"2024-08-02T18:48:06.476328+0000","last_fullsized":"2024-08-02T18:48:06.476328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469154+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:48:06.469154+0000","last_peered":"2024-08-02T18:48:06.469154+0000","last_clean":"2024-08-02T18:48:06.469154+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:48:06.469154+0000","last_undegraded":"2024-08-02T18:48:06.469154+0000","last_fullsized":"2024-08-02T18:48:06.469154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466908+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:48:06.466908+0000","last_peered":"2024-08-02T18:48:06.466908+0000","last_clean":"2024-08-02T18:48:06.466908+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:48:06.466908+0000","last_undegraded":"2024-08-02T18:48:06.466908+0000","last_fullsized":"2024-08-02T18:48:06.466908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472334+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:48:06.472334+0000","last_peered":"2024-08-02T18:48:06.472334+0000","last_clean":"2024-08-02T18:48:06.472334+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:48:06.472334+0000","last_undegraded":"2024-08-02T18:48:06.472334+0000","last_fullsized":"2024-08-02T18:48:06.472334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468348+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:48:06.468348+0000","last_peered":"2024-08-02T18:48:06.468348+0000","last_clean":"2024-08-02T18:48:06.468348+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:48:06.468348+0000","last_undegraded":"2024-08-02T18:48:06.468348+0000","last_fullsized":"2024-08-02T18:48:06.468348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471227+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:48:06.471227+0000","last_peered":"2024-08-02T18:48:06.471227+0000","last_clean":"2024-08-02T18:48:06.471227+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:48:06.471227+0000","last_undegraded":"2024-08-02T18:48:06.471227+0000","last_fullsized":"2024-08-02T18:48:06.471227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467420+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:48:06.467420+0000","last_peered":"2024-08-02T18:48:06.467420+0000","last_clean":"2024-08-02T18:48:06.467420+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:48:06.467420+0000","last_undegraded":"2024-08-02T18:48:06.467420+0000","last_fullsized":"2024-08-02T18:48:06.467420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468674+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:48:06.468674+0000","last_peered":"2024-08-02T18:48:06.468674+0000","last_clean":"2024-08-02T18:48:06.468674+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:48:06.468674+0000","last_undegraded":"2024-08-02T18:48:06.468674+0000","last_fullsized":"2024-08-02T18:48:06.468674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468642+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:48:06.468642+0000","last_peered":"2024-08-02T18:48:06.468642+0000","last_clean":"2024-08-02T18:48:06.468642+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:48:06.468642+0000","last_undegraded":"2024-08-02T18:48:06.468642+0000","last_fullsized":"2024-08-02T18:48:06.468642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471807+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:48:06.471807+0000","last_peered":"2024-08-02T18:48:06.471807+0000","last_clean":"2024-08-02T18:48:06.471807+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:48:06.471807+0000","last_undegraded":"2024-08-02T18:48:06.471807+0000","last_fullsized":"2024-08-02T18:48:06.471807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466974+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:48:06.466974+0000","last_peered":"2024-08-02T18:48:06.466974+0000","last_clean":"2024-08-02T18:48:06.466974+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:48:06.466974+0000","last_undegraded":"2024-08-02T18:48:06.466974+0000","last_fullsized":"2024-08-02T18:48:06.466974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472170+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:48:06.472170+0000","last_peered":"2024-08-02T18:48:06.472170+0000","last_clean":"2024-08-02T18:48:06.472170+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:48:06.472170+0000","last_undegraded":"2024-08-02T18:48:06.472170+0000","last_fullsized":"2024-08-02T18:48:06.472170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857187+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:48:06.857187+0000","last_peered":"2024-08-02T18:48:06.857187+0000","last_clean":"2024-08-02T18:48:06.857187+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:48:06.857187+0000","last_undegraded":"2024-08-02T18:48:06.857187+0000","last_fullsized":"2024-08-02T18:48:06.857187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478332+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:48:06.478332+0000","last_peered":"2024-08-02T18:48:06.478332+0000","last_clean":"2024-08-02T18:48:06.478332+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:48:06.478332+0000","last_undegraded":"2024-08-02T18:48:06.478332+0000","last_fullsized":"2024-08-02T18:48:06.478332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475960+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:48:06.475960+0000","last_peered":"2024-08-02T18:48:06.475960+0000","last_clean":"2024-08-02T18:48:06.475960+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:48:06.475960+0000","last_undegraded":"2024-08-02T18:48:06.475960+0000","last_fullsized":"2024-08-02T18:48:06.475960+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469266+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:48:06.469266+0000","last_peered":"2024-08-02T18:48:06.469266+0000","last_clean":"2024-08-02T18:48:06.469266+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:48:06.469266+0000","last_undegraded":"2024-08-02T18:48:06.469266+0000","last_fullsized":"2024-08-02T18:48:06.469266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467032+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:48:06.467032+0000","last_peered":"2024-08-02T18:48:06.467032+0000","last_clean":"2024-08-02T18:48:06.467032+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:48:06.467032+0000","last_undegraded":"2024-08-02T18:48:06.467032+0000","last_fullsized":"2024-08-02T18:48:06.467032+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471463+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:48:06.471463+0000","last_peered":"2024-08-02T18:48:06.471463+0000","last_clean":"2024-08-02T18:48:06.471463+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:48:06.471463+0000","last_undegraded":"2024-08-02T18:48:06.471463+0000","last_fullsized":"2024-08-02T18:48:06.471463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'12","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:18.330233+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:48:18.330233+0000","last_peered":"2024-08-02T18:48:18.330233+0000","last_clean":"2024-08-02T18:48:18.330233+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:48:18.330233+0000","last_undegraded":"2024-08-02T18:48:18.330233+0000","last_fullsized":"2024-08-02T18:48:18.330233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471002+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:48:06.471002+0000","last_peered":"2024-08-02T18:48:06.471002+0000","last_clean":"2024-08-02T18:48:06.471002+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:48:06.471002+0000","last_undegraded":"2024-08-02T18:48:06.471002+0000","last_fullsized":"2024-08-02T18:48:06.471002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475418+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:48:06.475418+0000","last_peered":"2024-08-02T18:48:06.475418+0000","last_clean":"2024-08-02T18:48:06.475418+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:48:06.475418+0000","last_undegraded":"2024-08-02T18:48:06.475418+0000","last_fullsized":"2024-08-02T18:48:06.475418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472995+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:48:06.472995+0000","last_peered":"2024-08-02T18:48:06.472995+0000","last_clean":"2024-08-02T18:48:06.472995+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:48:06.472995+0000","last_undegraded":"2024-08-02T18:48:06.472995+0000","last_fullsized":"2024-08-02T18:48:06.472995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469428+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:48:06.469428+0000","last_peered":"2024-08-02T18:48:06.469428+0000","last_clean":"2024-08-02T18:48:06.469428+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:48:06.469428+0000","last_undegraded":"2024-08-02T18:48:06.469428+0000","last_fullsized":"2024-08-02T18:48:06.469428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470281+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:48:06.470281+0000","last_peered":"2024-08-02T18:48:06.470281+0000","last_clean":"2024-08-02T18:48:06.470281+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:48:06.470281+0000","last_undegraded":"2024-08-02T18:48:06.470281+0000","last_fullsized":"2024-08-02T18:48:06.470281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466380+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:48:06.466380+0000","last_peered":"2024-08-02T18:48:06.466380+0000","last_clean":"2024-08-02T18:48:06.466380+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:48:06.466380+0000","last_undegraded":"2024-08-02T18:48:06.466380+0000","last_fullsized":"2024-08-02T18:48:06.466380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472334+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:48:06.472334+0000","last_peered":"2024-08-02T18:48:06.472334+0000","last_clean":"2024-08-02T18:48:06.472334+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:48:06.472334+0000","last_undegraded":"2024-08-02T18:48:06.472334+0000","last_fullsized":"2024-08-02T18:48:06.472334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470170+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:48:06.470170+0000","last_peered":"2024-08-02T18:48:06.470170+0000","last_clean":"2024-08-02T18:48:06.470170+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:48:06.470170+0000","last_undegraded":"2024-08-02T18:48:06.470170+0000","last_fullsized":"2024-08-02T18:48:06.470170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467096+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:48:06.467096+0000","last_peered":"2024-08-02T18:48:06.467096+0000","last_clean":"2024-08-02T18:48:06.467096+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:48:06.467096+0000","last_undegraded":"2024-08-02T18:48:06.467096+0000","last_fullsized":"2024-08-02T18:48:06.467096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475268+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:48:06.475268+0000","last_peered":"2024-08-02T18:48:06.475268+0000","last_clean":"2024-08-02T18:48:06.475268+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:48:06.475268+0000","last_undegraded":"2024-08-02T18:48:06.475268+0000","last_fullsized":"2024-08-02T18:48:06.475268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476482+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:48:06.476482+0000","last_peered":"2024-08-02T18:48:06.476482+0000","last_clean":"2024-08-02T18:48:06.476482+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:48:06.476482+0000","last_undegraded":"2024-08-02T18:48:06.476482+0000","last_fullsized":"2024-08-02T18:48:06.476482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":89,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:53.539800+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:48:53.539800+0000","last_peered":"2024-08-02T18:48:53.539800+0000","last_clean":"2024-08-02T18:48:53.539800+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:48:53.539800+0000","last_undegraded":"2024-08-02T18:48:53.539800+0000","last_fullsized":"2024-08-02T18:48:53.539800+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475578+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:48:06.475578+0000","last_peered":"2024-08-02T18:48:06.475578+0000","last_clean":"2024-08-02T18:48:06.475578+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:48:06.475578+0000","last_undegraded":"2024-08-02T18:48:06.475578+0000","last_fullsized":"2024-08-02T18:48:06.475578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474772+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:48:06.474772+0000","last_peered":"2024-08-02T18:48:06.474772+0000","last_clean":"2024-08-02T18:48:06.474772+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:48:06.474772+0000","last_undegraded":"2024-08-02T18:48:06.474772+0000","last_fullsized":"2024-08-02T18:48:06.474772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466844+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:48:06.466844+0000","last_peered":"2024-08-02T18:48:06.466844+0000","last_clean":"2024-08-02T18:48:06.466844+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:48:06.466844+0000","last_undegraded":"2024-08-02T18:48:06.466844+0000","last_fullsized":"2024-08-02T18:48:06.466844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476640+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:48:06.476640+0000","last_peered":"2024-08-02T18:48:06.476640+0000","last_clean":"2024-08-02T18:48:06.476640+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:48:06.476640+0000","last_undegraded":"2024-08-02T18:48:06.476640+0000","last_fullsized":"2024-08-02T18:48:06.476640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471153+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:48:06.471153+0000","last_peered":"2024-08-02T18:48:06.471153+0000","last_clean":"2024-08-02T18:48:06.471153+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:48:06.471153+0000","last_undegraded":"2024-08-02T18:48:06.471153+0000","last_fullsized":"2024-08-02T18:48:06.471153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468846+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:48:06.468846+0000","last_peered":"2024-08-02T18:48:06.468846+0000","last_clean":"2024-08-02T18:48:06.468846+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:48:06.468846+0000","last_undegraded":"2024-08-02T18:48:06.468846+0000","last_fullsized":"2024-08-02T18:48:06.468846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466987+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:48:06.466987+0000","last_peered":"2024-08-02T18:48:06.466987+0000","last_clean":"2024-08-02T18:48:06.466987+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:48:06.466987+0000","last_undegraded":"2024-08-02T18:48:06.466987+0000","last_fullsized":"2024-08-02T18:48:06.466987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467297+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:48:06.467297+0000","last_peered":"2024-08-02T18:48:06.467297+0000","last_clean":"2024-08-02T18:48:06.467297+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:48:06.467297+0000","last_undegraded":"2024-08-02T18:48:06.467297+0000","last_fullsized":"2024-08-02T18:48:06.467297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467403+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:48:06.467403+0000","last_peered":"2024-08-02T18:48:06.467403+0000","last_clean":"2024-08-02T18:48:06.467403+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:48:06.467403+0000","last_undegraded":"2024-08-02T18:48:06.467403+0000","last_fullsized":"2024-08-02T18:48:06.467403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468158+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:48:06.468158+0000","last_peered":"2024-08-02T18:48:06.468158+0000","last_clean":"2024-08-02T18:48:06.468158+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:48:06.468158+0000","last_undegraded":"2024-08-02T18:48:06.468158+0000","last_fullsized":"2024-08-02T18:48:06.468158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857189+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:48:06.857189+0000","last_peered":"2024-08-02T18:48:06.857189+0000","last_clean":"2024-08-02T18:48:06.857189+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:48:06.857189+0000","last_undegraded":"2024-08-02T18:48:06.857189+0000","last_fullsized":"2024-08-02T18:48:06.857189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467131+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:48:06.467131+0000","last_peered":"2024-08-02T18:48:06.467131+0000","last_clean":"2024-08-02T18:48:06.467131+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:48:06.467131+0000","last_undegraded":"2024-08-02T18:48:06.467131+0000","last_fullsized":"2024-08-02T18:48:06.467131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476651+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:48:06.476651+0000","last_peered":"2024-08-02T18:48:06.476651+0000","last_clean":"2024-08-02T18:48:06.476651+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:48:06.476651+0000","last_undegraded":"2024-08-02T18:48:06.476651+0000","last_fullsized":"2024-08-02T18:48:06.476651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469891+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:48:06.469891+0000","last_peered":"2024-08-02T18:48:06.469891+0000","last_clean":"2024-08-02T18:48:06.469891+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:48:06.469891+0000","last_undegraded":"2024-08-02T18:48:06.469891+0000","last_fullsized":"2024-08-02T18:48:06.469891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467502+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:48:06.467502+0000","last_peered":"2024-08-02T18:48:06.467502+0000","last_clean":"2024-08-02T18:48:06.467502+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:48:06.467502+0000","last_undegraded":"2024-08-02T18:48:06.467502+0000","last_fullsized":"2024-08-02T18:48:06.467502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475786+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:48:06.475786+0000","last_peered":"2024-08-02T18:48:06.475786+0000","last_clean":"2024-08-02T18:48:06.475786+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:48:06.475786+0000","last_undegraded":"2024-08-02T18:48:06.475786+0000","last_fullsized":"2024-08-02T18:48:06.475786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475721+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:48:06.475721+0000","last_peered":"2024-08-02T18:48:06.475721+0000","last_clean":"2024-08-02T18:48:06.475721+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:48:06.475721+0000","last_undegraded":"2024-08-02T18:48:06.475721+0000","last_fullsized":"2024-08-02T18:48:06.475721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468919+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:48:06.468919+0000","last_peered":"2024-08-02T18:48:06.468919+0000","last_clean":"2024-08-02T18:48:06.468919+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:48:06.468919+0000","last_undegraded":"2024-08-02T18:48:06.468919+0000","last_fullsized":"2024-08-02T18:48:06.468919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473065+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:48:06.473065+0000","last_peered":"2024-08-02T18:48:06.473065+0000","last_clean":"2024-08-02T18:48:06.473065+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:48:06.473065+0000","last_undegraded":"2024-08-02T18:48:06.473065+0000","last_fullsized":"2024-08-02T18:48:06.473065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475791+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:48:06.475791+0000","last_peered":"2024-08-02T18:48:06.475791+0000","last_clean":"2024-08-02T18:48:06.475791+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:48:06.475791+0000","last_undegraded":"2024-08-02T18:48:06.475791+0000","last_fullsized":"2024-08-02T18:48:06.475791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475922+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:48:06.475922+0000","last_peered":"2024-08-02T18:48:06.475922+0000","last_clean":"2024-08-02T18:48:06.475922+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:48:06.475922+0000","last_undegraded":"2024-08-02T18:48:06.475922+0000","last_fullsized":"2024-08-02T18:48:06.475922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472152+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:48:06.472152+0000","last_peered":"2024-08-02T18:48:06.472152+0000","last_clean":"2024-08-02T18:48:06.472152+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:48:06.472152+0000","last_undegraded":"2024-08-02T18:48:06.472152+0000","last_fullsized":"2024-08-02T18:48:06.472152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475691+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:48:06.475691+0000","last_peered":"2024-08-02T18:48:06.475691+0000","last_clean":"2024-08-02T18:48:06.475691+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:48:06.475691+0000","last_undegraded":"2024-08-02T18:48:06.475691+0000","last_fullsized":"2024-08-02T18:48:06.475691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466616+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:48:06.466616+0000","last_peered":"2024-08-02T18:48:06.466616+0000","last_clean":"2024-08-02T18:48:06.466616+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:48:06.466616+0000","last_undegraded":"2024-08-02T18:48:06.466616+0000","last_fullsized":"2024-08-02T18:48:06.466616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'3","reported_seq":90,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:53.540605+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:48:53.540605+0000","last_peered":"2024-08-02T18:48:53.540605+0000","last_clean":"2024-08-02T18:48:53.540605+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:48:53.540605+0000","last_undegraded":"2024-08-02T18:48:53.540605+0000","last_fullsized":"2024-08-02T18:48:53.540605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467063+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:48:06.467063+0000","last_peered":"2024-08-02T18:48:06.467063+0000","last_clean":"2024-08-02T18:48:06.467063+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:48:06.467063+0000","last_undegraded":"2024-08-02T18:48:06.467063+0000","last_fullsized":"2024-08-02T18:48:06.467063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467254+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:48:06.467254+0000","last_peered":"2024-08-02T18:48:06.467254+0000","last_clean":"2024-08-02T18:48:06.467254+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:48:06.467254+0000","last_undegraded":"2024-08-02T18:48:06.467254+0000","last_fullsized":"2024-08-02T18:48:06.467254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476845+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:48:06.476845+0000","last_peered":"2024-08-02T18:48:06.476845+0000","last_clean":"2024-08-02T18:48:06.476845+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:48:06.476845+0000","last_undegraded":"2024-08-02T18:48:06.476845+0000","last_fullsized":"2024-08-02T18:48:06.476845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468624+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:48:06.468624+0000","last_peered":"2024-08-02T18:48:06.468624+0000","last_clean":"2024-08-02T18:48:06.468624+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:48:06.468624+0000","last_undegraded":"2024-08-02T18:48:06.468624+0000","last_fullsized":"2024-08-02T18:48:06.468624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474919+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:48:06.474919+0000","last_peered":"2024-08-02T18:48:06.474919+0000","last_clean":"2024-08-02T18:48:06.474919+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:48:06.474919+0000","last_undegraded":"2024-08-02T18:48:06.474919+0000","last_fullsized":"2024-08-02T18:48:06.474919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.485388+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:48:06.485388+0000","last_peered":"2024-08-02T18:48:06.485388+0000","last_clean":"2024-08-02T18:48:06.485388+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:48:06.485388+0000","last_undegraded":"2024-08-02T18:48:06.485388+0000","last_fullsized":"2024-08-02T18:48:06.485388+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476167+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:48:06.476167+0000","last_peered":"2024-08-02T18:48:06.476167+0000","last_clean":"2024-08-02T18:48:06.476167+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:48:06.476167+0000","last_undegraded":"2024-08-02T18:48:06.476167+0000","last_fullsized":"2024-08-02T18:48:06.476167+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472835+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:48:06.472835+0000","last_peered":"2024-08-02T18:48:06.472835+0000","last_clean":"2024-08-02T18:48:06.472835+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:48:06.472835+0000","last_undegraded":"2024-08-02T18:48:06.472835+0000","last_fullsized":"2024-08-02T18:48:06.472835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":184,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:57.547366+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:48:57.547366+0000","last_peered":"2024-08-02T18:48:57.547366+0000","last_clean":"2024-08-02T18:48:57.547366+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:48:57.547366+0000","last_undegraded":"2024-08-02T18:48:57.547366+0000","last_fullsized":"2024-08-02T18:48:57.547366+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64058,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":122,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465906+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:48:06.465906+0000","last_peered":"2024-08-02T18:48:06.465906+0000","last_clean":"2024-08-02T18:48:06.465906+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:48:06.465906+0000","last_undegraded":"2024-08-02T18:48:06.465906+0000","last_fullsized":"2024-08-02T18:48:06.465906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857426+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:48:06.857426+0000","last_peered":"2024-08-02T18:48:06.857426+0000","last_clean":"2024-08-02T18:48:06.857426+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:48:06.857426+0000","last_undegraded":"2024-08-02T18:48:06.857426+0000","last_fullsized":"2024-08-02T18:48:06.857426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476504+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:48:06.476504+0000","last_peered":"2024-08-02T18:48:06.476504+0000","last_clean":"2024-08-02T18:48:06.476504+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:48:06.476504+0000","last_undegraded":"2024-08-02T18:48:06.476504+0000","last_fullsized":"2024-08-02T18:48:06.476504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468616+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:48:06.468616+0000","last_peered":"2024-08-02T18:48:06.468616+0000","last_clean":"2024-08-02T18:48:06.468616+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:48:06.468616+0000","last_undegraded":"2024-08-02T18:48:06.468616+0000","last_fullsized":"2024-08-02T18:48:06.468616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470496+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:48:06.470496+0000","last_peered":"2024-08-02T18:48:06.470496+0000","last_clean":"2024-08-02T18:48:06.470496+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:48:06.470496+0000","last_undegraded":"2024-08-02T18:48:06.470496+0000","last_fullsized":"2024-08-02T18:48:06.470496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467216+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:48:06.467216+0000","last_peered":"2024-08-02T18:48:06.467216+0000","last_clean":"2024-08-02T18:48:06.467216+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:48:06.467216+0000","last_undegraded":"2024-08-02T18:48:06.467216+0000","last_fullsized":"2024-08-02T18:48:06.467216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465752+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:48:06.465752+0000","last_peered":"2024-08-02T18:48:06.465752+0000","last_clean":"2024-08-02T18:48:06.465752+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:48:06.465752+0000","last_undegraded":"2024-08-02T18:48:06.465752+0000","last_fullsized":"2024-08-02T18:48:06.465752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857610+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:48:06.857610+0000","last_peered":"2024-08-02T18:48:06.857610+0000","last_clean":"2024-08-02T18:48:06.857610+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:48:06.857610+0000","last_undegraded":"2024-08-02T18:48:06.857610+0000","last_fullsized":"2024-08-02T18:48:06.857610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:56.546684+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:48:56.546684+0000","last_peered":"2024-08-02T18:48:56.546684+0000","last_clean":"2024-08-02T18:48:56.546684+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:48:56.546684+0000","last_undegraded":"2024-08-02T18:48:56.546684+0000","last_fullsized":"2024-08-02T18:48:56.546684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471007+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:48:06.471007+0000","last_peered":"2024-08-02T18:48:06.471007+0000","last_clean":"2024-08-02T18:48:06.471007+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:48:06.471007+0000","last_undegraded":"2024-08-02T18:48:06.471007+0000","last_fullsized":"2024-08-02T18:48:06.471007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469865+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:48:06.469865+0000","last_peered":"2024-08-02T18:48:06.469865+0000","last_clean":"2024-08-02T18:48:06.469865+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:48:06.469865+0000","last_undegraded":"2024-08-02T18:48:06.469865+0000","last_fullsized":"2024-08-02T18:48:06.469865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465865+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:48:06.465865+0000","last_peered":"2024-08-02T18:48:06.465865+0000","last_clean":"2024-08-02T18:48:06.465865+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:48:06.465865+0000","last_undegraded":"2024-08-02T18:48:06.465865+0000","last_fullsized":"2024-08-02T18:48:06.465865+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476710+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:48:06.476710+0000","last_peered":"2024-08-02T18:48:06.476710+0000","last_clean":"2024-08-02T18:48:06.476710+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:48:06.476710+0000","last_undegraded":"2024-08-02T18:48:06.476710+0000","last_fullsized":"2024-08-02T18:48:06.476710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474720+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:48:06.474720+0000","last_peered":"2024-08-02T18:48:06.474720+0000","last_clean":"2024-08-02T18:48:06.474720+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:48:06.474720+0000","last_undegraded":"2024-08-02T18:48:06.474720+0000","last_fullsized":"2024-08-02T18:48:06.474720+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471153+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:48:06.471153+0000","last_peered":"2024-08-02T18:48:06.471153+0000","last_clean":"2024-08-02T18:48:06.471153+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:48:06.471153+0000","last_undegraded":"2024-08-02T18:48:06.471153+0000","last_fullsized":"2024-08-02T18:48:06.471153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474786+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:48:06.474786+0000","last_peered":"2024-08-02T18:48:06.474786+0000","last_clean":"2024-08-02T18:48:06.474786+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:48:06.474786+0000","last_undegraded":"2024-08-02T18:48:06.474786+0000","last_fullsized":"2024-08-02T18:48:06.474786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470163+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:48:06.470163+0000","last_peered":"2024-08-02T18:48:06.470163+0000","last_clean":"2024-08-02T18:48:06.470163+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:48:06.470163+0000","last_undegraded":"2024-08-02T18:48:06.470163+0000","last_fullsized":"2024-08-02T18:48:06.470163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473185+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:48:06.473185+0000","last_peered":"2024-08-02T18:48:06.473185+0000","last_clean":"2024-08-02T18:48:06.473185+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:48:06.473185+0000","last_undegraded":"2024-08-02T18:48:06.473185+0000","last_fullsized":"2024-08-02T18:48:06.473185+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478161+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:48:06.478161+0000","last_peered":"2024-08-02T18:48:06.478161+0000","last_clean":"2024-08-02T18:48:06.478161+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:48:06.478161+0000","last_undegraded":"2024-08-02T18:48:06.478161+0000","last_fullsized":"2024-08-02T18:48:06.478161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:54.544906+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:48:54.544906+0000","last_peered":"2024-08-02T18:48:54.544906+0000","last_clean":"2024-08-02T18:48:54.544906+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:48:54.544906+0000","last_undegraded":"2024-08-02T18:48:54.544906+0000","last_fullsized":"2024-08-02T18:48:54.544906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472468+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:48:06.472468+0000","last_peered":"2024-08-02T18:48:06.472468+0000","last_clean":"2024-08-02T18:48:06.472468+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:48:06.472468+0000","last_undegraded":"2024-08-02T18:48:06.472468+0000","last_fullsized":"2024-08-02T18:48:06.472468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467180+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:48:06.467180+0000","last_peered":"2024-08-02T18:48:06.467180+0000","last_clean":"2024-08-02T18:48:06.467180+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:48:06.467180+0000","last_undegraded":"2024-08-02T18:48:06.467180+0000","last_fullsized":"2024-08-02T18:48:06.467180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468760+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:48:06.468760+0000","last_peered":"2024-08-02T18:48:06.468760+0000","last_clean":"2024-08-02T18:48:06.468760+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:48:06.468760+0000","last_undegraded":"2024-08-02T18:48:06.468760+0000","last_fullsized":"2024-08-02T18:48:06.468760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467581+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:48:06.467581+0000","last_peered":"2024-08-02T18:48:06.467581+0000","last_clean":"2024-08-02T18:48:06.467581+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:48:06.467581+0000","last_undegraded":"2024-08-02T18:48:06.467581+0000","last_fullsized":"2024-08-02T18:48:06.467581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467303+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:48:06.467303+0000","last_peered":"2024-08-02T18:48:06.467303+0000","last_clean":"2024-08-02T18:48:06.467303+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:48:06.467303+0000","last_undegraded":"2024-08-02T18:48:06.467303+0000","last_fullsized":"2024-08-02T18:48:06.467303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469987+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:48:06.469987+0000","last_peered":"2024-08-02T18:48:06.469987+0000","last_clean":"2024-08-02T18:48:06.469987+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:48:06.469987+0000","last_undegraded":"2024-08-02T18:48:06.469987+0000","last_fullsized":"2024-08-02T18:48:06.469987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475366+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:48:06.475366+0000","last_peered":"2024-08-02T18:48:06.475366+0000","last_clean":"2024-08-02T18:48:06.475366+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:48:06.475366+0000","last_undegraded":"2024-08-02T18:48:06.475366+0000","last_fullsized":"2024-08-02T18:48:06.475366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470004+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:48:06.470004+0000","last_peered":"2024-08-02T18:48:06.470004+0000","last_clean":"2024-08-02T18:48:06.470004+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:48:06.470004+0000","last_undegraded":"2024-08-02T18:48:06.470004+0000","last_fullsized":"2024-08-02T18:48:06.470004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468267+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:48:06.468267+0000","last_peered":"2024-08-02T18:48:06.468267+0000","last_clean":"2024-08-02T18:48:06.468267+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:48:06.468267+0000","last_undegraded":"2024-08-02T18:48:06.468267+0000","last_fullsized":"2024-08-02T18:48:06.468267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471381+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:48:06.471381+0000","last_peered":"2024-08-02T18:48:06.471381+0000","last_clean":"2024-08-02T18:48:06.471381+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:48:06.471381+0000","last_undegraded":"2024-08-02T18:48:06.471381+0000","last_fullsized":"2024-08-02T18:48:06.471381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476371+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:48:06.476371+0000","last_peered":"2024-08-02T18:48:06.476371+0000","last_clean":"2024-08-02T18:48:06.476371+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:48:06.476371+0000","last_undegraded":"2024-08-02T18:48:06.476371+0000","last_fullsized":"2024-08-02T18:48:06.476371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471171+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:48:06.471171+0000","last_peered":"2024-08-02T18:48:06.471171+0000","last_clean":"2024-08-02T18:48:06.471171+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:48:06.471171+0000","last_undegraded":"2024-08-02T18:48:06.471171+0000","last_fullsized":"2024-08-02T18:48:06.471171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857311+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:48:06.857311+0000","last_peered":"2024-08-02T18:48:06.857311+0000","last_clean":"2024-08-02T18:48:06.857311+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:48:06.857311+0000","last_undegraded":"2024-08-02T18:48:06.857311+0000","last_fullsized":"2024-08-02T18:48:06.857311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475156+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:48:06.475156+0000","last_peered":"2024-08-02T18:48:06.475156+0000","last_clean":"2024-08-02T18:48:06.475156+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:48:06.475156+0000","last_undegraded":"2024-08-02T18:48:06.475156+0000","last_fullsized":"2024-08-02T18:48:06.475156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468795+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:48:06.468795+0000","last_peered":"2024-08-02T18:48:06.468795+0000","last_clean":"2024-08-02T18:48:06.468795+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:48:06.468795+0000","last_undegraded":"2024-08-02T18:48:06.468795+0000","last_fullsized":"2024-08-02T18:48:06.468795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467620+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:48:06.467620+0000","last_peered":"2024-08-02T18:48:06.467620+0000","last_clean":"2024-08-02T18:48:06.467620+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:48:06.467620+0000","last_undegraded":"2024-08-02T18:48:06.467620+0000","last_fullsized":"2024-08-02T18:48:06.467620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466617+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:48:06.466617+0000","last_peered":"2024-08-02T18:48:06.466617+0000","last_clean":"2024-08-02T18:48:06.466617+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:48:06.466617+0000","last_undegraded":"2024-08-02T18:48:06.466617+0000","last_fullsized":"2024-08-02T18:48:06.466617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469489+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:48:06.469489+0000","last_peered":"2024-08-02T18:48:06.469489+0000","last_clean":"2024-08-02T18:48:06.469489+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:48:06.469489+0000","last_undegraded":"2024-08-02T18:48:06.469489+0000","last_fullsized":"2024-08-02T18:48:06.469489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857053+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:48:06.857053+0000","last_peered":"2024-08-02T18:48:06.857053+0000","last_clean":"2024-08-02T18:48:06.857053+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:48:06.857053+0000","last_undegraded":"2024-08-02T18:48:06.857053+0000","last_fullsized":"2024-08-02T18:48:06.857053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470006+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:48:06.470006+0000","last_peered":"2024-08-02T18:48:06.470006+0000","last_clean":"2024-08-02T18:48:06.470006+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:48:06.470006+0000","last_undegraded":"2024-08-02T18:48:06.470006+0000","last_fullsized":"2024-08-02T18:48:06.470006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469719+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:48:06.469719+0000","last_peered":"2024-08-02T18:48:06.469719+0000","last_clean":"2024-08-02T18:48:06.469719+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:48:06.469719+0000","last_undegraded":"2024-08-02T18:48:06.469719+0000","last_fullsized":"2024-08-02T18:48:06.469719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475155+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:48:06.475155+0000","last_peered":"2024-08-02T18:48:06.475155+0000","last_clean":"2024-08-02T18:48:06.475155+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:48:06.475155+0000","last_undegraded":"2024-08-02T18:48:06.475155+0000","last_fullsized":"2024-08-02T18:48:06.475155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468906+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:48:06.468906+0000","last_peered":"2024-08-02T18:48:06.468906+0000","last_clean":"2024-08-02T18:48:06.468906+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:48:06.468906+0000","last_undegraded":"2024-08-02T18:48:06.468906+0000","last_fullsized":"2024-08-02T18:48:06.468906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467663+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:48:06.467663+0000","last_peered":"2024-08-02T18:48:06.467663+0000","last_clean":"2024-08-02T18:48:06.467663+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:48:06.467663+0000","last_undegraded":"2024-08-02T18:48:06.467663+0000","last_fullsized":"2024-08-02T18:48:06.467663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470984+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:48:06.470984+0000","last_peered":"2024-08-02T18:48:06.470984+0000","last_clean":"2024-08-02T18:48:06.470984+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:48:06.470984+0000","last_undegraded":"2024-08-02T18:48:06.470984+0000","last_fullsized":"2024-08-02T18:48:06.470984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857678+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:48:06.857678+0000","last_peered":"2024-08-02T18:48:06.857678+0000","last_clean":"2024-08-02T18:48:06.857678+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:48:06.857678+0000","last_undegraded":"2024-08-02T18:48:06.857678+0000","last_fullsized":"2024-08-02T18:48:06.857678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471116+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:48:06.471116+0000","last_peered":"2024-08-02T18:48:06.471116+0000","last_clean":"2024-08-02T18:48:06.471116+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:48:06.471116+0000","last_undegraded":"2024-08-02T18:48:06.471116+0000","last_fullsized":"2024-08-02T18:48:06.471116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466723+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:48:06.466723+0000","last_peered":"2024-08-02T18:48:06.466723+0000","last_clean":"2024-08-02T18:48:06.466723+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:48:06.466723+0000","last_undegraded":"2024-08-02T18:48:06.466723+0000","last_fullsized":"2024-08-02T18:48:06.466723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470038+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:48:06.470038+0000","last_peered":"2024-08-02T18:48:06.470038+0000","last_clean":"2024-08-02T18:48:06.470038+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:48:06.470038+0000","last_undegraded":"2024-08-02T18:48:06.470038+0000","last_fullsized":"2024-08-02T18:48:06.470038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472226+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:48:06.472226+0000","last_peered":"2024-08-02T18:48:06.472226+0000","last_clean":"2024-08-02T18:48:06.472226+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:48:06.472226+0000","last_undegraded":"2024-08-02T18:48:06.472226+0000","last_fullsized":"2024-08-02T18:48:06.472226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473958+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:48:06.473958+0000","last_peered":"2024-08-02T18:48:06.473958+0000","last_clean":"2024-08-02T18:48:06.473958+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:48:06.473958+0000","last_undegraded":"2024-08-02T18:48:06.473958+0000","last_fullsized":"2024-08-02T18:48:06.473958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469763+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:48:06.469763+0000","last_peered":"2024-08-02T18:48:06.469763+0000","last_clean":"2024-08-02T18:48:06.469763+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:48:06.469763+0000","last_undegraded":"2024-08-02T18:48:06.469763+0000","last_fullsized":"2024-08-02T18:48:06.469763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469968+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:48:06.469968+0000","last_peered":"2024-08-02T18:48:06.469968+0000","last_clean":"2024-08-02T18:48:06.469968+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:48:06.469968+0000","last_undegraded":"2024-08-02T18:48:06.469968+0000","last_fullsized":"2024-08-02T18:48:06.469968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469411+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:48:06.469411+0000","last_peered":"2024-08-02T18:48:06.469411+0000","last_clean":"2024-08-02T18:48:06.469411+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:48:06.469411+0000","last_undegraded":"2024-08-02T18:48:06.469411+0000","last_fullsized":"2024-08-02T18:48:06.469411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68058,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":348,"num_read_kb":247,"num_write":169,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":204174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547233,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":499721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776165,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1151013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939689,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":504019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168623,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":499843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397556,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1622016,"data_stored":1095751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561080,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":495099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822716,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1630208,"data_stored":1091339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986241,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":499749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215173,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":495293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1097728,"data_stored":560773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":559067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":496487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:49:00.197 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-02T18:49:00.451 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:00 smithi121 ceph-mon[37236]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:00.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:00 smithi121 ceph-mon[37236]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:00 smithi151 ceph-mon[37155]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:00.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:00 smithi151 ceph-mon[37155]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:00 smithi103 ceph-mon[32753]: pgmap v316: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:00.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:00 smithi103 ceph-mon[32753]: from='client.15027 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:00.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 -- 172.21.15.103:0/700493249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 msgr2=0x7f76e810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:00.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 --2- 172.21.15.103:0/700493249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 0x7f76e810e780 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f76e0009930 tx=0x7f76e002a420 comp rx=0 tx=0).stop 2024-08-02T18:49:00.943 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 -- 172.21.15.103:0/700493249 shutdown_connections 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 --2- 172.21.15.103:0/700493249 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 0x7f76e810e780 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 --2- 172.21.15.103:0/700493249 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e81018b0 0x7f76e8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 --2- 172.21.15.103:0/700493249 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76e81078b0 0x7f76e8107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 -- 172.21.15.103:0/700493249 >> 172.21.15.103:0/700493249 conn(0x7f76e80fd5f0 msgr2=0x7f76e80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 -- 172.21.15.103:0/700493249 shutdown_connections 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 -- 172.21.15.103:0/700493249 wait complete. 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.938+0000 7f76ecf24640 1 Processor -- start 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76ecf24640 1 -- start start 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76ecf24640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e81018b0 0x7f76e819a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76ecf24640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 0x7f76e819a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:00.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76ecf24640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76e81078b0 0x7f76e819ed10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76ecf24640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8111e30 con 0x7f76e8102250 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76ecf24640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8111cb0 con 0x7f76e81018b0 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76ecf24640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f76e8111fb0 con 0x7f76e81078b0 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 0x7f76e819a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 0x7f76e819a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53216/0 (socket says 172.21.15.103:53216) 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 -- 172.21.15.103:0/2803846430 learned_addr learned my addr 172.21.15.103:0/2803846430 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e659c640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e81018b0 0x7f76e819a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e6d9d640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76e81078b0 0x7f76e819ed10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 -- 172.21.15.103:0/2803846430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76e81078b0 msgr2=0x7f76e819ed10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76e81078b0 0x7f76e819ed10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 -- 172.21.15.103:0/2803846430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e81018b0 msgr2=0x7f76e819a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:00.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e81018b0 0x7f76e819a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 -- 172.21.15.103:0/2803846430 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76e819f3f0 con 0x7f76e8102250 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.939+0000 7f76e5d9b640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 0x7f76e819a980 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00b4a0 tx=0x7f76dc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.940+0000 7f76d77fe640 1 -- 172.21.15.103:0/2803846430 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc014070 con 0x7f76e8102250 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.940+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76e819f6e0 con 0x7f76e8102250 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.940+0000 7f76d77fe640 1 -- 172.21.15.103:0/2803846430 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f76dc010b10 con 0x7f76e8102250 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.940+0000 7f76d77fe640 1 -- 172.21.15.103:0/2803846430 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76dc017d60 con 0x7f76e8102250 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.940+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76e81a6fc0 con 0x7f76e8102250 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.941+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76e8101d10 con 0x7f76e8102250 2024-08-02T18:49:00.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.942+0000 7f76d77fe640 1 -- 172.21.15.103:0/2803846430 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f76dc017070 con 0x7f76e8102250 2024-08-02T18:49:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.943+0000 7f76d77fe640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f76d00a2c10 0x7f76d00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.943+0000 7f76d77fe640 1 -- 172.21.15.103:0/2803846430 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f76dc0ce7c0 con 0x7f76e8102250 2024-08-02T18:49:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.943+0000 7f76e659c640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f76d00a2c10 0x7f76d00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:00.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.943+0000 7f76e659c640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f76d00a2c10 0x7f76d00a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f76d8005fd0 tx=0x7f76d8009680 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:00.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:00.947+0000 7f76d77fe640 1 -- 172.21.15.103:0/2803846430 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f76dc09b370 con 0x7f76e8102250 2024-08-02T18:49:01.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.110+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f76e80fec10 con 0x7f76d00a2c10 2024-08-02T18:49:01.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.118+0000 7f76d77fe640 1 -- 172.21.15.103:0/2803846430 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+340370 (secure 0 0 0) 0x7f76e80fec10 con 0x7f76d00a2c10 2024-08-02T18:49:01.123 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:01.124 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f76d00a2c10 msgr2=0x7f76d00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f76d00a2c10 0x7f76d00a50d0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f76d8005fd0 tx=0x7f76d8009680 comp rx=0 tx=0).stop 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 msgr2=0x7f76e819a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 0x7f76e819a980 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f76dc00b4a0 tx=0x7f76dc00b960 comp rx=0 tx=0).stop 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 shutdown_connections 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f76d00a2c10 0x7f76d00a50d0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f76e81078b0 0x7f76e819ed10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f76e8102250 0x7f76e819a980 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 --2- 172.21.15.103:0/2803846430 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f76e81018b0 0x7f76e819a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 >> 172.21.15.103:0/2803846430 conn(0x7f76e80fd5f0 msgr2=0x7f76e810cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 shutdown_connections 2024-08-02T18:49:01.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:01.121+0000 7f76ecf24640 1 -- 172.21.15.103:0/2803846430 wait complete. 2024-08-02T18:49:01.827 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":316,"stamp":"2024-08-02T18:48:59.355988+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":658660,"num_objects":64,"num_object_clones":0,"num_object_copies":194,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":0,"num_read":484,"num_read_kb":366,"num_write":352,"num_write_kb":3059,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":283,"ondisk_log_size":283,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":375604,"kb_used_data":13952,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124566220,"statfs":{"total":1151940427776,"available":1151555809280,"internally_reserved":0,"allocated":14286848,"data_stored":7948154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":40,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003209"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":44,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467259+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:48:06.467259+0000","last_peered":"2024-08-02T18:48:06.467259+0000","last_clean":"2024-08-02T18:48:06.467259+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:48:06.467259+0000","last_undegraded":"2024-08-02T18:48:06.467259+0000","last_fullsized":"2024-08-02T18:48:06.467259+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.479265+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:48:06.479265+0000","last_peered":"2024-08-02T18:48:06.479265+0000","last_clean":"2024-08-02T18:48:06.479265+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:48:06.479265+0000","last_undegraded":"2024-08-02T18:48:06.479265+0000","last_fullsized":"2024-08-02T18:48:06.479265+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466753+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:48:06.466753+0000","last_peered":"2024-08-02T18:48:06.466753+0000","last_clean":"2024-08-02T18:48:06.466753+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:48:06.466753+0000","last_undegraded":"2024-08-02T18:48:06.466753+0000","last_fullsized":"2024-08-02T18:48:06.466753+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471873+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:48:06.471873+0000","last_peered":"2024-08-02T18:48:06.471873+0000","last_clean":"2024-08-02T18:48:06.471873+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:48:06.471873+0000","last_undegraded":"2024-08-02T18:48:06.471873+0000","last_fullsized":"2024-08-02T18:48:06.471873+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470243+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:48:06.470243+0000","last_peered":"2024-08-02T18:48:06.470243+0000","last_clean":"2024-08-02T18:48:06.470243+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:48:06.470243+0000","last_undegraded":"2024-08-02T18:48:06.470243+0000","last_fullsized":"2024-08-02T18:48:06.470243+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468214+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:48:06.468214+0000","last_peered":"2024-08-02T18:48:06.468214+0000","last_clean":"2024-08-02T18:48:06.468214+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:48:06.468214+0000","last_undegraded":"2024-08-02T18:48:06.468214+0000","last_fullsized":"2024-08-02T18:48:06.468214+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":17,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478787+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:48:06.478787+0000","last_peered":"2024-08-02T18:48:06.478787+0000","last_clean":"2024-08-02T18:48:06.478787+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:48:06.478787+0000","last_undegraded":"2024-08-02T18:48:06.478787+0000","last_fullsized":"2024-08-02T18:48:06.478787+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857372+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:48:06.857372+0000","last_peered":"2024-08-02T18:48:06.857372+0000","last_clean":"2024-08-02T18:48:06.857372+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:48:06.857372+0000","last_undegraded":"2024-08-02T18:48:06.857372+0000","last_fullsized":"2024-08-02T18:48:06.857372+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468363+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:48:06.468363+0000","last_peered":"2024-08-02T18:48:06.468363+0000","last_clean":"2024-08-02T18:48:06.468363+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:48:06.468363+0000","last_undegraded":"2024-08-02T18:48:06.468363+0000","last_fullsized":"2024-08-02T18:48:06.468363+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472850+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:48:06.472850+0000","last_peered":"2024-08-02T18:48:06.472850+0000","last_clean":"2024-08-02T18:48:06.472850+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:48:06.472850+0000","last_undegraded":"2024-08-02T18:48:06.472850+0000","last_fullsized":"2024-08-02T18:48:06.472850+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476328+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:48:06.476328+0000","last_peered":"2024-08-02T18:48:06.476328+0000","last_clean":"2024-08-02T18:48:06.476328+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:48:06.476328+0000","last_undegraded":"2024-08-02T18:48:06.476328+0000","last_fullsized":"2024-08-02T18:48:06.476328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469154+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:48:06.469154+0000","last_peered":"2024-08-02T18:48:06.469154+0000","last_clean":"2024-08-02T18:48:06.469154+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:48:06.469154+0000","last_undegraded":"2024-08-02T18:48:06.469154+0000","last_fullsized":"2024-08-02T18:48:06.469154+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466908+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:48:06.466908+0000","last_peered":"2024-08-02T18:48:06.466908+0000","last_clean":"2024-08-02T18:48:06.466908+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:48:06.466908+0000","last_undegraded":"2024-08-02T18:48:06.466908+0000","last_fullsized":"2024-08-02T18:48:06.466908+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472334+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:48:06.472334+0000","last_peered":"2024-08-02T18:48:06.472334+0000","last_clean":"2024-08-02T18:48:06.472334+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:48:06.472334+0000","last_undegraded":"2024-08-02T18:48:06.472334+0000","last_fullsized":"2024-08-02T18:48:06.472334+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468348+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:48:06.468348+0000","last_peered":"2024-08-02T18:48:06.468348+0000","last_clean":"2024-08-02T18:48:06.468348+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:48:06.468348+0000","last_undegraded":"2024-08-02T18:48:06.468348+0000","last_fullsized":"2024-08-02T18:48:06.468348+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471227+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:48:06.471227+0000","last_peered":"2024-08-02T18:48:06.471227+0000","last_clean":"2024-08-02T18:48:06.471227+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:48:06.471227+0000","last_undegraded":"2024-08-02T18:48:06.471227+0000","last_fullsized":"2024-08-02T18:48:06.471227+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467420+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:48:06.467420+0000","last_peered":"2024-08-02T18:48:06.467420+0000","last_clean":"2024-08-02T18:48:06.467420+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:48:06.467420+0000","last_undegraded":"2024-08-02T18:48:06.467420+0000","last_fullsized":"2024-08-02T18:48:06.467420+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468674+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:48:06.468674+0000","last_peered":"2024-08-02T18:48:06.468674+0000","last_clean":"2024-08-02T18:48:06.468674+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:48:06.468674+0000","last_undegraded":"2024-08-02T18:48:06.468674+0000","last_fullsized":"2024-08-02T18:48:06.468674+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468642+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:48:06.468642+0000","last_peered":"2024-08-02T18:48:06.468642+0000","last_clean":"2024-08-02T18:48:06.468642+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:48:06.468642+0000","last_undegraded":"2024-08-02T18:48:06.468642+0000","last_fullsized":"2024-08-02T18:48:06.468642+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471807+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:48:06.471807+0000","last_peered":"2024-08-02T18:48:06.471807+0000","last_clean":"2024-08-02T18:48:06.471807+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:48:06.471807+0000","last_undegraded":"2024-08-02T18:48:06.471807+0000","last_fullsized":"2024-08-02T18:48:06.471807+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466974+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:48:06.466974+0000","last_peered":"2024-08-02T18:48:06.466974+0000","last_clean":"2024-08-02T18:48:06.466974+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:48:06.466974+0000","last_undegraded":"2024-08-02T18:48:06.466974+0000","last_fullsized":"2024-08-02T18:48:06.466974+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472170+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:48:06.472170+0000","last_peered":"2024-08-02T18:48:06.472170+0000","last_clean":"2024-08-02T18:48:06.472170+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:48:06.472170+0000","last_undegraded":"2024-08-02T18:48:06.472170+0000","last_fullsized":"2024-08-02T18:48:06.472170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857187+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:48:06.857187+0000","last_peered":"2024-08-02T18:48:06.857187+0000","last_clean":"2024-08-02T18:48:06.857187+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:48:06.857187+0000","last_undegraded":"2024-08-02T18:48:06.857187+0000","last_fullsized":"2024-08-02T18:48:06.857187+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478332+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:48:06.478332+0000","last_peered":"2024-08-02T18:48:06.478332+0000","last_clean":"2024-08-02T18:48:06.478332+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:48:06.478332+0000","last_undegraded":"2024-08-02T18:48:06.478332+0000","last_fullsized":"2024-08-02T18:48:06.478332+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475960+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:48:06.475960+0000","last_peered":"2024-08-02T18:48:06.475960+0000","last_clean":"2024-08-02T18:48:06.475960+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:48:06.475960+0000","last_undegraded":"2024-08-02T18:48:06.475960+0000","last_fullsized":"2024-08-02T18:48:06.475960+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469266+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:48:06.469266+0000","last_peered":"2024-08-02T18:48:06.469266+0000","last_clean":"2024-08-02T18:48:06.469266+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:48:06.469266+0000","last_undegraded":"2024-08-02T18:48:06.469266+0000","last_fullsized":"2024-08-02T18:48:06.469266+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467032+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:48:06.467032+0000","last_peered":"2024-08-02T18:48:06.467032+0000","last_clean":"2024-08-02T18:48:06.467032+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:48:06.467032+0000","last_undegraded":"2024-08-02T18:48:06.467032+0000","last_fullsized":"2024-08-02T18:48:06.467032+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471463+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:48:06.471463+0000","last_peered":"2024-08-02T18:48:06.471463+0000","last_clean":"2024-08-02T18:48:06.471463+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:48:06.471463+0000","last_undegraded":"2024-08-02T18:48:06.471463+0000","last_fullsized":"2024-08-02T18:48:06.471463+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"89'12","reported_seq":46,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:18.330233+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:48:18.330233+0000","last_peered":"2024-08-02T18:48:18.330233+0000","last_clean":"2024-08-02T18:48:18.330233+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:48:18.330233+0000","last_undegraded":"2024-08-02T18:48:18.330233+0000","last_fullsized":"2024-08-02T18:48:18.330233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471002+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:48:06.471002+0000","last_peered":"2024-08-02T18:48:06.471002+0000","last_clean":"2024-08-02T18:48:06.471002+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:48:06.471002+0000","last_undegraded":"2024-08-02T18:48:06.471002+0000","last_fullsized":"2024-08-02T18:48:06.471002+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475418+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:48:06.475418+0000","last_peered":"2024-08-02T18:48:06.475418+0000","last_clean":"2024-08-02T18:48:06.475418+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:48:06.475418+0000","last_undegraded":"2024-08-02T18:48:06.475418+0000","last_fullsized":"2024-08-02T18:48:06.475418+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472995+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:48:06.472995+0000","last_peered":"2024-08-02T18:48:06.472995+0000","last_clean":"2024-08-02T18:48:06.472995+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:48:06.472995+0000","last_undegraded":"2024-08-02T18:48:06.472995+0000","last_fullsized":"2024-08-02T18:48:06.472995+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469428+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:48:06.469428+0000","last_peered":"2024-08-02T18:48:06.469428+0000","last_clean":"2024-08-02T18:48:06.469428+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:48:06.469428+0000","last_undegraded":"2024-08-02T18:48:06.469428+0000","last_fullsized":"2024-08-02T18:48:06.469428+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470281+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:48:06.470281+0000","last_peered":"2024-08-02T18:48:06.470281+0000","last_clean":"2024-08-02T18:48:06.470281+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:48:06.470281+0000","last_undegraded":"2024-08-02T18:48:06.470281+0000","last_fullsized":"2024-08-02T18:48:06.470281+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466380+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:48:06.466380+0000","last_peered":"2024-08-02T18:48:06.466380+0000","last_clean":"2024-08-02T18:48:06.466380+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:48:06.466380+0000","last_undegraded":"2024-08-02T18:48:06.466380+0000","last_fullsized":"2024-08-02T18:48:06.466380+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472334+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:48:06.472334+0000","last_peered":"2024-08-02T18:48:06.472334+0000","last_clean":"2024-08-02T18:48:06.472334+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:48:06.472334+0000","last_undegraded":"2024-08-02T18:48:06.472334+0000","last_fullsized":"2024-08-02T18:48:06.472334+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470170+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:48:06.470170+0000","last_peered":"2024-08-02T18:48:06.470170+0000","last_clean":"2024-08-02T18:48:06.470170+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:48:06.470170+0000","last_undegraded":"2024-08-02T18:48:06.470170+0000","last_fullsized":"2024-08-02T18:48:06.470170+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467096+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:48:06.467096+0000","last_peered":"2024-08-02T18:48:06.467096+0000","last_clean":"2024-08-02T18:48:06.467096+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:48:06.467096+0000","last_undegraded":"2024-08-02T18:48:06.467096+0000","last_fullsized":"2024-08-02T18:48:06.467096+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475268+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:48:06.475268+0000","last_peered":"2024-08-02T18:48:06.475268+0000","last_clean":"2024-08-02T18:48:06.475268+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:48:06.475268+0000","last_undegraded":"2024-08-02T18:48:06.475268+0000","last_fullsized":"2024-08-02T18:48:06.475268+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476482+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:48:06.476482+0000","last_peered":"2024-08-02T18:48:06.476482+0000","last_clean":"2024-08-02T18:48:06.476482+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:48:06.476482+0000","last_undegraded":"2024-08-02T18:48:06.476482+0000","last_fullsized":"2024-08-02T18:48:06.476482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"87'4","reported_seq":89,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:53.539800+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:48:53.539800+0000","last_peered":"2024-08-02T18:48:53.539800+0000","last_clean":"2024-08-02T18:48:53.539800+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:48:53.539800+0000","last_undegraded":"2024-08-02T18:48:53.539800+0000","last_fullsized":"2024-08-02T18:48:53.539800+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475578+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:48:06.475578+0000","last_peered":"2024-08-02T18:48:06.475578+0000","last_clean":"2024-08-02T18:48:06.475578+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:48:06.475578+0000","last_undegraded":"2024-08-02T18:48:06.475578+0000","last_fullsized":"2024-08-02T18:48:06.475578+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474772+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:48:06.474772+0000","last_peered":"2024-08-02T18:48:06.474772+0000","last_clean":"2024-08-02T18:48:06.474772+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:48:06.474772+0000","last_undegraded":"2024-08-02T18:48:06.474772+0000","last_fullsized":"2024-08-02T18:48:06.474772+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":37,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466844+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:48:06.466844+0000","last_peered":"2024-08-02T18:48:06.466844+0000","last_clean":"2024-08-02T18:48:06.466844+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:48:06.466844+0000","last_undegraded":"2024-08-02T18:48:06.466844+0000","last_fullsized":"2024-08-02T18:48:06.466844+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476640+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:48:06.476640+0000","last_peered":"2024-08-02T18:48:06.476640+0000","last_clean":"2024-08-02T18:48:06.476640+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:48:06.476640+0000","last_undegraded":"2024-08-02T18:48:06.476640+0000","last_fullsized":"2024-08-02T18:48:06.476640+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471153+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:48:06.471153+0000","last_peered":"2024-08-02T18:48:06.471153+0000","last_clean":"2024-08-02T18:48:06.471153+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:48:06.471153+0000","last_undegraded":"2024-08-02T18:48:06.471153+0000","last_fullsized":"2024-08-02T18:48:06.471153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468846+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:48:06.468846+0000","last_peered":"2024-08-02T18:48:06.468846+0000","last_clean":"2024-08-02T18:48:06.468846+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:48:06.468846+0000","last_undegraded":"2024-08-02T18:48:06.468846+0000","last_fullsized":"2024-08-02T18:48:06.468846+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":357,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466987+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:48:06.466987+0000","last_peered":"2024-08-02T18:48:06.466987+0000","last_clean":"2024-08-02T18:48:06.466987+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:48:06.466987+0000","last_undegraded":"2024-08-02T18:48:06.466987+0000","last_fullsized":"2024-08-02T18:48:06.466987+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":22,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467297+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:48:06.467297+0000","last_peered":"2024-08-02T18:48:06.467297+0000","last_clean":"2024-08-02T18:48:06.467297+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:48:06.467297+0000","last_undegraded":"2024-08-02T18:48:06.467297+0000","last_fullsized":"2024-08-02T18:48:06.467297+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467403+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:48:06.467403+0000","last_peered":"2024-08-02T18:48:06.467403+0000","last_clean":"2024-08-02T18:48:06.467403+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:48:06.467403+0000","last_undegraded":"2024-08-02T18:48:06.467403+0000","last_fullsized":"2024-08-02T18:48:06.467403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468158+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:48:06.468158+0000","last_peered":"2024-08-02T18:48:06.468158+0000","last_clean":"2024-08-02T18:48:06.468158+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:48:06.468158+0000","last_undegraded":"2024-08-02T18:48:06.468158+0000","last_fullsized":"2024-08-02T18:48:06.468158+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857189+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:48:06.857189+0000","last_peered":"2024-08-02T18:48:06.857189+0000","last_clean":"2024-08-02T18:48:06.857189+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:48:06.857189+0000","last_undegraded":"2024-08-02T18:48:06.857189+0000","last_fullsized":"2024-08-02T18:48:06.857189+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467131+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:48:06.467131+0000","last_peered":"2024-08-02T18:48:06.467131+0000","last_clean":"2024-08-02T18:48:06.467131+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:48:06.467131+0000","last_undegraded":"2024-08-02T18:48:06.467131+0000","last_fullsized":"2024-08-02T18:48:06.467131+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"81'1","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476651+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:48:06.476651+0000","last_peered":"2024-08-02T18:48:06.476651+0000","last_clean":"2024-08-02T18:48:06.476651+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:48:06.476651+0000","last_undegraded":"2024-08-02T18:48:06.476651+0000","last_fullsized":"2024-08-02T18:48:06.476651+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469891+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:48:06.469891+0000","last_peered":"2024-08-02T18:48:06.469891+0000","last_clean":"2024-08-02T18:48:06.469891+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:48:06.469891+0000","last_undegraded":"2024-08-02T18:48:06.469891+0000","last_fullsized":"2024-08-02T18:48:06.469891+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467502+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:48:06.467502+0000","last_peered":"2024-08-02T18:48:06.467502+0000","last_clean":"2024-08-02T18:48:06.467502+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:48:06.467502+0000","last_undegraded":"2024-08-02T18:48:06.467502+0000","last_fullsized":"2024-08-02T18:48:06.467502+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475786+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:48:06.475786+0000","last_peered":"2024-08-02T18:48:06.475786+0000","last_clean":"2024-08-02T18:48:06.475786+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:48:06.475786+0000","last_undegraded":"2024-08-02T18:48:06.475786+0000","last_fullsized":"2024-08-02T18:48:06.475786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475721+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:48:06.475721+0000","last_peered":"2024-08-02T18:48:06.475721+0000","last_clean":"2024-08-02T18:48:06.475721+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:48:06.475721+0000","last_undegraded":"2024-08-02T18:48:06.475721+0000","last_fullsized":"2024-08-02T18:48:06.475721+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468919+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:48:06.468919+0000","last_peered":"2024-08-02T18:48:06.468919+0000","last_clean":"2024-08-02T18:48:06.468919+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:48:06.468919+0000","last_undegraded":"2024-08-02T18:48:06.468919+0000","last_fullsized":"2024-08-02T18:48:06.468919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473065+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:48:06.473065+0000","last_peered":"2024-08-02T18:48:06.473065+0000","last_clean":"2024-08-02T18:48:06.473065+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:48:06.473065+0000","last_undegraded":"2024-08-02T18:48:06.473065+0000","last_fullsized":"2024-08-02T18:48:06.473065+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475791+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:48:06.475791+0000","last_peered":"2024-08-02T18:48:06.475791+0000","last_clean":"2024-08-02T18:48:06.475791+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:48:06.475791+0000","last_undegraded":"2024-08-02T18:48:06.475791+0000","last_fullsized":"2024-08-02T18:48:06.475791+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475922+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:48:06.475922+0000","last_peered":"2024-08-02T18:48:06.475922+0000","last_clean":"2024-08-02T18:48:06.475922+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:48:06.475922+0000","last_undegraded":"2024-08-02T18:48:06.475922+0000","last_fullsized":"2024-08-02T18:48:06.475922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":49,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472152+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:48:06.472152+0000","last_peered":"2024-08-02T18:48:06.472152+0000","last_clean":"2024-08-02T18:48:06.472152+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:48:06.472152+0000","last_undegraded":"2024-08-02T18:48:06.472152+0000","last_fullsized":"2024-08-02T18:48:06.472152+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475691+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:48:06.475691+0000","last_peered":"2024-08-02T18:48:06.475691+0000","last_clean":"2024-08-02T18:48:06.475691+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:48:06.475691+0000","last_undegraded":"2024-08-02T18:48:06.475691+0000","last_fullsized":"2024-08-02T18:48:06.475691+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466616+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:48:06.466616+0000","last_peered":"2024-08-02T18:48:06.466616+0000","last_clean":"2024-08-02T18:48:06.466616+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:48:06.466616+0000","last_undegraded":"2024-08-02T18:48:06.466616+0000","last_fullsized":"2024-08-02T18:48:06.466616+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"87'3","reported_seq":90,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:53.540605+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:48:53.540605+0000","last_peered":"2024-08-02T18:48:53.540605+0000","last_clean":"2024-08-02T18:48:53.540605+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:48:53.540605+0000","last_undegraded":"2024-08-02T18:48:53.540605+0000","last_fullsized":"2024-08-02T18:48:53.540605+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":3,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467063+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:48:06.467063+0000","last_peered":"2024-08-02T18:48:06.467063+0000","last_clean":"2024-08-02T18:48:06.467063+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:48:06.467063+0000","last_undegraded":"2024-08-02T18:48:06.467063+0000","last_fullsized":"2024-08-02T18:48:06.467063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467254+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:48:06.467254+0000","last_peered":"2024-08-02T18:48:06.467254+0000","last_clean":"2024-08-02T18:48:06.467254+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:48:06.467254+0000","last_undegraded":"2024-08-02T18:48:06.467254+0000","last_fullsized":"2024-08-02T18:48:06.467254+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476845+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:48:06.476845+0000","last_peered":"2024-08-02T18:48:06.476845+0000","last_clean":"2024-08-02T18:48:06.476845+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:48:06.476845+0000","last_undegraded":"2024-08-02T18:48:06.476845+0000","last_fullsized":"2024-08-02T18:48:06.476845+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468624+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:48:06.468624+0000","last_peered":"2024-08-02T18:48:06.468624+0000","last_clean":"2024-08-02T18:48:06.468624+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:48:06.468624+0000","last_undegraded":"2024-08-02T18:48:06.468624+0000","last_fullsized":"2024-08-02T18:48:06.468624+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474919+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:48:06.474919+0000","last_peered":"2024-08-02T18:48:06.474919+0000","last_clean":"2024-08-02T18:48:06.474919+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:48:06.474919+0000","last_undegraded":"2024-08-02T18:48:06.474919+0000","last_fullsized":"2024-08-02T18:48:06.474919+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.485388+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:48:06.485388+0000","last_peered":"2024-08-02T18:48:06.485388+0000","last_clean":"2024-08-02T18:48:06.485388+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:48:06.485388+0000","last_undegraded":"2024-08-02T18:48:06.485388+0000","last_fullsized":"2024-08-02T18:48:06.485388+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":12,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476167+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:48:06.476167+0000","last_peered":"2024-08-02T18:48:06.476167+0000","last_clean":"2024-08-02T18:48:06.476167+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:48:06.476167+0000","last_undegraded":"2024-08-02T18:48:06.476167+0000","last_fullsized":"2024-08-02T18:48:06.476167+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472835+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:48:06.472835+0000","last_peered":"2024-08-02T18:48:06.472835+0000","last_clean":"2024-08-02T18:48:06.472835+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:48:06.472835+0000","last_undegraded":"2024-08-02T18:48:06.472835+0000","last_fullsized":"2024-08-02T18:48:06.472835+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"89'33","reported_seq":184,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:57.547366+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:48:57.547366+0000","last_peered":"2024-08-02T18:48:57.547366+0000","last_clean":"2024-08-02T18:48:57.547366+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:48:57.547366+0000","last_undegraded":"2024-08-02T18:48:57.547366+0000","last_fullsized":"2024-08-02T18:48:57.547366+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":64058,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":118,"num_read_kb":122,"num_write":34,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465906+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:48:06.465906+0000","last_peered":"2024-08-02T18:48:06.465906+0000","last_clean":"2024-08-02T18:48:06.465906+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:48:06.465906+0000","last_undegraded":"2024-08-02T18:48:06.465906+0000","last_fullsized":"2024-08-02T18:48:06.465906+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857426+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:48:06.857426+0000","last_peered":"2024-08-02T18:48:06.857426+0000","last_clean":"2024-08-02T18:48:06.857426+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:48:06.857426+0000","last_undegraded":"2024-08-02T18:48:06.857426+0000","last_fullsized":"2024-08-02T18:48:06.857426+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":38,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476504+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:48:06.476504+0000","last_peered":"2024-08-02T18:48:06.476504+0000","last_clean":"2024-08-02T18:48:06.476504+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:48:06.476504+0000","last_undegraded":"2024-08-02T18:48:06.476504+0000","last_fullsized":"2024-08-02T18:48:06.476504+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468616+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:48:06.468616+0000","last_peered":"2024-08-02T18:48:06.468616+0000","last_clean":"2024-08-02T18:48:06.468616+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:48:06.468616+0000","last_undegraded":"2024-08-02T18:48:06.468616+0000","last_fullsized":"2024-08-02T18:48:06.468616+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470496+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:48:06.470496+0000","last_peered":"2024-08-02T18:48:06.470496+0000","last_clean":"2024-08-02T18:48:06.470496+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:48:06.470496+0000","last_undegraded":"2024-08-02T18:48:06.470496+0000","last_fullsized":"2024-08-02T18:48:06.470496+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467216+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:48:06.467216+0000","last_peered":"2024-08-02T18:48:06.467216+0000","last_clean":"2024-08-02T18:48:06.467216+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:48:06.467216+0000","last_undegraded":"2024-08-02T18:48:06.467216+0000","last_fullsized":"2024-08-02T18:48:06.467216+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465752+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:48:06.465752+0000","last_peered":"2024-08-02T18:48:06.465752+0000","last_clean":"2024-08-02T18:48:06.465752+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:48:06.465752+0000","last_undegraded":"2024-08-02T18:48:06.465752+0000","last_fullsized":"2024-08-02T18:48:06.465752+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857610+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:48:06.857610+0000","last_peered":"2024-08-02T18:48:06.857610+0000","last_clean":"2024-08-02T18:48:06.857610+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:48:06.857610+0000","last_undegraded":"2024-08-02T18:48:06.857610+0000","last_fullsized":"2024-08-02T18:48:06.857610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"87'3","reported_seq":91,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:56.546684+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:48:56.546684+0000","last_peered":"2024-08-02T18:48:56.546684+0000","last_clean":"2024-08-02T18:48:56.546684+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:48:56.546684+0000","last_undegraded":"2024-08-02T18:48:56.546684+0000","last_fullsized":"2024-08-02T18:48:56.546684+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":55,"num_read_kb":55,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471007+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:48:06.471007+0000","last_peered":"2024-08-02T18:48:06.471007+0000","last_clean":"2024-08-02T18:48:06.471007+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:48:06.471007+0000","last_undegraded":"2024-08-02T18:48:06.471007+0000","last_fullsized":"2024-08-02T18:48:06.471007+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469865+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:48:06.469865+0000","last_peered":"2024-08-02T18:48:06.469865+0000","last_clean":"2024-08-02T18:48:06.469865+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:48:06.469865+0000","last_undegraded":"2024-08-02T18:48:06.469865+0000","last_fullsized":"2024-08-02T18:48:06.469865+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.465865+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:48:06.465865+0000","last_peered":"2024-08-02T18:48:06.465865+0000","last_clean":"2024-08-02T18:48:06.465865+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:48:06.465865+0000","last_undegraded":"2024-08-02T18:48:06.465865+0000","last_fullsized":"2024-08-02T18:48:06.465865+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":34,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476710+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:48:06.476710+0000","last_peered":"2024-08-02T18:48:06.476710+0000","last_clean":"2024-08-02T18:48:06.476710+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:48:06.476710+0000","last_undegraded":"2024-08-02T18:48:06.476710+0000","last_fullsized":"2024-08-02T18:48:06.476710+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474720+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:48:06.474720+0000","last_peered":"2024-08-02T18:48:06.474720+0000","last_clean":"2024-08-02T18:48:06.474720+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:48:06.474720+0000","last_undegraded":"2024-08-02T18:48:06.474720+0000","last_fullsized":"2024-08-02T18:48:06.474720+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471153+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:48:06.471153+0000","last_peered":"2024-08-02T18:48:06.471153+0000","last_clean":"2024-08-02T18:48:06.471153+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:48:06.471153+0000","last_undegraded":"2024-08-02T18:48:06.471153+0000","last_fullsized":"2024-08-02T18:48:06.471153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":35,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.474786+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:48:06.474786+0000","last_peered":"2024-08-02T18:48:06.474786+0000","last_clean":"2024-08-02T18:48:06.474786+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:48:06.474786+0000","last_undegraded":"2024-08-02T18:48:06.474786+0000","last_fullsized":"2024-08-02T18:48:06.474786+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":36,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470163+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:48:06.470163+0000","last_peered":"2024-08-02T18:48:06.470163+0000","last_clean":"2024-08-02T18:48:06.470163+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:48:06.470163+0000","last_undegraded":"2024-08-02T18:48:06.470163+0000","last_fullsized":"2024-08-02T18:48:06.470163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473185+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:48:06.473185+0000","last_peered":"2024-08-02T18:48:06.473185+0000","last_clean":"2024-08-02T18:48:06.473185+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:48:06.473185+0000","last_undegraded":"2024-08-02T18:48:06.473185+0000","last_fullsized":"2024-08-02T18:48:06.473185+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.478161+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:48:06.478161+0000","last_peered":"2024-08-02T18:48:06.478161+0000","last_clean":"2024-08-02T18:48:06.478161+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:48:06.478161+0000","last_undegraded":"2024-08-02T18:48:06.478161+0000","last_fullsized":"2024-08-02T18:48:06.478161+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"89'6","reported_seq":95,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:54.544906+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:48:54.544906+0000","last_peered":"2024-08-02T18:48:54.544906+0000","last_clean":"2024-08-02T18:48:54.544906+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:48:54.544906+0000","last_undegraded":"2024-08-02T18:48:54.544906+0000","last_fullsized":"2024-08-02T18:48:54.544906+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1012,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":56,"num_read_kb":3,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472468+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:48:06.472468+0000","last_peered":"2024-08-02T18:48:06.472468+0000","last_clean":"2024-08-02T18:48:06.472468+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:48:06.472468+0000","last_undegraded":"2024-08-02T18:48:06.472468+0000","last_fullsized":"2024-08-02T18:48:06.472468+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":21,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467180+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:48:06.467180+0000","last_peered":"2024-08-02T18:48:06.467180+0000","last_clean":"2024-08-02T18:48:06.467180+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:48:06.467180+0000","last_undegraded":"2024-08-02T18:48:06.467180+0000","last_fullsized":"2024-08-02T18:48:06.467180+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468760+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:48:06.468760+0000","last_peered":"2024-08-02T18:48:06.468760+0000","last_clean":"2024-08-02T18:48:06.468760+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:48:06.468760+0000","last_undegraded":"2024-08-02T18:48:06.468760+0000","last_fullsized":"2024-08-02T18:48:06.468760+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467581+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:48:06.467581+0000","last_peered":"2024-08-02T18:48:06.467581+0000","last_clean":"2024-08-02T18:48:06.467581+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:48:06.467581+0000","last_undegraded":"2024-08-02T18:48:06.467581+0000","last_fullsized":"2024-08-02T18:48:06.467581+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467303+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:48:06.467303+0000","last_peered":"2024-08-02T18:48:06.467303+0000","last_clean":"2024-08-02T18:48:06.467303+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:48:06.467303+0000","last_undegraded":"2024-08-02T18:48:06.467303+0000","last_fullsized":"2024-08-02T18:48:06.467303+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469987+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:48:06.469987+0000","last_peered":"2024-08-02T18:48:06.469987+0000","last_clean":"2024-08-02T18:48:06.469987+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:48:06.469987+0000","last_undegraded":"2024-08-02T18:48:06.469987+0000","last_fullsized":"2024-08-02T18:48:06.469987+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475366+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:48:06.475366+0000","last_peered":"2024-08-02T18:48:06.475366+0000","last_clean":"2024-08-02T18:48:06.475366+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:48:06.475366+0000","last_undegraded":"2024-08-02T18:48:06.475366+0000","last_fullsized":"2024-08-02T18:48:06.475366+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470004+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:48:06.470004+0000","last_peered":"2024-08-02T18:48:06.470004+0000","last_clean":"2024-08-02T18:48:06.470004+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:48:06.470004+0000","last_undegraded":"2024-08-02T18:48:06.470004+0000","last_fullsized":"2024-08-02T18:48:06.470004+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468267+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:48:06.468267+0000","last_peered":"2024-08-02T18:48:06.468267+0000","last_clean":"2024-08-02T18:48:06.468267+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:48:06.468267+0000","last_undegraded":"2024-08-02T18:48:06.468267+0000","last_fullsized":"2024-08-02T18:48:06.468267+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471381+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:48:06.471381+0000","last_peered":"2024-08-02T18:48:06.471381+0000","last_clean":"2024-08-02T18:48:06.471381+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:48:06.471381+0000","last_undegraded":"2024-08-02T18:48:06.471381+0000","last_fullsized":"2024-08-02T18:48:06.471381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.476371+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:48:06.476371+0000","last_peered":"2024-08-02T18:48:06.476371+0000","last_clean":"2024-08-02T18:48:06.476371+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:48:06.476371+0000","last_undegraded":"2024-08-02T18:48:06.476371+0000","last_fullsized":"2024-08-02T18:48:06.476371+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471171+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:48:06.471171+0000","last_peered":"2024-08-02T18:48:06.471171+0000","last_clean":"2024-08-02T18:48:06.471171+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:48:06.471171+0000","last_undegraded":"2024-08-02T18:48:06.471171+0000","last_fullsized":"2024-08-02T18:48:06.471171+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857311+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:48:06.857311+0000","last_peered":"2024-08-02T18:48:06.857311+0000","last_clean":"2024-08-02T18:48:06.857311+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:48:06.857311+0000","last_undegraded":"2024-08-02T18:48:06.857311+0000","last_fullsized":"2024-08-02T18:48:06.857311+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475156+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:48:06.475156+0000","last_peered":"2024-08-02T18:48:06.475156+0000","last_clean":"2024-08-02T18:48:06.475156+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:48:06.475156+0000","last_undegraded":"2024-08-02T18:48:06.475156+0000","last_fullsized":"2024-08-02T18:48:06.475156+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468795+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:48:06.468795+0000","last_peered":"2024-08-02T18:48:06.468795+0000","last_clean":"2024-08-02T18:48:06.468795+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:48:06.468795+0000","last_undegraded":"2024-08-02T18:48:06.468795+0000","last_fullsized":"2024-08-02T18:48:06.468795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467620+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:48:06.467620+0000","last_peered":"2024-08-02T18:48:06.467620+0000","last_clean":"2024-08-02T18:48:06.467620+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:48:06.467620+0000","last_undegraded":"2024-08-02T18:48:06.467620+0000","last_fullsized":"2024-08-02T18:48:06.467620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466617+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:48:06.466617+0000","last_peered":"2024-08-02T18:48:06.466617+0000","last_clean":"2024-08-02T18:48:06.466617+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:48:06.466617+0000","last_undegraded":"2024-08-02T18:48:06.466617+0000","last_fullsized":"2024-08-02T18:48:06.466617+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469489+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:48:06.469489+0000","last_peered":"2024-08-02T18:48:06.469489+0000","last_clean":"2024-08-02T18:48:06.469489+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:48:06.469489+0000","last_undegraded":"2024-08-02T18:48:06.469489+0000","last_fullsized":"2024-08-02T18:48:06.469489+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857053+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:48:06.857053+0000","last_peered":"2024-08-02T18:48:06.857053+0000","last_clean":"2024-08-02T18:48:06.857053+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:48:06.857053+0000","last_undegraded":"2024-08-02T18:48:06.857053+0000","last_fullsized":"2024-08-02T18:48:06.857053+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470006+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:48:06.470006+0000","last_peered":"2024-08-02T18:48:06.470006+0000","last_clean":"2024-08-02T18:48:06.470006+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:48:06.470006+0000","last_undegraded":"2024-08-02T18:48:06.470006+0000","last_fullsized":"2024-08-02T18:48:06.470006+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469719+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:48:06.469719+0000","last_peered":"2024-08-02T18:48:06.469719+0000","last_clean":"2024-08-02T18:48:06.469719+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:48:06.469719+0000","last_undegraded":"2024-08-02T18:48:06.469719+0000","last_fullsized":"2024-08-02T18:48:06.469719+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.475155+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:48:06.475155+0000","last_peered":"2024-08-02T18:48:06.475155+0000","last_clean":"2024-08-02T18:48:06.475155+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:48:06.475155+0000","last_undegraded":"2024-08-02T18:48:06.475155+0000","last_fullsized":"2024-08-02T18:48:06.475155+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.468906+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:48:06.468906+0000","last_peered":"2024-08-02T18:48:06.468906+0000","last_clean":"2024-08-02T18:48:06.468906+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:48:06.468906+0000","last_undegraded":"2024-08-02T18:48:06.468906+0000","last_fullsized":"2024-08-02T18:48:06.468906+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.467663+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:48:06.467663+0000","last_peered":"2024-08-02T18:48:06.467663+0000","last_clean":"2024-08-02T18:48:06.467663+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:48:06.467663+0000","last_undegraded":"2024-08-02T18:48:06.467663+0000","last_fullsized":"2024-08-02T18:48:06.467663+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470984+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:48:06.470984+0000","last_peered":"2024-08-02T18:48:06.470984+0000","last_clean":"2024-08-02T18:48:06.470984+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:48:06.470984+0000","last_undegraded":"2024-08-02T18:48:06.470984+0000","last_fullsized":"2024-08-02T18:48:06.470984+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.857678+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:48:06.857678+0000","last_peered":"2024-08-02T18:48:06.857678+0000","last_clean":"2024-08-02T18:48:06.857678+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:48:06.857678+0000","last_undegraded":"2024-08-02T18:48:06.857678+0000","last_fullsized":"2024-08-02T18:48:06.857678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.471116+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:48:06.471116+0000","last_peered":"2024-08-02T18:48:06.471116+0000","last_clean":"2024-08-02T18:48:06.471116+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:48:06.471116+0000","last_undegraded":"2024-08-02T18:48:06.471116+0000","last_fullsized":"2024-08-02T18:48:06.471116+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":29,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.466723+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:48:06.466723+0000","last_peered":"2024-08-02T18:48:06.466723+0000","last_clean":"2024-08-02T18:48:06.466723+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:48:06.466723+0000","last_undegraded":"2024-08-02T18:48:06.466723+0000","last_fullsized":"2024-08-02T18:48:06.466723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.470038+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:48:06.470038+0000","last_peered":"2024-08-02T18:48:06.470038+0000","last_clean":"2024-08-02T18:48:06.470038+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:48:06.470038+0000","last_undegraded":"2024-08-02T18:48:06.470038+0000","last_fullsized":"2024-08-02T18:48:06.470038+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.472226+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:48:06.472226+0000","last_peered":"2024-08-02T18:48:06.472226+0000","last_clean":"2024-08-02T18:48:06.472226+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:48:06.472226+0000","last_undegraded":"2024-08-02T18:48:06.472226+0000","last_fullsized":"2024-08-02T18:48:06.472226+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":11,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.473958+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:48:06.473958+0000","last_peered":"2024-08-02T18:48:06.473958+0000","last_clean":"2024-08-02T18:48:06.473958+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:48:06.473958+0000","last_undegraded":"2024-08-02T18:48:06.473958+0000","last_fullsized":"2024-08-02T18:48:06.473958+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469763+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:48:06.469763+0000","last_peered":"2024-08-02T18:48:06.469763+0000","last_clean":"2024-08-02T18:48:06.469763+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:48:06.469763+0000","last_undegraded":"2024-08-02T18:48:06.469763+0000","last_fullsized":"2024-08-02T18:48:06.469763+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469968+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:48:06.469968+0000","last_peered":"2024-08-02T18:48:06.469968+0000","last_clean":"2024-08-02T18:48:06.469968+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:48:06.469968+0000","last_undegraded":"2024-08-02T18:48:06.469968+0000","last_fullsized":"2024-08-02T18:48:06.469968+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":28,"reported_epoch":89,"state":"active+clean","last_fresh":"2024-08-02T18:48:06.469411+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:48:06.469411+0000","last_peered":"2024-08-02T18:48:06.469411+0000","last_clean":"2024-08-02T18:48:06.469411+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:48:06.469411+0000","last_undegraded":"2024-08-02T18:48:06.469411+0000","last_fullsized":"2024-08-02T18:48:06.469411+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":68058,"num_objects":60,"num_object_clones":0,"num_object_copies":180,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":0,"num_read":348,"num_read_kb":247,"num_write":169,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":430080,"data_stored":204174,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":144,"ondisk_log_size":144,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4751360,"data_stored":4722944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":8}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547233,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":499721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776165,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28680,"kb_used_data":1664,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716472,"statfs":{"total":95995035648,"available":95965667328,"internally_reserved":0,"allocated":1703936,"data_stored":1151013,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939689,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28024,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717128,"statfs":{"total":95995035648,"available":95966339072,"internally_reserved":0,"allocated":1032192,"data_stored":504019,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168623,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28020,"kb_used_data":1004,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717132,"statfs":{"total":95995035648,"available":95966343168,"internally_reserved":0,"allocated":1028096,"data_stored":499843,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397556,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36920,"kb_used_data":1584,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708232,"statfs":{"total":95995035648,"available":95957229568,"internally_reserved":0,"allocated":1622016,"data_stored":1095751,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561080,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36328,"kb_used_data":984,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708824,"statfs":{"total":95995035648,"available":95957835776,"internally_reserved":0,"allocated":1007616,"data_stored":495099,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822716,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28612,"kb_used_data":1592,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716540,"statfs":{"total":95995035648,"available":95965736960,"internally_reserved":0,"allocated":1630208,"data_stored":1091339,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986241,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":499749,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215173,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28012,"kb_used_data":996,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717140,"statfs":{"total":95995035648,"available":95966351360,"internally_reserved":0,"allocated":1019904,"data_stored":495293,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411402,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36408,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708744,"statfs":{"total":95995035648,"available":95957753856,"internally_reserved":0,"allocated":1097728,"data_stored":560773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574926,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28068,"kb_used_data":1052,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717084,"statfs":{"total":95995035648,"available":95966294016,"internally_reserved":0,"allocated":1077248,"data_stored":559067,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738451,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708800,"statfs":{"total":95995035648,"available":95957811200,"internally_reserved":0,"allocated":1032192,"data_stored":496487,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":64058,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":94208,"data_stored":65764,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":284,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":644,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":2182,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":738,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":106496,"data_stored":65636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:49:01.832 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-02T18:49:01.832 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-08-02T18:49:01.833 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-08-02T18:49:01.833 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph health --format=json 2024-08-02T18:49:02.087 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:02.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 -- 172.21.15.103:0/3318880398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e0102a70 msgr2=0x7f19e0102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:02.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 --2- 172.21.15.103:0/3318880398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e0102a70 0x7f19e0102e50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f19d0009900 tx=0x7f19d002a480 comp rx=0 tx=0).stop 2024-08-02T18:49:02.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 -- 172.21.15.103:0/3318880398 shutdown_connections 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 --2- 172.21.15.103:0/3318880398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19e010bea0 0x7f19e010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 --2- 172.21.15.103:0/3318880398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19e0103390 0x7f19e010b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 --2- 172.21.15.103:0/3318880398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e0102a70 0x7f19e0102e50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 -- 172.21.15.103:0/3318880398 >> 172.21.15.103:0/3318880398 conn(0x7f19e00fc4d0 msgr2=0x7f19e00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 -- 172.21.15.103:0/3318880398 shutdown_connections 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.580+0000 7f19e6597640 1 -- 172.21.15.103:0/3318880398 wait complete. 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e6597640 1 Processor -- start 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e6597640 1 -- start start 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e6597640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19e0102a70 0x7f19e0198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e6597640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19e0103390 0x7f19e0198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e6597640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e010bea0 0x7f19e019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:02.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e6597640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0111e20 con 0x7f19e010bea0 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e6597640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0111ca0 con 0x7f19e0103390 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e6597640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f19e0111fa0 con 0x7f19e0102a70 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e4b34640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e010bea0 0x7f19e019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e4b34640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e010bea0 0x7f19e019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53232/0 (socket says 172.21.15.103:53232) 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.581+0000 7f19e4b34640 1 -- 172.21.15.103:0/2985659934 learned_addr learned my addr 172.21.15.103:0/2985659934 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19df7fe640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19e0103390 0x7f19e0198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19dffff640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19e0102a70 0x7f19e0198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19e4b34640 1 -- 172.21.15.103:0/2985659934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19e0102a70 msgr2=0x7f19e0198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19e4b34640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19e0102a70 0x7f19e0198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19e4b34640 1 -- 172.21.15.103:0/2985659934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19e0103390 msgr2=0x7f19e0198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:02.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19e4b34640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19e0103390 0x7f19e0198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19e4b34640 1 -- 172.21.15.103:0/2985659934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19e019d2f0 con 0x7f19e010bea0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19df7fe640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19e0103390 0x7f19e0198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19e4b34640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e010bea0 0x7f19e019cc10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f19d800cad0 tx=0x7f19d800cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19dd7fa640 1 -- 172.21.15.103:0/2985659934 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d800ae20 con 0x7f19e010bea0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19e019d5e0 con 0x7f19e010bea0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19dd7fa640 1 -- 172.21.15.103:0/2985659934 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f19d8004b20 con 0x7f19e010bea0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19dd7fa640 1 -- 172.21.15.103:0/2985659934 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19d800f780 con 0x7f19e010bea0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.582+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19e01a4ec0 con 0x7f19e010bea0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.583+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f19e0102e50 con 0x7f19e010bea0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.584+0000 7f19dd7fa640 1 -- 172.21.15.103:0/2985659934 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f19d800f940 con 0x7f19e010bea0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.585+0000 7f19dd7fa640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f19c80a2c10 0x7f19c80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.585+0000 7f19dffff640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f19c80a2c10 0x7f19c80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:02.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.585+0000 7f19dd7fa640 1 -- 172.21.15.103:0/2985659934 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f19d80cfa20 con 0x7f19e010bea0 2024-08-02T18:49:02.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.586+0000 7f19dffff640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f19c80a2c10 0x7f19c80a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19d0000c00 tx=0x7f19d00095f0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:02.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.588+0000 7f19dd7fa640 1 -- 172.21.15.103:0/2985659934 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f19d8014030 con 0x7f19e010bea0 2024-08-02T18:49:02.793 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.792+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f19e0106f70 con 0x7f19e010bea0 2024-08-02T18:49:02.793 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:02 smithi103 ceph-mon[32753]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:02.793 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:02 smithi103 ceph-mon[32753]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:02.794 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.792+0000 7f19dd7fa640 1 -- 172.21.15.103:0/2985659934 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f19d809c4c0 con 0x7f19e010bea0 2024-08-02T18:49:02.794 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:02.794 INFO:teuthology.orchestra.run.smithi103.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-08-02T18:49:02.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f19c80a2c10 msgr2=0x7f19c80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:02.795 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f19c80a2c10 0x7f19c80a50d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f19d0000c00 tx=0x7f19d00095f0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e010bea0 msgr2=0x7f19e019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e010bea0 0x7f19e019cc10 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f19d800cad0 tx=0x7f19d800cf90 comp rx=0 tx=0).stop 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 shutdown_connections 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f19e010bea0 0x7f19e019cc10 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f19e0103390 0x7f19e0198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f19c80a2c10 0x7f19c80a50d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 --2- 172.21.15.103:0/2985659934 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f19e0102a70 0x7f19e0198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 >> 172.21.15.103:0/2985659934 conn(0x7f19e00fc4d0 msgr2=0x7f19e00fd1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 shutdown_connections 2024-08-02T18:49:02.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:02.794+0000 7f19e6597640 1 -- 172.21.15.103:0/2985659934 wait complete. 2024-08-02T18:49:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:02 smithi151 ceph-mon[37155]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:02 smithi151 ceph-mon[37155]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:03.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:02 smithi121 ceph-mon[37236]: from='client.15033 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:03.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:02 smithi121 ceph-mon[37236]: pgmap v317: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:03.507 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-08-02T18:49:03.507 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:49:03.762 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:03.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:03 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2985659934' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-02T18:49:03.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:03 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2985659934' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-02T18:49:04.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:03 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2985659934' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-08-02T18:49:04.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 -- 172.21.15.103:0/2193351364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 msgr2=0x7fbfe010d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:04.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/2193351364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 0x7fbfe010d770 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8009ca0 tx=0x7fbfd802a950 comp rx=0 tx=0).stop 2024-08-02T18:49:04.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 -- 172.21.15.103:0/2193351364 shutdown_connections 2024-08-02T18:49:04.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/2193351364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 0x7fbfe010d770 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/2193351364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe01022a0 0x7fbfe01026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/2193351364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfe0100b50 0x7fbfe0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 -- 172.21.15.103:0/2193351364 >> 172.21.15.103:0/2193351364 conn(0x7fbfe00fc500 msgr2=0x7fbfe00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:04.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 -- 172.21.15.103:0/2193351364 shutdown_connections 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.320+0000 7fbfe70ed640 1 -- 172.21.15.103:0/2193351364 wait complete. 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe70ed640 1 Processor -- start 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe70ed640 1 -- start start 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe70ed640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfe0100b50 0x7fbfe00fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe70ed640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe01022a0 0x7fbfe00fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe70ed640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 0x7fbfe00fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe70ed640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0110dd0 con 0x7fbfe0102c20 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe70ed640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0110c50 con 0x7fbfe0100b50 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe70ed640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbfe0110f50 con 0x7fbfe01022a0 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe568a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 0x7fbfe00fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe568a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 0x7fbfe00fd430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53242/0 (socket says 172.21.15.103:53242) 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe568a640 1 -- 172.21.15.103:0/1606437535 learned_addr learned my addr 172.21.15.103:0/1606437535 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:04.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfe4e89640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfe0100b50 0x7fbfe00fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.321+0000 7fbfdffff640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe01022a0 0x7fbfe00fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfe568a640 1 -- 172.21.15.103:0/1606437535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe01022a0 msgr2=0x7fbfe00fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfe568a640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe01022a0 0x7fbfe00fcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfe568a640 1 -- 172.21.15.103:0/1606437535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfe0100b50 msgr2=0x7fbfe00fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfe568a640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfe0100b50 0x7fbfe00fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfe568a640 1 -- 172.21.15.103:0/1606437535 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbfe01a67d0 con 0x7fbfe0102c20 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfe568a640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 0x7fbfe00fd430 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8005cc0 tx=0x7fbfd802f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfddffb640 1 -- 172.21.15.103:0/1606437535 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd8034040 con 0x7fbfe0102c20 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbfe01a6a60 con 0x7fbfe0102c20 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfddffb640 1 -- 172.21.15.103:0/1606437535 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbfd8030940 con 0x7fbfe0102c20 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfddffb640 1 -- 172.21.15.103:0/1606437535 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbfd80456e0 con 0x7fbfe0102c20 2024-08-02T18:49:04.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.322+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbfe01a6f90 con 0x7fbfe0102c20 2024-08-02T18:49:04.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.323+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbfe0100f30 con 0x7fbfe0102c20 2024-08-02T18:49:04.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.324+0000 7fbfddffb640 1 -- 172.21.15.103:0/1606437535 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbfd8037020 con 0x7fbfe0102c20 2024-08-02T18:49:04.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.325+0000 7fbfddffb640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbfd00a2c10 0x7fbfd00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:04.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.325+0000 7fbfddffb640 1 -- 172.21.15.103:0/1606437535 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fbfd80f0540 con 0x7fbfe0102c20 2024-08-02T18:49:04.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.325+0000 7fbfe4e89640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbfd00a2c10 0x7fbfd00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:04.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.326+0000 7fbfe4e89640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbfd00a2c10 0x7fbfd00a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4005fd0 tx=0x7fbfd4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:04.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.329+0000 7fbfddffb640 1 -- 172.21.15.103:0/1606437535 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbfd80bd0f0 con 0x7fbfe0102c20 2024-08-02T18:49:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.541+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbfe0109dd0 con 0x7fbfe0102c20 2024-08-02T18:49:04.543 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.542+0000 7fbfddffb640 1 -- 172.21.15.103:0/1606437535 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7fbfd80bc9f0 con 0x7fbfe0102c20 2024-08-02T18:49:04.543 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:04.544 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-08-02T18:48:05:450957+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:48:05.212257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T18:49:04.544 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-08-02T18:49:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbfd00a2c10 msgr2=0x7fbfd00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbfd00a2c10 0x7fbfd00a50d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fbfd4005fd0 tx=0x7fbfd4005850 comp rx=0 tx=0).stop 2024-08-02T18:49:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 msgr2=0x7fbfe00fd430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 0x7fbfe00fd430 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fbfd8005cc0 tx=0x7fbfd802f790 comp rx=0 tx=0).stop 2024-08-02T18:49:04.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 shutdown_connections 2024-08-02T18:49:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbfe0102c20 0x7fbfe00fd430 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbfd00a2c10 0x7fbfd00a50d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbfe01022a0 0x7fbfe00fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.544+0000 7fbfe70ed640 1 --2- 172.21.15.103:0/1606437535 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbfe0100b50 0x7fbfe00fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.545+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 >> 172.21.15.103:0/1606437535 conn(0x7fbfe00fc500 msgr2=0x7fbfe0069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.545+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 shutdown_connections 2024-08-02T18:49:04.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:04.545+0000 7fbfe70ed640 1 -- 172.21.15.103:0/1606437535 wait complete. 2024-08-02T18:49:04.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:04 smithi151 ceph-mon[37155]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:04.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:04 smithi103 ceph-mon[32753]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:04.902 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:04 smithi121 ceph-mon[37236]: pgmap v318: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:05.238 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:49:05.504 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:05.768 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:05 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1606437535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:05.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:05 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1606437535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 -- 172.21.15.103:0/3997434057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 msgr2=0x7f3cfc106b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 --2- 172.21.15.103:0/3997434057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 0x7f3cfc106b90 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f3cf4009cd0 tx=0x7f3cf402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 -- 172.21.15.103:0/3997434057 shutdown_connections 2024-08-02T18:49:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 --2- 172.21.15.103:0/3997434057 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cfc101150 0x7f3cfc10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:05.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 --2- 172.21.15.103:0/3997434057 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc1007b0 0x7f3cfc100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 --2- 172.21.15.103:0/3997434057 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 0x7f3cfc106b90 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 -- 172.21.15.103:0/3997434057 >> 172.21.15.103:0/3997434057 conn(0x7f3cfc0fc4d0 msgr2=0x7f3cfc0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 -- 172.21.15.103:0/3997434057 shutdown_connections 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.984+0000 7f3d0132a640 1 -- 172.21.15.103:0/3997434057 wait complete. 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3d0132a640 1 Processor -- start 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3d0132a640 1 -- start start 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3d0132a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc1007b0 0x7f3cfc1983d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3d0132a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cfc101150 0x7f3cfc198910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3d0132a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 0x7f3cfc19cca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3d0132a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc110d90 con 0x7f3cfc1067b0 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3d0132a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc110c10 con 0x7f3cfc101150 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3d0132a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3cfc110f10 con 0x7f3cfc1007b0 2024-08-02T18:49:05.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 0x7f3cfc19cca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 0x7f3cfc19cca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53260/0 (socket says 172.21.15.103:53260) 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfb7fe640 1 -- 172.21.15.103:0/1128760262 learned_addr learned my addr 172.21.15.103:0/1128760262 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfaffd640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc1007b0 0x7f3cfc1983d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfa7fc640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cfc101150 0x7f3cfc198910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfb7fe640 1 -- 172.21.15.103:0/1128760262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc1007b0 msgr2=0x7f3cfc1983d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfb7fe640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc1007b0 0x7f3cfc1983d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfb7fe640 1 -- 172.21.15.103:0/1128760262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cfc101150 msgr2=0x7f3cfc198910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfb7fe640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cfc101150 0x7f3cfc198910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfb7fe640 1 -- 172.21.15.103:0/1128760262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cfc19d380 con 0x7f3cfc1067b0 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.985+0000 7f3cfa7fc640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cfc101150 0x7f3cfc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.986+0000 7f3cfb7fe640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 0x7f3cfc19cca0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009fd0 tx=0x7f3cec00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.986+0000 7f3cf3fff640 1 -- 172.21.15.103:0/1128760262 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec011830 con 0x7f3cfc1067b0 2024-08-02T18:49:06.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.986+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cfc19d670 con 0x7f3cfc1067b0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.986+0000 7f3cf3fff640 1 -- 172.21.15.103:0/1128760262 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3cec016070 con 0x7f3cfc1067b0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.986+0000 7f3cf3fff640 1 -- 172.21.15.103:0/1128760262 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3cec00f2e0 con 0x7f3cfc1067b0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.986+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cfc1a4f50 con 0x7f3cfc1067b0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.987+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cfc100c90 con 0x7f3cfc1067b0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.988+0000 7f3cf3fff640 1 -- 172.21.15.103:0/1128760262 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3cec01b460 con 0x7f3cfc1067b0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.989+0000 7f3cf3fff640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.989+0000 7f3cfaffd640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.989+0000 7f3cf3fff640 1 -- 172.21.15.103:0/1128760262 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3cec0cea90 con 0x7f3cfc1067b0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.989+0000 7f3cfaffd640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40098d0 tx=0x7f3cf4031000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:06.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:05.993+0000 7f3cf3fff640 1 -- 172.21.15.103:0/1128760262 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3cec09b640 con 0x7f3cfc1067b0 2024-08-02T18:49:06.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:05 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1606437535' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:06.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.194+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3cfc109d30 con 0x7f3cfc1067b0 2024-08-02T18:49:06.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.194+0000 7f3cf3fff640 1 -- 172.21.15.103:0/1128760262 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7f3cec09af40 con 0x7f3cfc1067b0 2024-08-02T18:49:06.196 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:06.196 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-08-02T18:48:05:450957+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:48:05.212257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T18:49:06.196 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-08-02T18:49:06.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ce80a2c10 msgr2=0x7f3ce80a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:06.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f3cf40098d0 tx=0x7f3cf4031000 comp rx=0 tx=0).stop 2024-08-02T18:49:06.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 msgr2=0x7f3cfc19cca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:06.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 0x7f3cfc19cca0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f3cec009fd0 tx=0x7f3cec00b8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:06.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 shutdown_connections 2024-08-02T18:49:06.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3cfc1067b0 0x7f3cfc19cca0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:06.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3cfc101150 0x7f3cfc198910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:06.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3ce80a2c10 0x7f3ce80a50d0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:06.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 --2- 172.21.15.103:0/1128760262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3cfc1007b0 0x7f3cfc1983d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:06.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 >> 172.21.15.103:0/1128760262 conn(0x7f3cfc0fc4d0 msgr2=0x7f3cfc06a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:06.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 shutdown_connections 2024-08-02T18:49:06.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:06.197+0000 7f3d0132a640 1 -- 172.21.15.103:0/1128760262 wait complete. 2024-08-02T18:49:06.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:06 smithi151 ceph-mon[37155]: pgmap v319: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:06.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:06 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1128760262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:06 smithi103 ceph-mon[32753]: pgmap v319: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:06.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:06 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1128760262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:06.902 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:49:07.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:06 smithi121 ceph-mon[37236]: pgmap v319: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:07.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:06 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1128760262' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:07.157 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:07.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 -- 172.21.15.103:0/3672931228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 msgr2=0x7fed8410e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:07.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3672931228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 0x7fed8410e330 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fed7c009ca0 tx=0x7fed7c02a950 comp rx=0 tx=0).stop 2024-08-02T18:49:07.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 -- 172.21.15.103:0/3672931228 shutdown_connections 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3672931228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 0x7fed8410e330 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3672931228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed841033f0 0x7fed8410b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3672931228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed84102ad0 0x7fed84102eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 -- 172.21.15.103:0/3672931228 >> 172.21.15.103:0/3672931228 conn(0x7fed840fc4d0 msgr2=0x7fed840fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 -- 172.21.15.103:0/3672931228 shutdown_connections 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.646+0000 7fed8aefe640 1 -- 172.21.15.103:0/3672931228 wait complete. 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8aefe640 1 Processor -- start 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8aefe640 1 -- start start 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8aefe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed84102ad0 0x7fed84100730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8aefe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed841033f0 0x7fed84100c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8aefe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 0x7fed841011b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8aefe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fed84111db0 con 0x7fed8410beb0 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8aefe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fed84111c30 con 0x7fed841033f0 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8aefe640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fed84111f30 con 0x7fed84102ad0 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 0x7fed841011b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 0x7fed841011b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53268/0 (socket says 172.21.15.103:53268) 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 -- 172.21.15.103:0/3578401576 learned_addr learned my addr 172.21.15.103:0/3578401576 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed83fff640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed841033f0 0x7fed84100c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 -- 172.21.15.103:0/3578401576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed84102ad0 msgr2=0x7fed84100730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed88c9a640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed84102ad0 0x7fed84100730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed84102ad0 0x7fed84100730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 -- 172.21.15.103:0/3578401576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed841033f0 msgr2=0x7fed84100c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed841033f0 0x7fed84100c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 -- 172.21.15.103:0/3578401576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed841a66d0 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed83fff640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed841033f0 0x7fed84100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.647+0000 7fed8949b640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 0x7fed841011b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fed7c005cc0 tx=0x7fed7c02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.648+0000 7fed81ffb640 1 -- 172.21.15.103:0/3578401576 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c034040 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.648+0000 7fed81ffb640 1 -- 172.21.15.103:0/3578401576 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fed7c030940 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.648+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed841a6960 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.648+0000 7fed81ffb640 1 -- 172.21.15.103:0/3578401576 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed7c045480 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.648+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed841a6e40 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.649+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed84102eb0 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.650+0000 7fed81ffb640 1 -- 172.21.15.103:0/3578401576 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fed7c037020 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.650+0000 7fed81ffb640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fed740a2c10 0x7fed740a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.651+0000 7fed88c9a640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fed740a2c10 0x7fed740a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.651+0000 7fed81ffb640 1 -- 172.21.15.103:0/3578401576 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fed7c0f0350 con 0x7fed8410beb0 2024-08-02T18:49:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.651+0000 7fed88c9a640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fed740a2c10 0x7fed740a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fed78005fd0 tx=0x7fed78005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.655+0000 7fed81ffb640 1 -- 172.21.15.103:0/3578401576 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fed7c0bcf00 con 0x7fed8410beb0 2024-08-02T18:49:07.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.824+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fed84106f50 con 0x7fed8410beb0 2024-08-02T18:49:07.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.825+0000 7fed81ffb640 1 -- 172.21.15.103:0/3578401576 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24703 (secure 0 0 0) 0x7fed7c030b10 con 0x7fed8410beb0 2024-08-02T18:49:07.827 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:07.827 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:48:06.458748+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:49:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fed740a2c10 msgr2=0x7fed740a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fed740a2c10 0x7fed740a50d0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fed78005fd0 tx=0x7fed78005850 comp rx=0 tx=0).stop 2024-08-02T18:49:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 msgr2=0x7fed841011b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 0x7fed841011b0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7fed7c005cc0 tx=0x7fed7c02f790 comp rx=0 tx=0).stop 2024-08-02T18:49:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 shutdown_connections 2024-08-02T18:49:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fed8410beb0 0x7fed841011b0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fed841033f0 0x7fed84100c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fed740a2c10 0x7fed740a50d0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 --2- 172.21.15.103:0/3578401576 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fed84102ad0 0x7fed84100730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 >> 172.21.15.103:0/3578401576 conn(0x7fed840fc4d0 msgr2=0x7fed840fdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 shutdown_connections 2024-08-02T18:49:07.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:07.828+0000 7fed8aefe640 1 -- 172.21.15.103:0/3578401576 wait complete. 2024-08-02T18:49:08.537 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:49:08.791 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:08.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:08 smithi151 ceph-mon[37155]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:08.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:08 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3578401576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:08 smithi103 ceph-mon[32753]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:08 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3578401576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:09.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:08 smithi121 ceph-mon[37236]: pgmap v320: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:09.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:08 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3578401576' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 -- 172.21.15.103:0/1519287094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3220103390 msgr2=0x7f322010b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 --2- 172.21.15.103:0/1519287094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3220103390 0x7f322010b880 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f321c009ca0 tx=0x7f321c02a950 comp rx=0 tx=0).stop 2024-08-02T18:49:09.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 -- 172.21.15.103:0/1519287094 shutdown_connections 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 --2- 172.21.15.103:0/1519287094 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f322010bea0 0x7f322010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 --2- 172.21.15.103:0/1519287094 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3220103390 0x7f322010b880 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 --2- 172.21.15.103:0/1519287094 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3220102a70 0x7f3220102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 -- 172.21.15.103:0/1519287094 >> 172.21.15.103:0/1519287094 conn(0x7f32200fc4d0 msgr2=0x7f32200fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 -- 172.21.15.103:0/1519287094 shutdown_connections 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.264+0000 7f3227ba5640 1 -- 172.21.15.103:0/1519287094 wait complete. 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3227ba5640 1 Processor -- start 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3227ba5640 1 -- start start 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3227ba5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3220102a70 0x7f3220198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3227ba5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3220103390 0x7f3220198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3227ba5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f322010bea0 0x7f322019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3227ba5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3220111dc0 con 0x7f322010bea0 2024-08-02T18:49:09.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3227ba5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3220111c40 con 0x7f3220102a70 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3227ba5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3220111f40 con 0x7f3220103390 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3226142640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f322010bea0 0x7f322019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3226142640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f322010bea0 0x7f322019caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49724/0 (socket says 172.21.15.103:49724) 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3226142640 1 -- 172.21.15.103:0/3034438229 learned_addr learned my addr 172.21.15.103:0/3034438229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3225941640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3220102a70 0x7f3220198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3226142640 1 -- 172.21.15.103:0/3034438229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3220103390 msgr2=0x7f3220198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3226142640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3220103390 0x7f3220198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3226142640 1 -- 172.21.15.103:0/3034438229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3220102a70 msgr2=0x7f3220198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3226142640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3220102a70 0x7f3220198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3226142640 1 -- 172.21.15.103:0/3034438229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f322019d1d0 con 0x7f322010bea0 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.265+0000 7f3225941640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3220102a70 0x7f3220198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.266+0000 7f3226142640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f322010bea0 0x7f322019caf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f321800e970 tx=0x7f321800ed70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:09.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.266+0000 7f3212ffd640 1 -- 172.21.15.103:0/3034438229 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f321800ccc0 con 0x7f322010bea0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.266+0000 7f3212ffd640 1 -- 172.21.15.103:0/3034438229 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f321800ce60 con 0x7f322010bea0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.266+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f322019d4c0 con 0x7f322010bea0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.266+0000 7f3212ffd640 1 -- 172.21.15.103:0/3034438229 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3218010690 con 0x7f322010bea0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.266+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32201a4da0 con 0x7f322010bea0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.267+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3220102e50 con 0x7f322010bea0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.268+0000 7f3212ffd640 1 -- 172.21.15.103:0/3034438229 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f32180046c0 con 0x7f322010bea0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.268+0000 7f3212ffd640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f320c0a2c10 0x7f320c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.269+0000 7f3225941640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f320c0a2c10 0x7f320c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.269+0000 7f3212ffd640 1 -- 172.21.15.103:0/3034438229 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f32180cfbf0 con 0x7f322010bea0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.269+0000 7f3225941640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f320c0a2c10 0x7f320c0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f32140058c0 tx=0x7f3214005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:09.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.272+0000 7f3212ffd640 1 -- 172.21.15.103:0/3034438229 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3218053df0 con 0x7f322010bea0 2024-08-02T18:49:09.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.475+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3220199580 con 0x7f322010bea0 2024-08-02T18:49:09.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.475+0000 7f3212ffd640 1 -- 172.21.15.103:0/3034438229 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7f3220199580 con 0x7f322010bea0 2024-08-02T18:49:09.477 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:09.477 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-08-02T18:48:05:450957+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:48:05.212257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T18:49:09.477 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-08-02T18:49:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f320c0a2c10 msgr2=0x7f320c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f320c0a2c10 0x7f320c0a50d0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f32140058c0 tx=0x7f3214005850 comp rx=0 tx=0).stop 2024-08-02T18:49:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f322010bea0 msgr2=0x7f322019caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f322010bea0 0x7f322019caf0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f321800e970 tx=0x7f321800ed70 comp rx=0 tx=0).stop 2024-08-02T18:49:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 shutdown_connections 2024-08-02T18:49:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f322010bea0 0x7f322019caf0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f320c0a2c10 0x7f320c0a50d0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3220103390 0x7f3220198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 --2- 172.21.15.103:0/3034438229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3220102a70 0x7f3220198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:09.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 >> 172.21.15.103:0/3034438229 conn(0x7f32200fc4d0 msgr2=0x7f32200fdae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:09.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 shutdown_connections 2024-08-02T18:49:09.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:09.478+0000 7f3227ba5640 1 -- 172.21.15.103:0/3034438229 wait complete. 2024-08-02T18:49:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:09 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3034438229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:09.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:09 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3034438229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:09 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3034438229' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:10.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-02T18:47:22.067716+0000', 'modified': '2024-08-02T18:48:05.212257+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24473, 'mds_1': 24469, 'mds_2': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6835/1461531566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 1461531566}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 1461531566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6835/126654937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 126654937}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 126654937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6837/1633433490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 1633433490}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 1633433490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.151:6837/1434322363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 1434322363}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 1434322363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.151:6839/3705298051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 3705298051}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 3705298051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.121:6839/3512573309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3512573309}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3512573309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24454, 24469, 24473]} 2024-08-02T18:49:10.292 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-02T18:49:10.293 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.c status 2024-08-02T18:49:10.549 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:10.802 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:10 smithi103 ceph-mon[32753]: pgmap v321: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:10.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:10 smithi151 ceph-mon[37155]: pgmap v321: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:11.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:10 smithi121 ceph-mon[37236]: pgmap v321: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:10.999+0000 7f55b5e77640 1 -- 172.21.15.103:0/1803653632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01078b0 msgr2=0x7f55b0107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:10.999+0000 7f55b5e77640 1 --2- 172.21.15.103:0/1803653632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01078b0 0x7f55b0107c90 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009930 tx=0x7f55a002a420 comp rx=0 tx=0).stop 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 -- 172.21.15.103:0/1803653632 shutdown_connections 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 --2- 172.21.15.103:0/1803653632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55b0102250 0x7f55b010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 --2- 172.21.15.103:0/1803653632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b01018b0 0x7f55b0101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 --2- 172.21.15.103:0/1803653632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01078b0 0x7f55b0107c90 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 -- 172.21.15.103:0/1803653632 >> 172.21.15.103:0/1803653632 conn(0x7f55b00fd5f0 msgr2=0x7f55b00ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 -- 172.21.15.103:0/1803653632 shutdown_connections 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 -- 172.21.15.103:0/1803653632 wait complete. 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 Processor -- start 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.000+0000 7f55b5e77640 1 -- start start 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55b5e77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01018b0 0x7f55b01983f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55b5e77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55b0102250 0x7f55b0198930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55b5e77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b01078b0 0x7f55b019ccc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55b5e77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f55b0111e90 con 0x7f55b01018b0 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55b5e77640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f55b0111d10 con 0x7f55b0102250 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55b5e77640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f55b0112010 con 0x7f55b01078b0 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01018b0 0x7f55b01983f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01018b0 0x7f55b01983f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49734/0 (socket says 172.21.15.103:49734) 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 -- 172.21.15.103:0/2533061496 learned_addr learned my addr 172.21.15.103:0/2533061496 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55aeffd640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55b0102250 0x7f55b0198930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55affff640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b01078b0 0x7f55b019ccc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 -- 172.21.15.103:0/2533061496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b01078b0 msgr2=0x7f55b019ccc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b01078b0 0x7f55b019ccc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 -- 172.21.15.103:0/2533061496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55b0102250 msgr2=0x7f55b0198930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55b0102250 0x7f55b0198930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 -- 172.21.15.103:0/2533061496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f55b019d3a0 con 0x7f55b01018b0 2024-08-02T18:49:11.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.001+0000 7f55af7fe640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01018b0 0x7f55b01983f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009a50 tx=0x7f55a0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.002+0000 7f55acff9640 1 -- 172.21.15.103:0/2533061496 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a003f030 con 0x7f55b01018b0 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.002+0000 7f55b5e77640 1 -- 172.21.15.103:0/2533061496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f55b019d630 con 0x7f55b01018b0 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.002+0000 7f55acff9640 1 -- 172.21.15.103:0/2533061496 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55a0003af0 con 0x7f55b01018b0 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.002+0000 7f55acff9640 1 -- 172.21.15.103:0/2533061496 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0035070 con 0x7f55b01018b0 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.002+0000 7f55b5e77640 1 -- 172.21.15.103:0/2533061496 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f55b01a4f70 con 0x7f55b01018b0 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55acff9640 1 -- 172.21.15.103:0/2533061496 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f55a0042030 con 0x7f55b01018b0 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55b8275740 1 Processor -- start 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55b8275740 1 -- start start 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55b8275740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b5b8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55b8275740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5be10 0x556256b6a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55acff9640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55980a2c90 0x7f55980a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55b8275740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b6d010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55b8275740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556256ac0710 con 0x556256b5be10 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55b8275740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556256a58770 con 0x556256b5b4f0 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.004+0000 7f55b8275740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556256abc6d0 con 0x556256b6ac20 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5be10 0x556256b6a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55aeffd640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55980a2c90 0x7f55980a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5be10 0x556256b6a6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49748/0 (socket says 172.21.15.103:49748) 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 -- 172.21.15.103:0/3028703184 learned_addr learned my addr 172.21.15.103:0/3028703184 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55affff640 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b5b8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55affff640 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b6d010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55acff9640 1 -- 172.21.15.103:0/2533061496 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f55a00efa90 con 0x7f55b01018b0 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 -- 172.21.15.103:0/3028703184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 msgr2=0x556256b6d010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:11.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b6d010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 -- 172.21.15.103:0/3028703184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 msgr2=0x556256b5b8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b5b8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 -- 172.21.15.103:0/3028703184 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556256a5f3e0 con 0x556256b5be10 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55affff640 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b5b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55aeffd640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55980a2c90 0x7f55980a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ffbf0 tx=0x7f55a4008040 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f55af7fe640 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5be10 0x556256b6a6e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f55a0045000 tx=0x7f55a00b8200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38225ea7505fcfcc server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.005+0000 7f5595ffb640 1 -- 172.21.15.103:0/3028703184 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a0049070 con 0x556256b5be10 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f5595ffb640 1 -- 172.21.15.103:0/3028703184 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55a00bbe30 con 0x556256b5be10 2024-08-02T18:49:11.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f5595ffb640 1 -- 172.21.15.103:0/3028703184 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a003b460 con 0x556256b5be10 2024-08-02T18:49:11.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 -- 172.21.15.103:0/3028703184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5be10 msgr2=0x556256b6a6e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5be10 0x556256b6a6e0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f55a0045000 tx=0x7f55a00b8200 comp rx=0 tx=0).stop 2024-08-02T18:49:11.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 -- 172.21.15.103:0/3028703184 shutdown_connections 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b6d010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5be10 0x556256b6a6e0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 --2- 172.21.15.103:0/3028703184 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b5b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 -- 172.21.15.103:0/3028703184 >> 172.21.15.103:0/3028703184 conn(0x556256b57bc0 msgr2=0x556256b57fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 -- 172.21.15.103:0/3028703184 shutdown_connections 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.006+0000 7f55b8275740 1 -- 172.21.15.103:0/3028703184 wait complete. 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 1 -- start start 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 1 Processor -- start 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b67bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b68110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b6ac20 0x556256b68650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556256ac0710 con 0x556256b5b4f0 2024-08-02T18:49:11.014 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556256a7b970 con 0x556256b6ac20 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556256b6d5b0 con 0x556256b5be10 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55b8275740 10 client.0 _ll_register_callbacks cb 0x5562567cf7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b67bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b67bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49756/0 (socket says 172.21.15.103:49756) 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55af7fe640 1 -- 172.21.15.103:0/4059185937 learned_addr learned my addr 172.21.15.103:0/4059185937 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55affff640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b6ac20 0x556256b68650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55af7fe640 1 -- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 msgr2=0x556256b68110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55aeffd640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b68110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.007+0000 7f55af7fe640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b68110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55af7fe640 1 -- 172.21.15.103:0/4059185937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b6ac20 msgr2=0x556256b68650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55af7fe640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b6ac20 0x556256b68650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55af7fe640 1 -- 172.21.15.103:0/4059185937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562568322b0 con 0x556256b5b4f0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55affff640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b6ac20 0x556256b68650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55aeffd640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b68110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55af7fe640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b67bd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f55a00c6010 tx=0x7f55a002a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51b2f6e53213e798 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f558effd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f558effd640 1 -- 172.21.15.103:0/4059185937 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a00d8030 con 0x556256b5b4f0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f558effd640 1 -- 172.21.15.103:0/4059185937 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f55a00ba130 con 0x556256b5b4f0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55b8275740 1 -- 172.21.15.103:0/4059185937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55a00bbe30 con 0x556256b5b4f0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f558effd640 1 -- 172.21.15.103:0/4059185937 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f55a0049040 con 0x556256b5b4f0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55b8275740 10 client.15075 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55b8275740 1 -- 172.21.15.103:0/4059185937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556256b79150 con 0x556256b5b4f0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f558effd640 1 -- 172.21.15.103:0/4059185937 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55a00bbe30 con 0x556256b5b4f0 2024-08-02T18:49:11.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f558effd640 1 -- 172.21.15.103:0/4059185937 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f55a004c060 con 0x556256b5b4f0 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55b8275740 10 client.15075 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55b8275740 10 client.15075 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.008+0000 7f55b8275740 20 client.15075 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.009+0000 7f55b8275740 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556256b7b400 0x556256b7c870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.009+0000 7f55b8275740 4 client.15075 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.009+0000 7f55b8275740 1 -- 172.21.15.103:0/4059185937 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556256acdc80 con 0x556256b7b400 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.009+0000 7f55aeffd640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556256b7b400 0x556256b7c870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.009+0000 7f558effd640 10 client.15075 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.009+0000 7f55aeffd640 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556256b7b400 0x556256b7c870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4077ade5e095fd90 server_cookie=596d8ba368206a17 in_seq=0 out_seq=0 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f558effd640 1 -- 172.21.15.103:0/4059185937 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556256acdc80 con 0x556256b7b400 2024-08-02T18:49:11.017 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f558effd640 10 client.15075 handle_command_reply: tid=0 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f55b8275740 1 client.15075 shutdown 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f55b8275740 1 -- 172.21.15.103:0/4059185937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 msgr2=0x556256b67bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f55b8275740 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b67bd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f55a00c6010 tx=0x7f55a002a420 comp rx=0 tx=0).stop 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f55b8275740 1 -- 172.21.15.103:0/4059185937 shutdown_connections 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f55b8275740 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b6ac20 0x556256b68650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f55b8275740 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b68110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f55b8275740 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556256b7b400 0x556256b7c870 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.011+0000 7f558effd640 0 client.15075 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.010+0000 7f55b8275740 1 --2- 172.21.15.103:0/4059185937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b67bd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.011+0000 7f55b8275740 1 -- 172.21.15.103:0/4059185937 >> 172.21.15.103:0/4059185937 conn(0x556256b57bc0 msgr2=0x556256b5d920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.011+0000 7f55b8275740 1 -- 172.21.15.103:0/4059185937 shutdown_connections 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.011+0000 7f55b8275740 1 -- 172.21.15.103:0/4059185937 wait complete. 2024-08-02T18:49:11.018 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.011+0000 7f55b8275740 20 client.15075 trim_cache size 0 max 16384 2024-08-02T18:49:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55b8275740 1 Processor -- start 2024-08-02T18:49:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55b8275740 1 -- start start 2024-08-02T18:49:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55b8275740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b6a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55b8275740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b56c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55b8275740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b6ac20 0x556256b684a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55b8275740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556256b7abb0 con 0x556256b6ac20 2024-08-02T18:49:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55b8275740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556256b7b280 con 0x556256b5b4f0 2024-08-02T18:49:11.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55b8275740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556256b7b950 con 0x556256b5be10 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b6ac20 0x556256b684a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b6ac20 0x556256b684a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49768/0 (socket says 172.21.15.103:49768) 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.028+0000 7f55affff640 1 -- 172.21.15.103:0/2717044001 learned_addr learned my addr 172.21.15.103:0/2717044001 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55af7fe640 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b6a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55aeffd640 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b56c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55affff640 1 -- 172.21.15.103:0/2717044001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 msgr2=0x556256b56c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55affff640 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b56c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55affff640 1 -- 172.21.15.103:0/2717044001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 msgr2=0x556256b6a330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55affff640 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b6a330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55affff640 1 -- 172.21.15.103:0/2717044001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556256b66b80 con 0x556256b6ac20 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55aeffd640 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b56c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:11.036 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55af7fe640 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b6a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55affff640 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b6ac20 0x556256b684a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f55a800a430 tx=0x7f55a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c934c7662b57f30 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55957fa640 1 -- 172.21.15.103:0/2717044001 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8013040 con 0x556256b6ac20 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55957fa640 1 -- 172.21.15.103:0/2717044001 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55a801e070 con 0x556256b6ac20 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.029+0000 7f55957fa640 1 -- 172.21.15.103:0/2717044001 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a8016be0 con 0x556256b6ac20 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 -- 172.21.15.103:0/2717044001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b6ac20 msgr2=0x556256b684a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b6ac20 0x556256b684a0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f55a800a430 tx=0x7f55a8004a40 comp rx=0 tx=0).stop 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 -- 172.21.15.103:0/2717044001 shutdown_connections 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b6ac20 0x556256b684a0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b5be10 0x556256b56c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 --2- 172.21.15.103:0/2717044001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5b4f0 0x556256b6a330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 -- 172.21.15.103:0/2717044001 >> 172.21.15.103:0/2717044001 conn(0x556256b57bc0 msgr2=0x556256b56520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 -- 172.21.15.103:0/2717044001 shutdown_connections 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 -- 172.21.15.103:0/2717044001 wait complete. 2024-08-02T18:49:11.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 -- start start 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.030+0000 7f55b8275740 1 Processor -- start 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55b8275740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b7e950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55b8275740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5be10 0x556256b7ee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55b8275740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b7f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55b8275740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556256b7c6f0 con 0x556256b5b4f0 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55b8275740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556256b7c020 con 0x556256b5be10 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55b8275740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556256b7cdc0 con 0x556256b6ac20 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55b8275740 10 client.0 _ll_register_callbacks cb 0x7f55a8009c30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b7e950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b7e950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49784/0 (socket says 172.21.15.103:49784) 2024-08-02T18:49:11.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 -- 172.21.15.103:0/3182632275 learned_addr learned my addr 172.21.15.103:0/3182632275 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55affff640 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b7f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55aeffd640 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5be10 0x556256b7ee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 -- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 msgr2=0x556256b7f3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b7f3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 -- 172.21.15.103:0/3182632275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5be10 msgr2=0x556256b7ee90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5be10 0x556256b7ee90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 -- 172.21.15.103:0/3182632275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556256b831f0 con 0x556256b5b4f0 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55affff640 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b7f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55af7fe640 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b7e950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f55a00d6040 tx=0x7f55a00ed330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f808f109c5f19b73 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f558effd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f558effd640 1 -- 172.21.15.103:0/3182632275 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f55a00d8070 con 0x556256b5b4f0 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f558effd640 1 -- 172.21.15.103:0/3182632275 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f55a003b460 con 0x556256b5b4f0 2024-08-02T18:49:11.039 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.031+0000 7f55b8275740 1 -- 172.21.15.103:0/3182632275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f55a801e070 con 0x556256b5b4f0 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f558effd640 1 -- 172.21.15.103:0/3182632275 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f55a00a4050 con 0x556256b5b4f0 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55b8275740 10 client.15081 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55b8275740 1 -- 172.21.15.103:0/3182632275 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x556256b831f0 con 0x556256b5b4f0 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f558effd640 1 -- 172.21.15.103:0/3182632275 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f55a801e070 con 0x556256b5b4f0 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f558effd640 1 -- 172.21.15.103:0/3182632275 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f55a00c4610 con 0x556256b5b4f0 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55b8275740 10 client.15081 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55b8275740 10 client.15081 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55b8275740 20 client.15081 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55b8275740 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556256b7b400 0x556256be92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55b8275740 4 client.15081 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55b8275740 1 -- 172.21.15.103:0/3182632275 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "status"}) -- 0x556256ac8190 con 0x556256b7b400 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.032+0000 7f55aeffd640 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556256b7b400 0x556256be92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f558effd640 10 client.15081 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:49:11.040 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55aeffd640 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556256b7b400 0x556256be92f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=df7cb7cb6c1db90e server_cookie=8e8f8d622ada621a in_seq=0 out_seq=0 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f558effd640 1 -- 172.21.15.103:0/3182632275 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x556256ac8190 con 0x556256b7b400 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f558effd640 10 client.15081 handle_command_reply: tid=0 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 client.15081 shutdown 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 -- 172.21.15.103:0/3182632275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 msgr2=0x556256b7e950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b7e950 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f55a00d6040 tx=0x7f55a00ed330 comp rx=0 tx=0).stop 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 -- 172.21.15.103:0/3182632275 shutdown_connections 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556256b6ac20 0x556256b7f3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556256b5be10 0x556256b7ee90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556256b7b400 0x556256be92f0 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 --2- 172.21.15.103:0/3182632275 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556256b5b4f0 0x556256b7e950 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f558effd640 0 client.15081 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 -- 172.21.15.103:0/3182632275 >> 172.21.15.103:0/3182632275 conn(0x556256b57bc0 msgr2=0x556256b76060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:11.041 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 -- 172.21.15.103:0/3182632275 shutdown_connections 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 1 -- 172.21.15.103:0/3182632275 wait complete. 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.033+0000 7f55b8275740 20 client.15081 trim_cache size 0 max 16384 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24454, 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:49:11.042 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 68.591587094000005, 2024-08-02T18:49:11.043 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-08-02T18:49:11.043 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-08-02T18:49:11.043 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-08-02T18:49:11.043 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 134.69204166399999 2024-08-02T18:49:11.043 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 -- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55980a2c90 msgr2=0x7f55980a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55980a2c90 0x7f55980a5150 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f55b00ffbf0 tx=0x7f55a4008040 comp rx=0 tx=0).stop 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 -- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01018b0 msgr2=0x7f55b01983f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01018b0 0x7f55b01983f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f55a0009a50 tx=0x7f55a0004270 comp rx=0 tx=0).stop 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 -- 172.21.15.103:0/2533061496 shutdown_connections 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f55980a2c90 0x7f55980a5150 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f55b01078b0 0x7f55b019ccc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f55b0102250 0x7f55b0198930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 --2- 172.21.15.103:0/2533061496 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f55b01018b0 0x7f55b01983f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 -- 172.21.15.103:0/2533061496 >> 172.21.15.103:0/2533061496 conn(0x7f55b00fd5f0 msgr2=0x7f55b00fdea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 -- 172.21.15.103:0/2533061496 shutdown_connections 2024-08-02T18:49:11.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:11.034+0000 7f55b5e77640 1 -- 172.21.15.103:0/2533061496 wait complete. 2024-08-02T18:49:11.866 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.i status 2024-08-02T18:49:12.120 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 -- 172.21.15.103:0/1839519327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c102260 msgr2=0x7f438c10e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 --2- 172.21.15.103:0/1839519327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c102260 0x7f438c10e790 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f4384009cd0 tx=0x7f438402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 -- 172.21.15.103:0/1839519327 shutdown_connections 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 --2- 172.21.15.103:0/1839519327 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c102260 0x7f438c10e790 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 --2- 172.21.15.103:0/1839519327 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f438c1018c0 0x7f438c101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 --2- 172.21.15.103:0/1839519327 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438c1078c0 0x7f438c107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 -- 172.21.15.103:0/1839519327 >> 172.21.15.103:0/1839519327 conn(0x7f438c0fd5e0 msgr2=0x7f438c0ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 -- 172.21.15.103:0/1839519327 shutdown_connections 2024-08-02T18:49:12.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.587+0000 7f4394278640 1 -- 172.21.15.103:0/1839519327 wait complete. 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4394278640 1 Processor -- start 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4394278640 1 -- start start 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4394278640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f438c1018c0 0x7f438c074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4394278640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438c102260 0x7f438c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4394278640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c1078c0 0x7f438c074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4394278640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f438c111e20 con 0x7f438c1078c0 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4394278640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f438c111ca0 con 0x7f438c102260 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4394278640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f438c111fa0 con 0x7f438c1018c0 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c1078c0 0x7f438c074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c1078c0 0x7f438c074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49814/0 (socket says 172.21.15.103:49814) 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 -- 172.21.15.103:0/3036071665 learned_addr learned my addr 172.21.15.103:0/3036071665 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:12.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392014640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f438c1018c0 0x7f438c074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4391813640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438c102260 0x7f438c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 -- 172.21.15.103:0/3036071665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f438c1018c0 msgr2=0x7f438c074220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f438c1018c0 0x7f438c074220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 -- 172.21.15.103:0/3036071665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438c102260 msgr2=0x7f438c074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438c102260 0x7f438c074760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 -- 172.21.15.103:0/3036071665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f438c1a6740 con 0x7f438c1078c0 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4391813640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438c102260 0x7f438c074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.588+0000 7f4392815640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c1078c0 0x7f438c074ca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4384009df0 tx=0x7f4384032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.589+0000 7f437f7fe640 1 -- 172.21.15.103:0/3036071665 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4384004240 con 0x7f438c1078c0 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.589+0000 7f437f7fe640 1 -- 172.21.15.103:0/3036071665 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f43840305a0 con 0x7f438c1078c0 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.589+0000 7f4394278640 1 -- 172.21.15.103:0/3036071665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f438c1a69d0 con 0x7f438c1078c0 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.589+0000 7f437f7fe640 1 -- 172.21.15.103:0/3036071665 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43840466c0 con 0x7f438c1078c0 2024-08-02T18:49:12.610 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.589+0000 7f4394278640 1 -- 172.21.15.103:0/3036071665 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f438c1a6f10 con 0x7f438c1078c0 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.591+0000 7f437f7fe640 1 -- 172.21.15.103:0/3036071665 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f4384030750 con 0x7f438c1078c0 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.591+0000 7f4396676740 1 Processor -- start 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.591+0000 7f4396676740 1 -- start start 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.591+0000 7f4396676740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 0x55ce77658a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.591+0000 7f4396676740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce776632d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4396676740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77665c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4396676740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ce775bd710 con 0x55ce77658f50 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4396676740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ce77555770 con 0x55ce77663810 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4396676740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ce775b96d0 con 0x55ce77658630 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce776632d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce776632d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49818/0 (socket says 172.21.15.103:49818) 2024-08-02T18:49:12.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 -- 172.21.15.103:0/1781478177 learned_addr learned my addr 172.21.15.103:0/1781478177 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f437f7fe640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f43780a2c10 0x7f43780a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4391813640 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 0x55ce77658a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4391813640 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77665c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392815640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f43780a2c10 0x7f43780a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f437f7fe640 1 -- 172.21.15.103:0/3036071665 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f438402e030 con 0x7f438c1078c0 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 -- 172.21.15.103:0/1781478177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 msgr2=0x55ce77658a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 0x55ce77658a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 -- 172.21.15.103:0/1781478177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 msgr2=0x55ce77665c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77665c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 -- 172.21.15.103:0/1781478177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce7755c3e0 con 0x55ce77658f50 2024-08-02T18:49:12.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392014640 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce776632d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f438800cbf0 tx=0x7f438800e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=945398c42758d858 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:12.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f4392815640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f43780a2c10 0x7f43780a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f43840b9440 tx=0x7f438402a8e0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:12.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.592+0000 7f437cdea640 1 -- 172.21.15.103:0/1781478177 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388010630 con 0x55ce77658f50 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f437cdea640 1 -- 172.21.15.103:0/1781478177 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4388010cd0 con 0x55ce77658f50 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f437cdea640 1 -- 172.21.15.103:0/1781478177 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438800fcf0 con 0x55ce77658f50 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 -- 172.21.15.103:0/1781478177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 msgr2=0x55ce776632d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce776632d0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7f438800cbf0 tx=0x7f438800e720 comp rx=0 tx=0).stop 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 -- 172.21.15.103:0/1781478177 shutdown_connections 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77665c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce776632d0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 --2- 172.21.15.103:0/1781478177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 0x55ce77658a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 -- 172.21.15.103:0/1781478177 >> 172.21.15.103:0/1781478177 conn(0x55ce77654bc0 msgr2=0x55ce77654fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:12.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 -- 172.21.15.103:0/1781478177 shutdown_connections 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.593+0000 7f4396676740 1 -- 172.21.15.103:0/1781478177 wait complete. 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 1 -- start start 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 1 Processor -- start 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 0x55ce77660670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce77660bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77663810 0x55ce776610f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ce776663e0 con 0x55ce77658f50 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ce77578970 con 0x55ce77658630 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ce77666560 con 0x55ce77663810 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4396676740 10 client.0 _ll_register_callbacks cb 0x55ce772cc7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:12.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4392014640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce77660bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4392014640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce77660bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49822/0 (socket says 172.21.15.103:49822) 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4392014640 1 -- 172.21.15.103:0/771917754 learned_addr learned my addr 172.21.15.103:0/771917754 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4391813640 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77663810 0x55ce776610f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4392014640 1 -- 172.21.15.103:0/771917754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77663810 msgr2=0x55ce776610f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4392014640 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77663810 0x55ce776610f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4392014640 1 -- 172.21.15.103:0/771917754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 msgr2=0x55ce77660670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4391813640 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 0x55ce77660670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4392014640 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 0x55ce77660670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.594+0000 7f4392014640 1 -- 172.21.15.103:0/771917754 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce7732f2b0 con 0x55ce77658f50 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4392014640 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce77660bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f438800f870 tx=0x7f438800f5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=989079b4880cf3b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4375ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4375ffb640 1 -- 172.21.15.103:0/771917754 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438800c7f0 con 0x55ce77658f50 2024-08-02T18:49:12.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4375ffb640 1 -- 172.21.15.103:0/771917754 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f4388005260 con 0x55ce77658f50 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 1 -- 172.21.15.103:0/771917754 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4388010cd0 con 0x55ce77658f50 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4375ffb640 1 -- 172.21.15.103:0/771917754 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f4388005460 con 0x55ce77658f50 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 10 client.15093 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 1 -- 172.21.15.103:0/771917754 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce77671fa0 con 0x55ce77658f50 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4375ffb640 1 -- 172.21.15.103:0/771917754 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4388010cd0 con 0x55ce77658f50 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4375ffb640 1 -- 172.21.15.103:0/771917754 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f4388004750 con 0x55ce77658f50 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 10 client.15093 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 10 client.15093 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 20 client.15093 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ce77674420 0x55ce77675890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 4 client.15093 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.595+0000 7f4396676740 1 -- 172.21.15.103:0/771917754 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ce775cac80 con 0x55ce77674420 2024-08-02T18:49:12.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.596+0000 7f4391813640 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ce77674420 0x55ce77675890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.596+0000 7f4375ffb640 10 client.15093 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.596+0000 7f4391813640 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ce77674420 0x55ce77675890 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f57d9317b8959ae3 server_cookie=4680269df4cf5296 in_seq=0 out_seq=0 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4375ffb640 1 -- 172.21.15.103:0/771917754 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ce775cac80 con 0x55ce77674420 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4375ffb640 10 client.15093 handle_command_reply: tid=0 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 client.15093 shutdown 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 -- 172.21.15.103:0/771917754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 msgr2=0x55ce77660bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce77660bb0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f438800f870 tx=0x7f438800f5f0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 -- 172.21.15.103:0/771917754 shutdown_connections 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77663810 0x55ce776610f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce77660bb0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ce77674420 0x55ce77675890 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 --2- 172.21.15.103:0/771917754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 0x55ce77660670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4375ffb640 0 client.15093 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:49:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 -- 172.21.15.103:0/771917754 >> 172.21.15.103:0/771917754 conn(0x55ce77654bc0 msgr2=0x55ce77653d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 -- 172.21.15.103:0/771917754 shutdown_connections 2024-08-02T18:49:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 1 -- 172.21.15.103:0/771917754 wait complete. 2024-08-02T18:49:12.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.597+0000 7f4396676740 20 client.15093 trim_cache size 0 max 16384 2024-08-02T18:49:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4396676740 1 Processor -- start 2024-08-02T18:49:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4396676740 1 -- start start 2024-08-02T18:49:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4396676740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 0x55ce77675890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4396676740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce7765b090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4396676740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77662dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4396676740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ce77673bd0 con 0x55ce77658f50 2024-08-02T18:49:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4396676740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ce776742a0 con 0x55ce77663810 2024-08-02T18:49:12.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4396676740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ce77674970 con 0x55ce77658630 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce7765b090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce7765b090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49828/0 (socket says 172.21.15.103:49828) 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 -- 172.21.15.103:0/1949008611 learned_addr learned my addr 172.21.15.103:0/1949008611 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4391813640 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 0x55ce77675890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 -- 172.21.15.103:0/1949008611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 msgr2=0x55ce77675890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4391813640 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77662dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 0x55ce77675890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 -- 172.21.15.103:0/1949008611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 msgr2=0x55ce77662dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77662dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 -- 172.21.15.103:0/1949008611 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ce776549f0 con 0x55ce77658f50 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4391813640 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77662dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.615+0000 7f4392014640 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce7765b090 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4388004d80 tx=0x7f438800c4f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4cca4cb8b7bdec32 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:12.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4377fff640 1 -- 172.21.15.103:0/1949008611 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438801e070 con 0x55ce77658f50 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4377fff640 1 -- 172.21.15.103:0/1949008611 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f438800c7f0 con 0x55ce77658f50 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4377fff640 1 -- 172.21.15.103:0/1949008611 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4388025b30 con 0x55ce77658f50 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 -- 172.21.15.103:0/1949008611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 msgr2=0x55ce7765b090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce7765b090 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f4388004d80 tx=0x7f438800c4f0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 -- 172.21.15.103:0/1949008611 shutdown_connections 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77663810 0x55ce77662dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77658f50 0x55ce7765b090 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 --2- 172.21.15.103:0/1949008611 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658630 0x55ce77675890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 -- 172.21.15.103:0/1949008611 >> 172.21.15.103:0/1949008611 conn(0x55ce77654bc0 msgr2=0x55ce7765f760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 -- 172.21.15.103:0/1949008611 shutdown_connections 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.616+0000 7f4396676740 1 -- 172.21.15.103:0/1949008611 wait complete. 2024-08-02T18:49:12.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 1 -- start start 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 1 Processor -- start 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 0x55ce7767e2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658f50 0x55ce776775d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77663810 0x55ce77677b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ce77675710 con 0x55ce77663810 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ce77675040 con 0x55ce77658630 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ce77675de0 con 0x55ce77658f50 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4396676740 10 client.0 _ll_register_callbacks cb 0x7f4388014070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77663810 0x55ce77677b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77663810 0x55ce77677b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49840/0 (socket says 172.21.15.103:49840) 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 -- 172.21.15.103:0/4122086199 learned_addr learned my addr 172.21.15.103:0/4122086199 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 0x55ce7767e2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4392014640 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658f50 0x55ce776775d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 -- 172.21.15.103:0/4122086199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658f50 msgr2=0x55ce776775d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658f50 0x55ce776775d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 -- 172.21.15.103:0/4122086199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 msgr2=0x55ce7767e2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 0x55ce7767e2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 -- 172.21.15.103:0/4122086199 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ce77650130 con 0x55ce77663810 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.617+0000 7f4391813640 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77663810 0x55ce77677b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4380015380 tx=0x7f438800fda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbd3abb05c0e647f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4375ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4375ffb640 1 -- 172.21.15.103:0/4122086199 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f438000f040 con 0x55ce77663810 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 1 -- 172.21.15.103:0/4122086199 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f438800c7f0 con 0x55ce77663810 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4375ffb640 1 -- 172.21.15.103:0/4122086199 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f43800156f0 con 0x55ce77663810 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4375ffb640 1 -- 172.21.15.103:0/4122086199 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f43800158f0 con 0x55ce77663810 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 10 client.15099 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 1 -- 172.21.15.103:0/4122086199 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x55ce7767cbc0 con 0x55ce77663810 2024-08-02T18:49:12.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4375ffb640 1 -- 172.21.15.103:0/4122086199 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f438800c7f0 con 0x55ce77663810 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4375ffb640 1 -- 172.21.15.103:0/4122086199 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f4380015040 con 0x55ce77663810 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 10 client.15099 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 10 client.15099 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 20 client.15099 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ce776e3520 0x55ce776e2230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 4 client.15099 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.618+0000 7f4396676740 1 -- 172.21.15.103:0/4122086199 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "status"}) -- 0x55ce775c5190 con 0x55ce776e3520 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4392014640 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ce776e3520 0x55ce776e2230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4392014640 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ce776e3520 0x55ce776e2230 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=2381818c88baffd5 server_cookie=32df73e58ce6a852 in_seq=0 out_seq=0 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4375ffb640 10 client.15099 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4375ffb640 1 -- 172.21.15.103:0/4122086199 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55ce775c5190 con 0x55ce776e3520 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4375ffb640 10 client.15099 handle_command_reply: tid=0 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 client.15099 shutdown 2024-08-02T18:49:12.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 -- 172.21.15.103:0/4122086199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77663810 msgr2=0x55ce77677b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77663810 0x55ce77677b10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f4380015380 tx=0x7f438800fda0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 -- 172.21.15.103:0/4122086199 shutdown_connections 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ce77663810 0x55ce77677b10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ce77658f50 0x55ce776775d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ce776e3520 0x55ce776e2230 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 --2- 172.21.15.103:0/4122086199 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ce77658630 0x55ce7767e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4375ffb640 0 client.15099 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 -- 172.21.15.103:0/4122086199 >> 172.21.15.103:0/4122086199 conn(0x55ce77654bc0 msgr2=0x55ce77653520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.619+0000 7f4396676740 1 -- 172.21.15.103:0/4122086199 shutdown_connections 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4396676740 1 -- 172.21.15.103:0/4122086199 wait complete. 2024-08-02T18:49:12.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4396676740 20 client.15099 trim_cache size 0 max 16384 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24469, 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 71.183782155000003, 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-08-02T18:49:12.631 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-08-02T18:49:12.632 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 130.865168173 2024-08-02T18:49:12.632 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:49:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 -- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f43780a2c10 msgr2=0x7f43780a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f43780a2c10 0x7f43780a50d0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f43840b9440 tx=0x7f438402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 -- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c1078c0 msgr2=0x7f438c074ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c1078c0 0x7f438c074ca0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f4384009df0 tx=0x7f4384032c00 comp rx=0 tx=0).stop 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 -- 172.21.15.103:0/3036071665 shutdown_connections 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f438c1078c0 0x7f438c074ca0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f438c102260 0x7f438c074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f43780a2c10 0x7f43780a50d0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 --2- 172.21.15.103:0/3036071665 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f438c1018c0 0x7f438c074220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 -- 172.21.15.103:0/3036071665 >> 172.21.15.103:0/3036071665 conn(0x7f438c0fd5e0 msgr2=0x7f438c0fdc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 -- 172.21.15.103:0/3036071665 shutdown_connections 2024-08-02T18:49:12.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:12.620+0000 7f4394278640 1 -- 172.21.15.103:0/3036071665 wait complete. 2024-08-02T18:49:12.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:12 smithi151 ceph-mon[37155]: pgmap v322: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:12.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:12 smithi103 ceph-mon[32753]: pgmap v322: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:13.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:12 smithi121 ceph-mon[37236]: pgmap v322: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:13.520 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.b status 2024-08-02T18:49:13.775 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/3844943266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb4100b50 msgr2=0x7f3fb4100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/3844943266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb4100b50 0x7f3fb4100f30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009900 tx=0x7f3fb002a480 comp rx=0 tx=0).stop 2024-08-02T18:49:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/3844943266 shutdown_connections 2024-08-02T18:49:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/3844943266 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb4102c20 0x7f3fb410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/3844943266 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fb41022a0 0x7f3fb41026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/3844943266 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb4100b50 0x7f3fb4100f30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/3844943266 >> 172.21.15.103:0/3844943266 conn(0x7f3fb40fc500 msgr2=0x7f3fb40fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:14.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/3844943266 shutdown_connections 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/3844943266 wait complete. 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 Processor -- start 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.265+0000 7f3fbc5c9640 1 -- start start 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fbc5c9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fb4100b50 0x7f3fb4196f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fbc5c9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb41022a0 0x7f3fb41974c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fbc5c9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb4102c20 0x7f3fb4197a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fbc5c9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4110e10 con 0x7f3fb41022a0 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fbc5c9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4110c90 con 0x7f3fb4102c20 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fbc5c9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3fb4110f90 con 0x7f3fb4100b50 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb41022a0 0x7f3fb41974c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb41022a0 0x7f3fb41974c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49868/0 (socket says 172.21.15.103:49868) 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 -- 172.21.15.103:0/4280951784 learned_addr learned my addr 172.21.15.103:0/4280951784 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:14.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fbab66640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb4102c20 0x7f3fb4197a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fba365640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fb4100b50 0x7f3fb4196f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 -- 172.21.15.103:0/4280951784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fb4100b50 msgr2=0x7f3fb4196f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fb4100b50 0x7f3fb4196f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 -- 172.21.15.103:0/4280951784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb4102c20 msgr2=0x7f3fb4197a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb4102c20 0x7f3fb4197a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 -- 172.21.15.103:0/4280951784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3fb41a67f0 con 0x7f3fb41022a0 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fba365640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fb4100b50 0x7f3fb4196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb41022a0 0x7f3fb41974c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c890 tx=0x7f3fa400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fab7fe640 1 -- 172.21.15.103:0/4280951784 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4004220 con 0x7f3fb41022a0 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/4280951784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3fb41a6ae0 con 0x7f3fb41022a0 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fab7fe640 1 -- 172.21.15.103:0/4280951784 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fa40043c0 con 0x7f3fb41022a0 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.266+0000 7f3fab7fe640 1 -- 172.21.15.103:0/4280951784 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fa4004b10 con 0x7f3fb41022a0 2024-08-02T18:49:14.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.267+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/4280951784 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3fb41a7020 con 0x7f3fb41022a0 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.269+0000 7f3fab7fe640 1 -- 172.21.15.103:0/4280951784 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f3fa40051b0 con 0x7f3fb41022a0 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.269+0000 7f3fbe9c7740 1 Processor -- start 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.269+0000 7f3fbe9c7740 1 -- start start 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b2fa10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2ff50 0x563452b3a2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b3a810 0x563452b3cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563452a94710 con 0x563452b2f630 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563452a2c770 con 0x563452b2ff50 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563452a906d0 con 0x563452b3a810 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fab7fe640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3fa00a2c10 0x7f3fa00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b2fa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b2fa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49882/0 (socket says 172.21.15.103:49882) 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 -- 172.21.15.103:0/2863265649 learned_addr learned my addr 172.21.15.103:0/2863265649 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fba365640 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2ff50 0x563452b3a2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b3a810 0x563452b3cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3fa00a2c10 0x7f3fa00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fab7fe640 1 -- 172.21.15.103:0/4280951784 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3fa40cf6d0 con 0x7f3fb41022a0 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 -- 172.21.15.103:0/2863265649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b3a810 msgr2=0x563452b3cc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b3a810 0x563452b3cc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 -- 172.21.15.103:0/2863265649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2ff50 msgr2=0x563452b3a2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:14.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2ff50 0x563452b3a2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 -- 172.21.15.103:0/2863265649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563452a333e0 con 0x563452b2f630 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.270+0000 7f3fbab66640 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b2fa10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00a8b0 tx=0x7f3fac00ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6513636a23b4da3 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fa8ff9640 1 -- 172.21.15.103:0/2863265649 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac0188a0 con 0x563452b2f630 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fa8ff9640 1 -- 172.21.15.103:0/2863265649 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fac017370 con 0x563452b2f630 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fa8ff9640 1 -- 172.21.15.103:0/2863265649 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac008590 con 0x563452b2f630 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/2863265649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 msgr2=0x563452b2fa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fbab66640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3fa00a2c10 0x7f3fa00a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3fac01e000 tx=0x7f3fac01a000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b2fa10 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f3fac00a8b0 tx=0x7f3fac00ad70 comp rx=0 tx=0).stop 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/2863265649 shutdown_connections 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b3a810 0x563452b3cc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2ff50 0x563452b3a2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/2863265649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b2fa10 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.271+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/2863265649 >> 172.21.15.103:0/2863265649 conn(0x563452b2bbc0 msgr2=0x563452b2bfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/2863265649 shutdown_connections 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/2863265649 wait complete. 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 -- start start 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 Processor -- start 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 0x563452b37670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b37bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b380f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563452b3d3e0 con 0x563452b3a810 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563452a4f970 con 0x563452b2f630 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563452b3d560 con 0x563452b2ff50 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbe9c7740 10 client.0 _ll_register_callbacks cb 0x5634527a37b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbab66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b380f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbab66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b380f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49890/0 (socket says 172.21.15.103:49890) 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.272+0000 7f3fbab66640 1 -- 172.21.15.103:0/3573716474 learned_addr learned my addr 172.21.15.103:0/3573716474 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fba365640 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 0x563452b37670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbab66640 1 -- 172.21.15.103:0/3573716474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 msgr2=0x563452b37bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b37bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbab66640 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b37bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbab66640 1 -- 172.21.15.103:0/3573716474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 msgr2=0x563452b37670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbab66640 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 0x563452b37670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbab66640 1 -- 172.21.15.103:0/3573716474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5634528062b0 con 0x563452b3a810 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbab66640 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b380f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3fac017cc0 tx=0x7f3fac017750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f779033475b71e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3f9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3f9dffb640 1 -- 172.21.15.103:0/3573716474 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac025070 con 0x563452b3a810 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3f9dffb640 1 -- 172.21.15.103:0/3573716474 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3fac018ab0 con 0x563452b3a810 2024-08-02T18:49:14.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/3573716474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fac017370 con 0x563452b3a810 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3f9dffb640 1 -- 172.21.15.103:0/3573716474 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3fac039050 con 0x563452b3a810 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbe9c7740 10 client.15111 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/3573716474 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563452b48fa0 con 0x563452b3a810 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.273+0000 7f3f9dffb640 1 -- 172.21.15.103:0/3573716474 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fac017370 con 0x563452b3a810 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3f9dffb640 1 -- 172.21.15.103:0/3573716474 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3fac034030 con 0x563452b3a810 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3fbe9c7740 10 client.15111 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3fbe9c7740 10 client.15111 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3fbe9c7740 20 client.15111 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:14.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563452b4b410 0x563452b4c880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3fbe9c7740 4 client.15111 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/3573716474 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563452aa1c80 con 0x563452b4b410 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3fba365640 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563452b4b410 0x563452b4c880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3fba365640 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563452b4b410 0x563452b4c880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bf21b5b87fbec213 server_cookie=a5ceaddab0b7c7ed in_seq=0 out_seq=0 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.274+0000 7f3f9dffb640 10 client.15111 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.275+0000 7f3f9dffb640 1 -- 172.21.15.103:0/3573716474 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563452aa1c80 con 0x563452b4b410 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.275+0000 7f3f9dffb640 10 client.15111 handle_command_reply: tid=0 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.275+0000 7f3fbe9c7740 1 client.15111 shutdown 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.275+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/3573716474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 msgr2=0x563452b380f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.275+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b380f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f3fac017cc0 tx=0x7f3fac017750 comp rx=0 tx=0).stop 2024-08-02T18:49:14.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/3573716474 shutdown_connections 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563452b4b410 0x563452b4c880 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b380f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b37bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3f9dffb640 0 client.15111 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/3573716474 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 0x563452b37670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/3573716474 >> 172.21.15.103:0/3573716474 conn(0x563452b2bbc0 msgr2=0x563452b2ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/3573716474 shutdown_connections 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/3573716474 wait complete. 2024-08-02T18:49:14.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.276+0000 7f3fbe9c7740 20 client.15111 trim_cache size 0 max 16384 2024-08-02T18:49:14.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.293+0000 7f3fbe9c7740 1 Processor -- start 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.293+0000 7f3fbe9c7740 1 -- start start 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.293+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 0x563452b37f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.293+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b394d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.293+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b348d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.293+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563452b4abc0 con 0x563452b3a810 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.293+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563452b4b290 con 0x563452b2f630 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.293+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563452b4b960 con 0x563452b2ff50 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b348d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b348d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49904/0 (socket says 172.21.15.103:49904) 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 -- 172.21.15.103:0/1461970211 learned_addr learned my addr 172.21.15.103:0/1461970211 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fba365640 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 0x563452b37f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b394d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 -- 172.21.15.103:0/1461970211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 msgr2=0x563452b394d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b394d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 -- 172.21.15.103:0/1461970211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 msgr2=0x563452b37f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 0x563452b37f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 -- 172.21.15.103:0/1461970211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563452b2b9f0 con 0x563452b3a810 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3fbab66640 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b348d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009a50 tx=0x7f3fac00a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f38b28ea9c33c6d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3f9ffff640 1 -- 172.21.15.103:0/1461970211 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac025070 con 0x563452b3a810 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3f9ffff640 1 -- 172.21.15.103:0/1461970211 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fac0145c0 con 0x563452b3a810 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.294+0000 7f3f9ffff640 1 -- 172.21.15.103:0/1461970211 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fac017f80 con 0x563452b3a810 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1461970211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 msgr2=0x563452b348d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b348d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f3fac009a50 tx=0x7f3fac00a730 comp rx=0 tx=0).stop 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1461970211 shutdown_connections 2024-08-02T18:49:14.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b3a810 0x563452b348d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b394d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1461970211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b2f630 0x563452b37f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1461970211 >> 172.21.15.103:0/1461970211 conn(0x563452b2bbc0 msgr2=0x563452b38dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1461970211 shutdown_connections 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1461970211 wait complete. 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 -- start start 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.295+0000 7f3fbe9c7740 1 Processor -- start 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b54cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b55210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbe9c7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b3a810 0x563452b4e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563452b4c700 con 0x563452b2f630 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563452b4c030 con 0x563452b3a810 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbe9c7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563452b4cdd0 con 0x563452b2ff50 2024-08-02T18:49:14.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbe9c7740 10 client.0 _ll_register_callbacks cb 0x7f3fb0009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b54cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b54cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49914/0 (socket says 172.21.15.103:49914) 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 -- 172.21.15.103:0/1741577182 learned_addr learned my addr 172.21.15.103:0/1741577182 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbab66640 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b3a810 0x563452b4e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 -- 172.21.15.103:0/1741577182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 msgr2=0x563452b55210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b55210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b55210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 -- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b3a810 msgr2=0x563452b4e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b3a810 0x563452b4e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 -- 172.21.15.103:0/1741577182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563452b27130 con 0x563452b2f630 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbab66640 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b3a810 0x563452b4e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fba365640 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b54cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009900 tx=0x7f3fb002ab90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3beb7923510eef86 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:14.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3f9dffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3f9dffb640 1 -- 172.21.15.103:0/1741577182 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3fb0035040 con 0x563452b2f630 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3f9dffb640 1 -- 172.21.15.103:0/1741577182 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f3fb0004450 con 0x563452b2f630 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.296+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1741577182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3fac0145c0 con 0x563452b2f630 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3f9dffb640 1 -- 172.21.15.103:0/1741577182 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f3fb0057050 con 0x563452b2f630 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fbe9c7740 10 client.15117 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1741577182 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x563452b530d0 con 0x563452b2f630 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3f9dffb640 1 -- 172.21.15.103:0/1741577182 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3fac0145c0 con 0x563452b2f630 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3f9dffb640 1 -- 172.21.15.103:0/1741577182 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f3fb003a040 con 0x563452b2f630 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fbe9c7740 10 client.15117 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fbe9c7740 10 client.15117 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fbe9c7740 20 client.15117 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563452bba010 0x563452bb8d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:14.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fbe9c7740 4 client.15117 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1741577182 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "status"}) -- 0x563452a9c190 con 0x563452bba010 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.297+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563452bba010 0x563452bb8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fb9b64640 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563452bba010 0x563452bb8d20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=27c37fc408e4e6be server_cookie=20594f648d720508 in_seq=0 out_seq=0 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3f9dffb640 10 client.15117 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3f9dffb640 1 -- 172.21.15.103:0/1741577182 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x563452a9c190 con 0x563452bba010 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3f9dffb640 10 client.15117 handle_command_reply: tid=0 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 client.15117 shutdown 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1741577182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 msgr2=0x563452b54cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b54cd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f3fb0009900 tx=0x7f3fb002ab90 comp rx=0 tx=0).stop 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1741577182 shutdown_connections 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563452bba010 0x563452bb8d20 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563452b3a810 0x563452b4e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563452b2ff50 0x563452b55210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 --2- 172.21.15.103:0/1741577182 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563452b2f630 0x563452b54cd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1741577182 >> 172.21.15.103:0/1741577182 conn(0x563452b2bbc0 msgr2=0x563452b46000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3f9dffb640 0 client.15117 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1741577182 shutdown_connections 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 1 -- 172.21.15.103:0/1741577182 wait complete. 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.298+0000 7f3fbe9c7740 20 client.15117 trim_cache size 0 max 16384 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-08-02T18:49:14.308 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24473, 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 111.982929365, 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 122.67606298699999 2024-08-02T18:49:14.309 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3fa00a2c10 msgr2=0x7f3fa00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3fa00a2c10 0x7f3fa00a50d0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f3fac01e000 tx=0x7f3fac01a000 comp rx=0 tx=0).stop 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb41022a0 msgr2=0x7f3fb41974c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb41022a0 0x7f3fb41974c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f3fa400c890 tx=0x7f3fa400cd50 comp rx=0 tx=0).stop 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/4280951784 shutdown_connections 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3fb4102c20 0x7f3fb4197a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3fb41022a0 0x7f3fb41974c0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f3fa00a2c10 0x7f3fa00a50d0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 --2- 172.21.15.103:0/4280951784 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3fb4100b50 0x7f3fb4196f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/4280951784 >> 172.21.15.103:0/4280951784 conn(0x7f3fb40fc500 msgr2=0x7f3fb40fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/4280951784 shutdown_connections 2024-08-02T18:49:14.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:14.299+0000 7f3fbc5c9640 1 -- 172.21.15.103:0/4280951784 wait complete. 2024-08-02T18:49:14.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:14 smithi151 ceph-mon[37155]: pgmap v323: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:14.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:14 smithi103 ceph-mon[32753]: pgmap v323: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:15.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:14 smithi121 ceph-mon[37236]: pgmap v323: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:15.002 INFO:tasks.cephadm:Setup complete, yielding 2024-08-02T18:49:15.003 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-02T18:49:15.014 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:49:15.015 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- bash -c 'ceph orch status' 2024-08-02T18:49:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.816+0000 7f527a08c640 1 -- 172.21.15.103:0/3839217045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274101a40 msgr2=0x7f5274101ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.816+0000 7f527a08c640 1 --2- 172.21.15.103:0/3839217045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274101a40 0x7f5274101ec0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5268009900 tx=0x7f526802a410 comp rx=0 tx=0).stop 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.816+0000 7f527a08c640 1 -- 172.21.15.103:0/3839217045 shutdown_connections 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.816+0000 7f527a08c640 1 --2- 172.21.15.103:0/3839217045 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5274102400 0x7f5274108c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.816+0000 7f527a08c640 1 --2- 172.21.15.103:0/3839217045 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274101a40 0x7f5274101ec0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.816+0000 7f527a08c640 1 --2- 172.21.15.103:0/3839217045 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5274100840 0x7f5274100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.816+0000 7f527a08c640 1 -- 172.21.15.103:0/3839217045 >> 172.21.15.103:0/3839217045 conn(0x7f52740fbfd0 msgr2=0x7f52740fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.817+0000 7f527a08c640 1 -- 172.21.15.103:0/3839217045 shutdown_connections 2024-08-02T18:49:15.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.817+0000 7f527a08c640 1 -- 172.21.15.103:0/3839217045 wait complete. 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.817+0000 7f527a08c640 1 Processor -- start 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.817+0000 7f527a08c640 1 -- start start 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f527a08c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5274100840 0x7f5274197c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f527a08c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5274101a40 0x7f52741981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f527a08c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274102400 0x7f527419f220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f527a08c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f527410d710 con 0x7f5274102400 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f527a08c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f527410d590 con 0x7f5274100840 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f527a08c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f527410d890 con 0x7f5274101a40 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274102400 0x7f527419f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274102400 0x7f527419f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49938/0 (socket says 172.21.15.103:49938) 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 -- 172.21.15.103:0/2521582231 learned_addr learned my addr 172.21.15.103:0/2521582231 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f52737fe640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5274100840 0x7f5274197c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:15.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5272ffd640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5274101a40 0x7f52741981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 -- 172.21.15.103:0/2521582231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5274101a40 msgr2=0x7f52741981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5274101a40 0x7f52741981b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 -- 172.21.15.103:0/2521582231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5274100840 msgr2=0x7f5274197c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5274100840 0x7f5274197c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 -- 172.21.15.103:0/2521582231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f527419f890 con 0x7f5274102400 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5273fff640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274102400 0x7f527419f220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f526c00eaa0 tx=0x7f526c00ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.818+0000 7f5270ff9640 1 -- 172.21.15.103:0/2521582231 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c00cdb0 con 0x7f5274102400 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.819+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f527419fb80 con 0x7f5274102400 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.819+0000 7f5270ff9640 1 -- 172.21.15.103:0/2521582231 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f526c004b20 con 0x7f5274102400 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.819+0000 7f5270ff9640 1 -- 172.21.15.103:0/2521582231 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f526c011760 con 0x7f5274102400 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.819+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52741a00e0 con 0x7f5274102400 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.820+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5274107b70 con 0x7f5274102400 2024-08-02T18:49:15.856 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.821+0000 7f5270ff9640 1 -- 172.21.15.103:0/2521582231 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f526c011900 con 0x7f5274102400 2024-08-02T18:49:15.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.821+0000 7f5270ff9640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f525c0a2c10 0x7f525c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:15.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.822+0000 7f52737fe640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f525c0a2c10 0x7f525c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:15.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.822+0000 7f5270ff9640 1 -- 172.21.15.103:0/2521582231 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f526c0cfa50 con 0x7f5274102400 2024-08-02T18:49:15.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.822+0000 7f52737fe640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f525c0a2c10 0x7f525c0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5274198b50 tx=0x7f5264005f90 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:15.857 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:15.825+0000 7f5270ff9640 1 -- 172.21.15.103:0/2521582231 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f526c016030 con 0x7f5274102400 2024-08-02T18:49:16.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.008+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) -- 0x7f5274062360 con 0x7f525c0a2c10 2024-08-02T18:49:16.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.009+0000 7f5270ff9640 1 -- 172.21.15.103:0/2521582231 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+43 (secure 0 0 0) 0x7f5274062360 con 0x7f525c0a2c10 2024-08-02T18:49:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:Backend: cephadm 2024-08-02T18:49:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:Available: Yes 2024-08-02T18:49:16.014 INFO:teuthology.orchestra.run.smithi103.stdout:Paused: No 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.011+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f525c0a2c10 msgr2=0x7f525c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f525c0a2c10 0x7f525c0a50d0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7f5274198b50 tx=0x7f5264005f90 comp rx=0 tx=0).stop 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274102400 msgr2=0x7f527419f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274102400 0x7f527419f220 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f526c00eaa0 tx=0x7f526c00ef60 comp rx=0 tx=0).stop 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 shutdown_connections 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5274102400 0x7f527419f220 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f525c0a2c10 0x7f525c0a50d0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5274101a40 0x7f52741981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:16.015 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 --2- 172.21.15.103:0/2521582231 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5274100840 0x7f5274197c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:16.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 >> 172.21.15.103:0/2521582231 conn(0x7f52740fbfd0 msgr2=0x7f5274104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:16.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 shutdown_connections 2024-08-02T18:49:16.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:16.012+0000 7f527a08c640 1 -- 172.21.15.103:0/2521582231 wait complete. 2024-08-02T18:49:16.662 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- bash -c 'ceph orch ps' 2024-08-02T18:49:16.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:16 smithi151 ceph-mon[37155]: pgmap v324: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:16.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:16 smithi103 ceph-mon[32753]: pgmap v324: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:16.914 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:17.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:16 smithi121 ceph-mon[37236]: pgmap v324: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:17.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 -- 172.21.15.103:0/1655774976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 msgr2=0x7fc588102fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:17.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 --2- 172.21.15.103:0/1655774976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 0x7fc588102fb0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7fc578009900 tx=0x7fc57802a410 comp rx=0 tx=0).stop 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 -- 172.21.15.103:0/1655774976 shutdown_connections 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 --2- 172.21.15.103:0/1655774976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5881034f0 0x7fc588109d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 --2- 172.21.15.103:0/1655774976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 0x7fc588102fb0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 --2- 172.21.15.103:0/1655774976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588101930 0x7fc588101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 -- 172.21.15.103:0/1655774976 >> 172.21.15.103:0/1655774976 conn(0x7fc5880fd0c0 msgr2=0x7fc5880ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 -- 172.21.15.103:0/1655774976 shutdown_connections 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.401+0000 7fc590056640 1 -- 172.21.15.103:0/1655774976 wait complete. 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc590056640 1 Processor -- start 2024-08-02T18:49:17.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc590056640 1 -- start start 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc590056640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588101930 0x7fc588199f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc590056640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 0x7fc58819a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc590056640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5881034f0 0x7fc5881a1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc590056640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc58810d6f0 con 0x7fc588102b30 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc590056640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc58810d570 con 0x7fc588101930 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc590056640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc58810d870 con 0x7fc5881034f0 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58d5f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 0x7fc58819a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58d5f1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 0x7fc58819a4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:49968/0 (socket says 172.21.15.103:49968) 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58d5f1640 1 -- 172.21.15.103:0/2005140177 learned_addr learned my addr 172.21.15.103:0/2005140177 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:17.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58ddf2640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588101930 0x7fc588199f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58e5f3640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5881034f0 0x7fc5881a1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58d5f1640 1 -- 172.21.15.103:0/2005140177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5881034f0 msgr2=0x7fc5881a1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58d5f1640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5881034f0 0x7fc5881a1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58d5f1640 1 -- 172.21.15.103:0/2005140177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588101930 msgr2=0x7fc588199f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.402+0000 7fc58d5f1640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588101930 0x7fc588199f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.403+0000 7fc58d5f1640 1 -- 172.21.15.103:0/2005140177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc5881a1b90 con 0x7fc588102b30 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.403+0000 7fc58d5f1640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 0x7fc58819a4a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc578009a20 tx=0x7fc578004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.403+0000 7fc57effd640 1 -- 172.21.15.103:0/2005140177 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc57803f030 con 0x7fc588102b30 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.403+0000 7fc57effd640 1 -- 172.21.15.103:0/2005140177 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc578003d00 con 0x7fc588102b30 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.403+0000 7fc57effd640 1 -- 172.21.15.103:0/2005140177 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc578035070 con 0x7fc588102b30 2024-08-02T18:49:17.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.403+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc5881a1e20 con 0x7fc588102b30 2024-08-02T18:49:17.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.403+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc5881a2270 con 0x7fc588102b30 2024-08-02T18:49:17.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.404+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc5881a24a0 con 0x7fc588102b30 2024-08-02T18:49:17.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.405+0000 7fc57effd640 1 -- 172.21.15.103:0/2005140177 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fc578042030 con 0x7fc588102b30 2024-08-02T18:49:17.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.406+0000 7fc57effd640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc5740a2c40 0x7fc5740a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:17.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.406+0000 7fc58ddf2640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc5740a2c40 0x7fc5740a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:17.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.406+0000 7fc57effd640 1 -- 172.21.15.103:0/2005140177 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fc5780efb90 con 0x7fc588102b30 2024-08-02T18:49:17.410 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.406+0000 7fc58ddf2640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc5740a2c40 0x7fc5740a5100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc584005fd0 tx=0x7fc58400b410 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:17.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.410+0000 7fc57effd640 1 -- 172.21.15.103:0/2005140177 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fc5780bc630 con 0x7fc588102b30 2024-08-02T18:49:17.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:17 smithi103 ceph-mon[32753]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:17.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.590+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) -- 0x7fc588075870 con 0x7fc5740a2c40 2024-08-02T18:49:17.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.602+0000 7fc57effd640 1 -- 172.21.15.103:0/2005140177 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+4092 (secure 0 0 0) 0x7fc588075870 con 0x7fc5740a2c40 2024-08-02T18:49:17.603 INFO:teuthology.orchestra.run.smithi103.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.a smithi103 running (2m) 56s ago 2m 14.2M - 19.1.0-1260-g26c3fb8e 564b849e9656 d11753086e07 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.b smithi121 running (2m) 57s ago 2m 28.6M - 19.1.0-1260-g26c3fb8e 564b849e9656 d49ebf03fa4d 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.c smithi151 running (2m) 57s ago 2m 19.0M - 19.1.0-1260-g26c3fb8e 564b849e9656 108c81936486 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.d smithi103 running (2m) 56s ago 2m 17.9M - 19.1.0-1260-g26c3fb8e 564b849e9656 8973ba515c3c 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.e smithi121 running (2m) 57s ago 2m 19.3M - 19.1.0-1260-g26c3fb8e 564b849e9656 1aa3f21ff7e7 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.f smithi151 running (2m) 57s ago 2m 17.9M - 19.1.0-1260-g26c3fb8e 564b849e9656 18f73e5f41af 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.g smithi103 running (2m) 56s ago 2m 13.4M - 19.1.0-1260-g26c3fb8e 564b849e9656 3a0c4ca74da8 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.h smithi121 running (2m) 57s ago 2m 16.7M - 19.1.0-1260-g26c3fb8e 564b849e9656 948319a12319 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.i smithi151 running (2m) 57s ago 2m 17.3M - 19.1.0-1260-g26c3fb8e 564b849e9656 edf35a6810a6 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.j smithi103 running (2m) 56s ago 2m 14.5M - 19.1.0-1260-g26c3fb8e 564b849e9656 d84c0df1ea2f 2024-08-02T18:49:17.604 INFO:teuthology.orchestra.run.smithi103.stdout:mds.k smithi121 running (2m) 57s ago 2m 14.2M - 19.1.0-1260-g26c3fb8e 564b849e9656 2d5eeeccfd54 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:mds.l smithi151 running (2m) 57s ago 2m 14.4M - 19.1.0-1260-g26c3fb8e 564b849e9656 6f3d26102afc 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.x smithi103 *:9283,8765 running (8m) 56s ago 8m 508M - 19.1.0-1260-g26c3fb8e 564b849e9656 ffcd03abcab0 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.y smithi121 *:8443,8765 running (7m) 57s ago 7m 445M - 19.1.0-1260-g26c3fb8e 564b849e9656 f14d365e8546 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:mgr.z smithi151 *:8443,8765 running (7m) 57s ago 7m 442M - 19.1.0-1260-g26c3fb8e 564b849e9656 694d5fc294c9 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:mon.a smithi103 running (8m) 56s ago 8m 51.9M 2048M 19.1.0-1260-g26c3fb8e 564b849e9656 966880a17b7e 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:mon.b smithi121 running (7m) 57s ago 7m 40.7M 2048M 19.1.0-1260-g26c3fb8e 564b849e9656 6e33e9aa0082 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:mon.c smithi151 running (7m) 57s ago 7m 43.6M 2048M 19.1.0-1260-g26c3fb8e 564b849e9656 6d6b6bf8a41a 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 smithi103 running (7m) 56s ago 7m 55.1M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 7135c35acaa3 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 smithi121 running (6m) 57s ago 6m 47.1M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 0c603d08da45 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 smithi151 running (6m) 57s ago 6m 55.9M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 b0ef97efbf95 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 smithi103 running (5m) 56s ago 5m 47.6M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 6942644b5e9c 2024-08-02T18:49:17.605 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 smithi121 running (5m) 57s ago 5m 43.8M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 567e8ba80bf8 2024-08-02T18:49:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 smithi151 running (5m) 57s ago 5m 45.0M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 12a77a18ba97 2024-08-02T18:49:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 smithi103 running (4m) 56s ago 4m 49.3M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 f29b7e787888 2024-08-02T18:49:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 smithi121 running (4m) 57s ago 4m 53.7M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 8fb284d421ef 2024-08-02T18:49:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:osd.8 smithi151 running (4m) 57s ago 4m 43.4M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 28ca70e1c4f4 2024-08-02T18:49:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:osd.9 smithi103 running (3m) 56s ago 3m 42.4M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 38ae0bce78d4 2024-08-02T18:49:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:osd.10 smithi121 running (3m) 57s ago 3m 45.9M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 f9a740ba0b47 2024-08-02T18:49:17.606 INFO:teuthology.orchestra.run.smithi103.stdout:osd.11 smithi151 running (2m) 57s ago 2m 50.7M 4272M 19.1.0-1260-g26c3fb8e 564b849e9656 ab41d6ad1cf7 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc5740a2c40 msgr2=0x7fc5740a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc5740a2c40 0x7fc5740a5100 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fc584005fd0 tx=0x7fc58400b410 comp rx=0 tx=0).stop 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 msgr2=0x7fc58819a4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 0x7fc58819a4a0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fc578009a20 tx=0x7fc578004430 comp rx=0 tx=0).stop 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 shutdown_connections 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fc5740a2c40 0x7fc5740a5100 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc5881034f0 0x7fc5881a1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc588102b30 0x7fc58819a4a0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 --2- 172.21.15.103:0/2005140177 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc588101930 0x7fc588199f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:17.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 >> 172.21.15.103:0/2005140177 conn(0x7fc5880fd0c0 msgr2=0x7fc588074150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:17.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 shutdown_connections 2024-08-02T18:49:17.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:17.604+0000 7fc590056640 1 -- 172.21.15.103:0/2005140177 wait complete. 2024-08-02T18:49:17.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:17 smithi151 ceph-mon[37155]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:18.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:17 smithi121 ceph-mon[37236]: from='client.15123 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:18.446 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- bash -c 'ceph orch ls' 2024-08-02T18:49:18.707 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:18.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:18 smithi151 ceph-mon[37155]: pgmap v325: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:18.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:18 smithi103 ceph-mon[32753]: pgmap v325: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:18 smithi121 ceph-mon[37236]: pgmap v325: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 -- 172.21.15.103:0/2494150192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44104d00 msgr2=0x7f5f441070f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/2494150192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44104d00 0x7f5f441070f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f5f34009900 tx=0x7f5f3402a410 comp rx=0 tx=0).stop 2024-08-02T18:49:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 -- 172.21.15.103:0/2494150192 shutdown_connections 2024-08-02T18:49:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/2494150192 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f44107630 0x7f5f44109a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/2494150192 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44104d00 0x7f5f441070f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/2494150192 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f441023d0 0x7f5f441047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 -- 172.21.15.103:0/2494150192 >> 172.21.15.103:0/2494150192 conn(0x7f5f440fbfd0 msgr2=0x7f5f440fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 -- 172.21.15.103:0/2494150192 shutdown_connections 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.203+0000 7f5f48e8b640 1 -- 172.21.15.103:0/2494150192 wait complete. 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f48e8b640 1 Processor -- start 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f48e8b640 1 -- start start 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f48e8b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f441023d0 0x7f5f44199fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f48e8b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f44104d00 0x7f5f4419a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f48e8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44107630 0x7f5f441a1590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f48e8b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410d780 con 0x7f5f44107630 2024-08-02T18:49:19.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f48e8b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410d600 con 0x7f5f44104d00 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f48e8b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5f4410d900 con 0x7f5f441023d0 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f42d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44107630 0x7f5f441a1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f42d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44107630 0x7f5f441a1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59506/0 (socket says 172.21.15.103:59506) 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f42d9d640 1 -- 172.21.15.103:0/1970860298 learned_addr learned my addr 172.21.15.103:0/1970860298 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f4259c640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f441023d0 0x7f5f44199fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f41d9b640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f44104d00 0x7f5f4419a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f42d9d640 1 -- 172.21.15.103:0/1970860298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f441023d0 msgr2=0x7f5f44199fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f42d9d640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f441023d0 0x7f5f44199fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f42d9d640 1 -- 172.21.15.103:0/1970860298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f44104d00 msgr2=0x7f5f4419a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:19.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f42d9d640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f44104d00 0x7f5f4419a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.204+0000 7f5f42d9d640 1 -- 172.21.15.103:0/1970860298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5f441a1c00 con 0x7f5f44107630 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.205+0000 7f5f42d9d640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44107630 0x7f5f441a1590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00eaa0 tx=0x7f5f3c00eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.205+0000 7f5f3b7fe640 1 -- 172.21.15.103:0/1970860298 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c004d20 con 0x7f5f44107630 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.205+0000 7f5f3b7fe640 1 -- 172.21.15.103:0/1970860298 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5f3c005020 con 0x7f5f44107630 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.205+0000 7f5f3b7fe640 1 -- 172.21.15.103:0/1970860298 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5f3c0116b0 con 0x7f5f44107630 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.205+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5f441a1ef0 con 0x7f5f44107630 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.205+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5f441a23d0 con 0x7f5f44107630 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.206+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5f44109160 con 0x7f5f44107630 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.207+0000 7f5f3b7fe640 1 -- 172.21.15.103:0/1970860298 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5f3c0051d0 con 0x7f5f44107630 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.208+0000 7f5f3b7fe640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5f300a2c40 0x7f5f300a5100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.208+0000 7f5f4259c640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5f300a2c40 0x7f5f300a5100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:19.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.208+0000 7f5f3b7fe640 1 -- 172.21.15.103:0/1970860298 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5f3c0cfb40 con 0x7f5f44107630 2024-08-02T18:49:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.208+0000 7f5f4259c640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5f300a2c40 0x7f5f300a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009990 tx=0x7f5f2c009110 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:19.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.211+0000 7f5f3b7fe640 1 -- 172.21.15.103:0/1970860298 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5f3c016030 con 0x7f5f44107630 2024-08-02T18:49:19.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.387+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) -- 0x7f5f44062360 con 0x7f5f300a2c40 2024-08-02T18:49:19.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.392+0000 7f5f3b7fe640 1 -- 172.21.15.103:0/1970860298 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+980 (secure 0 0 0) 0x7f5f44062360 con 0x7f5f300a2c40 2024-08-02T18:49:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-08-02T18:49:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:mds.all 12/12 59s ago 2m smithi103=a;smithi103=d;smithi103=g;smithi103=j;smithi121=b;smithi121=e;smithi121=h;smithi121=k;smithi151=c;smithi151=f;smithi151=i;smithi151=l;count:12 2024-08-02T18:49:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:mgr 3/3 59s ago 7m smithi103=x;smithi121=y;smithi151=z;count:3 2024-08-02T18:49:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:mon 3/3 59s ago 7m smithi103:172.21.15.103=a;smithi121:172.21.15.121=b;smithi151:172.21.15.151=c;count:3 2024-08-02T18:49:19.394 INFO:teuthology.orchestra.run.smithi103.stdout:osd 12 59s ago - 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5f300a2c40 msgr2=0x7f5f300a5100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5f300a2c40 0x7f5f300a5100 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f5f2c009990 tx=0x7f5f2c009110 comp rx=0 tx=0).stop 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44107630 msgr2=0x7f5f441a1590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44107630 0x7f5f441a1590 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f5f3c00eaa0 tx=0x7f5f3c00eea0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 shutdown_connections 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5f44107630 0x7f5f441a1590 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5f44104d00 0x7f5f4419a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5f300a2c40 0x7f5f300a5100 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 --2- 172.21.15.103:0/1970860298 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5f441023d0 0x7f5f44199fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:19.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.394+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 >> 172.21.15.103:0/1970860298 conn(0x7f5f440fbfd0 msgr2=0x7f5f44101ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:19.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.395+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 shutdown_connections 2024-08-02T18:49:19.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:19.395+0000 7f5f48e8b640 1 -- 172.21.15.103:0/1970860298 wait complete. 2024-08-02T18:49:19.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:19 smithi151 ceph-mon[37155]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:19.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:19 smithi103 ceph-mon[32753]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:20.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:19 smithi121 ceph-mon[37236]: from='client.15129 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:20.120 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- bash -c 'ceph orch host ls' 2024-08-02T18:49:20.379 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:20.784 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:20 smithi103 ceph-mon[32753]: pgmap v326: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:20.784 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:20 smithi103 ceph-mon[32753]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:20.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:20 smithi151 ceph-mon[37155]: pgmap v326: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:20.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:20 smithi151 ceph-mon[37155]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 -- 172.21.15.103:0/2326387594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0107630 msgr2=0x7fbeb0109a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 --2- 172.21.15.103:0/2326387594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0107630 0x7fbeb0109a80 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7fbea0009ca0 tx=0x7fbea002a8c0 comp rx=0 tx=0).stop 2024-08-02T18:49:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 -- 172.21.15.103:0/2326387594 shutdown_connections 2024-08-02T18:49:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 --2- 172.21.15.103:0/2326387594 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0107630 0x7fbeb0109a80 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 --2- 172.21.15.103:0/2326387594 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb0104d00 0x7fbeb01070f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 --2- 172.21.15.103:0/2326387594 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeb01023d0 0x7fbeb01047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 -- 172.21.15.103:0/2326387594 >> 172.21.15.103:0/2326387594 conn(0x7fbeb00fbfd0 msgr2=0x7fbeb00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:20.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 -- 172.21.15.103:0/2326387594 shutdown_connections 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 -- 172.21.15.103:0/2326387594 wait complete. 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.865+0000 7fbeb5128640 1 Processor -- start 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeb5128640 1 -- start start 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeb5128640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb01023d0 0x7fbeb0197c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeb5128640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0104d00 0x7fbeb01981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeb5128640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeb0107630 0x7fbeb019f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeb5128640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb010d780 con 0x7fbeb0104d00 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeb5128640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb010d600 con 0x7fbeb0107630 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeb5128640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbeb010d900 con 0x7fbeb01023d0 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0104d00 0x7fbeb01981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeae59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0104d00 0x7fbeb01981d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59524/0 (socket says 172.21.15.103:59524) 2024-08-02T18:49:20.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeae59c640 1 -- 172.21.15.103:0/532752442 learned_addr learned my addr 172.21.15.103:0/532752442 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeaed9d640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb01023d0 0x7fbeb0197c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeaf59e640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeb0107630 0x7fbeb019f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeae59c640 1 -- 172.21.15.103:0/532752442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb01023d0 msgr2=0x7fbeb0197c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeae59c640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb01023d0 0x7fbeb0197c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeae59c640 1 -- 172.21.15.103:0/532752442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeb0107630 msgr2=0x7fbeb019f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeae59c640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeb0107630 0x7fbeb019f240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.866+0000 7fbeae59c640 1 -- 172.21.15.103:0/532752442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbeb019f8b0 con 0x7fbeb0104d00 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.867+0000 7fbeae59c640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0104d00 0x7fbeb01981d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800b450 tx=0x7fbe9800b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.867+0000 7fbea7fff640 1 -- 172.21.15.103:0/532752442 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe98015020 con 0x7fbeb0104d00 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.867+0000 7fbea7fff640 1 -- 172.21.15.103:0/532752442 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbe98011d90 con 0x7fbeb0104d00 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.867+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbeb019fba0 con 0x7fbeb0104d00 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.867+0000 7fbea7fff640 1 -- 172.21.15.103:0/532752442 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe9800f340 con 0x7fbeb0104d00 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.867+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbeb01a00e0 con 0x7fbeb0104d00 2024-08-02T18:49:20.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.868+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbeb00fdac0 con 0x7fbeb0104d00 2024-08-02T18:49:20.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.869+0000 7fbea7fff640 1 -- 172.21.15.103:0/532752442 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fbe98018020 con 0x7fbeb0104d00 2024-08-02T18:49:20.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.870+0000 7fbea7fff640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbe9c0a2c10 0x7fbe9c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:20.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.870+0000 7fbeaed9d640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbe9c0a2c10 0x7fbe9c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:20.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.870+0000 7fbea7fff640 1 -- 172.21.15.103:0/532752442 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fbe980cef60 con 0x7fbeb0104d00 2024-08-02T18:49:20.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.870+0000 7fbeaed9d640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbe9c0a2c10 0x7fbe9c0a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbea8005fd0 tx=0x7fbea8005ce0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:20.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:20.874+0000 7fbea7fff640 1 -- 172.21.15.103:0/532752442 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fbe9801f020 con 0x7fbeb0104d00 2024-08-02T18:49:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:20 smithi121 ceph-mon[37236]: pgmap v326: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:20 smithi121 ceph-mon[37236]: from='client.15135 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:21.047 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.046+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) -- 0x7fbeb0062360 con 0x7fbe9c0a2c10 2024-08-02T18:49:21.048 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.047+0000 7fbea7fff640 1 -- 172.21.15.103:0/532752442 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+191 (secure 0 0 0) 0x7fbeb0062360 con 0x7fbe9c0a2c10 2024-08-02T18:49:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:HOST ADDR LABELS STATUS 2024-08-02T18:49:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 172.21.15.103 2024-08-02T18:49:21.048 INFO:teuthology.orchestra.run.smithi103.stdout:smithi121 172.21.15.121 2024-08-02T18:49:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:smithi151 172.21.15.151 2024-08-02T18:49:21.049 INFO:teuthology.orchestra.run.smithi103.stdout:3 hosts in cluster 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbe9c0a2c10 msgr2=0x7fbe9c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbe9c0a2c10 0x7fbe9c0a50d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fbea8005fd0 tx=0x7fbea8005ce0 comp rx=0 tx=0).stop 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0104d00 msgr2=0x7fbeb01981d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0104d00 0x7fbeb01981d0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fbe9800b450 tx=0x7fbe9800b910 comp rx=0 tx=0).stop 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 shutdown_connections 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbeb0107630 0x7fbeb019f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbeb0104d00 0x7fbeb01981d0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fbe9c0a2c10 0x7fbe9c0a50d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 --2- 172.21.15.103:0/532752442 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbeb01023d0 0x7fbeb0197c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:21.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 >> 172.21.15.103:0/532752442 conn(0x7fbeb00fbfd0 msgr2=0x7fbeb0102c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:21.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.049+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 shutdown_connections 2024-08-02T18:49:21.052 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:21.050+0000 7fbeb5128640 1 -- 172.21.15.103:0/532752442 wait complete. 2024-08-02T18:49:21.782 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:21 smithi103 ceph-mon[32753]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:21.782 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:21 smithi103 ceph-mon[32753]: pgmap v327: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:21.810 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- bash -c 'ceph orch device ls' 2024-08-02T18:49:22.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:21 smithi121 ceph-mon[37236]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:22.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:21 smithi121 ceph-mon[37236]: pgmap v327: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:22.060 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:22.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:21 smithi151 ceph-mon[37155]: from='client.15141 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:22.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:21 smithi151 ceph-mon[37155]: pgmap v327: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 -- 172.21.15.103:0/4240416449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0102400 msgr2=0x7f31b0108c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 --2- 172.21.15.103:0/4240416449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0102400 0x7f31b0108c90 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f31a8009ca0 tx=0x7f31a802a8c0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 -- 172.21.15.103:0/4240416449 shutdown_connections 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 --2- 172.21.15.103:0/4240416449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0102400 0x7f31b0108c90 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 --2- 172.21.15.103:0/4240416449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b0101a40 0x7f31b0101ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 --2- 172.21.15.103:0/4240416449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b0100840 0x7f31b0100c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 -- 172.21.15.103:0/4240416449 >> 172.21.15.103:0/4240416449 conn(0x7f31b00fbfd0 msgr2=0x7f31b00fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 -- 172.21.15.103:0/4240416449 shutdown_connections 2024-08-02T18:49:22.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.550+0000 7f31b62cb640 1 -- 172.21.15.103:0/4240416449 wait complete. 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b62cb640 1 Processor -- start 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b62cb640 1 -- start start 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b62cb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0100840 0x7f31b0196ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b62cb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b0101a40 0x7f31b01970e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b62cb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b0102400 0x7f31b019e160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b62cb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f31b010c600 con 0x7f31b0100840 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b62cb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f31b010c480 con 0x7f31b0101a40 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b62cb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f31b010c780 con 0x7f31b0102400 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0100840 0x7f31b0196ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0100840 0x7f31b0196ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59540/0 (socket says 172.21.15.103:59540) 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31affff640 1 -- 172.21.15.103:0/2358105691 learned_addr learned my addr 172.21.15.103:0/2358105691 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31af7fe640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b0101a40 0x7f31b01970e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:22.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.551+0000 7f31b4868640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b0102400 0x7f31b019e160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31affff640 1 -- 172.21.15.103:0/2358105691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b0102400 msgr2=0x7f31b019e160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31affff640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b0102400 0x7f31b019e160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31affff640 1 -- 172.21.15.103:0/2358105691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b0101a40 msgr2=0x7f31b01970e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31affff640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b0101a40 0x7f31b01970e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31affff640 1 -- 172.21.15.103:0/2358105691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f31b019e7d0 con 0x7f31b0100840 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31affff640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0100840 0x7f31b0196ba0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d950 tx=0x7f31a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31ad7fa640 1 -- 172.21.15.103:0/2358105691 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a0017020 con 0x7f31b0100840 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31ad7fa640 1 -- 172.21.15.103:0/2358105691 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f31a0009c30 con 0x7f31b0100840 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f31b019eac0 con 0x7f31b0100840 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31ad7fa640 1 -- 172.21.15.103:0/2358105691 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f31a000f7e0 con 0x7f31b0100840 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.552+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f31b019f050 con 0x7f31b0100840 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.553+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f31b0107b70 con 0x7f31b0100840 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.554+0000 7f31ad7fa640 1 -- 172.21.15.103:0/2358105691 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f31a001a020 con 0x7f31b0100840 2024-08-02T18:49:22.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.555+0000 7f31ad7fa640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f31980a2cc0 0x7f31980a5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.555+0000 7f31af7fe640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f31980a2cc0 0x7f31980a5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.555+0000 7f31ad7fa640 1 -- 172.21.15.103:0/2358105691 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f31a00cedf0 con 0x7f31b0100840 2024-08-02T18:49:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.555+0000 7f31af7fe640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f31980a2cc0 0x7f31980a5180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f31b01980c0 tx=0x7f31a400b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:22.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.559+0000 7f31ad7fa640 1 -- 172.21.15.103:0/2358105691 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f31a0021070 con 0x7f31b0100840 2024-08-02T18:49:22.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.747+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 --> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) -- 0x7f31b0062360 con 0x7f31980a2cc0 2024-08-02T18:49:22.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.749+0000 7f31ad7fa640 1 -- 172.21.15.103:0/2358105691 <== mgr.14150 v2:172.21.15.103:6800/3303960029 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+532 (secure 0 0 0) 0x7f31b0062360 con 0x7f31980a2cc0 2024-08-02T18:49:22.750 INFO:teuthology.orchestra.run.smithi103.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-08-02T18:49:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:smithi103 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT6204012Z400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-02T18:49:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:smithi121 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_PHFT620400ZF400BGN 372G No 3m ago Has a FileSystem, LVM detected 2024-08-02T18:49:22.751 INFO:teuthology.orchestra.run.smithi103.stdout:smithi151 /dev/nvme0n1 ssd INTEL_SSDPEDMD400G4_CVFT623300JJ400BGN 372G No 2m ago Has a FileSystem, LVM detected 2024-08-02T18:49:22.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f31980a2cc0 msgr2=0x7f31980a5180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f31980a2cc0 0x7f31980a5180 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f31b01980c0 tx=0x7f31a400b390 comp rx=0 tx=0).stop 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0100840 msgr2=0x7f31b0196ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0100840 0x7f31b0196ba0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f31a000d950 tx=0x7f31a000de10 comp rx=0 tx=0).stop 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 shutdown_connections 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f31980a2cc0 0x7f31980a5180 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f31b0102400 0x7f31b019e160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f31b0101a40 0x7f31b01970e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 --2- 172.21.15.103:0/2358105691 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f31b0100840 0x7f31b0196ba0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 >> 172.21.15.103:0/2358105691 conn(0x7f31b00fbfd0 msgr2=0x7f31b0104d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 shutdown_connections 2024-08-02T18:49:22.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:22.751+0000 7f31b62cb640 1 -- 172.21.15.103:0/2358105691 wait complete. 2024-08-02T18:49:22.897 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:22 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:22.907 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:22 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:23.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:22 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:23.528 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-08-02T18:49:23.538 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:49:23.538 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- bash -c 'ceph fs dump' 2024-08-02T18:49:23.814 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:23 smithi103 ceph-mon[32753]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:23.815 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:23 smithi103 ceph-mon[32753]: pgmap v328: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:24.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:23 smithi121 ceph-mon[37236]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:24.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:23 smithi121 ceph-mon[37236]: pgmap v328: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:24.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:23 smithi151 ceph-mon[37155]: from='client.15147 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:24.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:23 smithi151 ceph-mon[37155]: pgmap v328: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:24.252 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:24.652 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:24 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:24.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:24 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:24.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:24 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:24.653 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:24 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:24.735 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.733+0000 7f97b7d05640 1 -- 172.21.15.103:0/37246070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b01034f0 msgr2=0x7f97b0109d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.733+0000 7f97b7d05640 1 --2- 172.21.15.103:0/37246070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b01034f0 0x7f97b0109d80 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f97a8009ca0 tx=0x7f97a802a8c0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.733+0000 7f97b7d05640 1 -- 172.21.15.103:0/37246070 shutdown_connections 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.733+0000 7f97b7d05640 1 --2- 172.21.15.103:0/37246070 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b01034f0 0x7f97b0109d80 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.733+0000 7f97b7d05640 1 --2- 172.21.15.103:0/37246070 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b0102b30 0x7f97b0102fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.733+0000 7f97b7d05640 1 --2- 172.21.15.103:0/37246070 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97b0101930 0x7f97b0101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.733+0000 7f97b7d05640 1 -- 172.21.15.103:0/37246070 >> 172.21.15.103:0/37246070 conn(0x7f97b00fd0c0 msgr2=0x7f97b00ff500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 -- 172.21.15.103:0/37246070 shutdown_connections 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 -- 172.21.15.103:0/37246070 wait complete. 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 Processor -- start 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 -- start start 2024-08-02T18:49:24.736 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b0101930 0x7f97b0197c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:24.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b0102b30 0x7f97b0198160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:24.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97b01034f0 0x7f97b019f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:24.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f97b010d6f0 con 0x7f97b0102b30 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f97b010d570 con 0x7f97b01034f0 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.734+0000 7f97b7d05640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f97b010d870 con 0x7f97b0101930 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b5aa1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b0101930 0x7f97b0197c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b52a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b0102b30 0x7f97b0198160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b5aa1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b0101930 0x7f97b0197c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:49994/0 (socket says 172.21.15.103:49994) 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b5aa1640 1 -- 172.21.15.103:0/4063868394 learned_addr learned my addr 172.21.15.103:0/4063868394 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b62a2640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97b01034f0 0x7f97b019f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b5aa1640 1 -- 172.21.15.103:0/4063868394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97b01034f0 msgr2=0x7f97b019f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:24.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b5aa1640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97b01034f0 0x7f97b019f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b5aa1640 1 -- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b0102b30 msgr2=0x7f97b0198160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b5aa1640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b0102b30 0x7f97b0198160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b5aa1640 1 -- 172.21.15.103:0/4063868394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97b019f840 con 0x7f97b0101930 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.735+0000 7f97b52a0640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b0102b30 0x7f97b0198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.736+0000 7f97b5aa1640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b0101930 0x7f97b0197c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00d770 tx=0x7f97ac00dc30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.737+0000 7f97a6ffd640 1 -- 172.21.15.103:0/4063868394 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac017070 con 0x7f97b0101930 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.737+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f97b00741b0 con 0x7f97b0101930 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.737+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f97b0074740 con 0x7f97b0101930 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.737+0000 7f97a6ffd640 1 -- 172.21.15.103:0/4063868394 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f97ac009c30 con 0x7f97b0101930 2024-08-02T18:49:24.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.737+0000 7f97a6ffd640 1 -- 172.21.15.103:0/4063868394 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97ac020060 con 0x7f97b0101930 2024-08-02T18:49:24.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.738+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f97b0108c60 con 0x7f97b0101930 2024-08-02T18:49:24.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.739+0000 7f97a6ffd640 1 -- 172.21.15.103:0/4063868394 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f97ac004020 con 0x7f97b0101930 2024-08-02T18:49:24.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.740+0000 7f97a6ffd640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f979c0a2c10 0x7f979c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:24.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.740+0000 7f97a6ffd640 1 -- 172.21.15.103:0/4063868394 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f97ac0cf040 con 0x7f97b0101930 2024-08-02T18:49:24.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.740+0000 7f97b52a0640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f979c0a2c10 0x7f979c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:24.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.740+0000 7f97b52a0640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f979c0a2c10 0x7f979c0a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97a000cef0 tx=0x7f97a000c950 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:24.745 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.744+0000 7f97a6ffd640 1 -- 172.21.15.103:0/4063868394 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f97ac09bae0 con 0x7f97b0101930 2024-08-02T18:49:24.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.983+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump"} v 0) -- 0x7f97b0075b70 con 0x7f97b0101930 2024-08-02T18:49:24.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.984+0000 7f97a6ffd640 1 -- 172.21.15.103:0/4063868394 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 25 v25) ==== 76+0+3102 (secure 0 0 0) 0x7f97ac09b3e0 con 0x7f97b0101930 2024-08-02T18:49:24.986 INFO:teuthology.orchestra.run.smithi103.stdout:e25 2024-08-02T18:49:24.986 INFO:teuthology.orchestra.run.smithi103.stdout:btime 2024-08-02T18:48:05:450957+0000 2024-08-02T18:49:24.986 INFO:teuthology.orchestra.run.smithi103.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-08-02T18:49:24.986 INFO:teuthology.orchestra.run.smithi103.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-02T18:49:24.986 INFO:teuthology.orchestra.run.smithi103.stdout:legacy client fscid: 1 2024-08-02T18:49:24.986 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:24.986 INFO:teuthology.orchestra.run.smithi103.stdout:Filesystem 'cephfs' (1) 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:fs_name cephfs 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 25 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:flags 32 joinable allow_snaps allow_multimds_snaps allow_standby_replay 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-08-02T18:47:22.067716+0000 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-08-02T18:48:05.212257+0000 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:tableserver 0 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:root 0 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:session_timeout 300 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:session_autoclose 300 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:max_file_size 1099511627776 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:max_xattr_size 65536 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:required_client_features {} 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure 0 2024-08-02T18:49:24.987 INFO:teuthology.orchestra.run.smithi103.stdout:last_failure_osd_epoch 0 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2,11=minor log segments,12=quiesce subvolumes} 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:max_mds 3 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:in 0,1,2 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:up {0=24473,1=24469,2=24454} 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:failed 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:damaged 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:stopped 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:data_pools [3,4] 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:metadata_pool 2 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:inline_data disabled 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:balancer 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:bal_rank_mask -1 2024-08-02T18:49:24.988 INFO:teuthology.orchestra.run.smithi103.stdout:standby_count_wanted 0 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:qdb_cluster leader: 24473 members: 24454,24469,24473 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.b{0:24473} state up:active seq 4 addr [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.h{0:24449} state up:standby-replay seq 1 addr [v2:172.21.15.121:6836/1633433490,v1:172.21.15.121:6837/1633433490] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.i{1:24469} state up:active seq 16 addr [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.f{1:24442} state up:standby-replay seq 1 addr [v2:172.21.15.151:6834/126654937,v1:172.21.15.151:6835/126654937] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.c{2:24454} state up:active seq 18 addr [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.e{2:24425} state up:standby-replay seq 1 addr [v2:172.21.15.121:6834/1461531566,v1:172.21.15.121:6835/1461531566] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:Standby daemons: 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.j{-1:14547} state up:standby seq 1 addr [v2:172.21.15.103:6834/1945803931,v1:172.21.15.103:6835/1945803931] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.d{-1:14559} state up:standby seq 1 addr [v2:172.21.15.103:6836/3186466318,v1:172.21.15.103:6837/3186466318] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.989 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.g{-1:14607} state up:standby seq 1 addr [v2:172.21.15.103:6838/4168002022,v1:172.21.15.103:6839/4168002022] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.990 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.a{-1:14619} state up:standby seq 1 addr [v2:172.21.15.103:6840/1212214786,v1:172.21.15.103:6841/1212214786] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.990 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.l{-1:24403} state up:standby seq 1 addr [v2:172.21.15.151:6832/13799064,v1:172.21.15.151:6833/13799064] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.990 INFO:teuthology.orchestra.run.smithi103.stdout:[mds.k{-1:24404} state up:standby seq 1 addr [v2:172.21.15.121:6832/4001571667,v1:172.21.15.121:6833/4001571667] compat {c=[1],r=[1],i=[1fff]}] 2024-08-02T18:49:24.990 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.987+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f979c0a2c10 msgr2=0x7f979c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.987+0000 7f97b7d05640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f979c0a2c10 0x7f979c0a50d0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f97a000cef0 tx=0x7f97a000c950 comp rx=0 tx=0).stop 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.987+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b0101930 msgr2=0x7f97b0197c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.987+0000 7f97b7d05640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b0101930 0x7f97b0197c20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f97ac00d770 tx=0x7f97ac00dc30 comp rx=0 tx=0).stop 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.988+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 shutdown_connections 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.988+0000 7f97b7d05640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f97b01034f0 0x7f97b019f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.988+0000 7f97b7d05640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f97b0102b30 0x7f97b0198160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.988+0000 7f97b7d05640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f979c0a2c10 0x7f979c0a50d0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.988+0000 7f97b7d05640 1 --2- 172.21.15.103:0/4063868394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f97b0101930 0x7f97b0197c20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.988+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 >> 172.21.15.103:0/4063868394 conn(0x7f97b00fd0c0 msgr2=0x7f97b0105e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.988+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 shutdown_connections 2024-08-02T18:49:24.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:24.988+0000 7f97b7d05640 1 -- 172.21.15.103:0/4063868394 wait complete. 2024-08-02T18:49:25.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:24 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:25.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:24 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:25.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:24 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:25.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:24 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:24 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:24 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:24 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:24 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:25.703 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- bash -c 'ceph osd dump' 2024-08-02T18:49:25.955 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:26.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:25 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4063868394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-02T18:49:26.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:25 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:25 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:25 smithi121 ceph-mon[37236]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:26.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:25 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:26.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:25 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:26.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:25 smithi121 ceph-mon[37236]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:25 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4063868394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-02T18:49:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:25 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:25 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:25 smithi151 ceph-mon[37155]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:25 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:25 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:25 smithi151 ceph-mon[37155]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:25 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4063868394' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-08-02T18:49:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:25 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:25 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:25 smithi103 ceph-mon[32753]: pgmap v329: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:26.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:25 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:26.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:25 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:26.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:25 smithi103 ceph-mon[32753]: from='mgr.14150 172.21.15.103:0/2944668545' entity='mgr.x' 2024-08-02T18:49:26.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.426+0000 7fadcac07640 1 -- 172.21.15.103:0/463680059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 msgr2=0x7fadc4108c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.426+0000 7fadcac07640 1 --2- 172.21.15.103:0/463680059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 0x7fadc4108c50 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7fadbc009900 tx=0x7fadbc02a3f0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.426+0000 7fadcac07640 1 -- 172.21.15.103:0/463680059 shutdown_connections 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.426+0000 7fadcac07640 1 --2- 172.21.15.103:0/463680059 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 0x7fadc4108c50 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.426+0000 7fadcac07640 1 --2- 172.21.15.103:0/463680059 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadc4101a00 0x7fadc4101e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.426+0000 7fadcac07640 1 --2- 172.21.15.103:0/463680059 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc4100800 0x7fadc4100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.426+0000 7fadcac07640 1 -- 172.21.15.103:0/463680059 >> 172.21.15.103:0/463680059 conn(0x7fadc40fbfb0 msgr2=0x7fadc40fe3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 -- 172.21.15.103:0/463680059 shutdown_connections 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 -- 172.21.15.103:0/463680059 wait complete. 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 Processor -- start 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 -- start start 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadc4100800 0x7fadc406a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:26.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc4101a00 0x7fadc419c960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 0x7fadc419ef80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fadc410c5c0 con 0x7fadc41023c0 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fadc410c440 con 0x7fadc4101a00 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadcac07640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fadc410c740 con 0x7fadc4100800 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadc91a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 0x7fadc419ef80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadc91a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 0x7fadc419ef80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59568/0 (socket says 172.21.15.103:59568) 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.427+0000 7fadc91a4640 1 -- 172.21.15.103:0/3908535763 learned_addr learned my addr 172.21.15.103:0/3908535763 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc89a3640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadc4100800 0x7fadc406a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc3fff640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc4101a00 0x7fadc419c960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc91a4640 1 -- 172.21.15.103:0/3908535763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadc4100800 msgr2=0x7fadc406a800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc91a4640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadc4100800 0x7fadc406a800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc91a4640 1 -- 172.21.15.103:0/3908535763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc4101a00 msgr2=0x7fadc419c960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc91a4640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc4101a00 0x7fadc419c960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc91a4640 1 -- 172.21.15.103:0/3908535763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fadc419f890 con 0x7fadc41023c0 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc89a3640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadc4100800 0x7fadc406a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc3fff640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc4101a00 0x7fadc419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc91a4640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 0x7fadc419ef80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0316a0 tx=0x7fadbc004430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc1ffb640 1 -- 172.21.15.103:0/3908535763 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc03f030 con 0x7fadc41023c0 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc1ffb640 1 -- 172.21.15.103:0/3908535763 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fadbc003d00 con 0x7fadc41023c0 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadc1ffb640 1 -- 172.21.15.103:0/3908535763 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fadbc035070 con 0x7fadc41023c0 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fadc419fac0 con 0x7fadc41023c0 2024-08-02T18:49:26.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.428+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fadc419ff50 con 0x7fadc41023c0 2024-08-02T18:49:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.430+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fadc4107ad0 con 0x7fadc41023c0 2024-08-02T18:49:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.431+0000 7fadc1ffb640 1 -- 172.21.15.103:0/3908535763 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7fadbc042030 con 0x7fadc41023c0 2024-08-02T18:49:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.431+0000 7fadc1ffb640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fadac0a2c90 0x7fadac0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.432+0000 7fadc89a3640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fadac0a2c90 0x7fadac0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:26.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.432+0000 7fadc1ffb640 1 -- 172.21.15.103:0/3908535763 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fadbc0efc30 con 0x7fadc41023c0 2024-08-02T18:49:26.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.432+0000 7fadc89a3640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fadac0a2c90 0x7fadac0a5150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadb40058c0 tx=0x7fadb4005850 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:26.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.436+0000 7fadc1ffb640 1 -- 172.21.15.103:0/3908535763 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fadbc0bc6d0 con 0x7fadc41023c0 2024-08-02T18:49:26.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.609+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump"} v 0) -- 0x7fadc402d7e0 con 0x7fadc41023c0 2024-08-02T18:49:26.611 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.610+0000 7fadc1ffb640 1 -- 172.21.15.103:0/3908535763 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump"}]=0 v89) ==== 56+0+5626 (secure 0 0 0) 0x7fadbc0bbfd0 con 0x7fadc41023c0 2024-08-02T18:49:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:epoch 89 2024-08-02T18:49:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:fsid 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T18:49:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:created 2024-08-02T18:40:20.516286+0000 2024-08-02T18:49:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:modified 2024-08-02T18:48:06.458748+0000 2024-08-02T18:49:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-08-02T18:49:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:crush_version 27 2024-08-02T18:49:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:full_ratio 0.95 2024-08-02T18:49:26.612 INFO:teuthology.orchestra.run.smithi103.stdout:backfillfull_ratio 0.9 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:nearfull_ratio 0.85 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:require_min_compat_client luminous 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:min_compat_client luminous 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:require_osd_release squid 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:stretch_mode_enabled false 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:pool 1 '.mgr' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 21 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 12.00 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:pool 2 'cephfs_metadata' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_autoscale_bias 4 pg_num_min 16 recovery_priority 5 application cephfs read_balance_score 1.88 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:pool 3 'cephfs_data' replicated size 3 min_size 2 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 81 flags hashpspool stripe_width 0 pg_num_min 64 target_size_ratio 0.05 application cephfs read_balance_score 1.50 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:pool 4 'cephfs_data_ec' erasure profile cephfs_data_ec size 4 min_size 3 crush_rule 1 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 87 flags hashpspool,ec_overwrites stripe_width 8192 pg_num_min 64 target_size_ratio 0.9 application cephfs 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:max_osd 12 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:osd.0 up in weight 1 up_from 8 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6802/683162835,v1:172.21.15.103:6803/683162835] [v2:172.21.15.103:6804/683162835,v1:172.21.15.103:6805/683162835] exists,up 9478879a-fb16-4c8a-922d-e555bf3f7ff0 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:osd.1 up in weight 1 up_from 13 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6800/427937936,v1:172.21.15.121:6801/427937936] [v2:172.21.15.121:6802/427937936,v1:172.21.15.121:6803/427937936] exists,up 9ba10d16-f7e6-47ca-80f3-cccbfce499fe 2024-08-02T18:49:26.613 INFO:teuthology.orchestra.run.smithi103.stdout:osd.2 up in weight 1 up_from 18 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6800/352420773,v1:172.21.15.151:6801/352420773] [v2:172.21.15.151:6802/352420773,v1:172.21.15.151:6803/352420773] exists,up 4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.3 up in weight 1 up_from 24 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6810/3894858705,v1:172.21.15.103:6811/3894858705] [v2:172.21.15.103:6812/3894858705,v1:172.21.15.103:6813/3894858705] exists,up 63933dee-170e-4e8e-b9e3-e120c55cac8b 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.4 up in weight 1 up_from 31 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6808/3147928372,v1:172.21.15.121:6809/3147928372] [v2:172.21.15.121:6810/3147928372,v1:172.21.15.121:6811/3147928372] exists,up ef0e458a-1e86-42a3-afe4-7d80a10e12ea 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.5 up in weight 1 up_from 36 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6808/2549009973,v1:172.21.15.151:6809/2549009973] [v2:172.21.15.151:6810/2549009973,v1:172.21.15.151:6811/2549009973] exists,up a9e2a3d3-7b17-489c-9229-04141660dc5b 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.6 up in weight 1 up_from 44 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6818/3191321050,v1:172.21.15.103:6819/3191321050] [v2:172.21.15.103:6820/3191321050,v1:172.21.15.103:6821/3191321050] exists,up 3c779781-bb3d-4067-8c1d-86c5c5ef5dfe 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.7 up in weight 1 up_from 49 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6816/2205509035,v1:172.21.15.121:6817/2205509035] [v2:172.21.15.121:6818/2205509035,v1:172.21.15.121:6819/2205509035] exists,up 35728743-216c-4e32-be58-71f4feafabbc 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.8 up in weight 1 up_from 56 up_thru 84 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6816/931243122,v1:172.21.15.151:6817/931243122] [v2:172.21.15.151:6818/931243122,v1:172.21.15.151:6819/931243122] exists,up 277019f3-1818-4768-9a9e-dceaf7763848 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.9 up in weight 1 up_from 63 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.103:6826/2790635350,v1:172.21.15.103:6827/2790635350] [v2:172.21.15.103:6828/2790635350,v1:172.21.15.103:6829/2790635350] exists,up dd6a19ec-851e-4957-8968-53d1a614eaaa 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.10 up in weight 1 up_from 68 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.121:6824/1207550526,v1:172.21.15.121:6825/1207550526] [v2:172.21.15.121:6826/1207550526,v1:172.21.15.121:6827/1207550526] exists,up 29c7b69d-2db4-4ff1-b5d0-544096db8cf7 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:osd.11 up in weight 1 up_from 75 up_thru 88 down_at 0 last_clean_interval [0,0) [v2:172.21.15.151:6824/3221128949,v1:172.21.15.151:6825/3221128949] [v2:172.21.15.151:6826/3221128949,v1:172.21.15.151:6827/3221128949] exists,up 63dc42b7-851c-44a9-896d-cd9112f9ba35 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 2.13 [2,11] 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 2.1d [8,11] 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.6 [4,6] 2024-08-02T18:49:26.614 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.1b [5,9] 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.1e [3,9] 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 3.3c [4,9] 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 4.e [9,11] 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 4.15 [5,10] 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 4.1c [9,8] 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:pg_upmap_items 4.1f [9,8] 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6800/2532430315 expires 2024-08-03T18:41:05.260353+0000 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/34686070 expires 2024-08-03T18:41:05.260353+0000 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/1976977182 expires 2024-08-03T18:41:05.260353+0000 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/3927889797 expires 2024-08-03T18:40:42.170602+0000 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6801/2532430315 expires 2024-08-03T18:41:05.260353+0000 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/639519332 expires 2024-08-03T18:40:42.170602+0000 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/1840770374 expires 2024-08-03T18:40:42.170602+0000 2024-08-02T18:49:26.615 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:0/2020700081 expires 2024-08-03T18:41:05.260353+0000 2024-08-02T18:49:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6801/2382390785 expires 2024-08-03T18:40:42.170602+0000 2024-08-02T18:49:26.616 INFO:teuthology.orchestra.run.smithi103.stdout:blocklist 172.21.15.103:6800/2382390785 expires 2024-08-03T18:40:42.170602+0000 2024-08-02T18:49:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fadac0a2c90 msgr2=0x7fadac0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:26.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fadac0a2c90 0x7fadac0a5150 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fadb40058c0 tx=0x7fadb4005850 comp rx=0 tx=0).stop 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 msgr2=0x7fadc419ef80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 0x7fadc419ef80 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fadbc0316a0 tx=0x7fadbc004430 comp rx=0 tx=0).stop 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 shutdown_connections 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fadc41023c0 0x7fadc419ef80 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fadc4101a00 0x7fadc419c960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fadac0a2c90 0x7fadac0a5150 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 --2- 172.21.15.103:0/3908535763 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fadc4100800 0x7fadc406a800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 >> 172.21.15.103:0/3908535763 conn(0x7fadc40fbfb0 msgr2=0x7fadc4104ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 shutdown_connections 2024-08-02T18:49:26.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:26.612+0000 7fadcac07640 1 -- 172.21.15.103:0/3908535763 wait complete. 2024-08-02T18:49:27.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:27 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3908535763' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-02T18:49:27.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:27 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3908535763' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-02T18:49:27.434 INFO:teuthology.run_tasks:Running task fs.ready... 2024-08-02T18:49:27.445 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:49:27.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:27 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3908535763' entity='client.admin' cmd=[{"prefix": "osd dump"}]: dispatch 2024-08-02T18:49:27.701 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:28.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:28 smithi103 ceph-mon[32753]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:28.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.250+0000 7f2794e28640 1 -- 172.21.15.103:0/1770814740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901007b0 msgr2=0x7f2790100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:28.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.250+0000 7f2794e28640 1 --2- 172.21.15.103:0/1770814740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901007b0 0x7f2790100c10 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7f2778009930 tx=0x7f277802a420 comp rx=0 tx=0).stop 2024-08-02T18:49:28.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 -- 172.21.15.103:0/1770814740 shutdown_connections 2024-08-02T18:49:28.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 --2- 172.21.15.103:0/1770814740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2790101150 0x7f279010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 --2- 172.21.15.103:0/1770814740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901007b0 0x7f2790100c10 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 --2- 172.21.15.103:0/1770814740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27901067b0 0x7f2790106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 -- 172.21.15.103:0/1770814740 >> 172.21.15.103:0/1770814740 conn(0x7f27900fc4d0 msgr2=0x7f27900fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 -- 172.21.15.103:0/1770814740 shutdown_connections 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 -- 172.21.15.103:0/1770814740 wait complete. 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 Processor -- start 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.251+0000 7f2794e28640 1 -- start start 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2794e28640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27901007b0 0x7f2790198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2794e28640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2790101150 0x7f2790198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2794e28640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901067b0 0x7f279019cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2794e28640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2790110d10 con 0x7f27901067b0 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2794e28640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2790110b90 con 0x7f27901007b0 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2794e28640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2790110e90 con 0x7f2790101150 2024-08-02T18:49:28.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901067b0 0x7f279019cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901067b0 0x7f279019cc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59584/0 (socket says 172.21.15.103:59584) 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 -- 172.21.15.103:0/3504225293 learned_addr learned my addr 172.21.15.103:0/3504225293 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278e59c640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27901007b0 0x7f2790198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2787fff640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2790101150 0x7f2790198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 -- 172.21.15.103:0/3504225293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2790101150 msgr2=0x7f2790198880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2790101150 0x7f2790198880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 -- 172.21.15.103:0/3504225293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27901007b0 msgr2=0x7f2790198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27901007b0 0x7f2790198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 -- 172.21.15.103:0/3504225293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279019d2f0 con 0x7f27901067b0 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2787fff640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2790101150 0x7f2790198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f278ed9d640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901067b0 0x7f279019cc10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f278800b970 tx=0x7f278800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:28.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f27877fe640 1 -- 172.21.15.103:0/3504225293 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788019070 con 0x7f27901067b0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f27877fe640 1 -- 172.21.15.103:0/3504225293 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f278800cb40 con 0x7f27901067b0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279019d5e0 con 0x7f27901067b0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f27877fe640 1 -- 172.21.15.103:0/3504225293 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2788007700 con 0x7f27901067b0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.252+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f27901a4ec0 con 0x7f27901067b0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.253+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2790100c10 con 0x7f27901067b0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.255+0000 7f27877fe640 1 -- 172.21.15.103:0/3504225293 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f278801c070 con 0x7f27901067b0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.255+0000 7f27877fe640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f277c0a2c10 0x7f277c0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.255+0000 7f278e59c640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f277c0a2c10 0x7f277c0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.255+0000 7f27877fe640 1 -- 172.21.15.103:0/3504225293 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f27880cee40 con 0x7f27901067b0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.256+0000 7f278e59c640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f277c0a2c10 0x7f277c0a50d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f278000bbe0 tx=0x7f278000b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:28.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.258+0000 7f27877fe640 1 -- 172.21.15.103:0/3504225293 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f278809b3a0 con 0x7f27901067b0 2024-08-02T18:49:28.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:28 smithi151 ceph-mon[37155]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:28.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.463+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2790109d50 con 0x7f27901067b0 2024-08-02T18:49:28.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.464+0000 7f27877fe640 1 -- 172.21.15.103:0/3504225293 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7f278809f6a0 con 0x7f27901067b0 2024-08-02T18:49:28.465 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:28.465 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-08-02T18:48:05:450957+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:48:05.212257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T18:49:28.466 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-08-02T18:49:28.467 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f277c0a2c10 msgr2=0x7f277c0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f277c0a2c10 0x7f277c0a50d0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f278000bbe0 tx=0x7f278000b390 comp rx=0 tx=0).stop 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901067b0 msgr2=0x7f279019cc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901067b0 0x7f279019cc10 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f278800b970 tx=0x7f278800be30 comp rx=0 tx=0).stop 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 shutdown_connections 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f27901067b0 0x7f279019cc10 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f277c0a2c10 0x7f277c0a50d0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2790101150 0x7f2790198880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 --2- 172.21.15.103:0/3504225293 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f27901007b0 0x7f2790198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 >> 172.21.15.103:0/3504225293 conn(0x7f27900fc4d0 msgr2=0x7f279006a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 shutdown_connections 2024-08-02T18:49:28.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:28.466+0000 7f2794e28640 1 -- 172.21.15.103:0/3504225293 wait complete. 2024-08-02T18:49:28.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:28 smithi121 ceph-mon[37236]: pgmap v330: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 5 op/s 2024-08-02T18:49:29.246 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:29 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3504225293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:29.276 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:49:29.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:29 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3504225293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:29.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:29 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3504225293' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:29.533 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:30.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 -- 172.21.15.103:0/904521219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 msgr2=0x7f515c101d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:30.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 --2- 172.21.15.103:0/904521219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 0x7f515c101d10 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7f514c009930 tx=0x7f514c02a420 comp rx=0 tx=0).stop 2024-08-02T18:49:30.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 -- 172.21.15.103:0/904521219 shutdown_connections 2024-08-02T18:49:30.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 --2- 172.21.15.103:0/904521219 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f515c102250 0x7f515c10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 --2- 172.21.15.103:0/904521219 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 0x7f515c101d10 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.042 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 --2- 172.21.15.103:0/904521219 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f515c1078b0 0x7f515c107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 -- 172.21.15.103:0/904521219 >> 172.21.15.103:0/904521219 conn(0x7f515c0fd5f0 msgr2=0x7f515c0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 -- 172.21.15.103:0/904521219 shutdown_connections 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.012+0000 7f5162bbe640 1 -- 172.21.15.103:0/904521219 wait complete. 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5162bbe640 1 Processor -- start 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5162bbe640 1 -- start start 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5162bbe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 0x7f515c074220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5162bbe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f515c102250 0x7f515c074760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5162bbe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f515c1078b0 0x7f515c074ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5162bbe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f515c111dd0 con 0x7f515c1018b0 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5162bbe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f515c111c50 con 0x7f515c1078b0 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5162bbe640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f515c111f50 con 0x7f515c102250 2024-08-02T18:49:30.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f516095a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 0x7f515c074220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f516095a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 0x7f515c074220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47934/0 (socket says 172.21.15.103:47934) 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f516095a640 1 -- 172.21.15.103:0/1724602605 learned_addr learned my addr 172.21.15.103:0/1724602605 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f5153fff640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f515c102250 0x7f515c074760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f516095a640 1 -- 172.21.15.103:0/1724602605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f515c102250 msgr2=0x7f515c074760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f516095a640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f515c102250 0x7f515c074760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f516095a640 1 -- 172.21.15.103:0/1724602605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f515c1078b0 msgr2=0x7f515c074ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f516115b640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f515c1078b0 0x7f515c074ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.013+0000 7f516095a640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f515c1078b0 0x7f515c074ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.014+0000 7f516095a640 1 -- 172.21.15.103:0/1724602605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f515c1a6750 con 0x7f515c1018b0 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.014+0000 7f516095a640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 0x7f515c074220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f515800d770 tx=0x7f515800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.014+0000 7f5151ffb640 1 -- 172.21.15.103:0/1724602605 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158017070 con 0x7f515c1018b0 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.014+0000 7f5151ffb640 1 -- 172.21.15.103:0/1724602605 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5158005520 con 0x7f515c1018b0 2024-08-02T18:49:30.044 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.014+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f515c1a6a40 con 0x7f515c1018b0 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.014+0000 7f5151ffb640 1 -- 172.21.15.103:0/1724602605 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5158010460 con 0x7f515c1018b0 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.014+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f515c1a6f80 con 0x7f515c1018b0 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.015+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f515c101d10 con 0x7f515c1018b0 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.016+0000 7f5151ffb640 1 -- 172.21.15.103:0/1724602605 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5158004ea0 con 0x7f515c1018b0 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.017+0000 7f5151ffb640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f51440a2c90 0x7f51440a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.017+0000 7f5153fff640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f51440a2c90 0x7f51440a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.017+0000 7f5151ffb640 1 -- 172.21.15.103:0/1724602605 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f51580cf400 con 0x7f515c1018b0 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.018+0000 7f5153fff640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f51440a2c90 0x7f51440a5150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f514c006010 tx=0x7f514c000bc0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:30.045 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.020+0000 7f5151ffb640 1 -- 172.21.15.103:0/1724602605 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f515809bf20 con 0x7f515c1018b0 2024-08-02T18:49:30.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.224+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f515c075750 con 0x7f515c1018b0 2024-08-02T18:49:30.226 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:30 smithi103 ceph-mon[32753]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:30.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.225+0000 7f5151ffb640 1 -- 172.21.15.103:0/1724602605 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 25 v25) ==== 94+0+11933 (secure 0 0 0) 0x7f515809b820 con 0x7f515c1018b0 2024-08-02T18:49:30.227 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:30.227 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":25,"btime":"2024-08-02T18:48:05:450957+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":25,"flags":50,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:48:05.212257+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T18:49:30.227 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 25 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.227+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f51440a2c90 msgr2=0x7f51440a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.227+0000 7f5162bbe640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f51440a2c90 0x7f51440a5150 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f514c006010 tx=0x7f514c000bc0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.227+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 msgr2=0x7f515c074220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.227+0000 7f5162bbe640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 0x7f515c074220 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f515800d770 tx=0x7f515800dc30 comp rx=0 tx=0).stop 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.228+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 shutdown_connections 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.228+0000 7f5162bbe640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f515c1078b0 0x7f515c074ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.228+0000 7f5162bbe640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f51440a2c90 0x7f51440a5150 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.228+0000 7f5162bbe640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f515c102250 0x7f515c074760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.228+0000 7f5162bbe640 1 --2- 172.21.15.103:0/1724602605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f515c1018b0 0x7f515c074220 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:30.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.228+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 >> 172.21.15.103:0/1724602605 conn(0x7f515c0fd5f0 msgr2=0x7f515c0fddd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:30.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.228+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 shutdown_connections 2024-08-02T18:49:30.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:30.228+0000 7f5162bbe640 1 -- 172.21.15.103:0/1724602605 wait complete. 2024-08-02T18:49:30.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:30 smithi151 ceph-mon[37155]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:30.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:30 smithi121 ceph-mon[37236]: pgmap v331: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:31.022 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:49:31.277 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:31.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:31 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1724602605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:31.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:31 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1724602605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:31.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:31 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1724602605' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:31.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 -- 172.21.15.103:0/836377745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef0102a70 msgr2=0x7f6ef0102e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:31.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 --2- 172.21.15.103:0/836377745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef0102a70 0x7f6ef0102e50 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009900 tx=0x7f6ee402a480 comp rx=0 tx=0).stop 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 -- 172.21.15.103:0/836377745 shutdown_connections 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 --2- 172.21.15.103:0/836377745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ef010bea0 0x7f6ef010e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 --2- 172.21.15.103:0/836377745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef0103390 0x7f6ef010b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 --2- 172.21.15.103:0/836377745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef0102a70 0x7f6ef0102e50 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 -- 172.21.15.103:0/836377745 >> 172.21.15.103:0/836377745 conn(0x7f6ef00fc4d0 msgr2=0x7f6ef00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 -- 172.21.15.103:0/836377745 shutdown_connections 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.766+0000 7f6ef7105640 1 -- 172.21.15.103:0/836377745 wait complete. 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.767+0000 7f6ef7105640 1 Processor -- start 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.767+0000 7f6ef7105640 1 -- start start 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.767+0000 7f6ef7105640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef0102a70 0x7f6ef0198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.767+0000 7f6ef7105640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ef0103390 0x7f6ef01987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.767+0000 7f6ef7105640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef010bea0 0x7f6ef019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:31.798 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.767+0000 7f6ef7105640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0111dc0 con 0x7f6ef010bea0 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.767+0000 7f6ef7105640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0111c40 con 0x7f6ef0103390 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.767+0000 7f6ef7105640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6ef0111f40 con 0x7f6ef0102a70 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef010bea0 0x7f6ef019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef010bea0 0x7f6ef019cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47966/0 (socket says 172.21.15.103:47966) 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 -- 172.21.15.103:0/1475390945 learned_addr learned my addr 172.21.15.103:0/1475390945 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef4ea1640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef0102a70 0x7f6ef0198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6eeffff640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ef0103390 0x7f6ef01987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 -- 172.21.15.103:0/1475390945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef0102a70 msgr2=0x7f6ef0198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef0102a70 0x7f6ef0198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 -- 172.21.15.103:0/1475390945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ef0103390 msgr2=0x7f6ef01987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ef0103390 0x7f6ef01987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 -- 172.21.15.103:0/1475390945 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ef019d220 con 0x7f6ef010bea0 2024-08-02T18:49:31.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef56a2640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef010bea0 0x7f6ef019cb40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800eb10 tx=0x7f6ee800c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:31.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6eedffb640 1 -- 172.21.15.103:0/1475390945 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee8004b20 con 0x7f6ef010bea0 2024-08-02T18:49:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6eedffb640 1 -- 172.21.15.103:0/1475390945 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6ee8004cc0 con 0x7f6ef010bea0 2024-08-02T18:49:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ef019d510 con 0x7f6ef010bea0 2024-08-02T18:49:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6eedffb640 1 -- 172.21.15.103:0/1475390945 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6ee80107f0 con 0x7f6ef010bea0 2024-08-02T18:49:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.768+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ef01a4df0 con 0x7f6ef010bea0 2024-08-02T18:49:31.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.769+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ef0102e50 con 0x7f6ef010bea0 2024-08-02T18:49:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.770+0000 7f6eedffb640 1 -- 172.21.15.103:0/1475390945 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f6ee8005020 con 0x7f6ef010bea0 2024-08-02T18:49:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.771+0000 7f6eedffb640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6ee00a2c10 0x7f6ee00a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.771+0000 7f6ef4ea1640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6ee00a2c10 0x7f6ee00a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.772+0000 7f6eedffb640 1 -- 172.21.15.103:0/1475390945 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f6ee80cfb10 con 0x7f6ef010bea0 2024-08-02T18:49:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.772+0000 7f6ef4ea1640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6ee00a2c10 0x7f6ee00a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009230 tx=0x7f6ee40058d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:31.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.776+0000 7f6eedffb640 1 -- 172.21.15.103:0/1475390945 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6ee809c5b0 con 0x7f6ef010bea0 2024-08-02T18:49:31.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.944+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f6ef002d5e0 con 0x7f6ef010bea0 2024-08-02T18:49:31.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.946+0000 7f6eedffb640 1 -- 172.21.15.103:0/1475390945 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24703 (secure 0 0 0) 0x7f6ee809beb0 con 0x7f6ef010bea0 2024-08-02T18:49:31.947 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:31.948 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:48:06.458748+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:49:31.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6ee00a2c10 msgr2=0x7f6ee00a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6ee00a2c10 0x7f6ee00a50d0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f6ee4009230 tx=0x7f6ee40058d0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef010bea0 msgr2=0x7f6ef019cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef010bea0 0x7f6ef019cb40 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f6ee800eb10 tx=0x7f6ee800c2d0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 shutdown_connections 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6ef010bea0 0x7f6ef019cb40 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6ef0103390 0x7f6ef01987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f6ee00a2c10 0x7f6ee00a50d0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 --2- 172.21.15.103:0/1475390945 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6ef0102a70 0x7f6ef0198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 >> 172.21.15.103:0/1475390945 conn(0x7f6ef00fc4d0 msgr2=0x7f6ef00fd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 shutdown_connections 2024-08-02T18:49:31.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:31.948+0000 7f6ef7105640 1 -- 172.21.15.103:0/1475390945 wait complete. 2024-08-02T18:49:32.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:32 smithi151 ceph-mon[37155]: pgmap v332: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:32.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:32 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1475390945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:32.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:32 smithi103 ceph-mon[32753]: pgmap v332: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:32.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:32 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1475390945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:32.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:32 smithi121 ceph-mon[37236]: pgmap v332: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:32.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:32 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1475390945' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:32.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 25, 'flags': 50, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-02T18:47:22.067716+0000', 'modified': '2024-08-02T18:48:05.212257+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24473, 'mds_1': 24469, 'mds_2': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6835/1461531566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 1461531566}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 1461531566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6835/126654937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 126654937}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 126654937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6837/1633433490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 1633433490}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 1633433490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.151:6837/1434322363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 1434322363}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 1434322363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.151:6839/3705298051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 3705298051}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 3705298051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.121:6839/3512573309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3512573309}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3512573309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24454, 24469, 24473]} 2024-08-02T18:49:32.811 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-02T18:49:32.811 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.c status 2024-08-02T18:49:33.068 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:33.575 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 -- 172.21.15.103:0/670466007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41007b0 msgr2=0x7f1ee4100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/670466007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41007b0 0x7f1ee4100c10 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1ed8009930 tx=0x7f1ed802a420 comp rx=0 tx=0).stop 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 -- 172.21.15.103:0/670466007 shutdown_connections 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/670466007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ee4101150 0x7f1ee410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/670466007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41007b0 0x7f1ee4100c10 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/670466007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ee41067b0 0x7f1ee4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 -- 172.21.15.103:0/670466007 >> 172.21.15.103:0/670466007 conn(0x7f1ee40fc4d0 msgr2=0x7f1ee40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 -- 172.21.15.103:0/670466007 shutdown_connections 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.562+0000 7f1ee94e6640 1 -- 172.21.15.103:0/670466007 wait complete. 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee94e6640 1 Processor -- start 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee94e6640 1 -- start start 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee94e6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ee41007b0 0x7f1ee4197190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.576 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee94e6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ee4101150 0x7f1ee41976d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee94e6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41067b0 0x7f1ee419ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee94e6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4110d10 con 0x7f1ee41067b0 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee94e6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4110b90 con 0x7f1ee4101150 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee94e6640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1ee4110e90 con 0x7f1ee41007b0 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41067b0 0x7f1ee419ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41067b0 0x7f1ee419ba60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47982/0 (socket says 172.21.15.103:47982) 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee37fe640 1 -- 172.21.15.103:0/944043484 learned_addr learned my addr 172.21.15.103:0/944043484 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ee41007b0 0x7f1ee4197190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.563+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ee4101150 0x7f1ee41976d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee37fe640 1 -- 172.21.15.103:0/944043484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ee41007b0 msgr2=0x7f1ee4197190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee37fe640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ee41007b0 0x7f1ee4197190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee37fe640 1 -- 172.21.15.103:0/944043484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ee4101150 msgr2=0x7f1ee41976d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee37fe640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ee4101150 0x7f1ee41976d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee37fe640 1 -- 172.21.15.103:0/944043484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1ee419c140 con 0x7f1ee41067b0 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ee4101150 0x7f1ee41976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee37fe640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41067b0 0x7f1ee419ba60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00cce0 tx=0x7f1edc00a620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ecbfff640 1 -- 172.21.15.103:0/944043484 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc00f450 con 0x7f1ee41067b0 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee94e6640 1 -- 172.21.15.103:0/944043484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1ee419c430 con 0x7f1ee41067b0 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ecbfff640 1 -- 172.21.15.103:0/944043484 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1edc00faf0 con 0x7f1ee41067b0 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ecbfff640 1 -- 172.21.15.103:0/944043484 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1edc018c50 con 0x7f1ee41067b0 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.564+0000 7f1ee94e6640 1 -- 172.21.15.103:0/944043484 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1ee41a3d10 con 0x7f1ee41067b0 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.566+0000 7f1ecbfff640 1 -- 172.21.15.103:0/944043484 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f1edc00fca0 con 0x7f1ee41067b0 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.566+0000 7f1eeb8e4740 1 Processor -- start 2024-08-02T18:49:33.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.566+0000 7f1eeb8e4740 1 -- start start 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e27890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e27dd0 0x5602d2e344e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 0x5602d2e36e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5602d2d8c710 con 0x5602d2e274b0 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5602d2d24770 con 0x5602d2e34a20 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5602d2d886d0 con 0x5602d2e27dd0 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ecbfff640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1ecc0a2c10 0x7f1ecc0a50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e27890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e27890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47984/0 (socket says 172.21.15.103:47984) 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 -- 172.21.15.103:0/2415859845 learned_addr learned my addr 172.21.15.103:0/2415859845 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee37fe640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1ecc0a2c10 0x7f1ecc0a50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e27dd0 0x5602d2e344e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 0x5602d2e36e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ecbfff640 1 -- 172.21.15.103:0/944043484 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1edc0cfbb0 con 0x7f1ee41067b0 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 -- 172.21.15.103:0/2415859845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e27dd0 msgr2=0x5602d2e344e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e27dd0 0x5602d2e344e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 -- 172.21.15.103:0/2415859845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 msgr2=0x5602d2e36e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 0x5602d2e36e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 -- 172.21.15.103:0/2415859845 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d2d2b3e0 con 0x5602d2e274b0 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.567+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e27890 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1ed802a940 tx=0x7f1ed8009560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c44c0fbfaa2f78 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1ee37fe640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1ecc0a2c10 0x7f1ecc0a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1edc09bc50 tx=0x7f1edc018000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1ec97fa640 1 -- 172.21.15.103:0/2415859845 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8043030 con 0x5602d2e274b0 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1ec97fa640 1 -- 172.21.15.103:0/2415859845 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ed8005020 con 0x5602d2e274b0 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1ec97fa640 1 -- 172.21.15.103:0/2415859845 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8035050 con 0x5602d2e274b0 2024-08-02T18:49:33.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2415859845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 msgr2=0x5602d2e27890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e27890 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f1ed802a940 tx=0x7f1ed8009560 comp rx=0 tx=0).stop 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2415859845 shutdown_connections 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 0x5602d2e36e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e27dd0 0x5602d2e344e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2415859845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e27890 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2415859845 >> 172.21.15.103:0/2415859845 conn(0x5602d2e23bc0 msgr2=0x5602d2e23fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2415859845 shutdown_connections 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.568+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2415859845 wait complete. 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 1 -- start start 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 1 Processor -- start 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e274b0 0x5602d2e31970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e31eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 0x5602d2e323f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5602d2e375f0 con 0x5602d2e27dd0 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5602d2d47970 con 0x5602d2e34a20 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5602d2e37770 con 0x5602d2e274b0 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1eeb8e4740 10 client.0 _ll_register_callbacks cb 0x5602d2a9b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1ee2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e31eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1ee2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e31eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48000/0 (socket says 172.21.15.103:48000) 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1ee2ffd640 1 -- 172.21.15.103:0/3300353259 learned_addr learned my addr 172.21.15.103:0/3300353259 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 0x5602d2e323f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.569+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e274b0 0x5602d2e31970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ee2ffd640 1 -- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e274b0 msgr2=0x5602d2e31970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e274b0 0x5602d2e31970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ee2ffd640 1 -- 172.21.15.103:0/3300353259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 msgr2=0x5602d2e323f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:33.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 0x5602d2e323f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ee2ffd640 1 -- 172.21.15.103:0/3300353259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d2afe2b0 con 0x5602d2e27dd0 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e274b0 0x5602d2e31970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e31eb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4011570 tx=0x7f1ed4011a30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3789e44f9db169bf server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ec6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/3300353259 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed400f6d0 con 0x5602d2e27dd0 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/3300353259 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1ed400f870 con 0x5602d2e27dd0 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/3300353259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ed8005020 con 0x5602d2e27dd0 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/3300353259 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ed4026050 con 0x5602d2e27dd0 2024-08-02T18:49:33.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1eeb8e4740 10 client.15189 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/3300353259 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5602d2e43310 con 0x5602d2e27dd0 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/3300353259 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ed8005020 con 0x5602d2e27dd0 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/3300353259 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1ed401d400 con 0x5602d2e27dd0 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1eeb8e4740 10 client.15189 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1eeb8e4740 10 client.15189 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1eeb8e4740 20 client.15189 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x5602d2e45940 0x5602d2e46db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.570+0000 7f1eeb8e4740 4 client.15189 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.571+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/3300353259 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5602d2d99c80 con 0x5602d2e45940 2024-08-02T18:49:33.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.571+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x5602d2e45940 0x5602d2e46db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.571+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x5602d2e45940 0x5602d2e46db0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=1b1c2310bc143360 server_cookie=59f5c8d246d12739 in_seq=0 out_seq=0 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.571+0000 7f1ec6ff5640 10 client.15189 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/3300353259 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5602d2d99c80 con 0x5602d2e45940 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1ec6ff5640 10 client.15189 handle_command_reply: tid=0 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 client.15189 shutdown 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/3300353259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 msgr2=0x5602d2e31eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e31eb0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4011570 tx=0x7f1ed4011a30 comp rx=0 tx=0).stop 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/3300353259 shutdown_connections 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e34a20 0x5602d2e323f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x5602d2e45940 0x5602d2e46db0 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e31eb0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/3300353259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e274b0 0x5602d2e31970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1ec6ff5640 0 client.15189 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:49:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/3300353259 >> 172.21.15.103:0/3300353259 conn(0x5602d2e23bc0 msgr2=0x5602d2e29880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/3300353259 shutdown_connections 2024-08-02T18:49:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/3300353259 wait complete. 2024-08-02T18:49:33.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.572+0000 7f1eeb8e4740 20 client.15189 trim_cache size 0 max 16384 2024-08-02T18:49:33.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1eeb8e4740 1 Processor -- start 2024-08-02T18:49:33.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1eeb8e4740 1 -- start start 2024-08-02T18:49:33.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e274b0 0x5602d2e46010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e32240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e2ebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5602d2e450f0 con 0x5602d2e27dd0 2024-08-02T18:49:33.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5602d2e457c0 con 0x5602d2e274b0 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5602d2e45e90 con 0x5602d2e34a20 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1ee2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e32240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1ee2ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e32240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48004/0 (socket says 172.21.15.103:48004) 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1ee2ffd640 1 -- 172.21.15.103:0/2293662267 learned_addr learned my addr 172.21.15.103:0/2293662267 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e2ebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1ee2ffd640 1 -- 172.21.15.103:0/2293662267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 msgr2=0x5602d2e2ebd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e2ebd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1ee2ffd640 1 -- 172.21.15.103:0/2293662267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e274b0 msgr2=0x5602d2e46010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.590+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e274b0 0x5602d2e46010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.591+0000 7f1ee2ffd640 1 -- 172.21.15.103:0/2293662267 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5602d2e24b20 con 0x5602d2e27dd0 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.591+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e2ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:33.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.591+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e32240 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4011540 tx=0x7f1ed4004640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f064b027034ba2b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:33.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.591+0000 7f1ec8ff9640 1 -- 172.21.15.103:0/2293662267 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed402e020 con 0x5602d2e27dd0 2024-08-02T18:49:33.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.591+0000 7f1ec8ff9640 1 -- 172.21.15.103:0/2293662267 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ed401d400 con 0x5602d2e27dd0 2024-08-02T18:49:33.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.591+0000 7f1ec8ff9640 1 -- 172.21.15.103:0/2293662267 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed40146a0 con 0x5602d2e27dd0 2024-08-02T18:49:33.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.591+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2293662267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 msgr2=0x5602d2e32240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.591+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e32240 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f1ed4011540 tx=0x7f1ed4004640 comp rx=0 tx=0).stop 2024-08-02T18:49:33.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2293662267 shutdown_connections 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e2ebd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e27dd0 0x5602d2e32240 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2293662267 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e274b0 0x5602d2e46010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2293662267 >> 172.21.15.103:0/2293662267 conn(0x5602d2e23bc0 msgr2=0x5602d2e30240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2293662267 shutdown_connections 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2293662267 wait complete. 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 -- start start 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 Processor -- start 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e48e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e27dd0 0x5602d2e49360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e498a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5602d2e46c30 con 0x5602d2e274b0 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5602d2e46560 con 0x5602d2e27dd0 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5602d2e47300 con 0x5602d2e34a20 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1ee27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e48e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1ee27fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e48e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48014/0 (socket says 172.21.15.103:48014) 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1eeb8e4740 10 client.0 _ll_register_callbacks cb 0x7f1ed4009590 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.592+0000 7f1ee27fc640 1 -- 172.21.15.103:0/2139558068 learned_addr learned my addr 172.21.15.103:0/2139558068 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e498a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e27dd0 0x5602d2e49360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee27fc640 1 -- 172.21.15.103:0/2139558068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 msgr2=0x5602d2e498a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e498a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee27fc640 1 -- 172.21.15.103:0/2139558068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e27dd0 msgr2=0x5602d2e49360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e27dd0 0x5602d2e49360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee27fc640 1 -- 172.21.15.103:0/2139558068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5602d2e4d6c0 con 0x5602d2e274b0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e27dd0 0x5602d2e49360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ee27fc640 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e48e20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80315e0 tx=0x7f1ed80318b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2630e7fe90daf58a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ec6ff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/2139558068 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ed8035040 con 0x5602d2e274b0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/2139558068 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f1ed8004240 con 0x5602d2e274b0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2139558068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1ed401d400 con 0x5602d2e274b0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/2139558068 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f1ed8004440 con 0x5602d2e274b0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1eeb8e4740 10 client.15195 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2139558068 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x5602d2eb0360 con 0x5602d2e274b0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.593+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/2139558068 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1ed401d400 con 0x5602d2e274b0 2024-08-02T18:49:33.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/2139558068 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f1ed8004b40 con 0x5602d2e274b0 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1eeb8e4740 10 client.15195 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1eeb8e4740 10 client.15195 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1eeb8e4740 20 client.15195 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x5602d2eb4a10 0x5602d2eb3720 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1eeb8e4740 4 client.15195 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2139558068 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "status"}) -- 0x5602d2d94190 con 0x5602d2eb4a10 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x5602d2eb4a10 0x5602d2eb3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1ee2ffd640 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x5602d2eb4a10 0x5602d2eb3720 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=6c10eae1651700c7 server_cookie=6826ef9d07e04d76 in_seq=0 out_seq=0 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.594+0000 7f1ec6ff5640 10 client.15195 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ec6ff5640 1 -- 172.21.15.103:0/2139558068 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5602d2d94190 con 0x5602d2eb4a10 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ec6ff5640 10 client.15195 handle_command_reply: tid=0 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 client.15195 shutdown 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2139558068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 msgr2=0x5602d2e48e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e48e20 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f1ed80315e0 tx=0x7f1ed80318b0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2139558068 shutdown_connections 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5602d2e34a20 0x5602d2e498a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5602d2e27dd0 0x5602d2e49360 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x5602d2eb4a10 0x5602d2eb3720 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 --2- 172.21.15.103:0/2139558068 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5602d2e274b0 0x5602d2e48e20 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ec6ff5640 0 client.15195 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2139558068 >> 172.21.15.103:0/2139558068 conn(0x5602d2e23bc0 msgr2=0x5602d2e3f9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2139558068 shutdown_connections 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 1 -- 172.21.15.103:0/2139558068 wait complete. 2024-08-02T18:49:33.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1eeb8e4740 20 client.15195 trim_cache size 0 max 16384 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24454, 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 91.153292336000007, 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-08-02T18:49:33.603 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-08-02T18:49:33.604 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 157.253746183 2024-08-02T18:49:33.604 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:49:33.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 -- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1ecc0a2c10 msgr2=0x7f1ecc0a50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1ecc0a2c10 0x7f1ecc0a50d0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f1edc09bc50 tx=0x7f1edc018000 comp rx=0 tx=0).stop 2024-08-02T18:49:33.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 -- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41067b0 msgr2=0x7f1ee419ba60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41067b0 0x7f1ee419ba60 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f1edc00cce0 tx=0x7f1edc00a620 comp rx=0 tx=0).stop 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 -- 172.21.15.103:0/944043484 shutdown_connections 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1ee41067b0 0x7f1ee419ba60 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1ee4101150 0x7f1ee41976d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f1ecc0a2c10 0x7f1ecc0a50d0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 --2- 172.21.15.103:0/944043484 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1ee41007b0 0x7f1ee4197190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.595+0000 7f1ee94e6640 1 -- 172.21.15.103:0/944043484 >> 172.21.15.103:0/944043484 conn(0x7f1ee40fc4d0 msgr2=0x7f1ee40fcad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.596+0000 7f1ee94e6640 1 -- 172.21.15.103:0/944043484 shutdown_connections 2024-08-02T18:49:33.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:33.596+0000 7f1ee94e6640 1 -- 172.21.15.103:0/944043484 wait complete. 2024-08-02T18:49:34.395 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.i status 2024-08-02T18:49:34.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:34 smithi103 ceph-mon[32753]: pgmap v333: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:34.653 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:34.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:34 smithi121 ceph-mon[37236]: pgmap v333: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:34.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:34 smithi151 ceph-mon[37155]: pgmap v333: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 6 op/s 2024-08-02T18:49:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 -- 172.21.15.103:0/802449732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 msgr2=0x7f50801026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 --2- 172.21.15.103:0/802449732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 0x7f50801026e0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f5068009900 tx=0x7f506802a480 comp rx=0 tx=0).stop 2024-08-02T18:49:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 -- 172.21.15.103:0/802449732 shutdown_connections 2024-08-02T18:49:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 --2- 172.21.15.103:0/802449732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5080102c20 0x7f508010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 --2- 172.21.15.103:0/802449732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 0x7f50801026e0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 --2- 172.21.15.103:0/802449732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5080100b50 0x7f5080100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 -- 172.21.15.103:0/802449732 >> 172.21.15.103:0/802449732 conn(0x7f50800fc500 msgr2=0x7f50800fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 -- 172.21.15.103:0/802449732 shutdown_connections 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 -- 172.21.15.103:0/802449732 wait complete. 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.139+0000 7f50861b7640 1 Processor -- start 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f50861b7640 1 -- start start 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f50861b7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5080100b50 0x7f5080199140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f50861b7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 0x7f5080199680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f50861b7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5080102c20 0x7f50801a41c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f50861b7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5080110dd0 con 0x7f50801022a0 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f50861b7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5080110c50 con 0x7f5080100b50 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f50861b7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5080110f50 con 0x7f5080102c20 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 0x7f5080199680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 0x7f5080199680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48032/0 (socket says 172.21.15.103:48032) 2024-08-02T18:49:35.195 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 -- 172.21.15.103:0/2048273084 learned_addr learned my addr 172.21.15.103:0/2048273084 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f507f7fe640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5080100b50 0x7f5080199140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f507ffff640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5080102c20 0x7f50801a41c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 -- 172.21.15.103:0/2048273084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5080102c20 msgr2=0x7f50801a41c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5080102c20 0x7f50801a41c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 -- 172.21.15.103:0/2048273084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5080100b50 msgr2=0x7f5080199140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5080100b50 0x7f5080199140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 -- 172.21.15.103:0/2048273084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50801a4700 con 0x7f50801022a0 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.140+0000 7f5077fff640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 0x7f5080199680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5068006010 tx=0x7f5068004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.141+0000 7f507d7fa640 1 -- 172.21.15.103:0/2048273084 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f506803f030 con 0x7f50801022a0 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.141+0000 7f507d7fa640 1 -- 172.21.15.103:0/2048273084 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5068005500 con 0x7f50801022a0 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.141+0000 7f50861b7640 1 -- 172.21.15.103:0/2048273084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50801a48d0 con 0x7f50801022a0 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.141+0000 7f507d7fa640 1 -- 172.21.15.103:0/2048273084 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068035070 con 0x7f50801022a0 2024-08-02T18:49:35.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.141+0000 7f50861b7640 1 -- 172.21.15.103:0/2048273084 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50801a4d80 con 0x7f50801022a0 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.143+0000 7f507d7fa640 1 -- 172.21.15.103:0/2048273084 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 17) ==== 137885+0+0 (secure 0 0 0) 0x7f5068042030 con 0x7f50801022a0 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.143+0000 7f50885b5740 1 Processor -- start 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.143+0000 7f50885b5740 1 -- start start 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f50885b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533630 0x564092533a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f50885b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f50885b5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x564092540c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f50885b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564092498710 con 0x564092533630 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f50885b5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564092430770 con 0x56409253e810 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f50885b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5640924946d0 con 0x564092533f50 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f5077fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x564092540c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533630 0x564092533a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533630 0x564092533a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48042/0 (socket says 172.21.15.103:48042) 2024-08-02T18:49:35.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 -- 172.21.15.103:0/2398434800 learned_addr learned my addr 172.21.15.103:0/2398434800 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f5077fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x564092540c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:37458/0 (socket says 172.21.15.103:37458) 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507d7fa640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f506c0a2c90 0x7f506c0a5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507f7fe640 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f506c0a2c90 0x7f506c0a5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 -- 172.21.15.103:0/2398434800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 msgr2=0x56409253e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 -- 172.21.15.103:0/2398434800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 msgr2=0x564092540c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x564092540c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 -- 172.21.15.103:0/2398434800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640924373e0 con 0x564092533630 2024-08-02T18:49:35.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507f7fe640 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507d7fa640 1 -- 172.21.15.103:0/2048273084 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f50680efa60 con 0x7f50801022a0 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.144+0000 7f507ffff640 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533630 0x564092533a10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f50780139d0 tx=0x7f5078013e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=633d448489c749d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f5075ffb640 1 -- 172.21.15.103:0/2398434800 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078013050 con 0x564092533630 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f5075ffb640 1 -- 172.21.15.103:0/2398434800 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5078022070 con 0x564092533630 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f5075ffb640 1 -- 172.21.15.103:0/2398434800 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078012740 con 0x564092533630 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f507ffff640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f506c0a2c90 0x7f506c0a5150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5078021000 tx=0x7f507801f000 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 -- 172.21.15.103:0/2398434800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533630 msgr2=0x564092533a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533630 0x564092533a10 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f50780139d0 tx=0x7f5078013e90 comp rx=0 tx=0).stop 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 -- 172.21.15.103:0/2398434800 shutdown_connections 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x564092540c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 --2- 172.21.15.103:0/2398434800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533630 0x564092533a10 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 -- 172.21.15.103:0/2398434800 >> 172.21.15.103:0/2398434800 conn(0x56409252fbc0 msgr2=0x56409252ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 -- 172.21.15.103:0/2398434800 shutdown_connections 2024-08-02T18:49:35.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.145+0000 7f50885b5740 1 -- 172.21.15.103:0/2398434800 wait complete. 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 1 -- start start 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 1 Processor -- start 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533630 0x56409253b680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x56409253bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x56409253c100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5640925413e0 con 0x564092533f50 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564092453970 con 0x56409253e810 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564092541560 con 0x564092533630 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f50885b5740 10 client.0 _ll_register_callbacks cb 0x5640921a77b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f5077fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x56409253bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f5077fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x56409253bbc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48056/0 (socket says 172.21.15.103:48056) 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f5077fff640 1 -- 172.21.15.103:0/1038738382 learned_addr learned my addr 172.21.15.103:0/1038738382 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:35.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.146+0000 7f507ffff640 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x56409253c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f507f7fe640 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533630 0x56409253b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f5077fff640 1 -- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533630 msgr2=0x56409253b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f5077fff640 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533630 0x56409253b680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f5077fff640 1 -- 172.21.15.103:0/1038738382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 msgr2=0x56409253c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f5077fff640 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x56409253c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f5077fff640 1 -- 172.21.15.103:0/1038738382 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56409220a2b0 con 0x564092533f50 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f507f7fe640 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533630 0x56409253b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f5077fff640 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x56409253bbc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f50680b8310 tx=0x7f50680f30e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4ac8f6c07487fbc server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f505effd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f505effd640 1 -- 172.21.15.103:0/1038738382 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068049040 con 0x564092533f50 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f505effd640 1 -- 172.21.15.103:0/1038738382 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5068004370 con 0x564092533f50 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f50885b5740 1 -- 172.21.15.103:0/1038738382 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5078022070 con 0x564092533f50 2024-08-02T18:49:35.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f505effd640 1 -- 172.21.15.103:0/1038738382 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f50680f7040 con 0x564092533f50 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f50885b5740 10 client.15207 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f50885b5740 1 -- 172.21.15.103:0/1038738382 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56409254cf70 con 0x564092533f50 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f505effd640 1 -- 172.21.15.103:0/1038738382 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5078022070 con 0x564092533f50 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f505effd640 1 -- 172.21.15.103:0/1038738382 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f50680b8520 con 0x564092533f50 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.147+0000 7f50885b5740 10 client.15207 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.148+0000 7f50885b5740 10 client.15207 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.148+0000 7f50885b5740 20 client.15207 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.148+0000 7f50885b5740 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x56409254f5a0 0x564092550a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.148+0000 7f50885b5740 4 client.15207 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.148+0000 7f50885b5740 1 -- 172.21.15.103:0/1038738382 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640924a5c80 con 0x56409254f5a0 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.148+0000 7f507f7fe640 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x56409254f5a0 0x564092550a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.148+0000 7f507f7fe640 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x56409254f5a0 0x564092550a10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=f5ba977c83784dae server_cookie=717e337662d2406a in_seq=0 out_seq=0 2024-08-02T18:49:35.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.148+0000 7f505effd640 10 client.15207 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f505effd640 1 -- 172.21.15.103:0/1038738382 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5640924a5c80 con 0x56409254f5a0 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f505effd640 10 client.15207 handle_command_reply: tid=0 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 client.15207 shutdown 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 -- 172.21.15.103:0/1038738382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 msgr2=0x56409253bbc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x56409253bbc0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f50680b8310 tx=0x7f50680f30e0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 -- 172.21.15.103:0/1038738382 shutdown_connections 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x56409254f5a0 0x564092550a10 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56409253e810 0x56409253c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x56409253bbc0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 --2- 172.21.15.103:0/1038738382 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533630 0x56409253b680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f505effd640 0 client.15207 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:49:35.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.149+0000 7f50885b5740 1 -- 172.21.15.103:0/1038738382 >> 172.21.15.103:0/1038738382 conn(0x56409252fbc0 msgr2=0x56409252ed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.150+0000 7f50885b5740 1 -- 172.21.15.103:0/1038738382 shutdown_connections 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.150+0000 7f50885b5740 1 -- 172.21.15.103:0/1038738382 wait complete. 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.150+0000 7f50885b5740 20 client.15207 trim_cache size 0 max 16384 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f50885b5740 1 Processor -- start 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f50885b5740 1 -- start start 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f50885b5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092536090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f50885b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253af40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f50885b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56409253e810 0x56409253a660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f50885b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56409254ed50 con 0x56409253e810 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f50885b5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56409254f420 con 0x564092533630 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f50885b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56409254faf0 con 0x564092533f50 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f507ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56409253e810 0x56409253a660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f507ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56409253e810 0x56409253a660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48068/0 (socket says 172.21.15.103:48068) 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.167+0000 7f507ffff640 1 -- 172.21.15.103:0/4261870958 learned_addr learned my addr 172.21.15.103:0/4261870958 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f507f7fe640 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092536090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f5077fff640 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253af40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f507ffff640 1 -- 172.21.15.103:0/4261870958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 msgr2=0x56409253af40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f507ffff640 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253af40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f507ffff640 1 -- 172.21.15.103:0/4261870958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 msgr2=0x564092536090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f507ffff640 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092536090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f507ffff640 1 -- 172.21.15.103:0/4261870958 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56409252f9f0 con 0x56409253e810 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f507f7fe640 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092536090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f507ffff640 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56409253e810 0x56409253a660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5078007310 tx=0x7f50780071c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=222c6d539cc9fafd server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f50757fa640 1 -- 172.21.15.103:0/4261870958 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5078013500 con 0x56409253e810 2024-08-02T18:49:35.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f50757fa640 1 -- 172.21.15.103:0/4261870958 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5078022040 con 0x56409253e810 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.168+0000 7f50757fa640 1 -- 172.21.15.103:0/4261870958 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f507801da70 con 0x56409253e810 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- 172.21.15.103:0/4261870958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56409253e810 msgr2=0x56409253a660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56409253e810 0x56409253a660 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f5078007310 tx=0x7f50780071c0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- 172.21.15.103:0/4261870958 shutdown_connections 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56409253e810 0x56409253a660 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564092533f50 0x56409253af40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 --2- 172.21.15.103:0/4261870958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092536090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- 172.21.15.103:0/4261870958 >> 172.21.15.103:0/4261870958 conn(0x56409252fbc0 msgr2=0x564092539f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- 172.21.15.103:0/4261870958 shutdown_connections 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- 172.21.15.103:0/4261870958 wait complete. 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- start start 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 Processor -- start 2024-08-02T18:49:35.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092557170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x5640925576b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56409253e810 0x5640925bcce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564092550890 con 0x564092533f50 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5640925501c0 con 0x564092533630 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564092550f60 con 0x56409253e810 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f50885b5740 10 client.0 _ll_register_callbacks cb 0x7f5068005890 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.169+0000 7f5077fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x5640925576b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f5077fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x5640925576b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48072/0 (socket says 172.21.15.103:48072) 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f5077fff640 1 -- 172.21.15.103:0/2327888746 learned_addr learned my addr 172.21.15.103:0/2327888746 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f507f7fe640 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092557170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f5077fff640 1 -- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56409253e810 msgr2=0x5640925bcce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:35.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f507ffff640 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56409253e810 0x5640925bcce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f5077fff640 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56409253e810 0x5640925bcce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f5077fff640 1 -- 172.21.15.103:0/2327888746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 msgr2=0x564092557170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f5077fff640 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092557170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f5077fff640 1 -- 172.21.15.103:0/2327888746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56409252b130 con 0x564092533f50 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f507ffff640 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56409253e810 0x5640925bcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f5077fff640 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x5640925576b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f50680bbbb0 tx=0x7f50680b8750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd24dbc0c91ebc1e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f505effd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f505effd640 1 -- 172.21.15.103:0/2327888746 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5068049040 con 0x564092533f50 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f505effd640 1 -- 172.21.15.103:0/2327888746 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5068003bc0 con 0x564092533f50 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f50885b5740 1 -- 172.21.15.103:0/2327888746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5078022040 con 0x564092533f50 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f505effd640 1 -- 172.21.15.103:0/2327888746 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f50680bbc80 con 0x564092533f50 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f50885b5740 10 client.15213 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:35.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f50885b5740 1 -- 172.21.15.103:0/2327888746 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x56409252b130 con 0x564092533f50 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.170+0000 7f505effd640 1 -- 172.21.15.103:0/2327888746 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5078022040 con 0x564092533f50 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f505effd640 1 -- 172.21.15.103:0/2327888746 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f5068031bc0 con 0x564092533f50 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24469, 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:49:35.209 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 93.736201175000005, 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 153.41758675099999 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f50885b5740 10 client.15213 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f50885b5740 10 client.15213 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f50885b5740 20 client.15213 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f50885b5740 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x5640925c2b20 0x5640925c1830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:35.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f50885b5740 4 client.15213 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f50885b5740 1 -- 172.21.15.103:0/2327888746 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "status"}) -- 0x5640924a0190 con 0x5640925c2b20 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f507f7fe640 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x5640925c2b20 0x5640925c1830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f505effd640 10 client.15213 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.171+0000 7f507f7fe640 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x5640925c2b20 0x5640925c1830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b890f5c507ada474 server_cookie=7fcf6fd81833e96e in_seq=0 out_seq=0 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f505effd640 1 -- 172.21.15.103:0/2327888746 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x5640924a0190 con 0x5640925c2b20 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f505effd640 10 client.15213 handle_command_reply: tid=0 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 client.15213 shutdown 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 -- 172.21.15.103:0/2327888746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 msgr2=0x5640925576b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x5640925576b0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f50680bbbb0 tx=0x7f50680b8750 comp rx=0 tx=0).stop 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 -- 172.21.15.103:0/2327888746 shutdown_connections 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56409253e810 0x5640925bcce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564092533f50 0x5640925576b0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x5640925c2b20 0x5640925c1830 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 --2- 172.21.15.103:0/2327888746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564092533630 0x564092557170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f505effd640 0 client.15213 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 -- 172.21.15.103:0/2327888746 >> 172.21.15.103:0/2327888746 conn(0x56409252fbc0 msgr2=0x56409253a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 -- 172.21.15.103:0/2327888746 shutdown_connections 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 1 -- 172.21.15.103:0/2327888746 wait complete. 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50885b5740 20 client.15213 trim_cache size 0 max 16384 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 -- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f506c0a2c90 msgr2=0x7f506c0a5150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f506c0a2c90 0x7f506c0a5150 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f5078021000 tx=0x7f507801f000 comp rx=0 tx=0).stop 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 -- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 msgr2=0x7f5080199680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 0x7f5080199680 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f5068006010 tx=0x7f5068004c00 comp rx=0 tx=0).stop 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 -- 172.21.15.103:0/2048273084 shutdown_connections 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f506c0a2c90 0x7f506c0a5150 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5080102c20 0x7f50801a41c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50801022a0 0x7f5080199680 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.172+0000 7f50861b7640 1 --2- 172.21.15.103:0/2048273084 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5080100b50 0x7f5080199140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:35.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.173+0000 7f50861b7640 1 -- 172.21.15.103:0/2048273084 >> 172.21.15.103:0/2048273084 conn(0x7f50800fc500 msgr2=0x7f50801065a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:35.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.173+0000 7f50861b7640 1 -- 172.21.15.103:0/2048273084 shutdown_connections 2024-08-02T18:49:35.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:35.173+0000 7f50861b7640 1 -- 172.21.15.103:0/2048273084 wait complete. 2024-08-02T18:49:35.896 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.b status 2024-08-02T18:49:36.161 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:36.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:36 smithi103 ceph-mon[32753]: pgmap v334: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.674+0000 7f7f06eb7640 1 -- 172.21.15.103:0/1991696359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001078c0 msgr2=0x7f7f00107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.674+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/1991696359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001078c0 0x7f7f00107ca0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009930 tx=0x7f7ef002a420 comp rx=0 tx=0).stop 2024-08-02T18:49:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 -- 172.21.15.103:0/1991696359 shutdown_connections 2024-08-02T18:49:36.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/1991696359 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f00102260 0x7f7f0010e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/1991696359 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f001018c0 0x7f7f00101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/1991696359 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001078c0 0x7f7f00107ca0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 -- 172.21.15.103:0/1991696359 >> 172.21.15.103:0/1991696359 conn(0x7f7f000fd5e0 msgr2=0x7f7f000ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 -- 172.21.15.103:0/1991696359 shutdown_connections 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 -- 172.21.15.103:0/1991696359 wait complete. 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 Processor -- start 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 -- start start 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001018c0 0x7f7f001982c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00102260 0x7f7f00198800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f001078c0 0x7f7f0019cb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7f00111de0 con 0x7f7f001018c0 2024-08-02T18:49:36.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7f00111c60 con 0x7f7f001078c0 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.675+0000 7f7f06eb7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7f00111f60 con 0x7f7f00102260 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001018c0 0x7f7f001982c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001018c0 0x7f7f001982c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48096/0 (socket says 172.21.15.103:48096) 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 -- 172.21.15.103:0/3699662795 learned_addr learned my addr 172.21.15.103:0/3699662795 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f05454640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f001078c0 0x7f7f0019cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7efffff640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00102260 0x7f7f00198800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 -- 172.21.15.103:0/3699662795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00102260 msgr2=0x7f7f00198800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00102260 0x7f7f00198800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 -- 172.21.15.103:0/3699662795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f001078c0 msgr2=0x7f7f0019cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f001078c0 0x7f7f0019cb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 -- 172.21.15.103:0/3699662795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f0019d270 con 0x7f7f001018c0 2024-08-02T18:49:36.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f05454640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f001078c0 0x7f7f0019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f04c53640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001018c0 0x7f7f001982c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009230 tx=0x7f7ef0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7efdffb640 1 -- 172.21.15.103:0/3699662795 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef003f030 con 0x7f7f001018c0 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f06eb7640 1 -- 172.21.15.103:0/3699662795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f0019d500 con 0x7f7f001018c0 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7efdffb640 1 -- 172.21.15.103:0/3699662795 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ef0003af0 con 0x7f7f001018c0 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7efdffb640 1 -- 172.21.15.103:0/3699662795 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0035070 con 0x7f7f001018c0 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.676+0000 7f7f06eb7640 1 -- 172.21.15.103:0/3699662795 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f001a4e40 con 0x7f7f001018c0 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.679+0000 7f7efdffb640 1 -- 172.21.15.103:0/3699662795 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7ef0042030 con 0x7f7f001018c0 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.679+0000 7f7f092b5740 1 Processor -- start 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.679+0000 7f7f092b5740 1 -- start start 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88420a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e8842b2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e8842b810 0x560e8842dc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f092b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560e88385710 con 0x560e88420630 2024-08-02T18:49:36.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f092b5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560e8831d770 con 0x560e88420f50 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f092b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560e883816d0 con 0x560e8842b810 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f05454640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88420a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f05454640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88420a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48106/0 (socket says 172.21.15.103:48106) 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f05454640 1 -- 172.21.15.103:0/2471291974 learned_addr learned my addr 172.21.15.103:0/2471291974 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f04c53640 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e8842b2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7efdffb640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7ee80a2b80 0x7f7ee80a5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f05454640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7ee80a2b80 0x7f7ee80a5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7efffff640 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e8842b810 0x560e8842dc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7efdffb640 1 -- 172.21.15.103:0/3699662795 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7ef00efa70 con 0x7f7f001018c0 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f04c53640 1 -- 172.21.15.103:0/2471291974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e8842b810 msgr2=0x560e8842dc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f04c53640 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e8842b810 0x560e8842dc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f04c53640 1 -- 172.21.15.103:0/2471291974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 msgr2=0x560e88420a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f04c53640 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88420a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f04c53640 1 -- 172.21.15.103:0/2471291974 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e883243e0 con 0x560e88420f50 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7efffff640 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e8842b810 0x560e8842dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.680+0000 7f7f04c53640 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e8842b2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00b8940 tx=0x7f7ef00b7c10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=114c111e6cbfe1b6 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f05454640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7ee80a2b80 0x7f7ee80a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8005c40 tx=0x7f7ef80136d0 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7ee6ffd640 1 -- 172.21.15.103:0/2471291974 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0049030 con 0x560e88420f50 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7ee6ffd640 1 -- 172.21.15.103:0/2471291974 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ef00bc670 con 0x560e88420f50 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7ee6ffd640 1 -- 172.21.15.103:0/2471291974 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef00c4be0 con 0x560e88420f50 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 -- 172.21.15.103:0/2471291974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 msgr2=0x560e8842b2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e8842b2d0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00b8940 tx=0x7f7ef00b7c10 comp rx=0 tx=0).stop 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 -- 172.21.15.103:0/2471291974 shutdown_connections 2024-08-02T18:49:36.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e8842b810 0x560e8842dc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e8842b2d0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2471291974 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88420a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 -- 172.21.15.103:0/2471291974 >> 172.21.15.103:0/2471291974 conn(0x560e8841cbc0 msgr2=0x560e8841cfa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 -- 172.21.15.103:0/2471291974 shutdown_connections 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.681+0000 7f7f092b5740 1 -- 172.21.15.103:0/2471291974 wait complete. 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 1 -- start start 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 1 Processor -- start 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88428710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 0x560e88428c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e8842b810 0x560e88429190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560e8842e1a0 con 0x560e88420630 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560e88340970 con 0x560e8842b810 2024-08-02T18:49:36.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560e8842e320 con 0x560e88420f50 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f092b5740 10 client.0 _ll_register_callbacks cb 0x560e880947b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f04c53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88428710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f04c53640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88428710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48120/0 (socket says 172.21.15.103:48120) 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f04c53640 1 -- 172.21.15.103:0/2496631261 learned_addr learned my addr 172.21.15.103:0/2496631261 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7f05454640 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e8842b810 0x560e88429190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.682+0000 7f7efffff640 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 0x560e88428c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f04c53640 1 -- 172.21.15.103:0/2496631261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 msgr2=0x560e88428c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f04c53640 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 0x560e88428c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f04c53640 1 -- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e8842b810 msgr2=0x560e88429190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f04c53640 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e8842b810 0x560e88429190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f04c53640 1 -- 172.21.15.103:0/2496631261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e880f72b0 con 0x560e88420630 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f05454640 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e8842b810 0x560e88429190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:36.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f04c53640 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88428710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00bbc70 tx=0x7f7ef00bbad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c8c22ae7643be10 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7edffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7edffff640 1 -- 172.21.15.103:0/2496631261 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef0049070 con 0x560e88420630 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7edffff640 1 -- 172.21.15.103:0/2496631261 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7ef0003ca0 con 0x560e88420630 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f092b5740 1 -- 172.21.15.103:0/2496631261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ef00bc670 con 0x560e88420630 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7edffff640 1 -- 172.21.15.103:0/2496631261 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7ef00bb8d0 con 0x560e88420630 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f092b5740 10 client.15225 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f092b5740 1 -- 172.21.15.103:0/2496631261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e8842e1a0 con 0x560e88420630 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7edffff640 1 -- 172.21.15.103:0/2496631261 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ef00bc670 con 0x560e88420630 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7edffff640 1 -- 172.21.15.103:0/2496631261 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7ef00dacd0 con 0x560e88420630 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f092b5740 10 client.15225 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f092b5740 10 client.15225 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.683+0000 7f7f092b5740 20 client.15225 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:36.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.684+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x560e8843bef0 0x560e8843d360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.684+0000 7f7f092b5740 4 client.15225 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:49:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.684+0000 7f7f092b5740 1 -- 172.21.15.103:0/2496631261 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560e88392c80 con 0x560e8843bef0 2024-08-02T18:49:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.684+0000 7f7efffff640 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x560e8843bef0 0x560e8843d360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.684+0000 7f7edffff640 10 client.15225 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.684+0000 7f7efffff640 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x560e8843bef0 0x560e8843d360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=dad449aae3133d62 server_cookie=a25d47f1aaca140b in_seq=0 out_seq=0 2024-08-02T18:49:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7edffff640 1 -- 172.21.15.103:0/2496631261 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x560e88392c80 con 0x560e8843bef0 2024-08-02T18:49:36.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7edffff640 10 client.15225 handle_command_reply: tid=0 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 client.15225 shutdown 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 -- 172.21.15.103:0/2496631261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 msgr2=0x560e88428710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88428710 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00bbc70 tx=0x7f7ef00bbad0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 -- 172.21.15.103:0/2496631261 shutdown_connections 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x560e8843bef0 0x560e8843d360 crc :-1 s=READY pgs=25 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e8842b810 0x560e88429190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 0x560e88428c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7edffff640 0 client.15225 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 --2- 172.21.15.103:0/2496631261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e88420630 0x560e88428710 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 -- 172.21.15.103:0/2496631261 >> 172.21.15.103:0/2496631261 conn(0x560e8841cbc0 msgr2=0x560e884228f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:36.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 -- 172.21.15.103:0/2496631261 shutdown_connections 2024-08-02T18:49:36.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 1 -- 172.21.15.103:0/2496631261 wait complete. 2024-08-02T18:49:36.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.685+0000 7f7f092b5740 20 client.15225 trim_cache size 0 max 16384 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.702+0000 7f7f092b5740 1 Processor -- start 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f092b5740 1 -- start start 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420630 0x560e88428fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e88445a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88422080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f092b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560e8843b6a0 con 0x560e8842b810 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f092b5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560e8843bd70 con 0x560e88420f50 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f092b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560e8843c440 con 0x560e88420630 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88422080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88422080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48126/0 (socket says 172.21.15.103:48126) 2024-08-02T18:49:36.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 -- 172.21.15.103:0/787318125 learned_addr learned my addr 172.21.15.103:0/787318125 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7efffff640 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e88445a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f04c53640 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420630 0x560e88428fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 -- 172.21.15.103:0/787318125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420630 msgr2=0x560e88428fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420630 0x560e88428fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 -- 172.21.15.103:0/787318125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 msgr2=0x560e88445a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e88445a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 -- 172.21.15.103:0/787318125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560e8841c9f0 con 0x560e8842b810 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7f05454640 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88422080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80099e0 tx=0x7f7ef8015070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c461e404dbfd90ba server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.703+0000 7f7ee67fc640 1 -- 172.21.15.103:0/787318125 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8005230 con 0x560e8842b810 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7ee67fc640 1 -- 172.21.15.103:0/787318125 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ef80058d0 con 0x560e8842b810 2024-08-02T18:49:36.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7ee67fc640 1 -- 172.21.15.103:0/787318125 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef80226a0 con 0x560e8842b810 2024-08-02T18:49:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 -- 172.21.15.103:0/787318125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 msgr2=0x560e88422080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88422080 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f7ef80099e0 tx=0x7f7ef8015070 comp rx=0 tx=0).stop 2024-08-02T18:49:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 -- 172.21.15.103:0/787318125 shutdown_connections 2024-08-02T18:49:36.712 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88422080 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420f50 0x560e88445a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 --2- 172.21.15.103:0/787318125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420630 0x560e88428fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 -- 172.21.15.103:0/787318125 >> 172.21.15.103:0/787318125 conn(0x560e8841cbc0 msgr2=0x560e88427820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 -- 172.21.15.103:0/787318125 shutdown_connections 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.704+0000 7f7f092b5740 1 -- 172.21.15.103:0/787318125 wait complete. 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 1 -- start start 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 1 Processor -- start 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420630 0x560e884249a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 0x560e88424ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88425420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x560e8843d1e0 con 0x560e8842b810 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x560e8843cb10 con 0x560e88420630 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x560e8843d8b0 con 0x560e88420f50 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f092b5740 10 client.0 _ll_register_callbacks cb 0x7f7ef8009ee0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f04c53640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420630 0x560e884249a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f04c53640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420630 0x560e884249a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:37566/0 (socket says 172.21.15.103:37566) 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f04c53640 1 -- 172.21.15.103:0/4245537617 learned_addr learned my addr 172.21.15.103:0/4245537617 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7efffff640 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 0x560e88424ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f05454640 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88425420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f04c53640 1 -- 172.21.15.103:0/4245537617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 msgr2=0x560e88424ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f04c53640 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 0x560e88424ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f04c53640 1 -- 172.21.15.103:0/4245537617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 msgr2=0x560e88425420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:36.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f04c53640 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88425420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.705+0000 7f7f04c53640 1 -- 172.21.15.103:0/4245537617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560e88418130 con 0x560e88420630 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f04c53640 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420630 0x560e884249a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00d2040 tx=0x7f7ef00dc150 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd79b8c5aebfdcd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7edffff640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7edffff640 1 -- 172.21.15.103:0/4245537617 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ef009e070 con 0x560e88420630 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7edffff640 1 -- 172.21.15.103:0/4245537617 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7ef0003ca0 con 0x560e88420630 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 1 -- 172.21.15.103:0/4245537617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ef80058d0 con 0x560e88420630 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7edffff640 1 -- 172.21.15.103:0/4245537617 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=25) ==== 24+0+0 (secure 0 0 0) 0x7f7ef0049040 con 0x560e88420630 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 10 client.24851 fetch_fsmap learned FSMap version 25 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 1 -- 172.21.15.103:0/4245537617 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=25,monmap=4+}) -- 0x560e88418130 con 0x560e88420630 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7edffff640 1 -- 172.21.15.103:0/4245537617 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7ef80058d0 con 0x560e88420630 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7edffff640 1 -- 172.21.15.103:0/4245537617 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 25) ==== 8354+0+0 (secure 0 0 0) 0x7f7ef00a1020 con 0x560e88420630 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 10 client.24851 fetch_fsmap finished waiting for FSMap version 25 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 10 client.24851 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-02T18:49:36.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 20 client.24851 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x560e884af0c0 0x560e884addd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 4 client.24851 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.706+0000 7f7f092b5740 1 -- 172.21.15.103:0/4245537617 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "status"}) -- 0x560e8838d190 con 0x560e884af0c0 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7efffff640 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x560e884af0c0 0x560e884addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7edffff640 10 client.24851 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7efffff640 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x560e884af0c0 0x560e884addd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f40d973280505892 server_cookie=489863ad770fe9b7 in_seq=0 out_seq=0 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7edffff640 1 -- 172.21.15.103:0/4245537617 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x560e8838d190 con 0x560e884af0c0 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7edffff640 10 client.24851 handle_command_reply: tid=0 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 client.24851 shutdown 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 -- 172.21.15.103:0/4245537617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420630 msgr2=0x560e884249a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420630 0x560e884249a0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f7ef00d2040 tx=0x7f7ef00dc150 comp rx=0 tx=0).stop 2024-08-02T18:49:36.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 -- 172.21.15.103:0/4245537617 shutdown_connections 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x560e884af0c0 0x560e884addd0 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x560e8842b810 0x560e88425420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x560e88420f50 0x560e88424ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7edffff640 0 client.24851 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 --2- 172.21.15.103:0/4245537617 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x560e88420630 0x560e884249a0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 -- 172.21.15.103:0/4245537617 >> 172.21.15.103:0/4245537617 conn(0x560e8841cbc0 msgr2=0x560e88429d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 -- 172.21.15.103:0/4245537617 shutdown_connections 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.707+0000 7f7f092b5740 1 -- 172.21.15.103:0/4245537617 wait complete. 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f092b5740 20 client.24851 trim_cache size 0 max 16384 2024-08-02T18:49:36.717 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24473, 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 134.39226930300001, 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 25, 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 89, 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 87, 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 145.085401553 2024-08-02T18:49:36.718 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:49:36.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 -- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7ee80a2b80 msgr2=0x7f7ee80a5040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7ee80a2b80 0x7f7ee80a5040 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8005c40 tx=0x7f7ef80136d0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 -- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001018c0 msgr2=0x7f7f001982c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:36.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001018c0 0x7f7f001982c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f7ef0009230 tx=0x7f7ef0004270 comp rx=0 tx=0).stop 2024-08-02T18:49:36.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 -- 172.21.15.103:0/3699662795 shutdown_connections 2024-08-02T18:49:36.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7f001078c0 0x7f7f0019cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7ee80a2b80 0x7f7ee80a5040 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7f00102260 0x7f7f00198800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 --2- 172.21.15.103:0/3699662795 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7f001018c0 0x7f7f001982c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:36.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 -- 172.21.15.103:0/3699662795 >> 172.21.15.103:0/3699662795 conn(0x7f7f000fd5e0 msgr2=0x7f7f000fde20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:36.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 -- 172.21.15.103:0/3699662795 shutdown_connections 2024-08-02T18:49:36.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:36.708+0000 7f7f06eb7640 1 -- 172.21.15.103:0/3699662795 wait complete. 2024-08-02T18:49:36.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:36 smithi121 ceph-mon[37236]: pgmap v334: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:36.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:36 smithi151 ceph-mon[37155]: pgmap v334: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 5 op/s 2024-08-02T18:49:37.431 INFO:teuthology.run_tasks:Running task sequential... 2024-08-02T18:49:37.445 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-08-02T18:49:37.445 INFO:teuthology.task.sequential:In sequential, running task print... 2024-08-02T18:49:37.446 INFO:teuthology.task.print:Enabling mgr modules 2024-08-02T18:49:37.446 INFO:teuthology.task.sequential:In sequential, running task exec... 2024-08-02T18:49:37.447 INFO:teuthology.task.exec:Executing custom commands... 2024-08-02T18:49:37.447 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:49:37.447 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph mgr module enable snap_schedule' 2024-08-02T18:49:37.551 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1469909374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 msgr2=0x7f7b1c108bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:37.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1469909374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 0x7f7b1c108bc0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f7b14009ca0 tx=0x7f7b1402a8c0 comp rx=0 tx=0).stop 2024-08-02T18:49:37.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1469909374 shutdown_connections 2024-08-02T18:49:37.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1469909374 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 0x7f7b1c108bc0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:37.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1469909374 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c101970 0x7f7b1c101df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:37.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1469909374 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c100780 0x7f7b1c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:37.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1469909374 >> 172.21.15.103:0/1469909374 conn(0x7f7b1c0fbee0 msgr2=0x7f7b1c0fe320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:37.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1469909374 shutdown_connections 2024-08-02T18:49:37.552 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.548+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1469909374 wait complete. 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b20b1b640 1 Processor -- start 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b20b1b640 1 -- start start 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b20b1b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c100780 0x7f7b1c197b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b20b1b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c101970 0x7f7b1c198040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b20b1b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 0x7f7b1c19f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b20b1b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c10d660 con 0x7f7b1c102330 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b20b1b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c10d4e0 con 0x7f7b1c100780 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b20b1b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7b1c10d7e0 con 0x7f7b1c101970 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 0x7f7b1c19f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 0x7f7b1c19f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:48150/0 (socket says 172.21.15.103:48150) 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1ad9d640 1 -- 172.21.15.103:0/1203224541 learned_addr learned my addr 172.21.15.103:0/1203224541 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:37.553 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1a59c640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c100780 0x7f7b1c197b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:37.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b11d9b640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c101970 0x7f7b1c198040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:37.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1ad9d640 1 -- 172.21.15.103:0/1203224541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c101970 msgr2=0x7f7b1c198040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:37.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1ad9d640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c101970 0x7f7b1c198040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:37.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1ad9d640 1 -- 172.21.15.103:0/1203224541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c100780 msgr2=0x7f7b1c197b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:37.554 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1ad9d640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c100780 0x7f7b1c197b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:37.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.549+0000 7f7b1ad9d640 1 -- 172.21.15.103:0/1203224541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7b1c19f720 con 0x7f7b1c102330 2024-08-02T18:49:37.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.550+0000 7f7b1ad9d640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 0x7f7b1c19f0b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7b14031a40 tx=0x7f7b14031ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:37.555 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.550+0000 7f7b13fff640 1 -- 172.21.15.103:0/1203224541 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b1402fbe0 con 0x7f7b1c102330 2024-08-02T18:49:37.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.550+0000 7f7b13fff640 1 -- 172.21.15.103:0/1203224541 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7b1402fd80 con 0x7f7b1c102330 2024-08-02T18:49:37.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.550+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7b1c19f9b0 con 0x7f7b1c102330 2024-08-02T18:49:37.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.550+0000 7f7b13fff640 1 -- 172.21.15.103:0/1203224541 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7b14046980 con 0x7f7b1c102330 2024-08-02T18:49:37.556 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.550+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7b1c19ff00 con 0x7f7b1c102330 2024-08-02T18:49:37.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.551+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7b1c1079d0 con 0x7f7b1c102330 2024-08-02T18:49:37.558 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.552+0000 7f7b13fff640 1 -- 172.21.15.103:0/1203224541 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 18) ==== 137834+0+0 (secure 0 0 0) 0x7f7b14030ce0 con 0x7f7b1c102330 2024-08-02T18:49:37.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.553+0000 7f7b13fff640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7b080a2c30 0x7f7b080a50f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:37.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.553+0000 7f7b1a59c640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7b080a2c30 0x7f7b080a50f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:37.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.553+0000 7f7b13fff640 1 -- 172.21.15.103:0/1203224541 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f7b140f09d0 con 0x7f7b1c102330 2024-08-02T18:49:37.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.554+0000 7f7b1a59c640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7b080a2c30 0x7f7b080a50f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c1017d0 tx=0x7f7b0c00b390 comp rx=0 tx=0).ready entity=mgr.14150 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:37.559 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.558+0000 7f7b13fff640 1 -- 172.21.15.103:0/1203224541 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7b140bd660 con 0x7f7b1c102330 2024-08-02T18:49:37.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:37 smithi103 ceph-mon[32753]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-02T18:49:37.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:37 smithi121 ceph-mon[37236]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-02T18:49:37.784 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:37.783+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "snap_schedule"} v 0) -- 0x7f7b1c062b20 con 0x7f7b1c102330 2024-08-02T18:49:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:37 smithi151 ceph-mon[37155]: mgrmap e18: x(active, since 8m), standbys: z, y 2024-08-02T18:49:38.447 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.445+0000 7f7b13fff640 1 -- 172.21.15.103:0/1203224541 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "snap_schedule"}]=0 v19) ==== 92+0+0 (secure 0 0 0) 0x7f7b140bcf60 con 0x7f7b1c102330 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.448+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7b080a2c30 msgr2=0x7f7b080a50f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.448+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7b080a2c30 0x7f7b080a50f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f7b1c1017d0 tx=0x7f7b0c00b390 comp rx=0 tx=0).stop 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.448+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 msgr2=0x7f7b1c19f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.448+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 0x7f7b1c19f0b0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f7b14031a40 tx=0x7f7b14031ee0 comp rx=0 tx=0).stop 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.448+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 shutdown_connections 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.448+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7b1c102330 0x7f7b1c19f0b0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.449+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f7b080a2c30 0x7f7b080a50f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.449+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7b1c101970 0x7f7b1c198040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:38.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.449+0000 7f7b20b1b640 1 --2- 172.21.15.103:0/1203224541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7b1c100780 0x7f7b1c197b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:38.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.449+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 >> 172.21.15.103:0/1203224541 conn(0x7f7b1c0fbee0 msgr2=0x7f7b1c104ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:38.451 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.449+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 shutdown_connections 2024-08-02T18:49:38.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:38.449+0000 7f7b20b1b640 1 -- 172.21.15.103:0/1203224541 wait complete. 2024-08-02T18:49:38.472 INFO:teuthology.run_tasks:Running task kclient... 2024-08-02T18:49:38.487 INFO:tasks.kclient:Mounting kernel clients... 2024-08-02T18:49:38.487 INFO:tasks.kclient:config is {'client.0': {}} 2024-08-02T18:49:38.487 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:38.487 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-02T18:49:38.504 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-08-02T18:49:38.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:38.504 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-08-02T18:49:38.571 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:38.571 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-08-02T18:49:38.690 INFO:tasks.kclient:client.0 config is {'mntopts': ['ms_mode=secure', 'nowsync'], 'rbytes': False, 'syntax': 'v1', 'mount_subvol_num': 1} 2024-08-02T18:49:38.690 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-08-02T18:49:38.690 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-02T18:49:38.691 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs ls 2024-08-02T18:49:38.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:38 smithi103 ceph-mon[32753]: pgmap v335: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-02T18:49:38.713 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:38 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1203224541' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-08-02T18:49:38.713 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ignoring --setuser ceph since I am not root 2024-08-02T18:49:38.713 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ignoring --setgroup ceph since I am not root 2024-08-02T18:49:38.713 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:38.616+0000 7f78ef503040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-02T18:49:38.748 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:38 smithi121 ceph-mon[37236]: pgmap v335: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-02T18:49:38.748 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:38 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1203224541' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-08-02T18:49:38.748 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: ignoring --setuser ceph since I am not root 2024-08-02T18:49:38.748 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: ignoring --setgroup ceph since I am not root 2024-08-02T18:49:38.748 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:38 smithi121 ceph-mgr[38616]: -- 172.21.15.121:0/3335912432 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56540ffc10e0 con 0x56540ff9e800 2024-08-02T18:49:38.748 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:38.600+0000 7f2e348c8040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-02T18:49:38.748 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:38.746+0000 7f2e348c8040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:49:38.749 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:38 smithi151 ceph-mon[37155]: pgmap v335: 129 pgs: 129 active+clean; 643 KiB data, 367 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 5 op/s 2024-08-02T18:49:38.749 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:38 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1203224541' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "snap_schedule"}]: dispatch 2024-08-02T18:49:38.749 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: ignoring --setuser ceph since I am not root 2024-08-02T18:49:38.749 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: ignoring --setgroup ceph since I am not root 2024-08-02T18:49:38.749 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:38 smithi151 ceph-mgr[38977]: -- 172.21.15.151:0/3754589306 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557a9d7c50e0 con 0x557a9d7a3400 2024-08-02T18:49:38.750 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:38.600+0000 7fc491a9c040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-08-02T18:49:38.750 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:38.748+0000 7fc491a9c040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:49:38.956 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:39.001 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:38.813+0000 7f2e348c8040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-02T18:49:39.058 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:38.815+0000 7fc491a9c040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-02T18:49:39.075 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:38.771+0000 7f78ef503040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:49:39.075 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:38.840+0000 7f78ef503040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-08-02T18:49:39.320 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:39.056+0000 7fc491a9c040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-02T18:49:39.320 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:39.117+0000 7fc491a9c040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-02T18:49:39.384 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:39.097+0000 7f78ef503040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-02T18:49:39.384 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:39.158+0000 7f78ef503040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-02T18:49:39.461 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:39.052+0000 7f2e348c8040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-08-02T18:49:39.461 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:39.111+0000 7f2e348c8040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 -- 172.21.15.103:0/1350831724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 msgr2=0x7fb74810e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 --2- 172.21.15.103:0/1350831724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 0x7fb74810e340 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb740009be0 tx=0x7fb74002a750 comp rx=0 tx=0).stop 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 -- 172.21.15.103:0/1350831724 shutdown_connections 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 --2- 172.21.15.103:0/1350831724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 0x7fb74810e340 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 --2- 172.21.15.103:0/1350831724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb748103390 0x7fb74810b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 --2- 172.21.15.103:0/1350831724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748102a70 0x7fb748102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 -- 172.21.15.103:0/1350831724 >> 172.21.15.103:0/1350831724 conn(0x7fb7480fc4d0 msgr2=0x7fb7480fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 -- 172.21.15.103:0/1350831724 shutdown_connections 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.467+0000 7fb74d974640 1 -- 172.21.15.103:0/1350831724 wait complete. 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.468+0000 7fb74d974640 1 Processor -- start 2024-08-02T18:49:39.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.468+0000 7fb74d974640 1 -- start start 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.468+0000 7fb74d974640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748102a70 0x7fb7481981c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.468+0000 7fb74d974640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb748103390 0x7fb748198700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.468+0000 7fb74d974640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 0x7fb74819ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.468+0000 7fb74d974640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb748111dc0 con 0x7fb748103390 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.468+0000 7fb74d974640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb748111c40 con 0x7fb74810bea0 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.468+0000 7fb74d974640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb748111f40 con 0x7fb748102a70 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7467fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb748103390 0x7fb748198700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7467fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb748103390 0x7fb748198700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51880/0 (socket says 172.21.15.103:51880) 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7467fc640 1 -- 172.21.15.103:0/619950355 learned_addr learned my addr 172.21.15.103:0/619950355 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7477fe640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 0x7fb74819ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb746ffd640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748102a70 0x7fb7481981c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7477fe640 1 -- 172.21.15.103:0/619950355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748102a70 msgr2=0x7fb7481981c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:39.485 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7477fe640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748102a70 0x7fb7481981c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7477fe640 1 -- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb748103390 msgr2=0x7fb748198700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7477fe640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb748103390 0x7fb748198700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7477fe640 1 -- 172.21.15.103:0/619950355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb74819d170 con 0x7fb74810bea0 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb746ffd640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748102a70 0x7fb7481981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7467fc640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb748103390 0x7fb748198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb7477fe640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 0x7fb74819ca90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb74002ac70 tx=0x7fb740003ba0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb74c972640 1 -- 172.21.15.103:0/619950355 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740041020 con 0x7fb74810bea0 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb74c972640 1 -- 172.21.15.103:0/619950355 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb7400308a0 con 0x7fb74810bea0 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb74819d400 con 0x7fb74810bea0 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb74c972640 1 -- 172.21.15.103:0/619950355 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb740036040 con 0x7fb74810bea0 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.469+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb7481a4d40 con 0x7fb74810bea0 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.470+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb748102e50 con 0x7fb74810bea0 2024-08-02T18:49:39.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.472+0000 7fb74c972640 1 -- 172.21.15.103:0/619950355 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7fb740044020 con 0x7fb74810bea0 2024-08-02T18:49:39.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.473+0000 7fb74c972640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7300a2c50 0x7fb7300a5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:39.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.473+0000 7fb746ffd640 1 -- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7300a2c50 msgr2=0x7fb7300a5110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:39.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.473+0000 7fb74c972640 1 -- 172.21.15.103:0/619950355 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fb7400eff90 con 0x7fb74810bea0 2024-08-02T18:49:39.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.473+0000 7fb746ffd640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7300a2c50 0x7fb7300a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:49:39.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.475+0000 7fb74c972640 1 -- 172.21.15.103:0/619950355 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb74004b020 con 0x7fb74810bea0 2024-08-02T18:49:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.674+0000 7fb746ffd640 1 -- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7300a2c50 msgr2=0x7fb7300a5110 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:39.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.674+0000 7fb746ffd640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7300a2c50 0x7fb7300a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-02T18:49:39.675 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:39 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1203224541' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-02T18:49:39.675 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:39 smithi103 ceph-mon[32753]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-02T18:49:39.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.687+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7fb748199520 con 0x7fb74810bea0 2024-08-02T18:49:39.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.688+0000 7fb74c972640 1 -- 172.21.15.103:0/619950355 <== mon.2 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v25) ==== 53+0+88 (secure 0 0 0) 0x7fb748199520 con 0x7fb74810bea0 2024-08-02T18:49:39.689 INFO:teuthology.orchestra.run.smithi103.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-08-02T18:49:39.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7300a2c50 msgr2=0x7fb7300a5110 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:49:39.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7300a2c50 0x7fb7300a5110 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 msgr2=0x7fb74819ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:39.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 0x7fb74819ca90 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fb74002ac70 tx=0x7fb740003ba0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 shutdown_connections 2024-08-02T18:49:39.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb74810bea0 0x7fb74819ca90 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb748103390 0x7fb748198700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fb7300a2c50 0x7fb7300a5110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 --2- 172.21.15.103:0/619950355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb748102a70 0x7fb7481981c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:39.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 >> 172.21.15.103:0/619950355 conn(0x7fb7480fc4d0 msgr2=0x7fb7480fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:39.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 shutdown_connections 2024-08-02T18:49:39.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:39.690+0000 7fb74d974640 1 -- 172.21.15.103:0/619950355 wait complete. 2024-08-02T18:49:39.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:39 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1203224541' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-02T18:49:39.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:39 smithi121 ceph-mon[37236]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-02T18:49:39.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:39 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1203224541' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "snap_schedule"}]': finished 2024-08-02T18:49:39.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:39 smithi151 ceph-mon[37155]: mgrmap e19: x(active, since 8m), standbys: z, y 2024-08-02T18:49:40.315 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:40.138+0000 7f78ef503040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-02T18:49:40.315 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:40.256+0000 7f78ef503040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-02T18:49:40.320 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:40.055+0000 7fc491a9c040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-02T18:49:40.320 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:40.168+0000 7fc491a9c040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-02T18:49:40.320 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:40.225+0000 7fc491a9c040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-02T18:49:40.344 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-08-02T18:49:40.344 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-08-02T18:49:40.344 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi103.front.sepia.ceph.com 2024-08-02T18:49:40.344 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-08-02T18:49:40.345 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-08-02T18:49:40.345 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-08-02T18:49:40.345 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-08-02T18:49:40.345 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-08-02T18:49:40.345 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-08-02T18:49:40.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:40.345 DEBUG:teuthology.orchestra.run.smithi103:> ip addr 2024-08-02T18:49:40.402 INFO:teuthology.orchestra.run.smithi103.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-08-02T18:49:40.402 INFO:teuthology.orchestra.run.smithi103.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: inet 127.0.0.1/8 scope host lo 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 ::1/128 scope host 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c4 brd ff:ff:ff:ff:ff:ff 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f0 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:d9:b5:c5 brd ff:ff:ff:ff:ff:ff 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: altname enp7s0f1 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0a brd ff:ff:ff:ff:ff:ff 2024-08-02T18:49:40.403 INFO:teuthology.orchestra.run.smithi103.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-08-02T18:49:40.404 INFO:teuthology.orchestra.run.smithi103.stdout: link/ether 0c:c4:7a:8f:cc:0b brd ff:ff:ff:ff:ff:ff 2024-08-02T18:49:40.404 INFO:teuthology.orchestra.run.smithi103.stdout: inet 172.21.15.103/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-08-02T18:49:40.404 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft 42163sec preferred_lft 42163sec 2024-08-02T18:49:40.404 INFO:teuthology.orchestra.run.smithi103.stdout: inet6 fe80::ec4:7aff:fe8f:cc0b/64 scope link 2024-08-02T18:49:40.404 INFO:teuthology.orchestra.run.smithi103.stdout: valid_lft forever preferred_lft forever 2024-08-02T18:49:40.404 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-08-02T18:49:40.404 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:49:40.404 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:49:40.404 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add name ceph-brx type bridge 2024-08-02T18:49:40.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr flush dev ceph-brx 2024-08-02T18:49:40.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set ceph-brx up 2024-08-02T18:49:40.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-08-02T18:49:40.405 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:49:40.415 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:40.036+0000 7f2e348c8040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-08-02T18:49:40.415 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:40.149+0000 7f2e348c8040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-08-02T18:49:40.415 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:40.204+0000 7f2e348c8040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-02T18:49:40.416 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:40.414+0000 7f2e348c8040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-02T18:49:40.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:49:40.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:40.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:40.548 DEBUG:teuthology.orchestra.run.smithi103:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-08-02T18:49:40.569 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:40 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/619950355' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-02T18:49:40.569 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:40.313+0000 7f78ef503040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-08-02T18:49:40.569 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:40.541+0000 7f78ef503040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-02T18:49:40.571 INFO:teuthology.orchestra.run.smithi103.stdout:1 2024-08-02T18:49:40.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:40.573 DEBUG:teuthology.orchestra.run.smithi103:> route 2024-08-02T18:49:40.629 INFO:teuthology.orchestra.run.smithi103.stdout:Kernel IP routing table 2024-08-02T18:49:40.630 INFO:teuthology.orchestra.run.smithi103.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-08-02T18:49:40.630 INFO:teuthology.orchestra.run.smithi103.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-08-02T18:49:40.630 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-08-02T18:49:40.630 INFO:teuthology.orchestra.run.smithi103.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-08-02T18:49:40.630 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:49:40.630 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:49:40.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-08-02T18:49:40.630 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-08-02T18:49:40.631 DEBUG:teuthology.orchestra.run.smithi103:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-08-02T18:49:40.631 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:49:40.690 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:40 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/619950355' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-02T18:49:40.690 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:40.476+0000 7f2e348c8040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-02T18:49:40.690 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:40.543+0000 7f2e348c8040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-02T18:49:40.690 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:40.688+0000 7f2e348c8040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:49:40.715 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:40 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/619950355' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-08-02T18:49:40.715 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:40.437+0000 7fc491a9c040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-08-02T18:49:40.715 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:40.500+0000 7fc491a9c040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-02T18:49:40.715 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:40.566+0000 7fc491a9c040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-02T18:49:40.715 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:40.713+0000 7fc491a9c040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:49:40.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:49:40.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:40.760 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:40.760 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-02T18:49:40.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:40.776 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list-id 2024-08-02T18:49:40.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:40.608+0000 7f78ef503040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-08-02T18:49:40.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:40.678+0000 7f78ef503040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-08-02T18:49:40.832 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:49:40.832 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:49:40.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-02T18:49:40.832 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-08-02T18:49:40.832 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:49:40.922 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:40 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:49:40.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:40 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:40.952 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-08-02T18:49:40.952 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:49:40.952 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:49:40.952 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-08-02T18:49:40.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-08-02T18:49:40.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-08-02T18:49:40.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-08-02T18:49:40.953 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-08-02T18:49:40.953 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:49:41.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:49:41.062 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:41.068 DEBUG:teuthology.orchestra.run.smithi103:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-08-02T18:49:41.068 DEBUG:teuthology.orchestra.run.smithi103:> set -e 2024-08-02T18:49:41.068 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set brx.0 up 2024-08-02T18:49:41.069 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link set dev brx.0 master ceph-brx 2024-08-02T18:49:41.069 DEBUG:teuthology.orchestra.run.smithi103:> ') 2024-08-02T18:49:41.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:49:41.127 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:40.833+0000 7f78ef503040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-08-02T18:49:41.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:41.148 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-02T18:49:41.148 DEBUG:teuthology.orchestra.run.smithi103:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-08-02T18:49:41.164 INFO:teuthology.orchestra.run.smithi103.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-08-02T18:49:41.164 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-08-02T18:49:41.165 DEBUG:teuthology.orchestra.run.smithi103:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-08-02T18:49:41.221 WARNING:tasks.cephfs.mount:You cannot specify both: cephfs_mntpt and mount_subvol_num 2024-08-02T18:49:41.222 INFO:tasks.cephfs.mount:Mounting subvol 1 for now 2024-08-02T18:49:41.222 INFO:tasks.cephfs.kernel_mount:mounting using device: :/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 2024-08-02T18:49:41.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:41.222 DEBUG:teuthology.orchestra.run.smithi103:> sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage /bin/mount -t ceph :/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 /home/ubuntu/cephtest/mnt.0 -v -o norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-08-02T18:49:41.306 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-08-02T18:49:41.306 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-08-02T18:49:41.306 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-08-02T18:49:41.393 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:41.280+0000 7f78ef503040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-02T18:49:41.411 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:41.098+0000 7f2e348c8040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-02T18:49:41.447 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:41.132+0000 7fc491a9c040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-08-02T18:49:41.452 INFO:teuthology.orchestra.run.smithi103.stdout:parsing options: rw,norequire_active_mds,conf=/etc/ceph/ceph.conf,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync 2024-08-02T18:49:41.452 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync". 2024-08-02T18:49:41.452 INFO:teuthology.orchestra.run.smithi103.stdout:invalid new device string format 2024-08-02T18:49:41.452 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: resolved to: "172.21.15.103:3300,172.21.15.121:3300,172.21.15.151:3300" 2024-08-02T18:49:41.452 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: trying mount with old device syntax: 172.21.15.103:3300,172.21.15.121:3300,172.21.15.151:3300:/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 2024-08-02T18:49:41.452 INFO:teuthology.orchestra.run.smithi103.stdout:mount.ceph: options "norequire_active_mds,norbytes,name=0,mds_namespace=cephfs,ms_mode=secure,nowsync,key=0,fsid=7ef68402-50fe-11ef-bcca-c7b262605968" will pass to kernel 2024-08-02T18:49:41.453 INFO:teuthology.orchestra.run.smithi103.stdout:mount: /home/ubuntu/cephtest/mnt.0 does not contain SELinux labels. 2024-08-02T18:49:41.454 INFO:teuthology.orchestra.run.smithi103.stdout: You just mounted a file system that supports labels which does not 2024-08-02T18:49:41.454 INFO:teuthology.orchestra.run.smithi103.stdout: contain labels, onto an SELinux box. It is likely that confined 2024-08-02T18:49:41.454 INFO:teuthology.orchestra.run.smithi103.stdout: applications will generate AVC messages and not be allowed access to 2024-08-02T18:49:41.454 INFO:teuthology.orchestra.run.smithi103.stdout: this file system. For more details see restorecon(8) and mount(8). 2024-08-02T18:49:41.455 INFO:tasks.cephfs.kernel_mount:mount command passed 2024-08-02T18:49:41.455 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T18:49:41.455 DEBUG:teuthology.orchestra.run.smithi103:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-08-02T18:49:41.485 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-02T18:49:41.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-02T18:49:41.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:41.586 INFO:teuthology.orchestra.run.smithi103.stdout:client24881 2024-08-02T18:49:41.586 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:49:41.586 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-02T18:49:41.603 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-02T18:49:41.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-02T18:49:41.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:41.702 INFO:teuthology.orchestra.run.smithi103.stdout:client24881 2024-08-02T18:49:41.702 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=900 -- bash -c 'getfattr --only-values -n ceph.client_id .') 2024-08-02T18:49:41.751 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:41.409+0000 7f2e348c8040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-02T18:49:41.751 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:41.476+0000 7f2e348c8040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-02T18:49:41.751 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:41.627+0000 7f2e348c8040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-02T18:49:41.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-08-02T18:49:41.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:41.759 INFO:teuthology.orchestra.run.smithi103.stdout:client24881 2024-08-02T18:49:41.759 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest/mnt.0 && exec stdin-killer --timeout=300 -- bash -c 'sudo dd if=/sys/kernel/debug/ceph/7ef68402-50fe-11ef-bcca-c7b262605968.client24881/status') 2024-08-02T18:49:41.809 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-08-02T18:49:41.817 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:41.620+0000 7f78ef503040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-02T18:49:41.818 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:41.690+0000 7f78ef503040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-02T18:49:41.819 INFO:teuthology.orchestra.run.smithi103.stdout:instance: client.24881 (3)172.21.15.103:0/21994006 2024-08-02T18:49:41.819 INFO:teuthology.orchestra.run.smithi103.stdout:blocklisted: false 2024-08-02T18:49:41.819 INFO:teuthology.orchestra.run.smithi103.stderr:0+1 records in 2024-08-02T18:49:41.819 INFO:teuthology.orchestra.run.smithi103.stderr:0+1 records out 2024-08-02T18:49:41.819 INFO:teuthology.orchestra.run.smithi103.stderr:70 bytes copied, 2.358e-05 s, 3.0 MB/s 2024-08-02T18:49:41.820 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:41.446+0000 7fc491a9c040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-08-02T18:49:41.820 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:41.515+0000 7fc491a9c040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-08-02T18:49:41.820 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:41.666+0000 7fc491a9c040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-02T18:49:41.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-08-02T18:49:41.827 INFO:teuthology.run_tasks:Running task exec... 2024-08-02T18:49:41.836 INFO:teuthology.task.exec:Executing custom commands... 2024-08-02T18:49:41.836 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:49:41.836 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs set cephfs balance_automate true' 2024-08-02T18:49:41.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 -- 172.21.15.103:0/952003525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab081018a0 msgr2=0x7fab08101ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:41.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/952003525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab081018a0 0x7fab08101ca0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7faaf0009900 tx=0x7faaf002a410 comp rx=0 tx=0).stop 2024-08-02T18:49:41.941 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 -- 172.21.15.103:0/952003525 shutdown_connections 2024-08-02T18:49:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/952003525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab08103450 0x7fab08109ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/952003525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab08102a90 0x7fab08102f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/952003525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab081018a0 0x7fab08101ca0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 -- 172.21.15.103:0/952003525 >> 172.21.15.103:0/952003525 conn(0x7fab080fd020 msgr2=0x7fab080ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 -- 172.21.15.103:0/952003525 shutdown_connections 2024-08-02T18:49:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 -- 172.21.15.103:0/952003525 wait complete. 2024-08-02T18:49:41.942 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.940+0000 7fab0d6dc640 1 Processor -- start 2024-08-02T18:49:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab0d6dc640 1 -- start start 2024-08-02T18:49:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab0d6dc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab081018a0 0x7fab08075cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab0d6dc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab08102a90 0x7fab08074310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab0d6dc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab08103450 0x7fab08074850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab0d6dc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fab0810d690 con 0x7fab08103450 2024-08-02T18:49:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab0d6dc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fab0810d510 con 0x7fab08102a90 2024-08-02T18:49:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab0d6dc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fab0810d810 con 0x7fab081018a0 2024-08-02T18:49:41.944 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab08103450 0x7fab08074850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab08103450 0x7fab08074850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51904/0 (socket says 172.21.15.103:51904) 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 -- 172.21.15.103:0/3564732364 learned_addr learned my addr 172.21.15.103:0/3564732364 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab067fc640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab08102a90 0x7fab08074310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab06ffd640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab081018a0 0x7fab08075cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 -- 172.21.15.103:0/3564732364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab081018a0 msgr2=0x7fab08075cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab081018a0 0x7fab08075cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 -- 172.21.15.103:0/3564732364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab08102a90 msgr2=0x7fab08074310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab08102a90 0x7fab08074310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 -- 172.21.15.103:0/3564732364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab080750e0 con 0x7fab08103450 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab067fc640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab08102a90 0x7fab08074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab077fe640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab08103450 0x7fab08074850 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fab00009fd0 tx=0x7fab0000b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:41.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7faafffff640 1 -- 172.21.15.103:0/3564732364 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab00017070 con 0x7fab08103450 2024-08-02T18:49:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab081a1d20 con 0x7fab08103450 2024-08-02T18:49:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.941+0000 7faafffff640 1 -- 172.21.15.103:0/3564732364 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fab00004020 con 0x7fab08103450 2024-08-02T18:49:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.942+0000 7faafffff640 1 -- 172.21.15.103:0/3564732364 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab000106a0 con 0x7fab08103450 2024-08-02T18:49:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.942+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab081a21c0 con 0x7fab08103450 2024-08-02T18:49:41.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.942+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab08108bc0 con 0x7fab08103450 2024-08-02T18:49:41.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.945+0000 7faafffff640 1 -- 172.21.15.103:0/3564732364 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7fab000041d0 con 0x7fab08103450 2024-08-02T18:49:41.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.945+0000 7faafffff640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faaf40a2c80 0x7faaf40a5140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:41.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.945+0000 7fab06ffd640 1 -- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faaf40a2c80 msgr2=0x7faaf40a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:41.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.946+0000 7faafffff640 1 -- 172.21.15.103:0/3564732364 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fab000cf040 con 0x7fab08103450 2024-08-02T18:49:41.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.946+0000 7fab06ffd640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faaf40a2c80 0x7faaf40a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:49:41.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:41.949+0000 7faafffff640 1 -- 172.21.15.103:0/3564732364 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fab0009b5f0 con 0x7fab08103450 2024-08-02T18:49:42.075 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:41.849+0000 7f78ef503040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-08-02T18:49:42.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.147+0000 7fab06ffd640 1 -- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faaf40a2c80 msgr2=0x7faaf40a5140 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:42.148 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.147+0000 7fab06ffd640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faaf40a2c80 0x7faaf40a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-02T18:49:42.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.172+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"} v 0) -- 0x7fab0802d790 con 0x7fab08103450 2024-08-02T18:49:42.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.224+0000 7faafffff640 1 -- 172.21.15.103:0/3564732364 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]=0 v26) ==== 117+0+0 (secure 0 0 0) 0x7fab0009f8f0 con 0x7fab08103450 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faaf40a2c80 msgr2=0x7faaf40a5140 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faaf40a2c80 0x7faaf40a5140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab08103450 msgr2=0x7fab08074850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab08103450 0x7fab08074850 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fab00009fd0 tx=0x7fab0000b260 comp rx=0 tx=0).stop 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 shutdown_connections 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fab08103450 0x7fab08074850 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fab08102a90 0x7fab08074310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7faaf40a2c80 0x7faaf40a5140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 --2- 172.21.15.103:0/3564732364 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fab081018a0 0x7fab08075cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 >> 172.21.15.103:0/3564732364 conn(0x7fab080fd020 msgr2=0x7fab08105d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:42.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 shutdown_connections 2024-08-02T18:49:42.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.226+0000 7fab0d6dc640 1 -- 172.21.15.103:0/3564732364 wait complete. 2024-08-02T18:49:42.229 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:41.938+0000 7f2e348c8040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-02T18:49:42.230 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:42.000+0000 7f2e348c8040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-02T18:49:42.230 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:42.181+0000 7f2e348c8040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-02T18:49:42.239 INFO:teuthology.run_tasks:Running task check-counter... 2024-08-02T18:49:42.250 INFO:teuthology.run_tasks:Running task fwd_scrub... 2024-08-02T18:49:42.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-02T18:49:42.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:42 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3564732364' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-02T18:49:42.320 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:41.978+0000 7fc491a9c040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-02T18:49:42.321 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:42.039+0000 7fc491a9c040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-02T18:49:42.321 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:42.222+0000 7fc491a9c040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-02T18:49:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.363+0000 7f164a3e9640 1 -- 172.21.15.103:0/3667552869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 msgr2=0x7f1644108b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.363+0000 7f164a3e9640 1 --2- 172.21.15.103:0/3667552869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 0x7f1644108b80 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f163c009ca0 tx=0x7f163c02a8c0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.363+0000 7f164a3e9640 1 -- 172.21.15.103:0/3667552869 shutdown_connections 2024-08-02T18:49:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.363+0000 7f164a3e9640 1 --2- 172.21.15.103:0/3667552869 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 0x7f1644108b80 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.365 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.363+0000 7f164a3e9640 1 --2- 172.21.15.103:0/3667552869 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1644101930 0x7f1644101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.363+0000 7f164a3e9640 1 --2- 172.21.15.103:0/3667552869 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1644100740 0x7f1644100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.363+0000 7f164a3e9640 1 -- 172.21.15.103:0/3667552869 >> 172.21.15.103:0/3667552869 conn(0x7f16440fbea0 msgr2=0x7f16440fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.363+0000 7f164a3e9640 1 -- 172.21.15.103:0/3667552869 shutdown_connections 2024-08-02T18:49:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 -- 172.21.15.103:0/3667552869 wait complete. 2024-08-02T18:49:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 Processor -- start 2024-08-02T18:49:42.366 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 -- start start 2024-08-02T18:49:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1644100740 0x7f1644069c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1644101930 0x7f164419c930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 0x7f164419ef50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f164410c520 con 0x7f16441022f0 2024-08-02T18:49:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f164410c3a0 con 0x7f1644101930 2024-08-02T18:49:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.364+0000 7f164a3e9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f164410c6a0 con 0x7f1644100740 2024-08-02T18:49:42.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 0x7f164419ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 0x7f164419ef50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51912/0 (socket says 172.21.15.103:51912) 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 -- 172.21.15.103:0/2059063666 learned_addr learned my addr 172.21.15.103:0/2059063666 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f16437fe640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1644101930 0x7f164419c930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1643fff640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1644100740 0x7f1644069c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 -- 172.21.15.103:0/2059063666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1644100740 msgr2=0x7f1644069c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1644100740 0x7f1644069c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 -- 172.21.15.103:0/2059063666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1644101930 msgr2=0x7f164419c930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1644101930 0x7f164419c930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 -- 172.21.15.103:0/2059063666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f164419f860 con 0x7f16441022f0 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f1648986640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 0x7f164419ef50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f163c02f540 tx=0x7f163c009890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f16417fa640 1 -- 172.21.15.103:0/2059063666 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c02fae0 con 0x7f16441022f0 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f16417fa640 1 -- 172.21.15.103:0/2059063666 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f163c02fc80 con 0x7f16441022f0 2024-08-02T18:49:42.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f164419fa90 con 0x7f16441022f0 2024-08-02T18:49:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f16417fa640 1 -- 172.21.15.103:0/2059063666 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f163c0468c0 con 0x7f16441022f0 2024-08-02T18:49:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.365+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f164419ffe0 con 0x7f16441022f0 2024-08-02T18:49:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.366+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1644107b30 con 0x7f16441022f0 2024-08-02T18:49:42.370 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.368+0000 7f16417fa640 1 -- 172.21.15.103:0/2059063666 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f163c030bc0 con 0x7f16441022f0 2024-08-02T18:49:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.369+0000 7f16417fa640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f16300a2be0 0x7f16300a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.369+0000 7f1643fff640 1 -- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f16300a2be0 msgr2=0x7f16300a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.369+0000 7f16417fa640 1 -- 172.21.15.103:0/2059063666 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f163c0f0840 con 0x7f16441022f0 2024-08-02T18:49:42.371 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.369+0000 7f1643fff640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f16300a2be0 0x7f16300a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:49:42.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.373+0000 7f16417fa640 1 -- 172.21.15.103:0/2059063666 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f163c0bd440 con 0x7f16441022f0 2024-08-02T18:49:42.436 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:42 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3564732364' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-02T18:49:42.437 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:42.175+0000 7f78ef503040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-08-02T18:49:42.437 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:42.239+0000 7f78ef503040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-08-02T18:49:42.437 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:42.435+0000 7f78ef503040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-08-02T18:49:42.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:42 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3564732364' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]: dispatch 2024-08-02T18:49:42.501 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:42.326+0000 7f2e348c8040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-02T18:49:42.501 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:42.391+0000 7f2e348c8040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-02T18:49:42.501 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:42.475+0000 7f2e348c8040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-02T18:49:42.562 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.560+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1644062b20 con 0x7f16441022f0 2024-08-02T18:49:42.563 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.562+0000 7f16417fa640 1 -- 172.21.15.103:0/2059063666 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v89) ==== 74+0+24703 (secure 0 0 0) 0x7f163c0bcd40 con 0x7f16441022f0 2024-08-02T18:49:42.564 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:42.564 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":89,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:48:06.458748+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:49:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f16300a2be0 msgr2=0x7f16300a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:49:42.565 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f16300a2be0 0x7f16300a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 msgr2=0x7f164419ef50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 0x7f164419ef50 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f163c02f540 tx=0x7f163c009890 comp rx=0 tx=0).stop 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 shutdown_connections 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16441022f0 0x7f164419ef50 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1644101930 0x7f164419c930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f16300a2be0 0x7f16300a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 --2- 172.21.15.103:0/2059063666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1644100740 0x7f1644069c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 >> 172.21.15.103:0/2059063666 conn(0x7f16440fbea0 msgr2=0x7f1644104d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 shutdown_connections 2024-08-02T18:49:42.566 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.564+0000 7f164a3e9640 1 -- 172.21.15.103:0/2059063666 wait complete. 2024-08-02T18:49:42.577 INFO:tasks.fwd_scrub.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-02T18:43:05.562258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-02T18:47:18.244339+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-02T18:47:20.250497+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-02T18:47:26.589938+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '87', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-02T18:49:42.577 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-02T18:49:42.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 -- 172.21.15.103:0/2136651939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 msgr2=0x7fcf2c109980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/2136651939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 0x7fcf2c109980 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fcf24009ca0 tx=0x7fcf2402a8c0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 -- 172.21.15.103:0/2136651939 shutdown_connections 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/2136651939 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 0x7fcf2c109980 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/2136651939 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2c104c60 0x7fcf2c107050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/2136651939 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c102330 0x7fcf2c104720 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 -- 172.21.15.103:0/2136651939 >> 172.21.15.103:0/2136651939 conn(0x7fcf2c0fbe90 msgr2=0x7fcf2c0fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 -- 172.21.15.103:0/2136651939 shutdown_connections 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.683+0000 7fcf32ef7640 1 -- 172.21.15.103:0/2136651939 wait complete. 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf32ef7640 1 Processor -- start 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf32ef7640 1 -- start start 2024-08-02T18:49:42.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf32ef7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2c102330 0x7fcf2c197c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf32ef7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c104c60 0x7fcf2c198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf32ef7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 0x7fcf2c19f1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf32ef7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c10d620 con 0x7fcf2c107590 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf32ef7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c10d4a0 con 0x7fcf2c102330 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf32ef7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcf2c10d7a0 con 0x7fcf2c104c60 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf31494640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 0x7fcf2c19f1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf31494640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 0x7fcf2c19f1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51944/0 (socket says 172.21.15.103:51944) 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf30c93640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2c102330 0x7fcf2c197c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf31494640 1 -- 172.21.15.103:0/1020224259 learned_addr learned my addr 172.21.15.103:0/1020224259 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf2bfff640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c104c60 0x7fcf2c198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf30c93640 1 -- 172.21.15.103:0/1020224259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c104c60 msgr2=0x7fcf2c198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf30c93640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c104c60 0x7fcf2c198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf30c93640 1 -- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 msgr2=0x7fcf2c19f1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf30c93640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 0x7fcf2c19f1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf30c93640 1 -- 172.21.15.103:0/1020224259 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcf2c19f840 con 0x7fcf2c102330 2024-08-02T18:49:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.684+0000 7fcf30c93640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2c102330 0x7fcf2c197c30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009b50 tx=0x7fcf2000b690 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.685+0000 7fcf29ffb640 1 -- 172.21.15.103:0/1020224259 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20009e50 con 0x7fcf2c102330 2024-08-02T18:49:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.685+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcf2c100180 con 0x7fcf2c102330 2024-08-02T18:49:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.685+0000 7fcf29ffb640 1 -- 172.21.15.103:0/1020224259 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcf20005520 con 0x7fcf2c102330 2024-08-02T18:49:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.685+0000 7fcf29ffb640 1 -- 172.21.15.103:0/1020224259 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf20019670 con 0x7fcf2c102330 2024-08-02T18:49:42.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.685+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcf2c100680 con 0x7fcf2c102330 2024-08-02T18:49:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.686+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcf2c0fd980 con 0x7fcf2c102330 2024-08-02T18:49:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.687+0000 7fcf29ffb640 1 -- 172.21.15.103:0/1020224259 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7fcf20020020 con 0x7fcf2c102330 2024-08-02T18:49:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.687+0000 7fcf29ffb640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcf1c0a2d80 0x7fcf1c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.688+0000 7fcf2bfff640 1 -- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcf1c0a2d80 msgr2=0x7fcf1c0a5240 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.688+0000 7fcf29ffb640 1 -- 172.21.15.103:0/1020224259 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7fcf200d33e0 con 0x7fcf2c102330 2024-08-02T18:49:42.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.688+0000 7fcf2bfff640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcf1c0a2d80 0x7fcf1c0a5240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:49:42.692 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.691+0000 7fcf29ffb640 1 -- 172.21.15.103:0/1020224259 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcf2009ff80 con 0x7fcf2c102330 2024-08-02T18:49:42.747 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:42.590+0000 7f78ef503040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-02T18:49:42.747 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:42.658+0000 7f78ef503040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-02T18:49:42.747 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:42.745+0000 7f78ef503040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-02T18:49:42.820 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:42.371+0000 7fc491a9c040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-08-02T18:49:42.820 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:42.436+0000 7fc491a9c040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-08-02T18:49:42.820 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:42.522+0000 7fc491a9c040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-08-02T18:49:42.821 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:42.581+0000 7fc491a9c040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-02T18:49:42.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.876+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fcf2c02c460 con 0x7fcf2c102330 2024-08-02T18:49:42.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.876+0000 7fcf29ffb640 1 -- 172.21.15.103:0/1020224259 <== mon.2 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v89) ==== 93+0+10 (secure 0 0 0) 0x7fcf2009f880 con 0x7fcf2c102330 2024-08-02T18:49:42.878 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcf1c0a2d80 msgr2=0x7fcf1c0a5240 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcf1c0a2d80 0x7fcf1c0a5240 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2c102330 msgr2=0x7fcf2c197c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2c102330 0x7fcf2c197c30 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fcf20009b50 tx=0x7fcf2000b690 comp rx=0 tx=0).stop 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 shutdown_connections 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcf2c107590 0x7fcf2c19f1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7fcf1c0a2d80 0x7fcf1c0a5240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcf2c104c60 0x7fcf2c198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 --2- 172.21.15.103:0/1020224259 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcf2c102330 0x7fcf2c197c30 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:42.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 >> 172.21.15.103:0/1020224259 conn(0x7fcf2c0fbe90 msgr2=0x7fcf2c102bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:42.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 shutdown_connections 2024-08-02T18:49:42.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.878+0000 7fcf32ef7640 1 -- 172.21.15.103:0/1020224259 wait complete. 2024-08-02T18:49:42.892 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 -- 172.21.15.103:0/158478626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630104c50 msgr2=0x7f3630107040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 --2- 172.21.15.103:0/158478626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630104c50 0x7f3630107040 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f3624009860 tx=0x7f362402a340 comp rx=0 tx=0).stop 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 -- 172.21.15.103:0/158478626 shutdown_connections 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 --2- 172.21.15.103:0/158478626 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3630107580 0x7f3630109970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 --2- 172.21.15.103:0/158478626 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630104c50 0x7f3630107040 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 --2- 172.21.15.103:0/158478626 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3630102320 0x7f3630104710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 -- 172.21.15.103:0/158478626 >> 172.21.15.103:0/158478626 conn(0x7f36300fbe80 msgr2=0x7f36300fe2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 -- 172.21.15.103:0/158478626 shutdown_connections 2024-08-02T18:49:43.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.997+0000 7f3636399640 1 -- 172.21.15.103:0/158478626 wait complete. 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f3636399640 1 Processor -- start 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f3636399640 1 -- start start 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f3636399640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630102320 0x7f3630197ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f3636399640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3630104c50 0x7f36301981e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f3636399640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3630107580 0x7f363019f240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f3636399640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f363010d610 con 0x7f3630104c50 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f3636399640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f363010d490 con 0x7f3630102320 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f3636399640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f363010d790 con 0x7f3630107580 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.998+0000 7f362f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3630104c50 0x7f36301981e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630102320 0x7f3630197ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630102320 0x7f3630197ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:34944/0 (socket says 172.21.15.103:34944) 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 -- 172.21.15.103:0/3230139355 learned_addr learned my addr 172.21.15.103:0/3230139355 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:43.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f3634936640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3630107580 0x7f363019f240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 -- 172.21.15.103:0/3230139355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3630107580 msgr2=0x7f363019f240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3630107580 0x7f363019f240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 -- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3630104c50 msgr2=0x7f36301981e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3630104c50 0x7f36301981e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 -- 172.21.15.103:0/3230139355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f363019f8e0 con 0x7f3630102320 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362ffff640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630102320 0x7f3630197ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f362000e9f0 tx=0x7f362000edf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362d7fa640 1 -- 172.21.15.103:0/3230139355 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f362000cd80 con 0x7f3630102320 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362d7fa640 1 -- 172.21.15.103:0/3230139355 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3620005520 con 0x7f3630102320 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f363019fbd0 con 0x7f3630102320 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f362d7fa640 1 -- 172.21.15.103:0/3230139355 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3620010690 con 0x7f3630102320 2024-08-02T18:49:43.003 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:42.999+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36301a00a0 con 0x7f3630102320 2024-08-02T18:49:43.004 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:42.535+0000 7f2e348c8040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-02T18:49:43.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.000+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36300fd970 con 0x7f3630102320 2024-08-02T18:49:43.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.001+0000 7f362d7fa640 1 -- 172.21.15.103:0/3230139355 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 19) ==== 137851+0+0 (secure 0 0 0) 0x7f36200046c0 con 0x7f3630102320 2024-08-02T18:49:43.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.002+0000 7f362d7fa640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f36180a2be0 0x7f36180a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.002+0000 7f362f7fe640 1 -- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f36180a2be0 msgr2=0x7f36180a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:43.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.002+0000 7f362d7fa640 1 -- 172.21.15.103:0/3230139355 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f36200cfa70 con 0x7f3630102320 2024-08-02T18:49:43.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.002+0000 7f362f7fe640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f36180a2be0 0x7f36180a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:49:43.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.005+0000 7f362d7fa640 1 -- 172.21.15.103:0/3230139355 <== mon.2 v2:172.21.15.121:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3620053df0 con 0x7f3630102320 2024-08-02T18:49:43.075 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:42.807+0000 7f78ef503040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-08-02T18:49:43.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.186+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f363002d830 con 0x7f3630102320 2024-08-02T18:49:43.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.187+0000 7f362d7fa640 1 -- 172.21.15.103:0/3230139355 <== mon.2 v2:172.21.15.121:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v89) ==== 104+0+11 (secure 0 0 0) 0x7f362009c610 con 0x7f3630102320 2024-08-02T18:49:43.188 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-08-02T18:49:43.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f36180a2be0 msgr2=0x7f36180a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:49:43.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f36180a2be0 0x7f36180a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630102320 msgr2=0x7f3630197ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630102320 0x7f3630197ca0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f362000e9f0 tx=0x7f362000edf0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 shutdown_connections 2024-08-02T18:49:43.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f36180a2be0 0x7f36180a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f3630107580 0x7f363019f240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3630104c50 0x7f36301981e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 --2- 172.21.15.103:0/3230139355 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f3630102320 0x7f3630197ca0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 >> 172.21.15.103:0/3230139355 conn(0x7f36300fbe80 msgr2=0x7f3630102bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:43.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 shutdown_connections 2024-08-02T18:49:43.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.189+0000 7f3636399640 1 -- 172.21.15.103:0/3230139355 wait complete. 2024-08-02T18:49:43.201 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-02T18:49:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/182805711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8100730 msgr2=0x7f5dd8100b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/182805711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8100730 0x7f5dd8100b30 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5dc8009900 tx=0x7f5dc802a410 comp rx=0 tx=0).stop 2024-08-02T18:49:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/182805711 shutdown_connections 2024-08-02T18:49:43.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/182805711 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dd81022e0 0x7f5dd8108b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/182805711 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd8101920 0x7f5dd8101da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/182805711 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8100730 0x7f5dd8100b30 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/182805711 >> 172.21.15.103:0/182805711 conn(0x7f5dd80fbe70 msgr2=0x7f5dd80fe2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/182805711 shutdown_connections 2024-08-02T18:49:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.312+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/182805711 wait complete. 2024-08-02T18:49:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.313+0000 7f5ddd8f7640 1 Processor -- start 2024-08-02T18:49:43.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.313+0000 7f5ddd8f7640 1 -- start start 2024-08-02T18:49:43.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.313+0000 7f5ddd8f7640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd8100730 0x7f5dd8069c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.313+0000 7f5ddd8f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8101920 0x7f5dd819c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.313+0000 7f5ddd8f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dd81022e0 0x7f5dd819f000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.313+0000 7f5ddd8f7640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd810c510 con 0x7f5dd8101920 2024-08-02T18:49:43.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.313+0000 7f5ddd8f7640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd810c390 con 0x7f5dd81022e0 2024-08-02T18:49:43.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.313+0000 7f5ddd8f7640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5dd810c690 con 0x7f5dd8100730 2024-08-02T18:49:43.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dd81022e0 0x7f5dd819f000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:43.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dce7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8101920 0x7f5dd819c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dd77fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dd81022e0 0x7f5dd819f000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:34962/0 (socket says 172.21.15.103:34962) 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dce7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8101920 0x7f5dd819c9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:51984/0 (socket says 172.21.15.103:51984) 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dd77fe640 1 -- 172.21.15.103:0/2869849782 learned_addr learned my addr 172.21.15.103:0/2869849782 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dd6ffd640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd8100730 0x7f5dd8069c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dce7fc640 1 -- 172.21.15.103:0/2869849782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd8100730 msgr2=0x7f5dd8069c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dce7fc640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd8100730 0x7f5dd8069c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dce7fc640 1 -- 172.21.15.103:0/2869849782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dd81022e0 msgr2=0x7f5dd819f000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dce7fc640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dd81022e0 0x7f5dd819f000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dce7fc640 1 -- 172.21.15.103:0/2869849782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5dd8196800 con 0x7f5dd8101920 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dd77fe640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dd81022e0 0x7f5dd819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5dce7fc640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8101920 0x7f5dd819c9b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000e9f0 tx=0x7f5dc000eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5ddc8f5640 1 -- 172.21.15.103:0/2869849782 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc000ccc0 con 0x7f5dd8101920 2024-08-02T18:49:43.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5ddc8f5640 1 -- 172.21.15.103:0/2869849782 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5dc0005020 con 0x7f5dd8101920 2024-08-02T18:49:43.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5dd8196af0 con 0x7f5dd8101920 2024-08-02T18:49:43.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5ddc8f5640 1 -- 172.21.15.103:0/2869849782 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5dc0004b40 con 0x7f5dd8101920 2024-08-02T18:49:43.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.314+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5dd8196ff0 con 0x7f5dd8101920 2024-08-02T18:49:43.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.316+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5dd8198430 con 0x7f5dd8101920 2024-08-02T18:49:43.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.317+0000 7f5ddc8f5640 1 -- 172.21.15.103:0/2869849782 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 20) ==== 137851+0+0 (secure 0 0 0) 0x7f5dc0004ce0 con 0x7f5dd8101920 2024-08-02T18:49:43.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.318+0000 7f5ddc8f5640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5dc40a2be0 0x7f5dc40a50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.318+0000 7f5dd6ffd640 1 -- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5dc40a2be0 msgr2=0x7f5dc40a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:43.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.318+0000 7f5ddc8f5640 1 -- 172.21.15.103:0/2869849782 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(89..89 src has 1..89) ==== 9092+0+0 (secure 0 0 0) 0x7f5dc00cf320 con 0x7f5dd8101920 2024-08-02T18:49:43.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.318+0000 7f5dd6ffd640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5dc40a2be0 0x7f5dc40a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-08-02T18:49:43.323 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.322+0000 7f5ddc8f5640 1 -- 172.21.15.103:0/2869849782 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5dc009bfc0 con 0x7f5dd8101920 2024-08-02T18:49:43.501 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:43.068+0000 7f2e348c8040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-02T18:49:43.502 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y[38612]: 2024-08-02T18:49:43.224+0000 7f2e348c8040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-02T18:49:43.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3564732364' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-02T18:49:43.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:49:43.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2059063666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:43.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1020224259' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:49:43.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3230139355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-02T18:49:43.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-mon[37236]: Standby manager daemon y restarted 2024-08-02T18:49:43.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:43 smithi121 ceph-mon[37236]: Standby manager daemon y started 2024-08-02T18:49:43.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.519+0000 7f5dd6ffd640 1 -- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5dc40a2be0 msgr2=0x7f5dc40a50a0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.103:6800/3303960029 2024-08-02T18:49:43.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.519+0000 7f5dd6ffd640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5dc40a2be0 0x7f5dc40a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-08-02T18:49:43.525 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.524+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f5dd8107790 con 0x7f5dd8101920 2024-08-02T18:49:43.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.525+0000 7f5ddc8f5640 1 -- 172.21.15.103:0/2869849782 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v89) ==== 100+0+11 (secure 0 0 0) 0x7f5dc009b8c0 con 0x7f5dd8101920 2024-08-02T18:49:43.526 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-08-02T18:49:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5dc40a2be0 msgr2=0x7f5dc40a50a0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-08-02T18:49:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5dc40a2be0 0x7f5dc40a50a0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8101920 msgr2=0x7f5dd819c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8101920 0x7f5dd819c9b0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f5dc000e9f0 tx=0x7f5dc000eeb0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 shutdown_connections 2024-08-02T18:49:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5dd81022e0 0x7f5dd819f000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5dd8101920 0x7f5dd819c9b0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.103:6800/3303960029,v1:172.21.15.103:6801/3303960029] conn(0x7f5dc40a2be0 0x7f5dc40a50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 --2- 172.21.15.103:0/2869849782 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5dd8100730 0x7f5dd8069c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 >> 172.21.15.103:0/2869849782 conn(0x7f5dd80fbe70 msgr2=0x7f5dd8104d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 shutdown_connections 2024-08-02T18:49:43.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.527+0000 7f5ddd8f7640 1 -- 172.21.15.103:0/2869849782 wait complete. 2024-08-02T18:49:43.538 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.388+0000 7f78ef503040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-02T18:49:43.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3564732364' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-02T18:49:43.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:49:43.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2059063666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:43.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1020224259' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:49:43.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3230139355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-02T18:49:43.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-mon[32753]: Standby manager daemon y restarted 2024-08-02T18:49:43.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-mon[32753]: Standby manager daemon y started 2024-08-02T18:49:43.540 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-02T18:49:43.570 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:43.120+0000 7fc491a9c040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-08-02T18:49:43.570 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z[38973]: 2024-08-02T18:49:43.281+0000 7fc491a9c040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-02T18:49:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3564732364' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "balance_automate", "val": "true"}]': finished 2024-08-02T18:49:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:49:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2059063666' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1020224259' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:49:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3230139355' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-02T18:49:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-mon[37155]: Standby manager daemon y restarted 2024-08-02T18:49:43.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:43 smithi151 ceph-mon[37155]: Standby manager daemon y started 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 -- 172.21.15.103:0/1104992897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbc4101940 msgr2=0x7fcbc4101dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 --2- 172.21.15.103:0/1104992897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbc4101940 0x7fcbc4101dc0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fcbb4009860 tx=0x7fcbb402a360 comp rx=0 tx=0).stop 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 -- 172.21.15.103:0/1104992897 shutdown_connections 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 --2- 172.21.15.103:0/1104992897 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbc4102300 0x7fcbc4108b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 --2- 172.21.15.103:0/1104992897 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbc4101940 0x7fcbc4101dc0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 --2- 172.21.15.103:0/1104992897 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbc4100750 0x7fcbc4100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 -- 172.21.15.103:0/1104992897 >> 172.21.15.103:0/1104992897 conn(0x7fcbc40fbeb0 msgr2=0x7fcbc40fe2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 -- 172.21.15.103:0/1104992897 shutdown_connections 2024-08-02T18:49:43.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.660+0000 7fcbcb73d640 1 -- 172.21.15.103:0/1104992897 wait complete. 2024-08-02T18:49:43.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbcb73d640 1 Processor -- start 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbcb73d640 1 -- start start 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbcb73d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbc4100750 0x7fcbc4199ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbcb73d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbc4101940 0x7fcbc419a420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbcb73d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbc4102300 0x7fcbc41a1490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbcb73d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc410f8c0 con 0x7fcbc4100750 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbcb73d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc410f740 con 0x7fcbc4102300 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbcb73d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcbc410fa40 con 0x7fcbc4101940 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbc8cd8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbc4101940 0x7fcbc419a420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.661+0000 7fcbc8cd8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbc4101940 0x7fcbc419a420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:37078/0 (socket says 172.21.15.103:37078) 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.662+0000 7fcbc8cd8640 1 -- 172.21.15.103:0/2968753672 learned_addr learned my addr 172.21.15.103:0/2968753672 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.662+0000 7fcbc9cda640 1 --2- 172.21.15.103:0/2968753672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbc4102300 0x7fcbc41a1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:43.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.662+0000 7fcbc8cd8640 1 -- 172.21.15.103:0/2968753672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbc4102300 msgr2=0x7fcbc41a1490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.662+0000 7fcbc8cd8640 1 --2- 172.21.15.103:0/2968753672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbc4102300 0x7fcbc41a1490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.662+0000 7fcbc8cd8640 1 -- 172.21.15.103:0/2968753672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbc4100750 msgr2=0x7fcbc4199ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.662+0000 7fcbc8cd8640 1 --2- 172.21.15.103:0/2968753672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbc4100750 0x7fcbc4199ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.662+0000 7fcbc8cd8640 1 -- 172.21.15.103:0/2968753672 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcbc41a1b00 con 0x7fcbc4101940 2024-08-02T18:49:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.662+0000 7fcbc8cd8640 1 --2- 172.21.15.103:0/2968753672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbc4101940 0x7fcbc419a420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbb402a880 tx=0x7fcbb4030fa0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:43.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.663+0000 7fcbba7fc640 1 -- 172.21.15.103:0/2968753672 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4040020 con 0x7fcbc4101940 2024-08-02T18:49:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.663+0000 7fcbba7fc640 1 -- 172.21.15.103:0/2968753672 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcbb4032740 con 0x7fcbc4101940 2024-08-02T18:49:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.663+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcbc41a1d90 con 0x7fcbc4101940 2024-08-02T18:49:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.663+0000 7fcbba7fc640 1 -- 172.21.15.103:0/2968753672 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcbb4037040 con 0x7fcbc4101940 2024-08-02T18:49:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.664+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcbc41a21c0 con 0x7fcbc4101940 2024-08-02T18:49:43.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.665+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcbc4107af0 con 0x7fcbc4101940 2024-08-02T18:49:43.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.666+0000 7fcbba7fc640 1 -- 172.21.15.103:0/2968753672 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 21) ==== 137518+0+0 (secure 0 0 0) 0x7fcbb4043020 con 0x7fcbc4101940 2024-08-02T18:49:43.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.667+0000 7fcbba7fc640 1 -- 172.21.15.103:0/2968753672 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fcbb40ef140 con 0x7fcbc4101940 2024-08-02T18:49:43.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.671+0000 7fcbba7fc640 1 -- 172.21.15.103:0/2968753672 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcbb404a020 con 0x7fcbc4101940 2024-08-02T18:49:43.821 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.554+0000 7f78ef503040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-08-02T18:49:43.822 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.820+0000 7f7857744640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:43.934 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.933+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fcbc4062b20 con 0x7fcbc4101940 2024-08-02T18:49:43.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.934+0000 7fcbba7fc640 1 -- 172.21.15.103:0/2968753672 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v90) ==== 103+0+11 (secure 0 0 0) 0x7fcbb40bbfe0 con 0x7fcbc4101940 2024-08-02T18:49:43.935 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-08-02T18:49:43.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbc4101940 msgr2=0x7fcbc419a420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 --2- 172.21.15.103:0/2968753672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbc4101940 0x7fcbc419a420 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fcbb402a880 tx=0x7fcbb4030fa0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 shutdown_connections 2024-08-02T18:49:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 --2- 172.21.15.103:0/2968753672 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcbc4102300 0x7fcbc41a1490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 --2- 172.21.15.103:0/2968753672 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcbc4101940 0x7fcbc419a420 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 --2- 172.21.15.103:0/2968753672 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcbc4100750 0x7fcbc4199ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 >> 172.21.15.103:0/2968753672 conn(0x7fcbc40fbeb0 msgr2=0x7fcbc4104cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 shutdown_connections 2024-08-02T18:49:43.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:43.936+0000 7fcbcb73d640 1 -- 172.21.15.103:0/2968753672 wait complete. 2024-08-02T18:49:43.949 INFO:tasks.fwd_scrub:Wait for all MDSs to reach steady state... 2024-08-02T18:49:43.950 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:49:44.075 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.820+0000 7f7857744640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.076 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.820+0000 7f7857744640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.076 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.820+0000 7f7857744640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.076 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.820+0000 7f7857744640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.076 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.821+0000 7f7859f49640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.076 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.821+0000 7f7859f49640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.076 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.821+0000 7f7859f49640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.076 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.821+0000 7f7859f49640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.076 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:43.821+0000 7f7859f49640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:49:44.233 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-02T18:49:44.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: Standby manager daemon z restarted 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: Standby manager daemon z started 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2869849782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: Active manager daemon x restarted 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: Activating manager daemon x 2024-08-02T18:49:44.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: osdmap e90: 12 total, 12 up, 12 in 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: mgrmap e21: x(active, starting, since 0.01229s), standbys: z, y 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T18:49:44.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:49:44.504 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: Manager daemon x is now available 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-02T18:49:44.505 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:44 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2968753672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: Standby manager daemon z restarted 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: Standby manager daemon z started 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:49:44.509 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2869849782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: Active manager daemon x restarted 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: Activating manager daemon x 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: osdmap e90: 12 total, 12 up, 12 in 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: mgrmap e21: x(active, starting, since 0.01229s), standbys: z, y 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-02T18:49:44.510 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-02T18:49:44.511 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-02T18:49:44.512 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-02T18:49:44.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: Manager daemon x is now available 2024-08-02T18:49:44.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:44.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-02T18:49:44.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-02T18:49:44.513 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2968753672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-02T18:49:44.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-08-02T18:49:44.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:49:44.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.121:0/1993966505' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: mgrmap e20: x(active, since 8m), standbys: z, y 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: Standby manager daemon z restarted 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: Standby manager daemon z started 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/crt"}]: dispatch 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/z/key"}]: dispatch 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.? 172.21.15.151:0/2154656756' entity='mgr.z' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2869849782' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: Active manager daemon x restarted 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: Activating manager daemon x 2024-08-02T18:49:44.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: osdmap e90: 12 total, 12 up, 12 in 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: mgrmap e21: x(active, starting, since 0.01229s), standbys: z, y 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "j"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "d"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "g"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "a"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "l"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "k"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T18:49:44.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "z", "id": "z"}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-08-02T18:49:44.574 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 8}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 9}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 10}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 11}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: Manager daemon x is now available 2024-08-02T18:49:44.575 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:44.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-08-02T18:49:44.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-08-02T18:49:44.576 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:44 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2968753672' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-02T18:49:44.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 -- 172.21.15.103:0/1952830851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 msgr2=0x7f22e81026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/1952830851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 0x7f22e81026e0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f22d0009900 tx=0x7f22d002a480 comp rx=0 tx=0).stop 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 -- 172.21.15.103:0/1952830851 shutdown_connections 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/1952830851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22e8102c20 0x7f22e810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/1952830851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 0x7f22e81026e0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/1952830851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e8100b50 0x7f22e8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 -- 172.21.15.103:0/1952830851 >> 172.21.15.103:0/1952830851 conn(0x7f22e80fc500 msgr2=0x7f22e80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 -- 172.21.15.103:0/1952830851 shutdown_connections 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 -- 172.21.15.103:0/1952830851 wait complete. 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.742+0000 7f22ed7fe640 1 Processor -- start 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22ed7fe640 1 -- start start 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22ed7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e8100b50 0x7f22e80fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:44.748 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22ed7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 0x7f22e80fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22ed7fe640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22e8102c20 0x7f22e80fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22ed7fe640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8110dd0 con 0x7f22e81022a0 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22ed7fe640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8110c50 con 0x7f22e8102c20 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22ed7fe640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f22e8110f50 con 0x7f22e8100b50 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 0x7f22e80fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e67fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 0x7f22e80fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52108/0 (socket says 172.21.15.103:52108) 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e6ffd640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e8100b50 0x7f22e80fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e67fc640 1 -- 172.21.15.103:0/3975089486 learned_addr learned my addr 172.21.15.103:0/3975089486 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e77fe640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22e8102c20 0x7f22e80fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e67fc640 1 -- 172.21.15.103:0/3975089486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e8100b50 msgr2=0x7f22e80fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e67fc640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e8100b50 0x7f22e80fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e67fc640 1 -- 172.21.15.103:0/3975089486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22e8102c20 msgr2=0x7f22e80fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e67fc640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22e8102c20 0x7f22e80fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.749 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.743+0000 7f22e67fc640 1 -- 172.21.15.103:0/3975089486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f22e81a6840 con 0x7f22e81022a0 2024-08-02T18:49:44.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.744+0000 7f22e67fc640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 0x7f22e80fcef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006010 tx=0x7f22d0004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:44.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.744+0000 7f22dffff640 1 -- 172.21.15.103:0/3975089486 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d003f030 con 0x7f22e81022a0 2024-08-02T18:49:44.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.744+0000 7f22dffff640 1 -- 172.21.15.103:0/3975089486 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f22d0005500 con 0x7f22e81022a0 2024-08-02T18:49:44.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.744+0000 7f22dffff640 1 -- 172.21.15.103:0/3975089486 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f22d0035070 con 0x7f22e81022a0 2024-08-02T18:49:44.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.744+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f22e81a6ad0 con 0x7f22e81022a0 2024-08-02T18:49:44.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.744+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f22e81a6fb0 con 0x7f22e81022a0 2024-08-02T18:49:44.750 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.745+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f22e8100f30 con 0x7f22e81022a0 2024-08-02T18:49:44.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.746+0000 7f22dffff640 1 -- 172.21.15.103:0/3975089486 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 22) ==== 137645+0+0 (secure 0 0 0) 0x7f22d0042030 con 0x7f22e81022a0 2024-08-02T18:49:44.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.747+0000 7f22dffff640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f22d40a2970 0x7f22d40a4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:44.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.747+0000 7f22dffff640 1 -- 172.21.15.103:0/3975089486 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f22d00ef490 con 0x7f22e81022a0 2024-08-02T18:49:44.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.747+0000 7f22e6ffd640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f22d40a2970 0x7f22d40a4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:44.751 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.747+0000 7f22e6ffd640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f22d40a2970 0x7f22d40a4e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22d8005fd0 tx=0x7f22d800b390 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:44.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.751+0000 7f22dffff640 1 -- 172.21.15.103:0/3975089486 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f22d00bbc30 con 0x7f22e81022a0 2024-08-02T18:49:44.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.964+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f22e8109dd0 con 0x7f22e81022a0 2024-08-02T18:49:44.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.965+0000 7f22dffff640 1 -- 172.21.15.103:0/3975089486 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7f22d00bff30 con 0x7f22e81022a0 2024-08-02T18:49:44.968 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:44.968 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:49:44.968 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:49:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f22d40a2970 msgr2=0x7f22d40a4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f22d40a2970 0x7f22d40a4e30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f22d8005fd0 tx=0x7f22d800b390 comp rx=0 tx=0).stop 2024-08-02T18:49:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 msgr2=0x7f22e80fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 0x7f22e80fcef0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f22d0006010 tx=0x7f22d0004c00 comp rx=0 tx=0).stop 2024-08-02T18:49:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 shutdown_connections 2024-08-02T18:49:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f22d40a2970 0x7f22d40a4e30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f22e8102c20 0x7f22e80fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f22e81022a0 0x7f22e80fcef0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 --2- 172.21.15.103:0/3975089486 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f22e8100b50 0x7f22e80fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:44.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 >> 172.21.15.103:0/3975089486 conn(0x7f22e80fc500 msgr2=0x7f22e8069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:44.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 shutdown_connections 2024-08-02T18:49:44.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:44.967+0000 7f22ed7fe640 1 -- 172.21.15.103:0/3975089486 wait complete. 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:44.835+0000 7f783d6db640 -1 log_channel(cephadm) log [ERR] : [02/Aug/2024:18:49:44] ENGINE Error in HTTPServer.serve 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: Traceback (most recent call last): 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._connections.run(self.expiration_interval) 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._run(expiration_interval) 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: new_conn = self._from_server_socket(self.server.socket) 2024-08-02T18:49:45.101 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: s = self.context.wrap_socket( 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: return self.sslsocket_class._create( 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self.do_handshake() 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: self._sslobj.do_handshake() 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-02T18:49:45.102 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:49:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:45 smithi103 ceph-mon[32753]: mgrmap e22: x(active, since 1.01988s), standbys: z, y 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:49:44] ENGINE Bus STARTING 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:49:44] ENGINE Serving on http://172.21.15.103:8765 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:49:44] ENGINE Serving on https://172.21.15.103:7150 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:49:44] ENGINE Bus STARTED 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:45 smithi103 ceph-mon[32753]: [02/Aug/2024:18:49:44] ENGINE Error in HTTPServer.serve 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout: Traceback (most recent call last): 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._connections.run(self.expiration_interval) 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-02T18:49:45.609 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._run(expiration_interval) 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: s = self.context.wrap_socket( 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: return self.sslsocket_class._create( 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: self.do_handshake() 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: self._sslobj.do_handshake() 2024-08-02T18:49:45.610 INFO:journalctl@ceph.mon.a.smithi103.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-02T18:49:45.611 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:45 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3975089486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:45.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:45 smithi151 ceph-mon[37155]: mgrmap e22: x(active, since 1.01988s), standbys: z, y 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:45 smithi151 ceph-mon[37155]: [02/Aug/2024:18:49:44] ENGINE Bus STARTING 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:45 smithi151 ceph-mon[37155]: [02/Aug/2024:18:49:44] ENGINE Serving on http://172.21.15.103:8765 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:45 smithi151 ceph-mon[37155]: [02/Aug/2024:18:49:44] ENGINE Serving on https://172.21.15.103:7150 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:45 smithi151 ceph-mon[37155]: [02/Aug/2024:18:49:44] ENGINE Bus STARTED 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:45 smithi151 ceph-mon[37155]: [02/Aug/2024:18:49:44] ENGINE Error in HTTPServer.serve 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout: Traceback (most recent call last): 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout: self._connections.run(self.expiration_interval) 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-02T18:49:45.821 INFO:journalctl@ceph.mon.c.smithi151.stdout: self._run(expiration_interval) 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: s = self.context.wrap_socket( 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: return self.sslsocket_class._create( 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: self.do_handshake() 2024-08-02T18:49:45.822 INFO:journalctl@ceph.mon.c.smithi151.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-02T18:49:45.823 INFO:journalctl@ceph.mon.c.smithi151.stdout: self._sslobj.do_handshake() 2024-08-02T18:49:45.823 INFO:journalctl@ceph.mon.c.smithi151.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-02T18:49:45.823 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:45 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3975089486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:45 smithi121 ceph-mon[37236]: mgrmap e22: x(active, since 1.01988s), standbys: z, y 2024-08-02T18:49:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:45 smithi121 ceph-mon[37236]: [02/Aug/2024:18:49:44] ENGINE Bus STARTING 2024-08-02T18:49:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:45 smithi121 ceph-mon[37236]: [02/Aug/2024:18:49:44] ENGINE Serving on http://172.21.15.103:8765 2024-08-02T18:49:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:45 smithi121 ceph-mon[37236]: [02/Aug/2024:18:49:44] ENGINE Serving on https://172.21.15.103:7150 2024-08-02T18:49:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:45 smithi121 ceph-mon[37236]: [02/Aug/2024:18:49:44] ENGINE Bus STARTED 2024-08-02T18:49:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:45 smithi121 ceph-mon[37236]: [02/Aug/2024:18:49:44] ENGINE Error in HTTPServer.serve 2024-08-02T18:49:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout: Traceback (most recent call last): 2024-08-02T18:49:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/server.py", line 1823, in serve 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: self._connections.run(self.expiration_interval) 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 203, in run 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: self._run(expiration_interval) 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 246, in _run 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: new_conn = self._from_server_socket(self.server.socket) 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/connections.py", line 300, in _from_server_socket 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: s, ssl_env = self.server.ssl_adapter.wrap(s) 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib/python3.9/site-packages/cheroot/ssl/builtin.py", line 277, in wrap 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: s = self.context.wrap_socket( 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 501, in wrap_socket 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: return self.sslsocket_class._create( 2024-08-02T18:49:46.002 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1074, in _create 2024-08-02T18:49:46.003 INFO:journalctl@ceph.mon.b.smithi121.stdout: self.do_handshake() 2024-08-02T18:49:46.003 INFO:journalctl@ceph.mon.b.smithi121.stdout: File "/lib64/python3.9/ssl.py", line 1343, in do_handshake 2024-08-02T18:49:46.003 INFO:journalctl@ceph.mon.b.smithi121.stdout: self._sslobj.do_handshake() 2024-08-02T18:49:46.003 INFO:journalctl@ceph.mon.b.smithi121.stdout: ssl.SSLZeroReturnError: TLS/SSL connection has been closed (EOF) (_ssl.c:1133) 2024-08-02T18:49:46.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:45 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3975089486' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:46.259 INFO:tasks.fwd_scrub:Ready to start scrub thrashing 2024-08-02T18:49:46.260 INFO:tasks.fwd_scrub.ceph_manager:waiting for clean 2024-08-02T18:49:46.260 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-02T18:49:46.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 -- 172.21.15.103:0/3963587980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0100740 msgr2=0x7fd8a0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:46.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 --2- 172.21.15.103:0/3963587980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0100740 0x7fd8a0100b40 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fd890009900 tx=0x7fd89002a410 comp rx=0 tx=0).stop 2024-08-02T18:49:46.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 -- 172.21.15.103:0/3963587980 shutdown_connections 2024-08-02T18:49:46.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 --2- 172.21.15.103:0/3963587980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8a01022f0 0x7fd8a0108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 --2- 172.21.15.103:0/3963587980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a0101930 0x7fd8a0101db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 --2- 172.21.15.103:0/3963587980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0100740 0x7fd8a0100b40 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 -- 172.21.15.103:0/3963587980 >> 172.21.15.103:0/3963587980 conn(0x7fd8a00fbea0 msgr2=0x7fd8a00fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:46.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 -- 172.21.15.103:0/3963587980 shutdown_connections 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 -- 172.21.15.103:0/3963587980 wait complete. 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.380+0000 7fd8a6514640 1 Processor -- start 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd8a6514640 1 -- start start 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd8a6514640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8a0100740 0x7fd8a0196b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd8a6514640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0101930 0x7fd8a0197090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd8a6514640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a01022f0 0x7fd8a019e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd8a6514640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a010c570 con 0x7fd8a0101930 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd8a6514640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a010c3f0 con 0x7fd8a0100740 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd8a6514640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd8a010c6f0 con 0x7fd8a01022f0 2024-08-02T18:49:46.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0101930 0x7fd8a0197090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89f7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0101930 0x7fd8a0197090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52138/0 (socket says 172.21.15.103:52138) 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89f7fe640 1 -- 172.21.15.103:0/350623632 learned_addr learned my addr 172.21.15.103:0/350623632 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd8a4ab1640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a01022f0 0x7fd8a019e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89ffff640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8a0100740 0x7fd8a0196b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89f7fe640 1 -- 172.21.15.103:0/350623632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a01022f0 msgr2=0x7fd8a019e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89f7fe640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a01022f0 0x7fd8a019e100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89f7fe640 1 -- 172.21.15.103:0/350623632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8a0100740 msgr2=0x7fd8a0196b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89f7fe640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8a0100740 0x7fd8a0196b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89f7fe640 1 -- 172.21.15.103:0/350623632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd8a019e770 con 0x7fd8a0101930 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.381+0000 7fd89ffff640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8a0100740 0x7fd8a0196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.382+0000 7fd89f7fe640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0101930 0x7fd8a0197090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd89400ea60 tx=0x7fd89400ef20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.382+0000 7fd89d7fa640 1 -- 172.21.15.103:0/350623632 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd89400cde0 con 0x7fd8a0101930 2024-08-02T18:49:46.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.382+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd8a019ea60 con 0x7fd8a0101930 2024-08-02T18:49:46.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.382+0000 7fd89d7fa640 1 -- 172.21.15.103:0/350623632 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd8940035f0 con 0x7fd8a0101930 2024-08-02T18:49:46.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.382+0000 7fd89d7fa640 1 -- 172.21.15.103:0/350623632 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd894010720 con 0x7fd8a0101930 2024-08-02T18:49:46.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.382+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd8a019efb0 con 0x7fd8a0101930 2024-08-02T18:49:46.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.383+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd8a0107a60 con 0x7fd8a0101930 2024-08-02T18:49:46.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.384+0000 7fd89d7fa640 1 -- 172.21.15.103:0/350623632 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 23) ==== 137954+0+0 (secure 0 0 0) 0x7fd8940037a0 con 0x7fd8a0101930 2024-08-02T18:49:46.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.385+0000 7fd89d7fa640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd8880a2d00 0x7fd8880a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:46.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.385+0000 7fd89d7fa640 1 -- 172.21.15.103:0/350623632 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fd8940cfbd0 con 0x7fd8a0101930 2024-08-02T18:49:46.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.385+0000 7fd89ffff640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd8880a2d00 0x7fd8880a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:46.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.386+0000 7fd89ffff640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd8880a2d00 0x7fd8880a51c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd89002a930 tx=0x7fd890000bc0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:46.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.390+0000 7fd89d7fa640 1 -- 172.21.15.103:0/350623632 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd89409c490 con 0x7fd8a0101930 2024-08-02T18:49:46.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.624+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fd8a0062360 con 0x7fd8880a2d00 2024-08-02T18:49:46.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.634+0000 7fd89d7fa640 1 -- 172.21.15.103:0/350623632 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339434 (secure 0 0 0) 0x7fd8a0062360 con 0x7fd8880a2d00 2024-08-02T18:49:46.640 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:46.643 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:49:46.644 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd8880a2d00 msgr2=0x7fd8880a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd8880a2d00 0x7fd8880a51c0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fd89002a930 tx=0x7fd890000bc0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0101930 msgr2=0x7fd8a0197090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0101930 0x7fd8a0197090 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fd89400ea60 tx=0x7fd89400ef20 comp rx=0 tx=0).stop 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 shutdown_connections 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd8880a2d00 0x7fd8880a51c0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd8a01022f0 0x7fd8a019e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd8a0101930 0x7fd8a0197090 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 --2- 172.21.15.103:0/350623632 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd8a0100740 0x7fd8a0196b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.637+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 >> 172.21.15.103:0/350623632 conn(0x7fd8a00fbea0 msgr2=0x7fd8a0104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.638+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 shutdown_connections 2024-08-02T18:49:46.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.638+0000 7fd8a6514640 1 -- 172.21.15.103:0/350623632 wait complete. 2024-08-02T18:49:46.652 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-08-02T18:49:45.574836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190746,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":865,"num_read_kb":595,"num_write":484,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":874,"ondisk_log_size":874,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377352,"kb_used_data":15688,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564472,"statfs":{"total":1151940427776,"available":1151554019328,"internally_reserved":0,"allocated":16064512,"data_stored":9652300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.986236"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.655030+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:49:43.655030+0000","last_peered":"2024-08-02T18:49:43.655030+0000","last_clean":"2024-08-02T18:49:43.655030+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:49:43.655030+0000","last_undegraded":"2024-08-02T18:49:43.655030+0000","last_fullsized":"2024-08-02T18:49:43.655030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654228+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:49:43.654228+0000","last_peered":"2024-08-02T18:49:43.654228+0000","last_clean":"2024-08-02T18:49:43.654228+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:49:43.654228+0000","last_undegraded":"2024-08-02T18:49:43.654228+0000","last_fullsized":"2024-08-02T18:49:43.654228+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828991+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:49:43.828991+0000","last_peered":"2024-08-02T18:49:43.828991+0000","last_clean":"2024-08-02T18:49:43.828991+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:49:43.828991+0000","last_undegraded":"2024-08-02T18:49:43.828991+0000","last_fullsized":"2024-08-02T18:49:43.828991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609787+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:49:43.609787+0000","last_peered":"2024-08-02T18:49:43.609787+0000","last_clean":"2024-08-02T18:49:43.609787+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:49:43.609787+0000","last_undegraded":"2024-08-02T18:49:43.609787+0000","last_fullsized":"2024-08-02T18:49:43.609787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957153+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:49:43.957153+0000","last_peered":"2024-08-02T18:49:43.957153+0000","last_clean":"2024-08-02T18:49:43.957153+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:49:43.957153+0000","last_undegraded":"2024-08-02T18:49:43.957153+0000","last_fullsized":"2024-08-02T18:49:43.957153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609177+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:49:43.609177+0000","last_peered":"2024-08-02T18:49:43.609177+0000","last_clean":"2024-08-02T18:49:43.609177+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:49:43.609177+0000","last_undegraded":"2024-08-02T18:49:43.609177+0000","last_fullsized":"2024-08-02T18:49:43.609177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921278+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:49:43.921278+0000","last_peered":"2024-08-02T18:49:43.921278+0000","last_clean":"2024-08-02T18:49:43.921278+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:49:43.921278+0000","last_undegraded":"2024-08-02T18:49:43.921278+0000","last_fullsized":"2024-08-02T18:49:43.921278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562754+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:49:43.562754+0000","last_peered":"2024-08-02T18:49:43.562754+0000","last_clean":"2024-08-02T18:49:43.562754+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:49:43.562754+0000","last_undegraded":"2024-08-02T18:49:43.562754+0000","last_fullsized":"2024-08-02T18:49:43.562754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609407+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:49:43.609407+0000","last_peered":"2024-08-02T18:49:43.609407+0000","last_clean":"2024-08-02T18:49:43.609407+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:49:43.609407+0000","last_undegraded":"2024-08-02T18:49:43.609407+0000","last_fullsized":"2024-08-02T18:49:43.609407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656769+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:49:43.656769+0000","last_peered":"2024-08-02T18:49:43.656769+0000","last_clean":"2024-08-02T18:49:43.656769+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:49:43.656769+0000","last_undegraded":"2024-08-02T18:49:43.656769+0000","last_fullsized":"2024-08-02T18:49:43.656769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563340+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:49:43.563340+0000","last_peered":"2024-08-02T18:49:43.563340+0000","last_clean":"2024-08-02T18:49:43.563340+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:49:43.563340+0000","last_undegraded":"2024-08-02T18:49:43.563340+0000","last_fullsized":"2024-08-02T18:49:43.563340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609317+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:49:43.609317+0000","last_peered":"2024-08-02T18:49:43.609317+0000","last_clean":"2024-08-02T18:49:43.609317+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:49:43.609317+0000","last_undegraded":"2024-08-02T18:49:43.609317+0000","last_fullsized":"2024-08-02T18:49:43.609317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826836+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:49:43.826836+0000","last_peered":"2024-08-02T18:49:43.826836+0000","last_clean":"2024-08-02T18:49:43.826836+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:49:43.826836+0000","last_undegraded":"2024-08-02T18:49:43.826836+0000","last_fullsized":"2024-08-02T18:49:43.826836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656491+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:49:43.656491+0000","last_peered":"2024-08-02T18:49:43.656491+0000","last_clean":"2024-08-02T18:49:43.656491+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:49:43.656491+0000","last_undegraded":"2024-08-02T18:49:43.656491+0000","last_fullsized":"2024-08-02T18:49:43.656491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609487+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:49:43.609487+0000","last_peered":"2024-08-02T18:49:43.609487+0000","last_clean":"2024-08-02T18:49:43.609487+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:49:43.609487+0000","last_undegraded":"2024-08-02T18:49:43.609487+0000","last_fullsized":"2024-08-02T18:49:43.609487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609390+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:49:43.609390+0000","last_peered":"2024-08-02T18:49:43.609390+0000","last_clean":"2024-08-02T18:49:43.609390+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:49:43.609390+0000","last_undegraded":"2024-08-02T18:49:43.609390+0000","last_fullsized":"2024-08-02T18:49:43.609390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829268+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:49:43.829268+0000","last_peered":"2024-08-02T18:49:43.829268+0000","last_clean":"2024-08-02T18:49:43.829268+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:49:43.829268+0000","last_undegraded":"2024-08-02T18:49:43.829268+0000","last_fullsized":"2024-08-02T18:49:43.829268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609555+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:49:43.609555+0000","last_peered":"2024-08-02T18:49:43.609555+0000","last_clean":"2024-08-02T18:49:43.609555+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:49:43.609555+0000","last_undegraded":"2024-08-02T18:49:43.609555+0000","last_fullsized":"2024-08-02T18:49:43.609555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921113+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:49:43.921113+0000","last_peered":"2024-08-02T18:49:43.921113+0000","last_clean":"2024-08-02T18:49:43.921113+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:49:43.921113+0000","last_undegraded":"2024-08-02T18:49:43.921113+0000","last_fullsized":"2024-08-02T18:49:43.921113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609233+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:49:43.609233+0000","last_peered":"2024-08-02T18:49:43.609233+0000","last_clean":"2024-08-02T18:49:43.609233+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:49:43.609233+0000","last_undegraded":"2024-08-02T18:49:43.609233+0000","last_fullsized":"2024-08-02T18:49:43.609233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654077+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:49:43.654077+0000","last_peered":"2024-08-02T18:49:43.654077+0000","last_clean":"2024-08-02T18:49:43.654077+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:49:43.654077+0000","last_undegraded":"2024-08-02T18:49:43.654077+0000","last_fullsized":"2024-08-02T18:49:43.654077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656381+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:49:43.656381+0000","last_peered":"2024-08-02T18:49:43.656381+0000","last_clean":"2024-08-02T18:49:43.656381+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:49:43.656381+0000","last_undegraded":"2024-08-02T18:49:43.656381+0000","last_fullsized":"2024-08-02T18:49:43.656381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562686+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:49:43.562686+0000","last_peered":"2024-08-02T18:49:43.562686+0000","last_clean":"2024-08-02T18:49:43.562686+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:49:43.562686+0000","last_undegraded":"2024-08-02T18:49:43.562686+0000","last_fullsized":"2024-08-02T18:49:43.562686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609606+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:49:43.609606+0000","last_peered":"2024-08-02T18:49:43.609606+0000","last_clean":"2024-08-02T18:49:43.609606+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:49:43.609606+0000","last_undegraded":"2024-08-02T18:49:43.609606+0000","last_fullsized":"2024-08-02T18:49:43.609606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957022+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:49:43.957022+0000","last_peered":"2024-08-02T18:49:43.957022+0000","last_clean":"2024-08-02T18:49:43.957022+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:49:43.957022+0000","last_undegraded":"2024-08-02T18:49:43.957022+0000","last_fullsized":"2024-08-02T18:49:43.957022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609883+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:49:43.609883+0000","last_peered":"2024-08-02T18:49:43.609883+0000","last_clean":"2024-08-02T18:49:43.609883+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:49:43.609883+0000","last_undegraded":"2024-08-02T18:49:43.609883+0000","last_fullsized":"2024-08-02T18:49:43.609883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828996+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:49:43.828996+0000","last_peered":"2024-08-02T18:49:43.828996+0000","last_clean":"2024-08-02T18:49:43.828996+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:49:43.828996+0000","last_undegraded":"2024-08-02T18:49:43.828996+0000","last_fullsized":"2024-08-02T18:49:43.828996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609859+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:49:43.609859+0000","last_peered":"2024-08-02T18:49:43.609859+0000","last_clean":"2024-08-02T18:49:43.609859+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:49:43.609859+0000","last_undegraded":"2024-08-02T18:49:43.609859+0000","last_fullsized":"2024-08-02T18:49:43.609859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'48","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.787197+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:49:43.787197+0000","last_peered":"2024-08-02T18:49:43.787197+0000","last_clean":"2024-08-02T18:49:43.787197+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:49:43.787197+0000","last_undegraded":"2024-08-02T18:49:43.787197+0000","last_fullsized":"2024-08-02T18:49:43.787197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608943+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:49:43.608943+0000","last_peered":"2024-08-02T18:49:43.608943+0000","last_clean":"2024-08-02T18:49:43.608943+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:49:43.608943+0000","last_undegraded":"2024-08-02T18:49:43.608943+0000","last_fullsized":"2024-08-02T18:49:43.608943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561962+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:49:43.561962+0000","last_peered":"2024-08-02T18:49:43.561962+0000","last_clean":"2024-08-02T18:49:43.561962+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:49:43.561962+0000","last_undegraded":"2024-08-02T18:49:43.561962+0000","last_fullsized":"2024-08-02T18:49:43.561962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656835+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:49:43.656835+0000","last_peered":"2024-08-02T18:49:43.656835+0000","last_clean":"2024-08-02T18:49:43.656835+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:49:43.656835+0000","last_undegraded":"2024-08-02T18:49:43.656835+0000","last_fullsized":"2024-08-02T18:49:43.656835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921219+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:49:43.921219+0000","last_peered":"2024-08-02T18:49:43.921219+0000","last_clean":"2024-08-02T18:49:43.921219+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:49:43.921219+0000","last_undegraded":"2024-08-02T18:49:43.921219+0000","last_fullsized":"2024-08-02T18:49:43.921219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608457+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:49:43.608457+0000","last_peered":"2024-08-02T18:49:43.608457+0000","last_clean":"2024-08-02T18:49:43.608457+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:49:43.608457+0000","last_undegraded":"2024-08-02T18:49:43.608457+0000","last_fullsized":"2024-08-02T18:49:43.608457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654589+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:49:43.654589+0000","last_peered":"2024-08-02T18:49:43.654589+0000","last_clean":"2024-08-02T18:49:43.654589+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:49:43.654589+0000","last_undegraded":"2024-08-02T18:49:43.654589+0000","last_fullsized":"2024-08-02T18:49:43.654589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656388+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:49:43.656388+0000","last_peered":"2024-08-02T18:49:43.656388+0000","last_clean":"2024-08-02T18:49:43.656388+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:49:43.656388+0000","last_undegraded":"2024-08-02T18:49:43.656388+0000","last_fullsized":"2024-08-02T18:49:43.656388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608451+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:49:43.608451+0000","last_peered":"2024-08-02T18:49:43.608451+0000","last_clean":"2024-08-02T18:49:43.608451+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:49:43.608451+0000","last_undegraded":"2024-08-02T18:49:43.608451+0000","last_fullsized":"2024-08-02T18:49:43.608451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826989+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:49:43.826989+0000","last_peered":"2024-08-02T18:49:43.826989+0000","last_clean":"2024-08-02T18:49:43.826989+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:49:43.826989+0000","last_undegraded":"2024-08-02T18:49:43.826989+0000","last_fullsized":"2024-08-02T18:49:43.826989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561871+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:49:43.561871+0000","last_peered":"2024-08-02T18:49:43.561871+0000","last_clean":"2024-08-02T18:49:43.561871+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:49:43.561871+0000","last_undegraded":"2024-08-02T18:49:43.561871+0000","last_fullsized":"2024-08-02T18:49:43.561871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562994+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:49:43.562994+0000","last_peered":"2024-08-02T18:49:43.562994+0000","last_clean":"2024-08-02T18:49:43.562994+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:49:43.562994+0000","last_undegraded":"2024-08-02T18:49:43.562994+0000","last_fullsized":"2024-08-02T18:49:43.562994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":142,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561327+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:49:43.561327+0000","last_peered":"2024-08-02T18:49:43.561327+0000","last_clean":"2024-08-02T18:49:43.561327+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:49:43.561327+0000","last_undegraded":"2024-08-02T18:49:43.561327+0000","last_fullsized":"2024-08-02T18:49:43.561327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562217+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:49:43.562217+0000","last_peered":"2024-08-02T18:49:43.562217+0000","last_clean":"2024-08-02T18:49:43.562217+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:49:43.562217+0000","last_undegraded":"2024-08-02T18:49:43.562217+0000","last_fullsized":"2024-08-02T18:49:43.562217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561158+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:49:43.561158+0000","last_peered":"2024-08-02T18:49:43.561158+0000","last_clean":"2024-08-02T18:49:43.561158+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:49:43.561158+0000","last_undegraded":"2024-08-02T18:49:43.561158+0000","last_fullsized":"2024-08-02T18:49:43.561158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826778+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:49:43.826778+0000","last_peered":"2024-08-02T18:49:43.826778+0000","last_clean":"2024-08-02T18:49:43.826778+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.826778+0000","last_undegraded":"2024-08-02T18:49:43.826778+0000","last_fullsized":"2024-08-02T18:49:43.826778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563541+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:49:43.563541+0000","last_peered":"2024-08-02T18:49:43.563541+0000","last_clean":"2024-08-02T18:49:43.563541+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:49:43.563541+0000","last_undegraded":"2024-08-02T18:49:43.563541+0000","last_fullsized":"2024-08-02T18:49:43.563541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609341+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:49:43.609341+0000","last_peered":"2024-08-02T18:49:43.609341+0000","last_clean":"2024-08-02T18:49:43.609341+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:49:43.609341+0000","last_undegraded":"2024-08-02T18:49:43.609341+0000","last_fullsized":"2024-08-02T18:49:43.609341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609676+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:49:43.609676+0000","last_peered":"2024-08-02T18:49:43.609676+0000","last_clean":"2024-08-02T18:49:43.609676+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:49:43.609676+0000","last_undegraded":"2024-08-02T18:49:43.609676+0000","last_fullsized":"2024-08-02T18:49:43.609676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826926+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:49:43.826926+0000","last_peered":"2024-08-02T18:49:43.826926+0000","last_clean":"2024-08-02T18:49:43.826926+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:49:43.826926+0000","last_undegraded":"2024-08-02T18:49:43.826926+0000","last_fullsized":"2024-08-02T18:49:43.826926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827013+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:49:43.827013+0000","last_peered":"2024-08-02T18:49:43.827013+0000","last_clean":"2024-08-02T18:49:43.827013+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:49:43.827013+0000","last_undegraded":"2024-08-02T18:49:43.827013+0000","last_fullsized":"2024-08-02T18:49:43.827013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827183+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:49:43.827183+0000","last_peered":"2024-08-02T18:49:43.827183+0000","last_clean":"2024-08-02T18:49:43.827183+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:49:43.827183+0000","last_undegraded":"2024-08-02T18:49:43.827183+0000","last_fullsized":"2024-08-02T18:49:43.827183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829351+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:49:43.829351+0000","last_peered":"2024-08-02T18:49:43.829351+0000","last_clean":"2024-08-02T18:49:43.829351+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:49:43.829351+0000","last_undegraded":"2024-08-02T18:49:43.829351+0000","last_fullsized":"2024-08-02T18:49:43.829351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562654+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:49:43.562654+0000","last_peered":"2024-08-02T18:49:43.562654+0000","last_clean":"2024-08-02T18:49:43.562654+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:49:43.562654+0000","last_undegraded":"2024-08-02T18:49:43.562654+0000","last_fullsized":"2024-08-02T18:49:43.562654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826971+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:49:43.826971+0000","last_peered":"2024-08-02T18:49:43.826971+0000","last_clean":"2024-08-02T18:49:43.826971+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:49:43.826971+0000","last_undegraded":"2024-08-02T18:49:43.826971+0000","last_fullsized":"2024-08-02T18:49:43.826971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'39","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.783745+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:49:43.783745+0000","last_peered":"2024-08-02T18:49:43.783745+0000","last_clean":"2024-08-02T18:49:43.783745+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:49:43.783745+0000","last_undegraded":"2024-08-02T18:49:43.783745+0000","last_fullsized":"2024-08-02T18:49:43.783745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956875+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:49:43.956875+0000","last_peered":"2024-08-02T18:49:43.956875+0000","last_clean":"2024-08-02T18:49:43.956875+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:49:43.956875+0000","last_undegraded":"2024-08-02T18:49:43.956875+0000","last_fullsized":"2024-08-02T18:49:43.956875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827238+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:49:43.827238+0000","last_peered":"2024-08-02T18:49:43.827238+0000","last_clean":"2024-08-02T18:49:43.827238+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:49:43.827238+0000","last_undegraded":"2024-08-02T18:49:43.827238+0000","last_fullsized":"2024-08-02T18:49:43.827238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562375+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:49:43.562375+0000","last_peered":"2024-08-02T18:49:43.562375+0000","last_clean":"2024-08-02T18:49:43.562375+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:49:43.562375+0000","last_undegraded":"2024-08-02T18:49:43.562375+0000","last_fullsized":"2024-08-02T18:49:43.562375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562856+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:49:43.562856+0000","last_peered":"2024-08-02T18:49:43.562856+0000","last_clean":"2024-08-02T18:49:43.562856+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:49:43.562856+0000","last_undegraded":"2024-08-02T18:49:43.562856+0000","last_fullsized":"2024-08-02T18:49:43.562856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921519+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:49:43.921519+0000","last_peered":"2024-08-02T18:49:43.921519+0000","last_clean":"2024-08-02T18:49:43.921519+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:49:43.921519+0000","last_undegraded":"2024-08-02T18:49:43.921519+0000","last_fullsized":"2024-08-02T18:49:43.921519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656937+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:49:43.656937+0000","last_peered":"2024-08-02T18:49:43.656937+0000","last_clean":"2024-08-02T18:49:43.656937+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:49:43.656937+0000","last_undegraded":"2024-08-02T18:49:43.656937+0000","last_fullsized":"2024-08-02T18:49:43.656937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562946+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:49:43.562946+0000","last_peered":"2024-08-02T18:49:43.562946+0000","last_clean":"2024-08-02T18:49:43.562946+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:49:43.562946+0000","last_undegraded":"2024-08-02T18:49:43.562946+0000","last_fullsized":"2024-08-02T18:49:43.562946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563145+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:49:43.563145+0000","last_peered":"2024-08-02T18:49:43.563145+0000","last_clean":"2024-08-02T18:49:43.563145+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:49:43.563145+0000","last_undegraded":"2024-08-02T18:49:43.563145+0000","last_fullsized":"2024-08-02T18:49:43.563145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656450+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:49:43.656450+0000","last_peered":"2024-08-02T18:49:43.656450+0000","last_clean":"2024-08-02T18:49:43.656450+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:49:43.656450+0000","last_undegraded":"2024-08-02T18:49:43.656450+0000","last_fullsized":"2024-08-02T18:49:43.656450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562360+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:49:43.562360+0000","last_peered":"2024-08-02T18:49:43.562360+0000","last_clean":"2024-08-02T18:49:43.562360+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:49:43.562360+0000","last_undegraded":"2024-08-02T18:49:43.562360+0000","last_fullsized":"2024-08-02T18:49:43.562360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826765+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:49:43.826765+0000","last_peered":"2024-08-02T18:49:43.826765+0000","last_clean":"2024-08-02T18:49:43.826765+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:49:43.826765+0000","last_undegraded":"2024-08-02T18:49:43.826765+0000","last_fullsized":"2024-08-02T18:49:43.826765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.833753+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:49:43.833753+0000","last_peered":"2024-08-02T18:49:43.833753+0000","last_clean":"2024-08-02T18:49:43.833753+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:49:43.833753+0000","last_undegraded":"2024-08-02T18:49:43.833753+0000","last_fullsized":"2024-08-02T18:49:43.833753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1676,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654895+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:49:43.654895+0000","last_peered":"2024-08-02T18:49:43.654895+0000","last_clean":"2024-08-02T18:49:43.654895+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:49:43.654895+0000","last_undegraded":"2024-08-02T18:49:43.654895+0000","last_fullsized":"2024-08-02T18:49:43.654895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826962+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:49:43.826962+0000","last_peered":"2024-08-02T18:49:43.826962+0000","last_clean":"2024-08-02T18:49:43.826962+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:49:43.826962+0000","last_undegraded":"2024-08-02T18:49:43.826962+0000","last_fullsized":"2024-08-02T18:49:43.826962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563270+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:49:43.563270+0000","last_peered":"2024-08-02T18:49:43.563270+0000","last_clean":"2024-08-02T18:49:43.563270+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:49:43.563270+0000","last_undegraded":"2024-08-02T18:49:43.563270+0000","last_fullsized":"2024-08-02T18:49:43.563270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921244+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:49:43.921244+0000","last_peered":"2024-08-02T18:49:43.921244+0000","last_clean":"2024-08-02T18:49:43.921244+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:49:43.921244+0000","last_undegraded":"2024-08-02T18:49:43.921244+0000","last_fullsized":"2024-08-02T18:49:43.921244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561546+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:49:43.561546+0000","last_peered":"2024-08-02T18:49:43.561546+0000","last_clean":"2024-08-02T18:49:43.561546+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:49:43.561546+0000","last_undegraded":"2024-08-02T18:49:43.561546+0000","last_fullsized":"2024-08-02T18:49:43.561546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921110+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:49:43.921110+0000","last_peered":"2024-08-02T18:49:43.921110+0000","last_clean":"2024-08-02T18:49:43.921110+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:49:43.921110+0000","last_undegraded":"2024-08-02T18:49:43.921110+0000","last_fullsized":"2024-08-02T18:49:43.921110+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608422+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:49:43.608422+0000","last_peered":"2024-08-02T18:49:43.608422+0000","last_clean":"2024-08-02T18:49:43.608422+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:49:43.608422+0000","last_undegraded":"2024-08-02T18:49:43.608422+0000","last_fullsized":"2024-08-02T18:49:43.608422+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656771+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:49:43.656771+0000","last_peered":"2024-08-02T18:49:43.656771+0000","last_clean":"2024-08-02T18:49:43.656771+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:49:43.656771+0000","last_undegraded":"2024-08-02T18:49:43.656771+0000","last_fullsized":"2024-08-02T18:49:43.656771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'40","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.837163+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:49:43.837163+0000","last_peered":"2024-08-02T18:49:43.837163+0000","last_clean":"2024-08-02T18:49:43.837163+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.837163+0000","last_undegraded":"2024-08-02T18:49:43.837163+0000","last_fullsized":"2024-08-02T18:49:43.837163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69709,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":213,"num_read_kb":175,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653988+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:49:43.653988+0000","last_peered":"2024-08-02T18:49:43.653988+0000","last_clean":"2024-08-02T18:49:43.653988+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:49:43.653988+0000","last_undegraded":"2024-08-02T18:49:43.653988+0000","last_fullsized":"2024-08-02T18:49:43.653988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562852+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:49:43.562852+0000","last_peered":"2024-08-02T18:49:43.562852+0000","last_clean":"2024-08-02T18:49:43.562852+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:49:43.562852+0000","last_undegraded":"2024-08-02T18:49:43.562852+0000","last_fullsized":"2024-08-02T18:49:43.562852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563483+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:49:43.563483+0000","last_peered":"2024-08-02T18:49:43.563483+0000","last_clean":"2024-08-02T18:49:43.563483+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:49:43.563483+0000","last_undegraded":"2024-08-02T18:49:43.563483+0000","last_fullsized":"2024-08-02T18:49:43.563483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609553+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:49:43.609553+0000","last_peered":"2024-08-02T18:49:43.609553+0000","last_clean":"2024-08-02T18:49:43.609553+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:49:43.609553+0000","last_undegraded":"2024-08-02T18:49:43.609553+0000","last_fullsized":"2024-08-02T18:49:43.609553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957173+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:49:43.957173+0000","last_peered":"2024-08-02T18:49:43.957173+0000","last_clean":"2024-08-02T18:49:43.957173+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:49:43.957173+0000","last_undegraded":"2024-08-02T18:49:43.957173+0000","last_fullsized":"2024-08-02T18:49:43.957173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827137+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:49:43.827137+0000","last_peered":"2024-08-02T18:49:43.827137+0000","last_clean":"2024-08-02T18:49:43.827137+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:49:43.827137+0000","last_undegraded":"2024-08-02T18:49:43.827137+0000","last_fullsized":"2024-08-02T18:49:43.827137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653660+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:49:43.653660+0000","last_peered":"2024-08-02T18:49:43.653660+0000","last_clean":"2024-08-02T18:49:43.653660+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:49:43.653660+0000","last_undegraded":"2024-08-02T18:49:43.653660+0000","last_fullsized":"2024-08-02T18:49:43.653660+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563205+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:49:43.563205+0000","last_peered":"2024-08-02T18:49:43.563205+0000","last_clean":"2024-08-02T18:49:43.563205+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:49:43.563205+0000","last_undegraded":"2024-08-02T18:49:43.563205+0000","last_fullsized":"2024-08-02T18:49:43.563205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":140,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608658+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:49:43.608658+0000","last_peered":"2024-08-02T18:49:43.608658+0000","last_clean":"2024-08-02T18:49:43.608658+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:49:43.608658+0000","last_undegraded":"2024-08-02T18:49:43.608658+0000","last_fullsized":"2024-08-02T18:49:43.608658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609051+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:49:43.609051+0000","last_peered":"2024-08-02T18:49:43.609051+0000","last_clean":"2024-08-02T18:49:43.609051+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:49:43.609051+0000","last_undegraded":"2024-08-02T18:49:43.609051+0000","last_fullsized":"2024-08-02T18:49:43.609051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956951+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:49:43.956951+0000","last_peered":"2024-08-02T18:49:43.956951+0000","last_clean":"2024-08-02T18:49:43.956951+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:49:43.956951+0000","last_undegraded":"2024-08-02T18:49:43.956951+0000","last_fullsized":"2024-08-02T18:49:43.956951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653898+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:49:43.653898+0000","last_peered":"2024-08-02T18:49:43.653898+0000","last_clean":"2024-08-02T18:49:43.653898+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:49:43.653898+0000","last_undegraded":"2024-08-02T18:49:43.653898+0000","last_fullsized":"2024-08-02T18:49:43.653898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563162+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:49:43.563162+0000","last_peered":"2024-08-02T18:49:43.563162+0000","last_clean":"2024-08-02T18:49:43.563162+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:49:43.563162+0000","last_undegraded":"2024-08-02T18:49:43.563162+0000","last_fullsized":"2024-08-02T18:49:43.563162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921505+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:49:43.921505+0000","last_peered":"2024-08-02T18:49:43.921505+0000","last_clean":"2024-08-02T18:49:43.921505+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:49:43.921505+0000","last_undegraded":"2024-08-02T18:49:43.921505+0000","last_fullsized":"2024-08-02T18:49:43.921505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609073+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:49:43.609073+0000","last_peered":"2024-08-02T18:49:43.609073+0000","last_clean":"2024-08-02T18:49:43.609073+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:49:43.609073+0000","last_undegraded":"2024-08-02T18:49:43.609073+0000","last_fullsized":"2024-08-02T18:49:43.609073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561163+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:49:43.561163+0000","last_peered":"2024-08-02T18:49:43.561163+0000","last_clean":"2024-08-02T18:49:43.561163+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:49:43.561163+0000","last_undegraded":"2024-08-02T18:49:43.561163+0000","last_fullsized":"2024-08-02T18:49:43.561163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608626+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:49:43.608626+0000","last_peered":"2024-08-02T18:49:43.608626+0000","last_clean":"2024-08-02T18:49:43.608626+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:49:43.608626+0000","last_undegraded":"2024-08-02T18:49:43.608626+0000","last_fullsized":"2024-08-02T18:49:43.608626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654071+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:49:43.654071+0000","last_peered":"2024-08-02T18:49:43.654071+0000","last_clean":"2024-08-02T18:49:43.654071+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:49:43.654071+0000","last_undegraded":"2024-08-02T18:49:43.654071+0000","last_fullsized":"2024-08-02T18:49:43.654071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829094+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:49:43.829094+0000","last_peered":"2024-08-02T18:49:43.829094+0000","last_clean":"2024-08-02T18:49:43.829094+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:49:43.829094+0000","last_undegraded":"2024-08-02T18:49:43.829094+0000","last_fullsized":"2024-08-02T18:49:43.829094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609582+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:49:43.609582+0000","last_peered":"2024-08-02T18:49:43.609582+0000","last_clean":"2024-08-02T18:49:43.609582+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:49:43.609582+0000","last_undegraded":"2024-08-02T18:49:43.609582+0000","last_fullsized":"2024-08-02T18:49:43.609582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656472+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:49:43.656472+0000","last_peered":"2024-08-02T18:49:43.656472+0000","last_clean":"2024-08-02T18:49:43.656472+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:49:43.656472+0000","last_undegraded":"2024-08-02T18:49:43.656472+0000","last_fullsized":"2024-08-02T18:49:43.656472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829250+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:49:43.829250+0000","last_peered":"2024-08-02T18:49:43.829250+0000","last_clean":"2024-08-02T18:49:43.829250+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:49:43.829250+0000","last_undegraded":"2024-08-02T18:49:43.829250+0000","last_fullsized":"2024-08-02T18:49:43.829250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921020+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:49:43.921020+0000","last_peered":"2024-08-02T18:49:43.921020+0000","last_clean":"2024-08-02T18:49:43.921020+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:49:43.921020+0000","last_undegraded":"2024-08-02T18:49:43.921020+0000","last_fullsized":"2024-08-02T18:49:43.921020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829253+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:49:43.829253+0000","last_peered":"2024-08-02T18:49:43.829253+0000","last_clean":"2024-08-02T18:49:43.829253+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:49:43.829253+0000","last_undegraded":"2024-08-02T18:49:43.829253+0000","last_fullsized":"2024-08-02T18:49:43.829253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829051+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:49:43.829051+0000","last_peered":"2024-08-02T18:49:43.829051+0000","last_clean":"2024-08-02T18:49:43.829051+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:49:43.829051+0000","last_undegraded":"2024-08-02T18:49:43.829051+0000","last_fullsized":"2024-08-02T18:49:43.829051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956830+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:49:43.956830+0000","last_peered":"2024-08-02T18:49:43.956830+0000","last_clean":"2024-08-02T18:49:43.956830+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:49:43.956830+0000","last_undegraded":"2024-08-02T18:49:43.956830+0000","last_fullsized":"2024-08-02T18:49:43.956830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561943+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:49:43.561943+0000","last_peered":"2024-08-02T18:49:43.561943+0000","last_clean":"2024-08-02T18:49:43.561943+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:49:43.561943+0000","last_undegraded":"2024-08-02T18:49:43.561943+0000","last_fullsized":"2024-08-02T18:49:43.561943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921458+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:49:43.921458+0000","last_peered":"2024-08-02T18:49:43.921458+0000","last_clean":"2024-08-02T18:49:43.921458+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:49:43.921458+0000","last_undegraded":"2024-08-02T18:49:43.921458+0000","last_fullsized":"2024-08-02T18:49:43.921458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829511+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:49:43.829511+0000","last_peered":"2024-08-02T18:49:43.829511+0000","last_clean":"2024-08-02T18:49:43.829511+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:49:43.829511+0000","last_undegraded":"2024-08-02T18:49:43.829511+0000","last_fullsized":"2024-08-02T18:49:43.829511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609765+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:49:43.609765+0000","last_peered":"2024-08-02T18:49:43.609765+0000","last_clean":"2024-08-02T18:49:43.609765+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:49:43.609765+0000","last_undegraded":"2024-08-02T18:49:43.609765+0000","last_fullsized":"2024-08-02T18:49:43.609765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562988+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:49:43.562988+0000","last_peered":"2024-08-02T18:49:43.562988+0000","last_clean":"2024-08-02T18:49:43.562988+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:49:43.562988+0000","last_undegraded":"2024-08-02T18:49:43.562988+0000","last_fullsized":"2024-08-02T18:49:43.562988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609160+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:49:43.609160+0000","last_peered":"2024-08-02T18:49:43.609160+0000","last_clean":"2024-08-02T18:49:43.609160+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:49:43.609160+0000","last_undegraded":"2024-08-02T18:49:43.609160+0000","last_fullsized":"2024-08-02T18:49:43.609160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562877+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:49:43.562877+0000","last_peered":"2024-08-02T18:49:43.562877+0000","last_clean":"2024-08-02T18:49:43.562877+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:49:43.562877+0000","last_undegraded":"2024-08-02T18:49:43.562877+0000","last_fullsized":"2024-08-02T18:49:43.562877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561703+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:49:43.561703+0000","last_peered":"2024-08-02T18:49:43.561703+0000","last_clean":"2024-08-02T18:49:43.561703+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:49:43.561703+0000","last_undegraded":"2024-08-02T18:49:43.561703+0000","last_fullsized":"2024-08-02T18:49:43.561703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921328+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:49:43.921328+0000","last_peered":"2024-08-02T18:49:43.921328+0000","last_clean":"2024-08-02T18:49:43.921328+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:49:43.921328+0000","last_undegraded":"2024-08-02T18:49:43.921328+0000","last_fullsized":"2024-08-02T18:49:43.921328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829407+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:49:43.829407+0000","last_peered":"2024-08-02T18:49:43.829407+0000","last_clean":"2024-08-02T18:49:43.829407+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:49:43.829407+0000","last_undegraded":"2024-08-02T18:49:43.829407+0000","last_fullsized":"2024-08-02T18:49:43.829407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654732+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:49:43.654732+0000","last_peered":"2024-08-02T18:49:43.654732+0000","last_clean":"2024-08-02T18:49:43.654732+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:49:43.654732+0000","last_undegraded":"2024-08-02T18:49:43.654732+0000","last_fullsized":"2024-08-02T18:49:43.654732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921678+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:49:43.921678+0000","last_peered":"2024-08-02T18:49:43.921678+0000","last_clean":"2024-08-02T18:49:43.921678+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:49:43.921678+0000","last_undegraded":"2024-08-02T18:49:43.921678+0000","last_fullsized":"2024-08-02T18:49:43.921678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562579+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:49:43.562579+0000","last_peered":"2024-08-02T18:49:43.562579+0000","last_clean":"2024-08-02T18:49:43.562579+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:49:43.562579+0000","last_undegraded":"2024-08-02T18:49:43.562579+0000","last_fullsized":"2024-08-02T18:49:43.562579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.955905+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:49:43.955905+0000","last_peered":"2024-08-02T18:49:43.955905+0000","last_clean":"2024-08-02T18:49:43.955905+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:49:43.955905+0000","last_undegraded":"2024-08-02T18:49:43.955905+0000","last_fullsized":"2024-08-02T18:49:43.955905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956586+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:49:43.956586+0000","last_peered":"2024-08-02T18:49:43.956586+0000","last_clean":"2024-08-02T18:49:43.956586+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:49:43.956586+0000","last_undegraded":"2024-08-02T18:49:43.956586+0000","last_fullsized":"2024-08-02T18:49:43.956586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561524+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:49:43.561524+0000","last_peered":"2024-08-02T18:49:43.561524+0000","last_clean":"2024-08-02T18:49:43.561524+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:49:43.561524+0000","last_undegraded":"2024-08-02T18:49:43.561524+0000","last_fullsized":"2024-08-02T18:49:43.561524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609731+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:49:43.609731+0000","last_peered":"2024-08-02T18:49:43.609731+0000","last_clean":"2024-08-02T18:49:43.609731+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:49:43.609731+0000","last_undegraded":"2024-08-02T18:49:43.609731+0000","last_fullsized":"2024-08-02T18:49:43.609731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827121+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:49:43.827121+0000","last_peered":"2024-08-02T18:49:43.827121+0000","last_clean":"2024-08-02T18:49:43.827121+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:49:43.827121+0000","last_undegraded":"2024-08-02T18:49:43.827121+0000","last_fullsized":"2024-08-02T18:49:43.827121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608795+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:49:43.608795+0000","last_peered":"2024-08-02T18:49:43.608795+0000","last_clean":"2024-08-02T18:49:43.608795+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:49:43.608795+0000","last_undegraded":"2024-08-02T18:49:43.608795+0000","last_fullsized":"2024-08-02T18:49:43.608795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563166+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:49:43.563166+0000","last_peered":"2024-08-02T18:49:43.563166+0000","last_clean":"2024-08-02T18:49:43.563166+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:49:43.563166+0000","last_undegraded":"2024-08-02T18:49:43.563166+0000","last_fullsized":"2024-08-02T18:49:43.563166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609065+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:49:43.609065+0000","last_peered":"2024-08-02T18:49:43.609065+0000","last_clean":"2024-08-02T18:49:43.609065+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:49:43.609065+0000","last_undegraded":"2024-08-02T18:49:43.609065+0000","last_fullsized":"2024-08-02T18:49:43.609065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826709+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:49:43.826709+0000","last_peered":"2024-08-02T18:49:43.826709+0000","last_clean":"2024-08-02T18:49:43.826709+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:49:43.826709+0000","last_undegraded":"2024-08-02T18:49:43.826709+0000","last_fullsized":"2024-08-02T18:49:43.826709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608483+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:49:43.608483+0000","last_peered":"2024-08-02T18:49:43.608483+0000","last_clean":"2024-08-02T18:49:43.608483+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:49:43.608483+0000","last_undegraded":"2024-08-02T18:49:43.608483+0000","last_fullsized":"2024-08-02T18:49:43.608483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656457+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:49:43.656457+0000","last_peered":"2024-08-02T18:49:43.656457+0000","last_clean":"2024-08-02T18:49:43.656457+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:49:43.656457+0000","last_undegraded":"2024-08-02T18:49:43.656457+0000","last_fullsized":"2024-08-02T18:49:43.656457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654397+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:49:43.654397+0000","last_peered":"2024-08-02T18:49:43.654397+0000","last_clean":"2024-08-02T18:49:43.654397+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:49:43.654397+0000","last_undegraded":"2024-08-02T18:49:43.654397+0000","last_fullsized":"2024-08-02T18:49:43.654397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956825+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:49:43.956825+0000","last_peered":"2024-08-02T18:49:43.956825+0000","last_clean":"2024-08-02T18:49:43.956825+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:49:43.956825+0000","last_undegraded":"2024-08-02T18:49:43.956825+0000","last_fullsized":"2024-08-02T18:49:43.956825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956976+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:49:43.956976+0000","last_peered":"2024-08-02T18:49:43.956976+0000","last_clean":"2024-08-02T18:49:43.956976+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:49:43.956976+0000","last_undegraded":"2024-08-02T18:49:43.956976+0000","last_fullsized":"2024-08-02T18:49:43.956976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921644+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:49:43.921644+0000","last_peered":"2024-08-02T18:49:43.921644+0000","last_clean":"2024-08-02T18:49:43.921644+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:49:43.921644+0000","last_undegraded":"2024-08-02T18:49:43.921644+0000","last_fullsized":"2024-08-02T18:49:43.921644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600144,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":729,"num_read_kb":476,"num_write":301,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1800432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547242,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":499721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28832,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716320,"statfs":{"total":95995035648,"available":95965511680,"internally_reserved":0,"allocated":1859584,"data_stored":1299160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1441792,"data_stored":907043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168632,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1437696,"data_stored":902867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397565,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1638400,"data_stored":1107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":504907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28756,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716396,"statfs":{"total":95995035648,"available":95965589504,"internally_reserved":0,"allocated":1781760,"data_stored":1233278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":510645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1564672,"data_stored":1029917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":576763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":574526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1048576,"data_stored":506295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":203975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:49:46.658 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-02T18:49:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-08-02T18:49:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi121 to 176.1M 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: Unable to set osd_memory_target on smithi121 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-08-02T18:49:46.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:46 smithi121 ceph-mon[37236]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-08-02T18:49:46.796 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 -- 172.21.15.103:0/3044970773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c101930 msgr2=0x7fca6c101db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 --2- 172.21.15.103:0/3044970773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c101930 0x7fca6c101db0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fca5c009900 tx=0x7fca5c02a410 comp rx=0 tx=0).stop 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 -- 172.21.15.103:0/3044970773 shutdown_connections 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 --2- 172.21.15.103:0/3044970773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca6c1022f0 0x7fca6c108b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 --2- 172.21.15.103:0/3044970773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c101930 0x7fca6c101db0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 --2- 172.21.15.103:0/3044970773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6c100740 0x7fca6c100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 -- 172.21.15.103:0/3044970773 >> 172.21.15.103:0/3044970773 conn(0x7fca6c0fbea0 msgr2=0x7fca6c0fe2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 -- 172.21.15.103:0/3044970773 shutdown_connections 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.793+0000 7fca7408e640 1 -- 172.21.15.103:0/3044970773 wait complete. 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.794+0000 7fca7408e640 1 Processor -- start 2024-08-02T18:49:46.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.794+0000 7fca7408e640 1 -- start start 2024-08-02T18:49:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.794+0000 7fca7408e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c100740 0x7fca6c197c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.794+0000 7fca7408e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca6c101930 0x7fca6c198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.794+0000 7fca7408e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6c1022f0 0x7fca6c19f1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.794+0000 7fca7408e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10d620 con 0x7fca6c100740 2024-08-02T18:49:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.794+0000 7fca7408e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10d4a0 con 0x7fca6c101930 2024-08-02T18:49:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.794+0000 7fca7408e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fca6c10d7a0 con 0x7fca6c1022f0 2024-08-02T18:49:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c100740 0x7fca6c197c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:46.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c100740 0x7fca6c197c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52158/0 (socket says 172.21.15.103:52158) 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 -- 172.21.15.103:0/1589800226 learned_addr learned my addr 172.21.15.103:0/1589800226 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71629640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca6c101930 0x7fca6c198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca7262b640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6c1022f0 0x7fca6c19f1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 -- 172.21.15.103:0/1589800226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6c1022f0 msgr2=0x7fca6c19f1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6c1022f0 0x7fca6c19f1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 -- 172.21.15.103:0/1589800226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca6c101930 msgr2=0x7fca6c198180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca6c101930 0x7fca6c198180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 -- 172.21.15.103:0/1589800226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fca6c19f850 con 0x7fca6c100740 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca7262b640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6c1022f0 0x7fca6c19f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca71e2a640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c100740 0x7fca6c197c40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca6800e9c0 tx=0x7fca6800ee80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca62ffd640 1 -- 172.21.15.103:0/1589800226 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca6800cd80 con 0x7fca6c100740 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca62ffd640 1 -- 172.21.15.103:0/1589800226 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fca680035f0 con 0x7fca6c100740 2024-08-02T18:49:46.801 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fca6c19fb40 con 0x7fca6c100740 2024-08-02T18:49:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca62ffd640 1 -- 172.21.15.103:0/1589800226 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fca68010670 con 0x7fca6c100740 2024-08-02T18:49:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.795+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fca6c1a0090 con 0x7fca6c100740 2024-08-02T18:49:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.796+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fca6c107a60 con 0x7fca6c100740 2024-08-02T18:49:46.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.797+0000 7fca62ffd640 1 -- 172.21.15.103:0/1589800226 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 23) ==== 137954+0+0 (secure 0 0 0) 0x7fca680037a0 con 0x7fca6c100740 2024-08-02T18:49:46.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.798+0000 7fca62ffd640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fca580a2d80 0x7fca580a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:46.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.798+0000 7fca71629640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fca580a2d80 0x7fca580a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:46.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.799+0000 7fca62ffd640 1 -- 172.21.15.103:0/1589800226 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fca680cfba0 con 0x7fca6c100740 2024-08-02T18:49:46.804 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.799+0000 7fca71629640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fca580a2d80 0x7fca580a5240 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fca5c006010 tx=0x7fca5c031640 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:46.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.803+0000 7fca62ffd640 1 -- 172.21.15.103:0/1589800226 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fca6809c480 con 0x7fca6c100740 2024-08-02T18:49:46.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi121 to 176.1M 2024-08-02T18:49:46.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: Unable to set osd_memory_target on smithi121 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-08-02T18:49:46.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-08-02T18:49:46.822 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:46 smithi151 ceph-mon[37155]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-08-02T18:49:46.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: pgmap v4: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:46.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: mgrmap e23: x(active, since 2s), standbys: z, y 2024-08-02T18:49:46.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi121 to 176.1M 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: Unable to set osd_memory_target on smithi121 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:46.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-08-02T18:49:46.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:46 smithi103 ceph-mon[32753]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-08-02T18:49:46.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.988+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fca6c062360 con 0x7fca580a2d80 2024-08-02T18:49:46.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:46.996+0000 7fca62ffd640 1 -- 172.21.15.103:0/1589800226 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339434 (secure 0 0 0) 0x7fca6c062360 con 0x7fca580a2d80 2024-08-02T18:49:47.002 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:47.005 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:49:47.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fca580a2d80 msgr2=0x7fca580a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:47.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fca580a2d80 0x7fca580a5240 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fca5c006010 tx=0x7fca5c031640 comp rx=0 tx=0).stop 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c100740 msgr2=0x7fca6c197c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c100740 0x7fca6c197c40 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fca6800e9c0 tx=0x7fca6800ee80 comp rx=0 tx=0).stop 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 shutdown_connections 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fca580a2d80 0x7fca580a5240 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fca6c1022f0 0x7fca6c19f1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fca6c101930 0x7fca6c198180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 --2- 172.21.15.103:0/1589800226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fca6c100740 0x7fca6c197c40 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 >> 172.21.15.103:0/1589800226 conn(0x7fca6c0fbea0 msgr2=0x7fca6c104c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:47.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 shutdown_connections 2024-08-02T18:49:47.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.000+0000 7fca7408e640 1 -- 172.21.15.103:0/1589800226 wait complete. 2024-08-02T18:49:47.014 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-08-02T18:49:45.574836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190746,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":865,"num_read_kb":595,"num_write":484,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":874,"ondisk_log_size":874,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377352,"kb_used_data":15688,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564472,"statfs":{"total":1151940427776,"available":1151554019328,"internally_reserved":0,"allocated":16064512,"data_stored":9652300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.986236"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.655030+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:49:43.655030+0000","last_peered":"2024-08-02T18:49:43.655030+0000","last_clean":"2024-08-02T18:49:43.655030+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:49:43.655030+0000","last_undegraded":"2024-08-02T18:49:43.655030+0000","last_fullsized":"2024-08-02T18:49:43.655030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654228+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:49:43.654228+0000","last_peered":"2024-08-02T18:49:43.654228+0000","last_clean":"2024-08-02T18:49:43.654228+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:49:43.654228+0000","last_undegraded":"2024-08-02T18:49:43.654228+0000","last_fullsized":"2024-08-02T18:49:43.654228+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828991+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:49:43.828991+0000","last_peered":"2024-08-02T18:49:43.828991+0000","last_clean":"2024-08-02T18:49:43.828991+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:49:43.828991+0000","last_undegraded":"2024-08-02T18:49:43.828991+0000","last_fullsized":"2024-08-02T18:49:43.828991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609787+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:49:43.609787+0000","last_peered":"2024-08-02T18:49:43.609787+0000","last_clean":"2024-08-02T18:49:43.609787+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:49:43.609787+0000","last_undegraded":"2024-08-02T18:49:43.609787+0000","last_fullsized":"2024-08-02T18:49:43.609787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957153+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:49:43.957153+0000","last_peered":"2024-08-02T18:49:43.957153+0000","last_clean":"2024-08-02T18:49:43.957153+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:49:43.957153+0000","last_undegraded":"2024-08-02T18:49:43.957153+0000","last_fullsized":"2024-08-02T18:49:43.957153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609177+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:49:43.609177+0000","last_peered":"2024-08-02T18:49:43.609177+0000","last_clean":"2024-08-02T18:49:43.609177+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:49:43.609177+0000","last_undegraded":"2024-08-02T18:49:43.609177+0000","last_fullsized":"2024-08-02T18:49:43.609177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921278+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:49:43.921278+0000","last_peered":"2024-08-02T18:49:43.921278+0000","last_clean":"2024-08-02T18:49:43.921278+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:49:43.921278+0000","last_undegraded":"2024-08-02T18:49:43.921278+0000","last_fullsized":"2024-08-02T18:49:43.921278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562754+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:49:43.562754+0000","last_peered":"2024-08-02T18:49:43.562754+0000","last_clean":"2024-08-02T18:49:43.562754+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:49:43.562754+0000","last_undegraded":"2024-08-02T18:49:43.562754+0000","last_fullsized":"2024-08-02T18:49:43.562754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609407+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:49:43.609407+0000","last_peered":"2024-08-02T18:49:43.609407+0000","last_clean":"2024-08-02T18:49:43.609407+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:49:43.609407+0000","last_undegraded":"2024-08-02T18:49:43.609407+0000","last_fullsized":"2024-08-02T18:49:43.609407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656769+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:49:43.656769+0000","last_peered":"2024-08-02T18:49:43.656769+0000","last_clean":"2024-08-02T18:49:43.656769+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:49:43.656769+0000","last_undegraded":"2024-08-02T18:49:43.656769+0000","last_fullsized":"2024-08-02T18:49:43.656769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563340+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:49:43.563340+0000","last_peered":"2024-08-02T18:49:43.563340+0000","last_clean":"2024-08-02T18:49:43.563340+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:49:43.563340+0000","last_undegraded":"2024-08-02T18:49:43.563340+0000","last_fullsized":"2024-08-02T18:49:43.563340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609317+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:49:43.609317+0000","last_peered":"2024-08-02T18:49:43.609317+0000","last_clean":"2024-08-02T18:49:43.609317+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:49:43.609317+0000","last_undegraded":"2024-08-02T18:49:43.609317+0000","last_fullsized":"2024-08-02T18:49:43.609317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826836+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:49:43.826836+0000","last_peered":"2024-08-02T18:49:43.826836+0000","last_clean":"2024-08-02T18:49:43.826836+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:49:43.826836+0000","last_undegraded":"2024-08-02T18:49:43.826836+0000","last_fullsized":"2024-08-02T18:49:43.826836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656491+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:49:43.656491+0000","last_peered":"2024-08-02T18:49:43.656491+0000","last_clean":"2024-08-02T18:49:43.656491+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:49:43.656491+0000","last_undegraded":"2024-08-02T18:49:43.656491+0000","last_fullsized":"2024-08-02T18:49:43.656491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609487+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:49:43.609487+0000","last_peered":"2024-08-02T18:49:43.609487+0000","last_clean":"2024-08-02T18:49:43.609487+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:49:43.609487+0000","last_undegraded":"2024-08-02T18:49:43.609487+0000","last_fullsized":"2024-08-02T18:49:43.609487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609390+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:49:43.609390+0000","last_peered":"2024-08-02T18:49:43.609390+0000","last_clean":"2024-08-02T18:49:43.609390+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:49:43.609390+0000","last_undegraded":"2024-08-02T18:49:43.609390+0000","last_fullsized":"2024-08-02T18:49:43.609390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829268+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:49:43.829268+0000","last_peered":"2024-08-02T18:49:43.829268+0000","last_clean":"2024-08-02T18:49:43.829268+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:49:43.829268+0000","last_undegraded":"2024-08-02T18:49:43.829268+0000","last_fullsized":"2024-08-02T18:49:43.829268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609555+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:49:43.609555+0000","last_peered":"2024-08-02T18:49:43.609555+0000","last_clean":"2024-08-02T18:49:43.609555+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:49:43.609555+0000","last_undegraded":"2024-08-02T18:49:43.609555+0000","last_fullsized":"2024-08-02T18:49:43.609555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921113+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:49:43.921113+0000","last_peered":"2024-08-02T18:49:43.921113+0000","last_clean":"2024-08-02T18:49:43.921113+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:49:43.921113+0000","last_undegraded":"2024-08-02T18:49:43.921113+0000","last_fullsized":"2024-08-02T18:49:43.921113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609233+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:49:43.609233+0000","last_peered":"2024-08-02T18:49:43.609233+0000","last_clean":"2024-08-02T18:49:43.609233+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:49:43.609233+0000","last_undegraded":"2024-08-02T18:49:43.609233+0000","last_fullsized":"2024-08-02T18:49:43.609233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654077+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:49:43.654077+0000","last_peered":"2024-08-02T18:49:43.654077+0000","last_clean":"2024-08-02T18:49:43.654077+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:49:43.654077+0000","last_undegraded":"2024-08-02T18:49:43.654077+0000","last_fullsized":"2024-08-02T18:49:43.654077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656381+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:49:43.656381+0000","last_peered":"2024-08-02T18:49:43.656381+0000","last_clean":"2024-08-02T18:49:43.656381+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:49:43.656381+0000","last_undegraded":"2024-08-02T18:49:43.656381+0000","last_fullsized":"2024-08-02T18:49:43.656381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562686+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:49:43.562686+0000","last_peered":"2024-08-02T18:49:43.562686+0000","last_clean":"2024-08-02T18:49:43.562686+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:49:43.562686+0000","last_undegraded":"2024-08-02T18:49:43.562686+0000","last_fullsized":"2024-08-02T18:49:43.562686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609606+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:49:43.609606+0000","last_peered":"2024-08-02T18:49:43.609606+0000","last_clean":"2024-08-02T18:49:43.609606+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:49:43.609606+0000","last_undegraded":"2024-08-02T18:49:43.609606+0000","last_fullsized":"2024-08-02T18:49:43.609606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957022+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:49:43.957022+0000","last_peered":"2024-08-02T18:49:43.957022+0000","last_clean":"2024-08-02T18:49:43.957022+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:49:43.957022+0000","last_undegraded":"2024-08-02T18:49:43.957022+0000","last_fullsized":"2024-08-02T18:49:43.957022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609883+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:49:43.609883+0000","last_peered":"2024-08-02T18:49:43.609883+0000","last_clean":"2024-08-02T18:49:43.609883+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:49:43.609883+0000","last_undegraded":"2024-08-02T18:49:43.609883+0000","last_fullsized":"2024-08-02T18:49:43.609883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828996+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:49:43.828996+0000","last_peered":"2024-08-02T18:49:43.828996+0000","last_clean":"2024-08-02T18:49:43.828996+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:49:43.828996+0000","last_undegraded":"2024-08-02T18:49:43.828996+0000","last_fullsized":"2024-08-02T18:49:43.828996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609859+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:49:43.609859+0000","last_peered":"2024-08-02T18:49:43.609859+0000","last_clean":"2024-08-02T18:49:43.609859+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:49:43.609859+0000","last_undegraded":"2024-08-02T18:49:43.609859+0000","last_fullsized":"2024-08-02T18:49:43.609859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'48","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.787197+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:49:43.787197+0000","last_peered":"2024-08-02T18:49:43.787197+0000","last_clean":"2024-08-02T18:49:43.787197+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:49:43.787197+0000","last_undegraded":"2024-08-02T18:49:43.787197+0000","last_fullsized":"2024-08-02T18:49:43.787197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608943+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:49:43.608943+0000","last_peered":"2024-08-02T18:49:43.608943+0000","last_clean":"2024-08-02T18:49:43.608943+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:49:43.608943+0000","last_undegraded":"2024-08-02T18:49:43.608943+0000","last_fullsized":"2024-08-02T18:49:43.608943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561962+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:49:43.561962+0000","last_peered":"2024-08-02T18:49:43.561962+0000","last_clean":"2024-08-02T18:49:43.561962+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:49:43.561962+0000","last_undegraded":"2024-08-02T18:49:43.561962+0000","last_fullsized":"2024-08-02T18:49:43.561962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656835+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:49:43.656835+0000","last_peered":"2024-08-02T18:49:43.656835+0000","last_clean":"2024-08-02T18:49:43.656835+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:49:43.656835+0000","last_undegraded":"2024-08-02T18:49:43.656835+0000","last_fullsized":"2024-08-02T18:49:43.656835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921219+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:49:43.921219+0000","last_peered":"2024-08-02T18:49:43.921219+0000","last_clean":"2024-08-02T18:49:43.921219+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:49:43.921219+0000","last_undegraded":"2024-08-02T18:49:43.921219+0000","last_fullsized":"2024-08-02T18:49:43.921219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608457+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:49:43.608457+0000","last_peered":"2024-08-02T18:49:43.608457+0000","last_clean":"2024-08-02T18:49:43.608457+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:49:43.608457+0000","last_undegraded":"2024-08-02T18:49:43.608457+0000","last_fullsized":"2024-08-02T18:49:43.608457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654589+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:49:43.654589+0000","last_peered":"2024-08-02T18:49:43.654589+0000","last_clean":"2024-08-02T18:49:43.654589+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:49:43.654589+0000","last_undegraded":"2024-08-02T18:49:43.654589+0000","last_fullsized":"2024-08-02T18:49:43.654589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656388+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:49:43.656388+0000","last_peered":"2024-08-02T18:49:43.656388+0000","last_clean":"2024-08-02T18:49:43.656388+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:49:43.656388+0000","last_undegraded":"2024-08-02T18:49:43.656388+0000","last_fullsized":"2024-08-02T18:49:43.656388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608451+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:49:43.608451+0000","last_peered":"2024-08-02T18:49:43.608451+0000","last_clean":"2024-08-02T18:49:43.608451+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:49:43.608451+0000","last_undegraded":"2024-08-02T18:49:43.608451+0000","last_fullsized":"2024-08-02T18:49:43.608451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826989+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:49:43.826989+0000","last_peered":"2024-08-02T18:49:43.826989+0000","last_clean":"2024-08-02T18:49:43.826989+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:49:43.826989+0000","last_undegraded":"2024-08-02T18:49:43.826989+0000","last_fullsized":"2024-08-02T18:49:43.826989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561871+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:49:43.561871+0000","last_peered":"2024-08-02T18:49:43.561871+0000","last_clean":"2024-08-02T18:49:43.561871+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:49:43.561871+0000","last_undegraded":"2024-08-02T18:49:43.561871+0000","last_fullsized":"2024-08-02T18:49:43.561871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562994+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:49:43.562994+0000","last_peered":"2024-08-02T18:49:43.562994+0000","last_clean":"2024-08-02T18:49:43.562994+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:49:43.562994+0000","last_undegraded":"2024-08-02T18:49:43.562994+0000","last_fullsized":"2024-08-02T18:49:43.562994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":142,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561327+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:49:43.561327+0000","last_peered":"2024-08-02T18:49:43.561327+0000","last_clean":"2024-08-02T18:49:43.561327+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:49:43.561327+0000","last_undegraded":"2024-08-02T18:49:43.561327+0000","last_fullsized":"2024-08-02T18:49:43.561327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562217+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:49:43.562217+0000","last_peered":"2024-08-02T18:49:43.562217+0000","last_clean":"2024-08-02T18:49:43.562217+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:49:43.562217+0000","last_undegraded":"2024-08-02T18:49:43.562217+0000","last_fullsized":"2024-08-02T18:49:43.562217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561158+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:49:43.561158+0000","last_peered":"2024-08-02T18:49:43.561158+0000","last_clean":"2024-08-02T18:49:43.561158+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:49:43.561158+0000","last_undegraded":"2024-08-02T18:49:43.561158+0000","last_fullsized":"2024-08-02T18:49:43.561158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826778+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:49:43.826778+0000","last_peered":"2024-08-02T18:49:43.826778+0000","last_clean":"2024-08-02T18:49:43.826778+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.826778+0000","last_undegraded":"2024-08-02T18:49:43.826778+0000","last_fullsized":"2024-08-02T18:49:43.826778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563541+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:49:43.563541+0000","last_peered":"2024-08-02T18:49:43.563541+0000","last_clean":"2024-08-02T18:49:43.563541+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:49:43.563541+0000","last_undegraded":"2024-08-02T18:49:43.563541+0000","last_fullsized":"2024-08-02T18:49:43.563541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609341+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:49:43.609341+0000","last_peered":"2024-08-02T18:49:43.609341+0000","last_clean":"2024-08-02T18:49:43.609341+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:49:43.609341+0000","last_undegraded":"2024-08-02T18:49:43.609341+0000","last_fullsized":"2024-08-02T18:49:43.609341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609676+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:49:43.609676+0000","last_peered":"2024-08-02T18:49:43.609676+0000","last_clean":"2024-08-02T18:49:43.609676+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:49:43.609676+0000","last_undegraded":"2024-08-02T18:49:43.609676+0000","last_fullsized":"2024-08-02T18:49:43.609676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826926+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:49:43.826926+0000","last_peered":"2024-08-02T18:49:43.826926+0000","last_clean":"2024-08-02T18:49:43.826926+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:49:43.826926+0000","last_undegraded":"2024-08-02T18:49:43.826926+0000","last_fullsized":"2024-08-02T18:49:43.826926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827013+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:49:43.827013+0000","last_peered":"2024-08-02T18:49:43.827013+0000","last_clean":"2024-08-02T18:49:43.827013+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:49:43.827013+0000","last_undegraded":"2024-08-02T18:49:43.827013+0000","last_fullsized":"2024-08-02T18:49:43.827013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827183+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:49:43.827183+0000","last_peered":"2024-08-02T18:49:43.827183+0000","last_clean":"2024-08-02T18:49:43.827183+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:49:43.827183+0000","last_undegraded":"2024-08-02T18:49:43.827183+0000","last_fullsized":"2024-08-02T18:49:43.827183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829351+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:49:43.829351+0000","last_peered":"2024-08-02T18:49:43.829351+0000","last_clean":"2024-08-02T18:49:43.829351+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:49:43.829351+0000","last_undegraded":"2024-08-02T18:49:43.829351+0000","last_fullsized":"2024-08-02T18:49:43.829351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562654+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:49:43.562654+0000","last_peered":"2024-08-02T18:49:43.562654+0000","last_clean":"2024-08-02T18:49:43.562654+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:49:43.562654+0000","last_undegraded":"2024-08-02T18:49:43.562654+0000","last_fullsized":"2024-08-02T18:49:43.562654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826971+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:49:43.826971+0000","last_peered":"2024-08-02T18:49:43.826971+0000","last_clean":"2024-08-02T18:49:43.826971+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:49:43.826971+0000","last_undegraded":"2024-08-02T18:49:43.826971+0000","last_fullsized":"2024-08-02T18:49:43.826971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'39","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.783745+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:49:43.783745+0000","last_peered":"2024-08-02T18:49:43.783745+0000","last_clean":"2024-08-02T18:49:43.783745+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:49:43.783745+0000","last_undegraded":"2024-08-02T18:49:43.783745+0000","last_fullsized":"2024-08-02T18:49:43.783745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956875+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:49:43.956875+0000","last_peered":"2024-08-02T18:49:43.956875+0000","last_clean":"2024-08-02T18:49:43.956875+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:49:43.956875+0000","last_undegraded":"2024-08-02T18:49:43.956875+0000","last_fullsized":"2024-08-02T18:49:43.956875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827238+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:49:43.827238+0000","last_peered":"2024-08-02T18:49:43.827238+0000","last_clean":"2024-08-02T18:49:43.827238+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:49:43.827238+0000","last_undegraded":"2024-08-02T18:49:43.827238+0000","last_fullsized":"2024-08-02T18:49:43.827238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562375+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:49:43.562375+0000","last_peered":"2024-08-02T18:49:43.562375+0000","last_clean":"2024-08-02T18:49:43.562375+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:49:43.562375+0000","last_undegraded":"2024-08-02T18:49:43.562375+0000","last_fullsized":"2024-08-02T18:49:43.562375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562856+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:49:43.562856+0000","last_peered":"2024-08-02T18:49:43.562856+0000","last_clean":"2024-08-02T18:49:43.562856+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:49:43.562856+0000","last_undegraded":"2024-08-02T18:49:43.562856+0000","last_fullsized":"2024-08-02T18:49:43.562856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921519+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:49:43.921519+0000","last_peered":"2024-08-02T18:49:43.921519+0000","last_clean":"2024-08-02T18:49:43.921519+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:49:43.921519+0000","last_undegraded":"2024-08-02T18:49:43.921519+0000","last_fullsized":"2024-08-02T18:49:43.921519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656937+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:49:43.656937+0000","last_peered":"2024-08-02T18:49:43.656937+0000","last_clean":"2024-08-02T18:49:43.656937+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:49:43.656937+0000","last_undegraded":"2024-08-02T18:49:43.656937+0000","last_fullsized":"2024-08-02T18:49:43.656937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562946+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:49:43.562946+0000","last_peered":"2024-08-02T18:49:43.562946+0000","last_clean":"2024-08-02T18:49:43.562946+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:49:43.562946+0000","last_undegraded":"2024-08-02T18:49:43.562946+0000","last_fullsized":"2024-08-02T18:49:43.562946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563145+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:49:43.563145+0000","last_peered":"2024-08-02T18:49:43.563145+0000","last_clean":"2024-08-02T18:49:43.563145+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:49:43.563145+0000","last_undegraded":"2024-08-02T18:49:43.563145+0000","last_fullsized":"2024-08-02T18:49:43.563145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656450+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:49:43.656450+0000","last_peered":"2024-08-02T18:49:43.656450+0000","last_clean":"2024-08-02T18:49:43.656450+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:49:43.656450+0000","last_undegraded":"2024-08-02T18:49:43.656450+0000","last_fullsized":"2024-08-02T18:49:43.656450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562360+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:49:43.562360+0000","last_peered":"2024-08-02T18:49:43.562360+0000","last_clean":"2024-08-02T18:49:43.562360+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:49:43.562360+0000","last_undegraded":"2024-08-02T18:49:43.562360+0000","last_fullsized":"2024-08-02T18:49:43.562360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826765+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:49:43.826765+0000","last_peered":"2024-08-02T18:49:43.826765+0000","last_clean":"2024-08-02T18:49:43.826765+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:49:43.826765+0000","last_undegraded":"2024-08-02T18:49:43.826765+0000","last_fullsized":"2024-08-02T18:49:43.826765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.833753+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:49:43.833753+0000","last_peered":"2024-08-02T18:49:43.833753+0000","last_clean":"2024-08-02T18:49:43.833753+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:49:43.833753+0000","last_undegraded":"2024-08-02T18:49:43.833753+0000","last_fullsized":"2024-08-02T18:49:43.833753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1676,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654895+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:49:43.654895+0000","last_peered":"2024-08-02T18:49:43.654895+0000","last_clean":"2024-08-02T18:49:43.654895+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:49:43.654895+0000","last_undegraded":"2024-08-02T18:49:43.654895+0000","last_fullsized":"2024-08-02T18:49:43.654895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826962+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:49:43.826962+0000","last_peered":"2024-08-02T18:49:43.826962+0000","last_clean":"2024-08-02T18:49:43.826962+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:49:43.826962+0000","last_undegraded":"2024-08-02T18:49:43.826962+0000","last_fullsized":"2024-08-02T18:49:43.826962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563270+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:49:43.563270+0000","last_peered":"2024-08-02T18:49:43.563270+0000","last_clean":"2024-08-02T18:49:43.563270+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:49:43.563270+0000","last_undegraded":"2024-08-02T18:49:43.563270+0000","last_fullsized":"2024-08-02T18:49:43.563270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921244+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:49:43.921244+0000","last_peered":"2024-08-02T18:49:43.921244+0000","last_clean":"2024-08-02T18:49:43.921244+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:49:43.921244+0000","last_undegraded":"2024-08-02T18:49:43.921244+0000","last_fullsized":"2024-08-02T18:49:43.921244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561546+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:49:43.561546+0000","last_peered":"2024-08-02T18:49:43.561546+0000","last_clean":"2024-08-02T18:49:43.561546+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:49:43.561546+0000","last_undegraded":"2024-08-02T18:49:43.561546+0000","last_fullsized":"2024-08-02T18:49:43.561546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921110+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:49:43.921110+0000","last_peered":"2024-08-02T18:49:43.921110+0000","last_clean":"2024-08-02T18:49:43.921110+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:49:43.921110+0000","last_undegraded":"2024-08-02T18:49:43.921110+0000","last_fullsized":"2024-08-02T18:49:43.921110+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608422+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:49:43.608422+0000","last_peered":"2024-08-02T18:49:43.608422+0000","last_clean":"2024-08-02T18:49:43.608422+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:49:43.608422+0000","last_undegraded":"2024-08-02T18:49:43.608422+0000","last_fullsized":"2024-08-02T18:49:43.608422+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656771+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:49:43.656771+0000","last_peered":"2024-08-02T18:49:43.656771+0000","last_clean":"2024-08-02T18:49:43.656771+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:49:43.656771+0000","last_undegraded":"2024-08-02T18:49:43.656771+0000","last_fullsized":"2024-08-02T18:49:43.656771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'40","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.837163+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:49:43.837163+0000","last_peered":"2024-08-02T18:49:43.837163+0000","last_clean":"2024-08-02T18:49:43.837163+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.837163+0000","last_undegraded":"2024-08-02T18:49:43.837163+0000","last_fullsized":"2024-08-02T18:49:43.837163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69709,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":213,"num_read_kb":175,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653988+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:49:43.653988+0000","last_peered":"2024-08-02T18:49:43.653988+0000","last_clean":"2024-08-02T18:49:43.653988+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:49:43.653988+0000","last_undegraded":"2024-08-02T18:49:43.653988+0000","last_fullsized":"2024-08-02T18:49:43.653988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562852+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:49:43.562852+0000","last_peered":"2024-08-02T18:49:43.562852+0000","last_clean":"2024-08-02T18:49:43.562852+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:49:43.562852+0000","last_undegraded":"2024-08-02T18:49:43.562852+0000","last_fullsized":"2024-08-02T18:49:43.562852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563483+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:49:43.563483+0000","last_peered":"2024-08-02T18:49:43.563483+0000","last_clean":"2024-08-02T18:49:43.563483+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:49:43.563483+0000","last_undegraded":"2024-08-02T18:49:43.563483+0000","last_fullsized":"2024-08-02T18:49:43.563483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609553+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:49:43.609553+0000","last_peered":"2024-08-02T18:49:43.609553+0000","last_clean":"2024-08-02T18:49:43.609553+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:49:43.609553+0000","last_undegraded":"2024-08-02T18:49:43.609553+0000","last_fullsized":"2024-08-02T18:49:43.609553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957173+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:49:43.957173+0000","last_peered":"2024-08-02T18:49:43.957173+0000","last_clean":"2024-08-02T18:49:43.957173+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:49:43.957173+0000","last_undegraded":"2024-08-02T18:49:43.957173+0000","last_fullsized":"2024-08-02T18:49:43.957173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827137+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:49:43.827137+0000","last_peered":"2024-08-02T18:49:43.827137+0000","last_clean":"2024-08-02T18:49:43.827137+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:49:43.827137+0000","last_undegraded":"2024-08-02T18:49:43.827137+0000","last_fullsized":"2024-08-02T18:49:43.827137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653660+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:49:43.653660+0000","last_peered":"2024-08-02T18:49:43.653660+0000","last_clean":"2024-08-02T18:49:43.653660+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:49:43.653660+0000","last_undegraded":"2024-08-02T18:49:43.653660+0000","last_fullsized":"2024-08-02T18:49:43.653660+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563205+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:49:43.563205+0000","last_peered":"2024-08-02T18:49:43.563205+0000","last_clean":"2024-08-02T18:49:43.563205+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:49:43.563205+0000","last_undegraded":"2024-08-02T18:49:43.563205+0000","last_fullsized":"2024-08-02T18:49:43.563205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":140,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608658+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:49:43.608658+0000","last_peered":"2024-08-02T18:49:43.608658+0000","last_clean":"2024-08-02T18:49:43.608658+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:49:43.608658+0000","last_undegraded":"2024-08-02T18:49:43.608658+0000","last_fullsized":"2024-08-02T18:49:43.608658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609051+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:49:43.609051+0000","last_peered":"2024-08-02T18:49:43.609051+0000","last_clean":"2024-08-02T18:49:43.609051+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:49:43.609051+0000","last_undegraded":"2024-08-02T18:49:43.609051+0000","last_fullsized":"2024-08-02T18:49:43.609051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956951+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:49:43.956951+0000","last_peered":"2024-08-02T18:49:43.956951+0000","last_clean":"2024-08-02T18:49:43.956951+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:49:43.956951+0000","last_undegraded":"2024-08-02T18:49:43.956951+0000","last_fullsized":"2024-08-02T18:49:43.956951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653898+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:49:43.653898+0000","last_peered":"2024-08-02T18:49:43.653898+0000","last_clean":"2024-08-02T18:49:43.653898+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:49:43.653898+0000","last_undegraded":"2024-08-02T18:49:43.653898+0000","last_fullsized":"2024-08-02T18:49:43.653898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563162+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:49:43.563162+0000","last_peered":"2024-08-02T18:49:43.563162+0000","last_clean":"2024-08-02T18:49:43.563162+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:49:43.563162+0000","last_undegraded":"2024-08-02T18:49:43.563162+0000","last_fullsized":"2024-08-02T18:49:43.563162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921505+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:49:43.921505+0000","last_peered":"2024-08-02T18:49:43.921505+0000","last_clean":"2024-08-02T18:49:43.921505+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:49:43.921505+0000","last_undegraded":"2024-08-02T18:49:43.921505+0000","last_fullsized":"2024-08-02T18:49:43.921505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609073+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:49:43.609073+0000","last_peered":"2024-08-02T18:49:43.609073+0000","last_clean":"2024-08-02T18:49:43.609073+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:49:43.609073+0000","last_undegraded":"2024-08-02T18:49:43.609073+0000","last_fullsized":"2024-08-02T18:49:43.609073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561163+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:49:43.561163+0000","last_peered":"2024-08-02T18:49:43.561163+0000","last_clean":"2024-08-02T18:49:43.561163+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:49:43.561163+0000","last_undegraded":"2024-08-02T18:49:43.561163+0000","last_fullsized":"2024-08-02T18:49:43.561163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608626+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:49:43.608626+0000","last_peered":"2024-08-02T18:49:43.608626+0000","last_clean":"2024-08-02T18:49:43.608626+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:49:43.608626+0000","last_undegraded":"2024-08-02T18:49:43.608626+0000","last_fullsized":"2024-08-02T18:49:43.608626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654071+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:49:43.654071+0000","last_peered":"2024-08-02T18:49:43.654071+0000","last_clean":"2024-08-02T18:49:43.654071+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:49:43.654071+0000","last_undegraded":"2024-08-02T18:49:43.654071+0000","last_fullsized":"2024-08-02T18:49:43.654071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829094+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:49:43.829094+0000","last_peered":"2024-08-02T18:49:43.829094+0000","last_clean":"2024-08-02T18:49:43.829094+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:49:43.829094+0000","last_undegraded":"2024-08-02T18:49:43.829094+0000","last_fullsized":"2024-08-02T18:49:43.829094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609582+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:49:43.609582+0000","last_peered":"2024-08-02T18:49:43.609582+0000","last_clean":"2024-08-02T18:49:43.609582+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:49:43.609582+0000","last_undegraded":"2024-08-02T18:49:43.609582+0000","last_fullsized":"2024-08-02T18:49:43.609582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656472+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:49:43.656472+0000","last_peered":"2024-08-02T18:49:43.656472+0000","last_clean":"2024-08-02T18:49:43.656472+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:49:43.656472+0000","last_undegraded":"2024-08-02T18:49:43.656472+0000","last_fullsized":"2024-08-02T18:49:43.656472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829250+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:49:43.829250+0000","last_peered":"2024-08-02T18:49:43.829250+0000","last_clean":"2024-08-02T18:49:43.829250+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:49:43.829250+0000","last_undegraded":"2024-08-02T18:49:43.829250+0000","last_fullsized":"2024-08-02T18:49:43.829250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921020+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:49:43.921020+0000","last_peered":"2024-08-02T18:49:43.921020+0000","last_clean":"2024-08-02T18:49:43.921020+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:49:43.921020+0000","last_undegraded":"2024-08-02T18:49:43.921020+0000","last_fullsized":"2024-08-02T18:49:43.921020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829253+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:49:43.829253+0000","last_peered":"2024-08-02T18:49:43.829253+0000","last_clean":"2024-08-02T18:49:43.829253+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:49:43.829253+0000","last_undegraded":"2024-08-02T18:49:43.829253+0000","last_fullsized":"2024-08-02T18:49:43.829253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829051+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:49:43.829051+0000","last_peered":"2024-08-02T18:49:43.829051+0000","last_clean":"2024-08-02T18:49:43.829051+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:49:43.829051+0000","last_undegraded":"2024-08-02T18:49:43.829051+0000","last_fullsized":"2024-08-02T18:49:43.829051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956830+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:49:43.956830+0000","last_peered":"2024-08-02T18:49:43.956830+0000","last_clean":"2024-08-02T18:49:43.956830+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:49:43.956830+0000","last_undegraded":"2024-08-02T18:49:43.956830+0000","last_fullsized":"2024-08-02T18:49:43.956830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561943+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:49:43.561943+0000","last_peered":"2024-08-02T18:49:43.561943+0000","last_clean":"2024-08-02T18:49:43.561943+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:49:43.561943+0000","last_undegraded":"2024-08-02T18:49:43.561943+0000","last_fullsized":"2024-08-02T18:49:43.561943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921458+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:49:43.921458+0000","last_peered":"2024-08-02T18:49:43.921458+0000","last_clean":"2024-08-02T18:49:43.921458+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:49:43.921458+0000","last_undegraded":"2024-08-02T18:49:43.921458+0000","last_fullsized":"2024-08-02T18:49:43.921458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829511+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:49:43.829511+0000","last_peered":"2024-08-02T18:49:43.829511+0000","last_clean":"2024-08-02T18:49:43.829511+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:49:43.829511+0000","last_undegraded":"2024-08-02T18:49:43.829511+0000","last_fullsized":"2024-08-02T18:49:43.829511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609765+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:49:43.609765+0000","last_peered":"2024-08-02T18:49:43.609765+0000","last_clean":"2024-08-02T18:49:43.609765+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:49:43.609765+0000","last_undegraded":"2024-08-02T18:49:43.609765+0000","last_fullsized":"2024-08-02T18:49:43.609765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562988+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:49:43.562988+0000","last_peered":"2024-08-02T18:49:43.562988+0000","last_clean":"2024-08-02T18:49:43.562988+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:49:43.562988+0000","last_undegraded":"2024-08-02T18:49:43.562988+0000","last_fullsized":"2024-08-02T18:49:43.562988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609160+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:49:43.609160+0000","last_peered":"2024-08-02T18:49:43.609160+0000","last_clean":"2024-08-02T18:49:43.609160+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:49:43.609160+0000","last_undegraded":"2024-08-02T18:49:43.609160+0000","last_fullsized":"2024-08-02T18:49:43.609160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562877+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:49:43.562877+0000","last_peered":"2024-08-02T18:49:43.562877+0000","last_clean":"2024-08-02T18:49:43.562877+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:49:43.562877+0000","last_undegraded":"2024-08-02T18:49:43.562877+0000","last_fullsized":"2024-08-02T18:49:43.562877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561703+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:49:43.561703+0000","last_peered":"2024-08-02T18:49:43.561703+0000","last_clean":"2024-08-02T18:49:43.561703+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:49:43.561703+0000","last_undegraded":"2024-08-02T18:49:43.561703+0000","last_fullsized":"2024-08-02T18:49:43.561703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921328+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:49:43.921328+0000","last_peered":"2024-08-02T18:49:43.921328+0000","last_clean":"2024-08-02T18:49:43.921328+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:49:43.921328+0000","last_undegraded":"2024-08-02T18:49:43.921328+0000","last_fullsized":"2024-08-02T18:49:43.921328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829407+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:49:43.829407+0000","last_peered":"2024-08-02T18:49:43.829407+0000","last_clean":"2024-08-02T18:49:43.829407+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:49:43.829407+0000","last_undegraded":"2024-08-02T18:49:43.829407+0000","last_fullsized":"2024-08-02T18:49:43.829407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654732+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:49:43.654732+0000","last_peered":"2024-08-02T18:49:43.654732+0000","last_clean":"2024-08-02T18:49:43.654732+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:49:43.654732+0000","last_undegraded":"2024-08-02T18:49:43.654732+0000","last_fullsized":"2024-08-02T18:49:43.654732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921678+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:49:43.921678+0000","last_peered":"2024-08-02T18:49:43.921678+0000","last_clean":"2024-08-02T18:49:43.921678+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:49:43.921678+0000","last_undegraded":"2024-08-02T18:49:43.921678+0000","last_fullsized":"2024-08-02T18:49:43.921678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562579+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:49:43.562579+0000","last_peered":"2024-08-02T18:49:43.562579+0000","last_clean":"2024-08-02T18:49:43.562579+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:49:43.562579+0000","last_undegraded":"2024-08-02T18:49:43.562579+0000","last_fullsized":"2024-08-02T18:49:43.562579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.955905+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:49:43.955905+0000","last_peered":"2024-08-02T18:49:43.955905+0000","last_clean":"2024-08-02T18:49:43.955905+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:49:43.955905+0000","last_undegraded":"2024-08-02T18:49:43.955905+0000","last_fullsized":"2024-08-02T18:49:43.955905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956586+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:49:43.956586+0000","last_peered":"2024-08-02T18:49:43.956586+0000","last_clean":"2024-08-02T18:49:43.956586+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:49:43.956586+0000","last_undegraded":"2024-08-02T18:49:43.956586+0000","last_fullsized":"2024-08-02T18:49:43.956586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561524+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:49:43.561524+0000","last_peered":"2024-08-02T18:49:43.561524+0000","last_clean":"2024-08-02T18:49:43.561524+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:49:43.561524+0000","last_undegraded":"2024-08-02T18:49:43.561524+0000","last_fullsized":"2024-08-02T18:49:43.561524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609731+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:49:43.609731+0000","last_peered":"2024-08-02T18:49:43.609731+0000","last_clean":"2024-08-02T18:49:43.609731+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:49:43.609731+0000","last_undegraded":"2024-08-02T18:49:43.609731+0000","last_fullsized":"2024-08-02T18:49:43.609731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827121+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:49:43.827121+0000","last_peered":"2024-08-02T18:49:43.827121+0000","last_clean":"2024-08-02T18:49:43.827121+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:49:43.827121+0000","last_undegraded":"2024-08-02T18:49:43.827121+0000","last_fullsized":"2024-08-02T18:49:43.827121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608795+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:49:43.608795+0000","last_peered":"2024-08-02T18:49:43.608795+0000","last_clean":"2024-08-02T18:49:43.608795+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:49:43.608795+0000","last_undegraded":"2024-08-02T18:49:43.608795+0000","last_fullsized":"2024-08-02T18:49:43.608795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563166+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:49:43.563166+0000","last_peered":"2024-08-02T18:49:43.563166+0000","last_clean":"2024-08-02T18:49:43.563166+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:49:43.563166+0000","last_undegraded":"2024-08-02T18:49:43.563166+0000","last_fullsized":"2024-08-02T18:49:43.563166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609065+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:49:43.609065+0000","last_peered":"2024-08-02T18:49:43.609065+0000","last_clean":"2024-08-02T18:49:43.609065+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:49:43.609065+0000","last_undegraded":"2024-08-02T18:49:43.609065+0000","last_fullsized":"2024-08-02T18:49:43.609065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826709+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:49:43.826709+0000","last_peered":"2024-08-02T18:49:43.826709+0000","last_clean":"2024-08-02T18:49:43.826709+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:49:43.826709+0000","last_undegraded":"2024-08-02T18:49:43.826709+0000","last_fullsized":"2024-08-02T18:49:43.826709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608483+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:49:43.608483+0000","last_peered":"2024-08-02T18:49:43.608483+0000","last_clean":"2024-08-02T18:49:43.608483+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:49:43.608483+0000","last_undegraded":"2024-08-02T18:49:43.608483+0000","last_fullsized":"2024-08-02T18:49:43.608483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656457+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:49:43.656457+0000","last_peered":"2024-08-02T18:49:43.656457+0000","last_clean":"2024-08-02T18:49:43.656457+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:49:43.656457+0000","last_undegraded":"2024-08-02T18:49:43.656457+0000","last_fullsized":"2024-08-02T18:49:43.656457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654397+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:49:43.654397+0000","last_peered":"2024-08-02T18:49:43.654397+0000","last_clean":"2024-08-02T18:49:43.654397+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:49:43.654397+0000","last_undegraded":"2024-08-02T18:49:43.654397+0000","last_fullsized":"2024-08-02T18:49:43.654397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956825+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:49:43.956825+0000","last_peered":"2024-08-02T18:49:43.956825+0000","last_clean":"2024-08-02T18:49:43.956825+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:49:43.956825+0000","last_undegraded":"2024-08-02T18:49:43.956825+0000","last_fullsized":"2024-08-02T18:49:43.956825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956976+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:49:43.956976+0000","last_peered":"2024-08-02T18:49:43.956976+0000","last_clean":"2024-08-02T18:49:43.956976+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:49:43.956976+0000","last_undegraded":"2024-08-02T18:49:43.956976+0000","last_fullsized":"2024-08-02T18:49:43.956976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921644+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:49:43.921644+0000","last_peered":"2024-08-02T18:49:43.921644+0000","last_clean":"2024-08-02T18:49:43.921644+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:49:43.921644+0000","last_undegraded":"2024-08-02T18:49:43.921644+0000","last_fullsized":"2024-08-02T18:49:43.921644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600144,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":729,"num_read_kb":476,"num_write":301,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1800432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547242,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":499721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28832,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716320,"statfs":{"total":95995035648,"available":95965511680,"internally_reserved":0,"allocated":1859584,"data_stored":1299160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1441792,"data_stored":907043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168632,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1437696,"data_stored":902867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397565,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1638400,"data_stored":1107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":504907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28756,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716396,"statfs":{"total":95995035648,"available":95965589504,"internally_reserved":0,"allocated":1781760,"data_stored":1233278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":510645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1564672,"data_stored":1029917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":576763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":574526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1048576,"data_stored":506295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":203975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:49:47.019 INFO:tasks.fwd_scrub.ceph_manager:clean! 2024-08-02T18:49:47.019 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-08-02T18:49:47.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 -- 172.21.15.103:0/1971151679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2674107540 msgr2=0x7f26741099b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:47.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 --2- 172.21.15.103:0/1971151679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2674107540 0x7f26741099b0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f266c009ca0 tx=0x7f266c02a8c0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 -- 172.21.15.103:0/1971151679 shutdown_connections 2024-08-02T18:49:47.159 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 --2- 172.21.15.103:0/1971151679 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2674107540 0x7f26741099b0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 --2- 172.21.15.103:0/1971151679 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2674104c10 0x7f2674107000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 --2- 172.21.15.103:0/1971151679 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f26741022e0 0x7f26741046d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 -- 172.21.15.103:0/1971151679 >> 172.21.15.103:0/1971151679 conn(0x7f26740fbee0 msgr2=0x7f26740fe300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 -- 172.21.15.103:0/1971151679 shutdown_connections 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 -- 172.21.15.103:0/1971151679 wait complete. 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.155+0000 7f2679565640 1 Processor -- start 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2679565640 1 -- start start 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2679565640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26741022e0 0x7f2674197c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2679565640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2674104c10 0x7f26741981a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2679565640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2674107540 0x7f267419f1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2679565640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f267410d650 con 0x7f26741022e0 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2679565640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f267410d4d0 con 0x7f2674107540 2024-08-02T18:49:47.160 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2679565640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f267410d7d0 con 0x7f2674104c10 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26741022e0 0x7f2674197c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26741022e0 0x7f2674197c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52172/0 (socket says 172.21.15.103:52172) 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f26727fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2674104c10 0x7f26741981a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 -- 172.21.15.103:0/2564991345 learned_addr learned my addr 172.21.15.103:0/2564991345 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f26737fe640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2674107540 0x7f267419f1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 -- 172.21.15.103:0/2564991345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2674104c10 msgr2=0x7f26741981a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2674104c10 0x7f26741981a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 -- 172.21.15.103:0/2564991345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2674107540 msgr2=0x7f267419f1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2674107540 0x7f267419f1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 -- 172.21.15.103:0/2564991345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f267419f870 con 0x7f26741022e0 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f26727fc640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2674104c10 0x7f26741981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f2672ffd640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26741022e0 0x7f2674197c60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f266400d950 tx=0x7f266400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:47.161 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.156+0000 7f265bfff640 1 -- 172.21.15.103:0/2564991345 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664017030 con 0x7f26741022e0 2024-08-02T18:49:47.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.157+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f267419fb60 con 0x7f26741022e0 2024-08-02T18:49:47.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.157+0000 7f265bfff640 1 -- 172.21.15.103:0/2564991345 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2664004020 con 0x7f26741022e0 2024-08-02T18:49:47.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.157+0000 7f265bfff640 1 -- 172.21.15.103:0/2564991345 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2664004a00 con 0x7f26741022e0 2024-08-02T18:49:47.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.157+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26741a00b0 con 0x7f26741022e0 2024-08-02T18:49:47.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.158+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26740fd9d0 con 0x7f26741022e0 2024-08-02T18:49:47.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.159+0000 7f265bfff640 1 -- 172.21.15.103:0/2564991345 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 23) ==== 137954+0+0 (secure 0 0 0) 0x7f26640041d0 con 0x7f26741022e0 2024-08-02T18:49:47.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.159+0000 7f265bfff640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f265c0a2d00 0x7f265c0a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:47.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.159+0000 7f26727fc640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f265c0a2d00 0x7f265c0a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:47.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.159+0000 7f265bfff640 1 -- 172.21.15.103:0/2564991345 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f26640cf240 con 0x7f26741022e0 2024-08-02T18:49:47.163 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.160+0000 7f26727fc640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f265c0a2d00 0x7f265c0a51c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f267406ac30 tx=0x7f2668005f90 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:47.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.163+0000 7f265bfff640 1 -- 172.21.15.103:0/2564991345 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f266409bb20 con 0x7f26741022e0 2024-08-02T18:49:47.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.350+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2674062360 con 0x7f265c0a2d00 2024-08-02T18:49:47.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.358+0000 7f265bfff640 1 -- 172.21.15.103:0/2564991345 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339434 (secure 0 0 0) 0x7f2674062360 con 0x7f265c0a2d00 2024-08-02T18:49:47.364 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:47.366 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f265c0a2d00 msgr2=0x7f265c0a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f265c0a2d00 0x7f265c0a51c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f267406ac30 tx=0x7f2668005f90 comp rx=0 tx=0).stop 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26741022e0 msgr2=0x7f2674197c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26741022e0 0x7f2674197c60 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f266400d950 tx=0x7f266400de10 comp rx=0 tx=0).stop 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 shutdown_connections 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f265c0a2d00 0x7f265c0a51c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2674107540 0x7f267419f1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2674104c10 0x7f26741981a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.368 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 --2- 172.21.15.103:0/2564991345 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f26741022e0 0x7f2674197c60 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:47.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 >> 172.21.15.103:0/2564991345 conn(0x7f26740fbee0 msgr2=0x7f2674102b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:47.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 shutdown_connections 2024-08-02T18:49:47.369 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:47.363+0000 7f2679565640 1 -- 172.21.15.103:0/2564991345 wait complete. 2024-08-02T18:49:47.377 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":4,"stamp":"2024-08-02T18:49:45.574836+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190746,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":865,"num_read_kb":595,"num_write":484,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":874,"ondisk_log_size":874,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377352,"kb_used_data":15688,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564472,"statfs":{"total":1151940427776,"available":1151554019328,"internally_reserved":0,"allocated":16064512,"data_stored":9652300,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.986236"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.655030+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:49:43.655030+0000","last_peered":"2024-08-02T18:49:43.655030+0000","last_clean":"2024-08-02T18:49:43.655030+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:49:43.655030+0000","last_undegraded":"2024-08-02T18:49:43.655030+0000","last_fullsized":"2024-08-02T18:49:43.655030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654228+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:49:43.654228+0000","last_peered":"2024-08-02T18:49:43.654228+0000","last_clean":"2024-08-02T18:49:43.654228+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:49:43.654228+0000","last_undegraded":"2024-08-02T18:49:43.654228+0000","last_fullsized":"2024-08-02T18:49:43.654228+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828991+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:49:43.828991+0000","last_peered":"2024-08-02T18:49:43.828991+0000","last_clean":"2024-08-02T18:49:43.828991+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:49:43.828991+0000","last_undegraded":"2024-08-02T18:49:43.828991+0000","last_fullsized":"2024-08-02T18:49:43.828991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609787+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:49:43.609787+0000","last_peered":"2024-08-02T18:49:43.609787+0000","last_clean":"2024-08-02T18:49:43.609787+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:49:43.609787+0000","last_undegraded":"2024-08-02T18:49:43.609787+0000","last_fullsized":"2024-08-02T18:49:43.609787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957153+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:49:43.957153+0000","last_peered":"2024-08-02T18:49:43.957153+0000","last_clean":"2024-08-02T18:49:43.957153+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:49:43.957153+0000","last_undegraded":"2024-08-02T18:49:43.957153+0000","last_fullsized":"2024-08-02T18:49:43.957153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609177+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:49:43.609177+0000","last_peered":"2024-08-02T18:49:43.609177+0000","last_clean":"2024-08-02T18:49:43.609177+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:49:43.609177+0000","last_undegraded":"2024-08-02T18:49:43.609177+0000","last_fullsized":"2024-08-02T18:49:43.609177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921278+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:49:43.921278+0000","last_peered":"2024-08-02T18:49:43.921278+0000","last_clean":"2024-08-02T18:49:43.921278+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:49:43.921278+0000","last_undegraded":"2024-08-02T18:49:43.921278+0000","last_fullsized":"2024-08-02T18:49:43.921278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562754+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:49:43.562754+0000","last_peered":"2024-08-02T18:49:43.562754+0000","last_clean":"2024-08-02T18:49:43.562754+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:49:43.562754+0000","last_undegraded":"2024-08-02T18:49:43.562754+0000","last_fullsized":"2024-08-02T18:49:43.562754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609407+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:49:43.609407+0000","last_peered":"2024-08-02T18:49:43.609407+0000","last_clean":"2024-08-02T18:49:43.609407+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:49:43.609407+0000","last_undegraded":"2024-08-02T18:49:43.609407+0000","last_fullsized":"2024-08-02T18:49:43.609407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656769+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:49:43.656769+0000","last_peered":"2024-08-02T18:49:43.656769+0000","last_clean":"2024-08-02T18:49:43.656769+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:49:43.656769+0000","last_undegraded":"2024-08-02T18:49:43.656769+0000","last_fullsized":"2024-08-02T18:49:43.656769+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563340+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:49:43.563340+0000","last_peered":"2024-08-02T18:49:43.563340+0000","last_clean":"2024-08-02T18:49:43.563340+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:49:43.563340+0000","last_undegraded":"2024-08-02T18:49:43.563340+0000","last_fullsized":"2024-08-02T18:49:43.563340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609317+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:49:43.609317+0000","last_peered":"2024-08-02T18:49:43.609317+0000","last_clean":"2024-08-02T18:49:43.609317+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:49:43.609317+0000","last_undegraded":"2024-08-02T18:49:43.609317+0000","last_fullsized":"2024-08-02T18:49:43.609317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826836+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:49:43.826836+0000","last_peered":"2024-08-02T18:49:43.826836+0000","last_clean":"2024-08-02T18:49:43.826836+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:49:43.826836+0000","last_undegraded":"2024-08-02T18:49:43.826836+0000","last_fullsized":"2024-08-02T18:49:43.826836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656491+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:49:43.656491+0000","last_peered":"2024-08-02T18:49:43.656491+0000","last_clean":"2024-08-02T18:49:43.656491+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:49:43.656491+0000","last_undegraded":"2024-08-02T18:49:43.656491+0000","last_fullsized":"2024-08-02T18:49:43.656491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609487+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:49:43.609487+0000","last_peered":"2024-08-02T18:49:43.609487+0000","last_clean":"2024-08-02T18:49:43.609487+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:49:43.609487+0000","last_undegraded":"2024-08-02T18:49:43.609487+0000","last_fullsized":"2024-08-02T18:49:43.609487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609390+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:49:43.609390+0000","last_peered":"2024-08-02T18:49:43.609390+0000","last_clean":"2024-08-02T18:49:43.609390+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:49:43.609390+0000","last_undegraded":"2024-08-02T18:49:43.609390+0000","last_fullsized":"2024-08-02T18:49:43.609390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829268+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:49:43.829268+0000","last_peered":"2024-08-02T18:49:43.829268+0000","last_clean":"2024-08-02T18:49:43.829268+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:49:43.829268+0000","last_undegraded":"2024-08-02T18:49:43.829268+0000","last_fullsized":"2024-08-02T18:49:43.829268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609555+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:49:43.609555+0000","last_peered":"2024-08-02T18:49:43.609555+0000","last_clean":"2024-08-02T18:49:43.609555+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:49:43.609555+0000","last_undegraded":"2024-08-02T18:49:43.609555+0000","last_fullsized":"2024-08-02T18:49:43.609555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921113+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:49:43.921113+0000","last_peered":"2024-08-02T18:49:43.921113+0000","last_clean":"2024-08-02T18:49:43.921113+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:49:43.921113+0000","last_undegraded":"2024-08-02T18:49:43.921113+0000","last_fullsized":"2024-08-02T18:49:43.921113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609233+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:49:43.609233+0000","last_peered":"2024-08-02T18:49:43.609233+0000","last_clean":"2024-08-02T18:49:43.609233+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:49:43.609233+0000","last_undegraded":"2024-08-02T18:49:43.609233+0000","last_fullsized":"2024-08-02T18:49:43.609233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654077+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:49:43.654077+0000","last_peered":"2024-08-02T18:49:43.654077+0000","last_clean":"2024-08-02T18:49:43.654077+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:49:43.654077+0000","last_undegraded":"2024-08-02T18:49:43.654077+0000","last_fullsized":"2024-08-02T18:49:43.654077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656381+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:49:43.656381+0000","last_peered":"2024-08-02T18:49:43.656381+0000","last_clean":"2024-08-02T18:49:43.656381+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:49:43.656381+0000","last_undegraded":"2024-08-02T18:49:43.656381+0000","last_fullsized":"2024-08-02T18:49:43.656381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562686+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:49:43.562686+0000","last_peered":"2024-08-02T18:49:43.562686+0000","last_clean":"2024-08-02T18:49:43.562686+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:49:43.562686+0000","last_undegraded":"2024-08-02T18:49:43.562686+0000","last_fullsized":"2024-08-02T18:49:43.562686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609606+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:49:43.609606+0000","last_peered":"2024-08-02T18:49:43.609606+0000","last_clean":"2024-08-02T18:49:43.609606+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:49:43.609606+0000","last_undegraded":"2024-08-02T18:49:43.609606+0000","last_fullsized":"2024-08-02T18:49:43.609606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957022+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:49:43.957022+0000","last_peered":"2024-08-02T18:49:43.957022+0000","last_clean":"2024-08-02T18:49:43.957022+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:49:43.957022+0000","last_undegraded":"2024-08-02T18:49:43.957022+0000","last_fullsized":"2024-08-02T18:49:43.957022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609883+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:49:43.609883+0000","last_peered":"2024-08-02T18:49:43.609883+0000","last_clean":"2024-08-02T18:49:43.609883+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:49:43.609883+0000","last_undegraded":"2024-08-02T18:49:43.609883+0000","last_fullsized":"2024-08-02T18:49:43.609883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828996+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:49:43.828996+0000","last_peered":"2024-08-02T18:49:43.828996+0000","last_clean":"2024-08-02T18:49:43.828996+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:49:43.828996+0000","last_undegraded":"2024-08-02T18:49:43.828996+0000","last_fullsized":"2024-08-02T18:49:43.828996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609859+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:49:43.609859+0000","last_peered":"2024-08-02T18:49:43.609859+0000","last_clean":"2024-08-02T18:49:43.609859+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:49:43.609859+0000","last_undegraded":"2024-08-02T18:49:43.609859+0000","last_fullsized":"2024-08-02T18:49:43.609859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'48","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.787197+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:49:43.787197+0000","last_peered":"2024-08-02T18:49:43.787197+0000","last_clean":"2024-08-02T18:49:43.787197+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:49:43.787197+0000","last_undegraded":"2024-08-02T18:49:43.787197+0000","last_fullsized":"2024-08-02T18:49:43.787197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608943+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:49:43.608943+0000","last_peered":"2024-08-02T18:49:43.608943+0000","last_clean":"2024-08-02T18:49:43.608943+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:49:43.608943+0000","last_undegraded":"2024-08-02T18:49:43.608943+0000","last_fullsized":"2024-08-02T18:49:43.608943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561962+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:49:43.561962+0000","last_peered":"2024-08-02T18:49:43.561962+0000","last_clean":"2024-08-02T18:49:43.561962+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:49:43.561962+0000","last_undegraded":"2024-08-02T18:49:43.561962+0000","last_fullsized":"2024-08-02T18:49:43.561962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656835+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:49:43.656835+0000","last_peered":"2024-08-02T18:49:43.656835+0000","last_clean":"2024-08-02T18:49:43.656835+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:49:43.656835+0000","last_undegraded":"2024-08-02T18:49:43.656835+0000","last_fullsized":"2024-08-02T18:49:43.656835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921219+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:49:43.921219+0000","last_peered":"2024-08-02T18:49:43.921219+0000","last_clean":"2024-08-02T18:49:43.921219+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:49:43.921219+0000","last_undegraded":"2024-08-02T18:49:43.921219+0000","last_fullsized":"2024-08-02T18:49:43.921219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608457+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:49:43.608457+0000","last_peered":"2024-08-02T18:49:43.608457+0000","last_clean":"2024-08-02T18:49:43.608457+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:49:43.608457+0000","last_undegraded":"2024-08-02T18:49:43.608457+0000","last_fullsized":"2024-08-02T18:49:43.608457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654589+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:49:43.654589+0000","last_peered":"2024-08-02T18:49:43.654589+0000","last_clean":"2024-08-02T18:49:43.654589+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:49:43.654589+0000","last_undegraded":"2024-08-02T18:49:43.654589+0000","last_fullsized":"2024-08-02T18:49:43.654589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656388+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:49:43.656388+0000","last_peered":"2024-08-02T18:49:43.656388+0000","last_clean":"2024-08-02T18:49:43.656388+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:49:43.656388+0000","last_undegraded":"2024-08-02T18:49:43.656388+0000","last_fullsized":"2024-08-02T18:49:43.656388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608451+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:49:43.608451+0000","last_peered":"2024-08-02T18:49:43.608451+0000","last_clean":"2024-08-02T18:49:43.608451+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:49:43.608451+0000","last_undegraded":"2024-08-02T18:49:43.608451+0000","last_fullsized":"2024-08-02T18:49:43.608451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826989+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:49:43.826989+0000","last_peered":"2024-08-02T18:49:43.826989+0000","last_clean":"2024-08-02T18:49:43.826989+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:49:43.826989+0000","last_undegraded":"2024-08-02T18:49:43.826989+0000","last_fullsized":"2024-08-02T18:49:43.826989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561871+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:49:43.561871+0000","last_peered":"2024-08-02T18:49:43.561871+0000","last_clean":"2024-08-02T18:49:43.561871+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:49:43.561871+0000","last_undegraded":"2024-08-02T18:49:43.561871+0000","last_fullsized":"2024-08-02T18:49:43.561871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562994+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:49:43.562994+0000","last_peered":"2024-08-02T18:49:43.562994+0000","last_clean":"2024-08-02T18:49:43.562994+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:49:43.562994+0000","last_undegraded":"2024-08-02T18:49:43.562994+0000","last_fullsized":"2024-08-02T18:49:43.562994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":142,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561327+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:49:43.561327+0000","last_peered":"2024-08-02T18:49:43.561327+0000","last_clean":"2024-08-02T18:49:43.561327+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:49:43.561327+0000","last_undegraded":"2024-08-02T18:49:43.561327+0000","last_fullsized":"2024-08-02T18:49:43.561327+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562217+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:49:43.562217+0000","last_peered":"2024-08-02T18:49:43.562217+0000","last_clean":"2024-08-02T18:49:43.562217+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:49:43.562217+0000","last_undegraded":"2024-08-02T18:49:43.562217+0000","last_fullsized":"2024-08-02T18:49:43.562217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561158+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:49:43.561158+0000","last_peered":"2024-08-02T18:49:43.561158+0000","last_clean":"2024-08-02T18:49:43.561158+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:49:43.561158+0000","last_undegraded":"2024-08-02T18:49:43.561158+0000","last_fullsized":"2024-08-02T18:49:43.561158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826778+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:49:43.826778+0000","last_peered":"2024-08-02T18:49:43.826778+0000","last_clean":"2024-08-02T18:49:43.826778+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.826778+0000","last_undegraded":"2024-08-02T18:49:43.826778+0000","last_fullsized":"2024-08-02T18:49:43.826778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563541+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:49:43.563541+0000","last_peered":"2024-08-02T18:49:43.563541+0000","last_clean":"2024-08-02T18:49:43.563541+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:49:43.563541+0000","last_undegraded":"2024-08-02T18:49:43.563541+0000","last_fullsized":"2024-08-02T18:49:43.563541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609341+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:49:43.609341+0000","last_peered":"2024-08-02T18:49:43.609341+0000","last_clean":"2024-08-02T18:49:43.609341+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:49:43.609341+0000","last_undegraded":"2024-08-02T18:49:43.609341+0000","last_fullsized":"2024-08-02T18:49:43.609341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609676+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:49:43.609676+0000","last_peered":"2024-08-02T18:49:43.609676+0000","last_clean":"2024-08-02T18:49:43.609676+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:49:43.609676+0000","last_undegraded":"2024-08-02T18:49:43.609676+0000","last_fullsized":"2024-08-02T18:49:43.609676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"21'137","reported_seq":360,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826926+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:49:43.826926+0000","last_peered":"2024-08-02T18:49:43.826926+0000","last_clean":"2024-08-02T18:49:43.826926+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:49:43.826926+0000","last_undegraded":"2024-08-02T18:49:43.826926+0000","last_fullsized":"2024-08-02T18:49:43.826926+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827013+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:49:43.827013+0000","last_peered":"2024-08-02T18:49:43.827013+0000","last_clean":"2024-08-02T18:49:43.827013+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:49:43.827013+0000","last_undegraded":"2024-08-02T18:49:43.827013+0000","last_fullsized":"2024-08-02T18:49:43.827013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827183+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:49:43.827183+0000","last_peered":"2024-08-02T18:49:43.827183+0000","last_clean":"2024-08-02T18:49:43.827183+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:49:43.827183+0000","last_undegraded":"2024-08-02T18:49:43.827183+0000","last_fullsized":"2024-08-02T18:49:43.827183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829351+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:49:43.829351+0000","last_peered":"2024-08-02T18:49:43.829351+0000","last_clean":"2024-08-02T18:49:43.829351+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:49:43.829351+0000","last_undegraded":"2024-08-02T18:49:43.829351+0000","last_fullsized":"2024-08-02T18:49:43.829351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562654+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:49:43.562654+0000","last_peered":"2024-08-02T18:49:43.562654+0000","last_clean":"2024-08-02T18:49:43.562654+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:49:43.562654+0000","last_undegraded":"2024-08-02T18:49:43.562654+0000","last_fullsized":"2024-08-02T18:49:43.562654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826971+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:49:43.826971+0000","last_peered":"2024-08-02T18:49:43.826971+0000","last_clean":"2024-08-02T18:49:43.826971+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:49:43.826971+0000","last_undegraded":"2024-08-02T18:49:43.826971+0000","last_fullsized":"2024-08-02T18:49:43.826971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'39","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.783745+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:49:43.783745+0000","last_peered":"2024-08-02T18:49:43.783745+0000","last_clean":"2024-08-02T18:49:43.783745+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:49:43.783745+0000","last_undegraded":"2024-08-02T18:49:43.783745+0000","last_fullsized":"2024-08-02T18:49:43.783745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956875+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:49:43.956875+0000","last_peered":"2024-08-02T18:49:43.956875+0000","last_clean":"2024-08-02T18:49:43.956875+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:49:43.956875+0000","last_undegraded":"2024-08-02T18:49:43.956875+0000","last_fullsized":"2024-08-02T18:49:43.956875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827238+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:49:43.827238+0000","last_peered":"2024-08-02T18:49:43.827238+0000","last_clean":"2024-08-02T18:49:43.827238+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:49:43.827238+0000","last_undegraded":"2024-08-02T18:49:43.827238+0000","last_fullsized":"2024-08-02T18:49:43.827238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562375+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:49:43.562375+0000","last_peered":"2024-08-02T18:49:43.562375+0000","last_clean":"2024-08-02T18:49:43.562375+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:49:43.562375+0000","last_undegraded":"2024-08-02T18:49:43.562375+0000","last_fullsized":"2024-08-02T18:49:43.562375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562856+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:49:43.562856+0000","last_peered":"2024-08-02T18:49:43.562856+0000","last_clean":"2024-08-02T18:49:43.562856+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:49:43.562856+0000","last_undegraded":"2024-08-02T18:49:43.562856+0000","last_fullsized":"2024-08-02T18:49:43.562856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921519+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:49:43.921519+0000","last_peered":"2024-08-02T18:49:43.921519+0000","last_clean":"2024-08-02T18:49:43.921519+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:49:43.921519+0000","last_undegraded":"2024-08-02T18:49:43.921519+0000","last_fullsized":"2024-08-02T18:49:43.921519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656937+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:49:43.656937+0000","last_peered":"2024-08-02T18:49:43.656937+0000","last_clean":"2024-08-02T18:49:43.656937+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:49:43.656937+0000","last_undegraded":"2024-08-02T18:49:43.656937+0000","last_fullsized":"2024-08-02T18:49:43.656937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562946+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:49:43.562946+0000","last_peered":"2024-08-02T18:49:43.562946+0000","last_clean":"2024-08-02T18:49:43.562946+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:49:43.562946+0000","last_undegraded":"2024-08-02T18:49:43.562946+0000","last_fullsized":"2024-08-02T18:49:43.562946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563145+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:49:43.563145+0000","last_peered":"2024-08-02T18:49:43.563145+0000","last_clean":"2024-08-02T18:49:43.563145+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:49:43.563145+0000","last_undegraded":"2024-08-02T18:49:43.563145+0000","last_fullsized":"2024-08-02T18:49:43.563145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656450+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:49:43.656450+0000","last_peered":"2024-08-02T18:49:43.656450+0000","last_clean":"2024-08-02T18:49:43.656450+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:49:43.656450+0000","last_undegraded":"2024-08-02T18:49:43.656450+0000","last_fullsized":"2024-08-02T18:49:43.656450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562360+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:49:43.562360+0000","last_peered":"2024-08-02T18:49:43.562360+0000","last_clean":"2024-08-02T18:49:43.562360+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:49:43.562360+0000","last_undegraded":"2024-08-02T18:49:43.562360+0000","last_fullsized":"2024-08-02T18:49:43.562360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826765+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:49:43.826765+0000","last_peered":"2024-08-02T18:49:43.826765+0000","last_clean":"2024-08-02T18:49:43.826765+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:49:43.826765+0000","last_undegraded":"2024-08-02T18:49:43.826765+0000","last_fullsized":"2024-08-02T18:49:43.826765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.833753+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:49:43.833753+0000","last_peered":"2024-08-02T18:49:43.833753+0000","last_clean":"2024-08-02T18:49:43.833753+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:49:43.833753+0000","last_undegraded":"2024-08-02T18:49:43.833753+0000","last_fullsized":"2024-08-02T18:49:43.833753+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1676,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654895+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:49:43.654895+0000","last_peered":"2024-08-02T18:49:43.654895+0000","last_clean":"2024-08-02T18:49:43.654895+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:49:43.654895+0000","last_undegraded":"2024-08-02T18:49:43.654895+0000","last_fullsized":"2024-08-02T18:49:43.654895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826962+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:49:43.826962+0000","last_peered":"2024-08-02T18:49:43.826962+0000","last_clean":"2024-08-02T18:49:43.826962+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:49:43.826962+0000","last_undegraded":"2024-08-02T18:49:43.826962+0000","last_fullsized":"2024-08-02T18:49:43.826962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563270+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:49:43.563270+0000","last_peered":"2024-08-02T18:49:43.563270+0000","last_clean":"2024-08-02T18:49:43.563270+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:49:43.563270+0000","last_undegraded":"2024-08-02T18:49:43.563270+0000","last_fullsized":"2024-08-02T18:49:43.563270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921244+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:49:43.921244+0000","last_peered":"2024-08-02T18:49:43.921244+0000","last_clean":"2024-08-02T18:49:43.921244+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:49:43.921244+0000","last_undegraded":"2024-08-02T18:49:43.921244+0000","last_fullsized":"2024-08-02T18:49:43.921244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561546+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:49:43.561546+0000","last_peered":"2024-08-02T18:49:43.561546+0000","last_clean":"2024-08-02T18:49:43.561546+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:49:43.561546+0000","last_undegraded":"2024-08-02T18:49:43.561546+0000","last_fullsized":"2024-08-02T18:49:43.561546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921110+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:49:43.921110+0000","last_peered":"2024-08-02T18:49:43.921110+0000","last_clean":"2024-08-02T18:49:43.921110+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:49:43.921110+0000","last_undegraded":"2024-08-02T18:49:43.921110+0000","last_fullsized":"2024-08-02T18:49:43.921110+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608422+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:49:43.608422+0000","last_peered":"2024-08-02T18:49:43.608422+0000","last_clean":"2024-08-02T18:49:43.608422+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:49:43.608422+0000","last_undegraded":"2024-08-02T18:49:43.608422+0000","last_fullsized":"2024-08-02T18:49:43.608422+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656771+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:49:43.656771+0000","last_peered":"2024-08-02T18:49:43.656771+0000","last_clean":"2024-08-02T18:49:43.656771+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:49:43.656771+0000","last_undegraded":"2024-08-02T18:49:43.656771+0000","last_fullsized":"2024-08-02T18:49:43.656771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'40","reported_seq":289,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.837163+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:49:43.837163+0000","last_peered":"2024-08-02T18:49:43.837163+0000","last_clean":"2024-08-02T18:49:43.837163+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.837163+0000","last_undegraded":"2024-08-02T18:49:43.837163+0000","last_fullsized":"2024-08-02T18:49:43.837163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69709,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":213,"num_read_kb":175,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653988+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:49:43.653988+0000","last_peered":"2024-08-02T18:49:43.653988+0000","last_clean":"2024-08-02T18:49:43.653988+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:49:43.653988+0000","last_undegraded":"2024-08-02T18:49:43.653988+0000","last_fullsized":"2024-08-02T18:49:43.653988+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562852+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:49:43.562852+0000","last_peered":"2024-08-02T18:49:43.562852+0000","last_clean":"2024-08-02T18:49:43.562852+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:49:43.562852+0000","last_undegraded":"2024-08-02T18:49:43.562852+0000","last_fullsized":"2024-08-02T18:49:43.562852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563483+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:49:43.563483+0000","last_peered":"2024-08-02T18:49:43.563483+0000","last_clean":"2024-08-02T18:49:43.563483+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:49:43.563483+0000","last_undegraded":"2024-08-02T18:49:43.563483+0000","last_fullsized":"2024-08-02T18:49:43.563483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609553+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:49:43.609553+0000","last_peered":"2024-08-02T18:49:43.609553+0000","last_clean":"2024-08-02T18:49:43.609553+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:49:43.609553+0000","last_undegraded":"2024-08-02T18:49:43.609553+0000","last_fullsized":"2024-08-02T18:49:43.609553+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957173+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:49:43.957173+0000","last_peered":"2024-08-02T18:49:43.957173+0000","last_clean":"2024-08-02T18:49:43.957173+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:49:43.957173+0000","last_undegraded":"2024-08-02T18:49:43.957173+0000","last_fullsized":"2024-08-02T18:49:43.957173+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827137+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:49:43.827137+0000","last_peered":"2024-08-02T18:49:43.827137+0000","last_clean":"2024-08-02T18:49:43.827137+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:49:43.827137+0000","last_undegraded":"2024-08-02T18:49:43.827137+0000","last_fullsized":"2024-08-02T18:49:43.827137+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653660+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:49:43.653660+0000","last_peered":"2024-08-02T18:49:43.653660+0000","last_clean":"2024-08-02T18:49:43.653660+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:49:43.653660+0000","last_undegraded":"2024-08-02T18:49:43.653660+0000","last_fullsized":"2024-08-02T18:49:43.653660+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563205+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:49:43.563205+0000","last_peered":"2024-08-02T18:49:43.563205+0000","last_clean":"2024-08-02T18:49:43.563205+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:49:43.563205+0000","last_undegraded":"2024-08-02T18:49:43.563205+0000","last_fullsized":"2024-08-02T18:49:43.563205+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":140,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608658+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:49:43.608658+0000","last_peered":"2024-08-02T18:49:43.608658+0000","last_clean":"2024-08-02T18:49:43.608658+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:49:43.608658+0000","last_undegraded":"2024-08-02T18:49:43.608658+0000","last_fullsized":"2024-08-02T18:49:43.608658+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":101,"num_read_kb":101,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609051+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:49:43.609051+0000","last_peered":"2024-08-02T18:49:43.609051+0000","last_clean":"2024-08-02T18:49:43.609051+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:49:43.609051+0000","last_undegraded":"2024-08-02T18:49:43.609051+0000","last_fullsized":"2024-08-02T18:49:43.609051+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956951+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:49:43.956951+0000","last_peered":"2024-08-02T18:49:43.956951+0000","last_clean":"2024-08-02T18:49:43.956951+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:49:43.956951+0000","last_undegraded":"2024-08-02T18:49:43.956951+0000","last_fullsized":"2024-08-02T18:49:43.956951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653898+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:49:43.653898+0000","last_peered":"2024-08-02T18:49:43.653898+0000","last_clean":"2024-08-02T18:49:43.653898+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:49:43.653898+0000","last_undegraded":"2024-08-02T18:49:43.653898+0000","last_fullsized":"2024-08-02T18:49:43.653898+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563162+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:49:43.563162+0000","last_peered":"2024-08-02T18:49:43.563162+0000","last_clean":"2024-08-02T18:49:43.563162+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:49:43.563162+0000","last_undegraded":"2024-08-02T18:49:43.563162+0000","last_fullsized":"2024-08-02T18:49:43.563162+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921505+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:49:43.921505+0000","last_peered":"2024-08-02T18:49:43.921505+0000","last_clean":"2024-08-02T18:49:43.921505+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:49:43.921505+0000","last_undegraded":"2024-08-02T18:49:43.921505+0000","last_fullsized":"2024-08-02T18:49:43.921505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609073+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:49:43.609073+0000","last_peered":"2024-08-02T18:49:43.609073+0000","last_clean":"2024-08-02T18:49:43.609073+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:49:43.609073+0000","last_undegraded":"2024-08-02T18:49:43.609073+0000","last_fullsized":"2024-08-02T18:49:43.609073+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561163+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:49:43.561163+0000","last_peered":"2024-08-02T18:49:43.561163+0000","last_clean":"2024-08-02T18:49:43.561163+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:49:43.561163+0000","last_undegraded":"2024-08-02T18:49:43.561163+0000","last_fullsized":"2024-08-02T18:49:43.561163+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608626+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:49:43.608626+0000","last_peered":"2024-08-02T18:49:43.608626+0000","last_clean":"2024-08-02T18:49:43.608626+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:49:43.608626+0000","last_undegraded":"2024-08-02T18:49:43.608626+0000","last_fullsized":"2024-08-02T18:49:43.608626+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654071+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:49:43.654071+0000","last_peered":"2024-08-02T18:49:43.654071+0000","last_clean":"2024-08-02T18:49:43.654071+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:49:43.654071+0000","last_undegraded":"2024-08-02T18:49:43.654071+0000","last_fullsized":"2024-08-02T18:49:43.654071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829094+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:49:43.829094+0000","last_peered":"2024-08-02T18:49:43.829094+0000","last_clean":"2024-08-02T18:49:43.829094+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:49:43.829094+0000","last_undegraded":"2024-08-02T18:49:43.829094+0000","last_fullsized":"2024-08-02T18:49:43.829094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":148,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609582+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:49:43.609582+0000","last_peered":"2024-08-02T18:49:43.609582+0000","last_clean":"2024-08-02T18:49:43.609582+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:49:43.609582+0000","last_undegraded":"2024-08-02T18:49:43.609582+0000","last_fullsized":"2024-08-02T18:49:43.609582+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":105,"num_read_kb":4,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656472+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:49:43.656472+0000","last_peered":"2024-08-02T18:49:43.656472+0000","last_clean":"2024-08-02T18:49:43.656472+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:49:43.656472+0000","last_undegraded":"2024-08-02T18:49:43.656472+0000","last_fullsized":"2024-08-02T18:49:43.656472+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829250+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:49:43.829250+0000","last_peered":"2024-08-02T18:49:43.829250+0000","last_clean":"2024-08-02T18:49:43.829250+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:49:43.829250+0000","last_undegraded":"2024-08-02T18:49:43.829250+0000","last_fullsized":"2024-08-02T18:49:43.829250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921020+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:49:43.921020+0000","last_peered":"2024-08-02T18:49:43.921020+0000","last_clean":"2024-08-02T18:49:43.921020+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:49:43.921020+0000","last_undegraded":"2024-08-02T18:49:43.921020+0000","last_fullsized":"2024-08-02T18:49:43.921020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829253+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:49:43.829253+0000","last_peered":"2024-08-02T18:49:43.829253+0000","last_clean":"2024-08-02T18:49:43.829253+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:49:43.829253+0000","last_undegraded":"2024-08-02T18:49:43.829253+0000","last_fullsized":"2024-08-02T18:49:43.829253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829051+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:49:43.829051+0000","last_peered":"2024-08-02T18:49:43.829051+0000","last_clean":"2024-08-02T18:49:43.829051+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:49:43.829051+0000","last_undegraded":"2024-08-02T18:49:43.829051+0000","last_fullsized":"2024-08-02T18:49:43.829051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956830+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:49:43.956830+0000","last_peered":"2024-08-02T18:49:43.956830+0000","last_clean":"2024-08-02T18:49:43.956830+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:49:43.956830+0000","last_undegraded":"2024-08-02T18:49:43.956830+0000","last_fullsized":"2024-08-02T18:49:43.956830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561943+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:49:43.561943+0000","last_peered":"2024-08-02T18:49:43.561943+0000","last_clean":"2024-08-02T18:49:43.561943+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:49:43.561943+0000","last_undegraded":"2024-08-02T18:49:43.561943+0000","last_fullsized":"2024-08-02T18:49:43.561943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921458+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:49:43.921458+0000","last_peered":"2024-08-02T18:49:43.921458+0000","last_clean":"2024-08-02T18:49:43.921458+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:49:43.921458+0000","last_undegraded":"2024-08-02T18:49:43.921458+0000","last_fullsized":"2024-08-02T18:49:43.921458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829511+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:49:43.829511+0000","last_peered":"2024-08-02T18:49:43.829511+0000","last_clean":"2024-08-02T18:49:43.829511+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:49:43.829511+0000","last_undegraded":"2024-08-02T18:49:43.829511+0000","last_fullsized":"2024-08-02T18:49:43.829511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609765+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:49:43.609765+0000","last_peered":"2024-08-02T18:49:43.609765+0000","last_clean":"2024-08-02T18:49:43.609765+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:49:43.609765+0000","last_undegraded":"2024-08-02T18:49:43.609765+0000","last_fullsized":"2024-08-02T18:49:43.609765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562988+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:49:43.562988+0000","last_peered":"2024-08-02T18:49:43.562988+0000","last_clean":"2024-08-02T18:49:43.562988+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:49:43.562988+0000","last_undegraded":"2024-08-02T18:49:43.562988+0000","last_fullsized":"2024-08-02T18:49:43.562988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609160+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:49:43.609160+0000","last_peered":"2024-08-02T18:49:43.609160+0000","last_clean":"2024-08-02T18:49:43.609160+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:49:43.609160+0000","last_undegraded":"2024-08-02T18:49:43.609160+0000","last_fullsized":"2024-08-02T18:49:43.609160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562877+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:49:43.562877+0000","last_peered":"2024-08-02T18:49:43.562877+0000","last_clean":"2024-08-02T18:49:43.562877+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:49:43.562877+0000","last_undegraded":"2024-08-02T18:49:43.562877+0000","last_fullsized":"2024-08-02T18:49:43.562877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561703+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:49:43.561703+0000","last_peered":"2024-08-02T18:49:43.561703+0000","last_clean":"2024-08-02T18:49:43.561703+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:49:43.561703+0000","last_undegraded":"2024-08-02T18:49:43.561703+0000","last_fullsized":"2024-08-02T18:49:43.561703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921328+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:49:43.921328+0000","last_peered":"2024-08-02T18:49:43.921328+0000","last_clean":"2024-08-02T18:49:43.921328+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:49:43.921328+0000","last_undegraded":"2024-08-02T18:49:43.921328+0000","last_fullsized":"2024-08-02T18:49:43.921328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829407+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:49:43.829407+0000","last_peered":"2024-08-02T18:49:43.829407+0000","last_clean":"2024-08-02T18:49:43.829407+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:49:43.829407+0000","last_undegraded":"2024-08-02T18:49:43.829407+0000","last_fullsized":"2024-08-02T18:49:43.829407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654732+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:49:43.654732+0000","last_peered":"2024-08-02T18:49:43.654732+0000","last_clean":"2024-08-02T18:49:43.654732+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:49:43.654732+0000","last_undegraded":"2024-08-02T18:49:43.654732+0000","last_fullsized":"2024-08-02T18:49:43.654732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921678+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:49:43.921678+0000","last_peered":"2024-08-02T18:49:43.921678+0000","last_clean":"2024-08-02T18:49:43.921678+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:49:43.921678+0000","last_undegraded":"2024-08-02T18:49:43.921678+0000","last_fullsized":"2024-08-02T18:49:43.921678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562579+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:49:43.562579+0000","last_peered":"2024-08-02T18:49:43.562579+0000","last_clean":"2024-08-02T18:49:43.562579+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:49:43.562579+0000","last_undegraded":"2024-08-02T18:49:43.562579+0000","last_fullsized":"2024-08-02T18:49:43.562579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.955905+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:49:43.955905+0000","last_peered":"2024-08-02T18:49:43.955905+0000","last_clean":"2024-08-02T18:49:43.955905+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:49:43.955905+0000","last_undegraded":"2024-08-02T18:49:43.955905+0000","last_fullsized":"2024-08-02T18:49:43.955905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956586+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:49:43.956586+0000","last_peered":"2024-08-02T18:49:43.956586+0000","last_clean":"2024-08-02T18:49:43.956586+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:49:43.956586+0000","last_undegraded":"2024-08-02T18:49:43.956586+0000","last_fullsized":"2024-08-02T18:49:43.956586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561524+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:49:43.561524+0000","last_peered":"2024-08-02T18:49:43.561524+0000","last_clean":"2024-08-02T18:49:43.561524+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:49:43.561524+0000","last_undegraded":"2024-08-02T18:49:43.561524+0000","last_fullsized":"2024-08-02T18:49:43.561524+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609731+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:49:43.609731+0000","last_peered":"2024-08-02T18:49:43.609731+0000","last_clean":"2024-08-02T18:49:43.609731+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:49:43.609731+0000","last_undegraded":"2024-08-02T18:49:43.609731+0000","last_fullsized":"2024-08-02T18:49:43.609731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827121+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:49:43.827121+0000","last_peered":"2024-08-02T18:49:43.827121+0000","last_clean":"2024-08-02T18:49:43.827121+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:49:43.827121+0000","last_undegraded":"2024-08-02T18:49:43.827121+0000","last_fullsized":"2024-08-02T18:49:43.827121+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608795+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:49:43.608795+0000","last_peered":"2024-08-02T18:49:43.608795+0000","last_clean":"2024-08-02T18:49:43.608795+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:49:43.608795+0000","last_undegraded":"2024-08-02T18:49:43.608795+0000","last_fullsized":"2024-08-02T18:49:43.608795+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563166+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:49:43.563166+0000","last_peered":"2024-08-02T18:49:43.563166+0000","last_clean":"2024-08-02T18:49:43.563166+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:49:43.563166+0000","last_undegraded":"2024-08-02T18:49:43.563166+0000","last_fullsized":"2024-08-02T18:49:43.563166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609065+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:49:43.609065+0000","last_peered":"2024-08-02T18:49:43.609065+0000","last_clean":"2024-08-02T18:49:43.609065+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:49:43.609065+0000","last_undegraded":"2024-08-02T18:49:43.609065+0000","last_fullsized":"2024-08-02T18:49:43.609065+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826709+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:49:43.826709+0000","last_peered":"2024-08-02T18:49:43.826709+0000","last_clean":"2024-08-02T18:49:43.826709+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:49:43.826709+0000","last_undegraded":"2024-08-02T18:49:43.826709+0000","last_fullsized":"2024-08-02T18:49:43.826709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608483+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:49:43.608483+0000","last_peered":"2024-08-02T18:49:43.608483+0000","last_clean":"2024-08-02T18:49:43.608483+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:49:43.608483+0000","last_undegraded":"2024-08-02T18:49:43.608483+0000","last_fullsized":"2024-08-02T18:49:43.608483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656457+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:49:43.656457+0000","last_peered":"2024-08-02T18:49:43.656457+0000","last_clean":"2024-08-02T18:49:43.656457+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:49:43.656457+0000","last_undegraded":"2024-08-02T18:49:43.656457+0000","last_fullsized":"2024-08-02T18:49:43.656457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654397+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:49:43.654397+0000","last_peered":"2024-08-02T18:49:43.654397+0000","last_clean":"2024-08-02T18:49:43.654397+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:49:43.654397+0000","last_undegraded":"2024-08-02T18:49:43.654397+0000","last_fullsized":"2024-08-02T18:49:43.654397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956825+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:49:43.956825+0000","last_peered":"2024-08-02T18:49:43.956825+0000","last_clean":"2024-08-02T18:49:43.956825+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:49:43.956825+0000","last_undegraded":"2024-08-02T18:49:43.956825+0000","last_fullsized":"2024-08-02T18:49:43.956825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956976+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:49:43.956976+0000","last_peered":"2024-08-02T18:49:43.956976+0000","last_clean":"2024-08-02T18:49:43.956976+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:49:43.956976+0000","last_undegraded":"2024-08-02T18:49:43.956976+0000","last_fullsized":"2024-08-02T18:49:43.956976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921644+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:49:43.921644+0000","last_peered":"2024-08-02T18:49:43.921644+0000","last_clean":"2024-08-02T18:49:43.921644+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:49:43.921644+0000","last_undegraded":"2024-08-02T18:49:43.921644+0000","last_fullsized":"2024-08-02T18:49:43.921644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600144,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":729,"num_read_kb":476,"num_write":301,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1800432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":119,"num_write":181,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547242,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32168,"kb_used_data":992,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712984,"statfs":{"total":95995035648,"available":95962095616,"internally_reserved":0,"allocated":1015808,"data_stored":499721,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776174,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28832,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716320,"statfs":{"total":95995035648,"available":95965511680,"internally_reserved":0,"allocated":1859584,"data_stored":1299160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939697,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1441792,"data_stored":907043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168632,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1437696,"data_stored":902867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397565,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36940,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708212,"statfs":{"total":95995035648,"available":95957209088,"internally_reserved":0,"allocated":1638400,"data_stored":1107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561089,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":504907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822725,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28756,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716396,"statfs":{"total":95995035648,"available":95965589504,"internally_reserved":0,"allocated":1781760,"data_stored":1233278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986250,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":510645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215182,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1564672,"data_stored":1029917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411411,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":576763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":574526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738460,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1048576,"data_stored":506295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":203975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:49:47.383 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:49:47.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:47.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:47.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:47.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:47.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:47.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:47.635 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: Unable to set osd_memory_target on smithi103 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: Updating smithi103:/etc/ceph/ceph.conf 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-02T18:49:47.636 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: Updating smithi151:/etc/ceph/ceph.conf 2024-08-02T18:49:47.725 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: Unable to set osd_memory_target on smithi103 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: Updating smithi103:/etc/ceph/ceph.conf 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: Updating smithi151:/etc/ceph/ceph.conf 2024-08-02T18:49:48.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:47 smithi121 ceph-mon[37236]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:48.014 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:47 smithi103 ceph-mon[32753]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:48.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='client.15342 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='client.15348 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: Unable to set osd_memory_target on smithi103 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:48.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: Updating smithi103:/etc/ceph/ceph.conf 2024-08-02T18:49:48.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: Updating smithi121:/etc/ceph/ceph.conf 2024-08-02T18:49:48.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: Updating smithi151:/etc/ceph/ceph.conf 2024-08-02T18:49:48.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:47 smithi151 ceph-mon[37155]: from='client.15354 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:48.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.267+0000 7f7880ff9640 1 -- 172.21.15.103:0/2578543545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 msgr2=0x7f787c107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:48.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.267+0000 7f7880ff9640 1 --2- 172.21.15.103:0/2578543545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 0x7f787c107ca0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f786c009930 tx=0x7f786c02a420 comp rx=0 tx=0).stop 2024-08-02T18:49:48.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.268+0000 7f7880ff9640 1 -- 172.21.15.103:0/2578543545 shutdown_connections 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.268+0000 7f7880ff9640 1 --2- 172.21.15.103:0/2578543545 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f787c102260 0x7f787c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.268+0000 7f7880ff9640 1 --2- 172.21.15.103:0/2578543545 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f787c1018c0 0x7f787c101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.268+0000 7f7880ff9640 1 --2- 172.21.15.103:0/2578543545 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 0x7f787c107ca0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.268+0000 7f7880ff9640 1 -- 172.21.15.103:0/2578543545 >> 172.21.15.103:0/2578543545 conn(0x7f787c0fd620 msgr2=0x7f787c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.268+0000 7f7880ff9640 1 -- 172.21.15.103:0/2578543545 shutdown_connections 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.268+0000 7f7880ff9640 1 -- 172.21.15.103:0/2578543545 wait complete. 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7880ff9640 1 Processor -- start 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7880ff9640 1 -- start start 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7880ff9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f787c1018c0 0x7f787c1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7880ff9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f787c102260 0x7f787c1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7880ff9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 0x7f787c19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7880ff9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f787c111de0 con 0x7f787c1078c0 2024-08-02T18:49:48.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7880ff9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f787c111c60 con 0x7f787c102260 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7880ff9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f787c111f60 con 0x7f787c1018c0 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 0x7f787c19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 0x7f787c19cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52182/0 (socket says 172.21.15.103:52182) 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787ad9d640 1 -- 172.21.15.103:0/1149276661 learned_addr learned my addr 172.21.15.103:0/1149276661 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f7879d9b640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f787c102260 0x7f787c1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787a59c640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f787c1018c0 0x7f787c1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787ad9d640 1 -- 172.21.15.103:0/1149276661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f787c1018c0 msgr2=0x7f787c1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787ad9d640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f787c1018c0 0x7f787c1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787ad9d640 1 -- 172.21.15.103:0/1149276661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f787c102260 msgr2=0x7f787c1987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787ad9d640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f787c102260 0x7f787c1987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.269+0000 7f787ad9d640 1 -- 172.21.15.103:0/1149276661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f787c19d260 con 0x7f787c1078c0 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.270+0000 7f787a59c640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f787c1018c0 0x7f787c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:48.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.270+0000 7f787ad9d640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 0x7f787c19cb80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f787400eb10 tx=0x7f787400c2d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.270+0000 7f786b7fe640 1 -- 172.21.15.103:0/1149276661 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7874004b20 con 0x7f787c1078c0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.270+0000 7f786b7fe640 1 -- 172.21.15.103:0/1149276661 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7874004cc0 con 0x7f787c1078c0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.270+0000 7f786b7fe640 1 -- 172.21.15.103:0/1149276661 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f78740107f0 con 0x7f787c1078c0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.270+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f787c19d550 con 0x7f787c1078c0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.270+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f787c1a4e30 con 0x7f787c1078c0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.271+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f787c101d20 con 0x7f787c1078c0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.273+0000 7f786b7fe640 1 -- 172.21.15.103:0/1149276661 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 23) ==== 137954+0+0 (secure 0 0 0) 0x7f7874010990 con 0x7f787c1078c0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.273+0000 7f786b7fe640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f78640a2cf0 0x7f78640a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.273+0000 7f787a59c640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f78640a2cf0 0x7f78640a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.273+0000 7f786b7fe640 1 -- 172.21.15.103:0/1149276661 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f78740cff40 con 0x7f787c1078c0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.274+0000 7f787a59c640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f78640a2cf0 0x7f78640a51b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f786c000c00 tx=0x7f786c005a20 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:48.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.276+0000 7f786b7fe640 1 -- 172.21.15.103:0/1149276661 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7874053df0 con 0x7f787c1078c0 2024-08-02T18:49:48.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.317+0000 7f786b7fe640 1 -- 172.21.15.103:0/1149276661 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7f78740cd5d0 con 0x7f787c1078c0 2024-08-02T18:49:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.498+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f787c199610 con 0x7f787c1078c0 2024-08-02T18:49:48.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.499+0000 7f786b7fe640 1 -- 172.21.15.103:0/1149276661 <== mon.0 v2:172.21.15.103:3300/0 8 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7f787c199610 con 0x7f787c1078c0 2024-08-02T18:49:48.502 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:48.502 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:49:48.502 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:49:48.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f78640a2cf0 msgr2=0x7f78640a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:48.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f78640a2cf0 0x7f78640a51b0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f786c000c00 tx=0x7f786c005a20 comp rx=0 tx=0).stop 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 msgr2=0x7f787c19cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 0x7f787c19cb80 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f787400eb10 tx=0x7f787400c2d0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 shutdown_connections 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f78640a2cf0 0x7f78640a51b0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f787c1078c0 0x7f787c19cb80 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f787c102260 0x7f787c1987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 --2- 172.21.15.103:0/1149276661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f787c1018c0 0x7f787c1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 >> 172.21.15.103:0/1149276661 conn(0x7f787c0fd620 msgr2=0x7f787c0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 shutdown_connections 2024-08-02T18:49:48.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:48.501+0000 7f7880ff9640 1 -- 172.21.15.103:0/1149276661 wait complete. 2024-08-02T18:49:49.226 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:49:49.480 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-08-02T18:49:49.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.572 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:49.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:49.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:49.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.573 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:49 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1149276661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:49.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:49.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.576 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:49.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:49.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:49.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.577 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:49 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1149276661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.conf 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: pgmap v5: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi103:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi121:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi151:/etc/ceph/ceph.client.admin.keyring 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: Updating smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/config/ceph.client.admin.keyring 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: mgrmap e24: x(active, since 4s), standbys: z, y 2024-08-02T18:49:49.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:49.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:49.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:49.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:49.753 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:49 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1149276661' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:49:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 -- 172.21.15.103:0/108647981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c1022a0 msgr2=0x7f528c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 --2- 172.21.15.103:0/108647981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c1022a0 0x7f528c1026e0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f527c009900 tx=0x7f527c02a480 comp rx=0 tx=0).stop 2024-08-02T18:49:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 -- 172.21.15.103:0/108647981 shutdown_connections 2024-08-02T18:49:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 --2- 172.21.15.103:0/108647981 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f528c102c20 0x7f528c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:49.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 --2- 172.21.15.103:0/108647981 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c1022a0 0x7f528c1026e0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 --2- 172.21.15.103:0/108647981 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f528c100b50 0x7f528c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 -- 172.21.15.103:0/108647981 >> 172.21.15.103:0/108647981 conn(0x7f528c0fc500 msgr2=0x7f528c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 -- 172.21.15.103:0/108647981 shutdown_connections 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 -- 172.21.15.103:0/108647981 wait complete. 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.936+0000 7f5293f80640 1 Processor -- start 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5293f80640 1 -- start start 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5293f80640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c100b50 0x7f528c198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5293f80640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f528c1022a0 0x7f528c198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5293f80640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f528c102c20 0x7f528c19cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5293f80640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f528c110dd0 con 0x7f528c100b50 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5293f80640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f528c110c50 con 0x7f528c1022a0 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5293f80640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f528c110f50 con 0x7f528c102c20 2024-08-02T18:49:49.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c100b50 0x7f528c198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c100b50 0x7f528c198320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60554/0 (socket says 172.21.15.103:60554) 2024-08-02T18:49:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 -- 172.21.15.103:0/382540300 learned_addr learned my addr 172.21.15.103:0/382540300 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f529151b640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f528c1022a0 0x7f528c198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f529251d640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f528c102c20 0x7f528c19cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 -- 172.21.15.103:0/382540300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f528c102c20 msgr2=0x7f528c19cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f528c102c20 0x7f528c19cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 -- 172.21.15.103:0/382540300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f528c1022a0 msgr2=0x7f528c198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:49.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f528c1022a0 0x7f528c198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 -- 172.21.15.103:0/382540300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f528c19d2d0 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.937+0000 7f5291d1c640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c100b50 0x7f528c198320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f528800c890 tx=0x7f528800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.938+0000 7f5282ffd640 1 -- 172.21.15.103:0/382540300 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288004220 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.938+0000 7f5282ffd640 1 -- 172.21.15.103:0/382540300 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52880043c0 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.938+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f528c19d5c0 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.938+0000 7f5282ffd640 1 -- 172.21.15.103:0/382540300 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5288004b10 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.938+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f528c1a4ea0 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.939+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f528c100f30 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.940+0000 7f5282ffd640 1 -- 172.21.15.103:0/382540300 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7f52880051b0 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.940+0000 7f5282ffd640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52780a2d80 0x7f52780a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.940+0000 7f529151b640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52780a2d80 0x7f52780a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.940+0000 7f5282ffd640 1 -- 172.21.15.103:0/382540300 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f52880cf9b0 con 0x7f528c100b50 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.941+0000 7f529151b640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52780a2d80 0x7f52780a5240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f527c009230 tx=0x7f527c0058d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:49.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:49.945+0000 7f5282ffd640 1 -- 172.21.15.103:0/382540300 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5288014030 con 0x7f528c100b50 2024-08-02T18:49:50.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.112+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f528c109dd0 con 0x7f528c100b50 2024-08-02T18:49:50.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.114+0000 7f5282ffd640 1 -- 172.21.15.103:0/382540300 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25083 (secure 0 0 0) 0x7f528809c120 con 0x7f528c100b50 2024-08-02T18:49:50.117 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:50.117 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":90,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:49:43.556886+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/3303960029":"2024-08-03T18:49:43.556859+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/433411047":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/2738010911":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/15319849":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/3303960029":"2024-08-03T18:49:43.556859+0000","172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/592081832":"2024-08-03T18:49:43.556859+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:49:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52780a2d80 msgr2=0x7f52780a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52780a2d80 0x7f52780a5240 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f527c009230 tx=0x7f527c0058d0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c100b50 msgr2=0x7f528c198320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c100b50 0x7f528c198320 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f528800c890 tx=0x7f528800cd50 comp rx=0 tx=0).stop 2024-08-02T18:49:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 shutdown_connections 2024-08-02T18:49:50.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52780a2d80 0x7f52780a5240 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f528c102c20 0x7f528c19cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f528c1022a0 0x7f528c198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 --2- 172.21.15.103:0/382540300 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f528c100b50 0x7f528c198320 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 >> 172.21.15.103:0/382540300 conn(0x7f528c0fc500 msgr2=0x7f528c069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:50.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 shutdown_connections 2024-08-02T18:49:50.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.116+0000 7f5293f80640 1 -- 172.21.15.103:0/382540300 wait complete. 2024-08-02T18:49:50.471 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:50 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/382540300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:50.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:50 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/382540300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:50.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:50 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/382540300' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:49:50.852 DEBUG:tasks.fwd_scrub:Yielding 2024-08-02T18:49:50.852 INFO:teuthology.run_tasks:Running task exec... 2024-08-02T18:49:50.861 INFO:teuthology.task.exec:Executing custom commands... 2024-08-02T18:49:50.861 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:49:50.861 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/log_level debug' 2024-08-02T18:49:50.862 INFO:tasks.fwd_scrub.fs.[cephfs]:start scrubbing fs: cephfs 2024-08-02T18:49:50.862 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-02T18:49:50.862 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-02T18:49:50.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 -- 172.21.15.103:0/1457678542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 msgr2=0x7f52ec10b7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:50.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1457678542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 0x7f52ec10b7b0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f52dc009900 tx=0x7f52dc02a480 comp rx=0 tx=0).stop 2024-08-02T18:49:50.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 -- 172.21.15.103:0/1457678542 shutdown_connections 2024-08-02T18:49:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1457678542 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec10be00 0x7f52ec10e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1457678542 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 0x7f52ec10b7b0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1457678542 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52ec1029b0 0x7f52ec102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 -- 172.21.15.103:0/1457678542 >> 172.21.15.103:0/1457678542 conn(0x7f52ec0776c0 msgr2=0x7f52ec0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 -- 172.21.15.103:0/1457678542 shutdown_connections 2024-08-02T18:49:50.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 -- 172.21.15.103:0/1457678542 wait complete. 2024-08-02T18:49:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.967+0000 7f52f0eff640 1 Processor -- start 2024-08-02T18:49:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52f0eff640 1 -- start start 2024-08-02T18:49:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52f0eff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec1029b0 0x7f52ec1980f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52f0eff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 0x7f52ec198630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52f0eff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52ec10be00 0x7f52ec19c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52f0eff640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec111d00 con 0x7f52ec1032d0 2024-08-02T18:49:50.972 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52f0eff640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec111b80 con 0x7f52ec10be00 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52f0eff640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f52ec111e80 con 0x7f52ec1029b0 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 0x7f52ec198630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 0x7f52ec198630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60562/0 (socket says 172.21.15.103:60562) 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 -- 172.21.15.103:0/1135302253 learned_addr learned my addr 172.21.15.103:0/1135302253 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52ea59c640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec1029b0 0x7f52ec1980f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52ead9d640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52ec10be00 0x7f52ec19c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 -- 172.21.15.103:0/1135302253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec1029b0 msgr2=0x7f52ec1980f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec1029b0 0x7f52ec1980f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 -- 172.21.15.103:0/1135302253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52ec10be00 msgr2=0x7f52ec19c9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52ec10be00 0x7f52ec19c9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 -- 172.21.15.103:0/1135302253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f52ec19d0e0 con 0x7f52ec1032d0 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e9d9b640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 0x7f52ec198630 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f52dc006010 tx=0x7f52dc0042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:50.973 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.968+0000 7f52e37fe640 1 -- 172.21.15.103:0/1135302253 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc03f030 con 0x7f52ec1032d0 2024-08-02T18:49:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.969+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f52ec19d370 con 0x7f52ec1032d0 2024-08-02T18:49:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.969+0000 7f52e37fe640 1 -- 172.21.15.103:0/1135302253 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f52dc003d00 con 0x7f52ec1032d0 2024-08-02T18:49:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.969+0000 7f52e37fe640 1 -- 172.21.15.103:0/1135302253 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f52dc035070 con 0x7f52ec1032d0 2024-08-02T18:49:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.969+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f52ec1a4c60 con 0x7f52ec1032d0 2024-08-02T18:49:50.974 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.970+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f52ec102d90 con 0x7f52ec1032d0 2024-08-02T18:49:50.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.971+0000 7f52e37fe640 1 -- 172.21.15.103:0/1135302253 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7f52dc042030 con 0x7f52ec1032d0 2024-08-02T18:49:50.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.972+0000 7f52e37fe640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52d80a2e40 0x7f52d80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:50.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.972+0000 7f52ea59c640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52d80a2e40 0x7f52d80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:50.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.972+0000 7f52e37fe640 1 -- 172.21.15.103:0/1135302253 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f52dc0f0300 con 0x7f52ec1032d0 2024-08-02T18:49:50.975 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.972+0000 7f52ea59c640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52d80a2e40 0x7f52d80a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f52d400abe0 tx=0x7f52d400a2d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:50.977 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:50.975+0000 7f52e37fe640 1 -- 172.21.15.103:0/1135302253 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f52dc0bca70 con 0x7f52ec1032d0 2024-08-02T18:49:51.126 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:51.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.169+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/log_level}] v 0) -- 0x7f52ec199440 con 0x7f52ec1032d0 2024-08-02T18:49:51.174 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.172+0000 7f52e37fe640 1 -- 172.21.15.103:0/1135302253 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/log_level}]=0 v28)=0 v28) ==== 129+0+0 (secure 0 0 0) 0x7f52ec199440 con 0x7f52ec1032d0 2024-08-02T18:49:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52d80a2e40 msgr2=0x7f52d80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52d80a2e40 0x7f52d80a5300 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f52d400abe0 tx=0x7f52d400a2d0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 msgr2=0x7f52ec198630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 0x7f52ec198630 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f52dc006010 tx=0x7f52dc0042f0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 shutdown_connections 2024-08-02T18:49:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f52d80a2e40 0x7f52d80a5300 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f52ec10be00 0x7f52ec19c9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f52ec1032d0 0x7f52ec198630 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 --2- 172.21.15.103:0/1135302253 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f52ec1029b0 0x7f52ec1980f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 >> 172.21.15.103:0/1135302253 conn(0x7f52ec0776c0 msgr2=0x7f52ec0fca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 shutdown_connections 2024-08-02T18:49:51.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.175+0000 7f52f0eff640 1 -- 172.21.15.103:0/1135302253 wait complete. 2024-08-02T18:49:51.189 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/allow_m_granularity true' 2024-08-02T18:49:51.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 -- 172.21.15.103:0/2048404583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c1029d0 msgr2=0x7fa63c102db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2048404583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c1029d0 0x7fa63c102db0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009900 tx=0x7fa62c02a480 comp rx=0 tx=0).stop 2024-08-02T18:49:51.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 -- 172.21.15.103:0/2048404583 shutdown_connections 2024-08-02T18:49:51.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2048404583 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa63c10be20 0x7fa63c10e2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2048404583 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa63c1032f0 0x7fa63c10b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2048404583 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c1029d0 0x7fa63c102db0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 -- 172.21.15.103:0/2048404583 >> 172.21.15.103:0/2048404583 conn(0x7fa63c0fc3c0 msgr2=0x7fa63c0fe7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 -- 172.21.15.103:0/2048404583 shutdown_connections 2024-08-02T18:49:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.292+0000 7fa6411b9640 1 -- 172.21.15.103:0/2048404583 wait complete. 2024-08-02T18:49:51.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.293+0000 7fa6411b9640 1 Processor -- start 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.293+0000 7fa6411b9640 1 -- start start 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa6411b9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa63c1029d0 0x7fa63c1981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa6411b9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa63c1032f0 0x7fa63c198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa6411b9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c10be20 0x7fa63c19cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa6411b9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c111d20 con 0x7fa63c10be20 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa6411b9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c111ba0 con 0x7fa63c1032f0 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa6411b9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa63c111ea0 con 0x7fa63c1029d0 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c10be20 0x7fa63c19cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c10be20 0x7fa63c19cab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60576/0 (socket says 172.21.15.103:60576) 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 -- 172.21.15.103:0/2411731054 learned_addr learned my addr 172.21.15.103:0/2411731054 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:51.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63ad9d640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa63c1029d0 0x7fa63c1981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63a59c640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa63c1032f0 0x7fa63c198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 -- 172.21.15.103:0/2411731054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa63c1029d0 msgr2=0x7fa63c1981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa63c1029d0 0x7fa63c1981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 -- 172.21.15.103:0/2411731054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa63c1032f0 msgr2=0x7fa63c198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa63c1032f0 0x7fa63c198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 -- 172.21.15.103:0/2411731054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa63c19d1e0 con 0x7fa63c10be20 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa63b59e640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c10be20 0x7fa63c19cab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa63400eaa0 tx=0x7fa63400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa623fff640 1 -- 172.21.15.103:0/2411731054 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa63400cdb0 con 0x7fa63c10be20 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa63c19d4d0 con 0x7fa63c10be20 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa623fff640 1 -- 172.21.15.103:0/2411731054 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa634004b20 con 0x7fa63c10be20 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa623fff640 1 -- 172.21.15.103:0/2411731054 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa634011760 con 0x7fa63c10be20 2024-08-02T18:49:51.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.294+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa63c1a4d60 con 0x7fa63c10be20 2024-08-02T18:49:51.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.296+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa63c102db0 con 0x7fa63c10be20 2024-08-02T18:49:51.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.297+0000 7fa623fff640 1 -- 172.21.15.103:0/2411731054 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7fa634004cd0 con 0x7fa63c10be20 2024-08-02T18:49:51.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.297+0000 7fa623fff640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa6240a2e40 0x7fa6240a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.297+0000 7fa63ad9d640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa6240a2e40 0x7fa6240a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.297+0000 7fa623fff640 1 -- 172.21.15.103:0/2411731054 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa6340cfa80 con 0x7fa63c10be20 2024-08-02T18:49:51.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.298+0000 7fa63ad9d640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa6240a2e40 0x7fa6240a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009230 tx=0x7fa62c0058d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.302+0000 7fa623fff640 1 -- 172.21.15.103:0/2411731054 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa634016030 con 0x7fa63c10be20 2024-08-02T18:49:51.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.497+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}] v 0) -- 0x7fa63c106e90 con 0x7fa63c10be20 2024-08-02T18:49:51.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.502+0000 7fa623fff640 1 -- 172.21.15.103:0/2411731054 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/allow_m_granularity}]=0 v29)=0 v29) ==== 138+0+0 (secure 0 0 0) 0x7fa63409bba0 con 0x7fa63c10be20 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa6240a2e40 msgr2=0x7fa6240a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa6240a2e40 0x7fa6240a5300 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa62c009230 tx=0x7fa62c0058d0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c10be20 msgr2=0x7fa63c19cab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c10be20 0x7fa63c19cab0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fa63400eaa0 tx=0x7fa63400ef60 comp rx=0 tx=0).stop 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 shutdown_connections 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa6240a2e40 0x7fa6240a5300 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa63c10be20 0x7fa63c19cab0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa63c1032f0 0x7fa63c198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 --2- 172.21.15.103:0/2411731054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa63c1029d0 0x7fa63c1981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.504+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 >> 172.21.15.103:0/2411731054 conn(0x7fa63c0fc3c0 msgr2=0x7fa63c0fd020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.505+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 shutdown_connections 2024-08-02T18:49:51.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.505+0000 7fa6411b9640 1 -- 172.21.15.103:0/2411731054 wait complete. 2024-08-02T18:49:51.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:51 smithi103 ceph-mon[32753]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:51.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:51 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1135302253' entity='client.admin' 2024-08-02T18:49:51.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:51 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:51.518 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:51 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:51.519 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:51 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:51.519 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:51 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:51.520 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph config set mgr mgr/snap_schedule/dump_on_update true' 2024-08-02T18:49:51.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:51 smithi151 ceph-mon[37155]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:51.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:51 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1135302253' entity='client.admin' 2024-08-02T18:49:51.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:51 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:51.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:51 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:51.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:51 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:51.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:51 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:51.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 -- 172.21.15.103:0/2649751076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc100ea0 msgr2=0x7fa8dc1012e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 --2- 172.21.15.103:0/2649751076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc100ea0 0x7fa8dc1012e0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009900 tx=0x7fa8d002a480 comp rx=0 tx=0).stop 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 -- 172.21.15.103:0/2649751076 shutdown_connections 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 --2- 172.21.15.103:0/2649751076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8dc101820 0x7fa8dc10d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 --2- 172.21.15.103:0/2649751076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc100ea0 0x7fa8dc1012e0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 --2- 172.21.15.103:0/2649751076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc1025d0 0x7fa8dc1029b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 -- 172.21.15.103:0/2649751076 >> 172.21.15.103:0/2649751076 conn(0x7fa8dc076e20 msgr2=0x7fa8dc0fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 -- 172.21.15.103:0/2649751076 shutdown_connections 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 -- 172.21.15.103:0/2649751076 wait complete. 2024-08-02T18:49:51.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 Processor -- start 2024-08-02T18:49:51.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.625+0000 7fa8e212b640 1 -- start start 2024-08-02T18:49:51.630 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8e212b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc100ea0 0x7fa8dc199020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8e212b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101820 0x7fa8dc199560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8e212b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8dc1025d0 0x7fa8dc1a40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8e212b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc110cb0 con 0x7fa8dc101820 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8e212b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc110b30 con 0x7fa8dc100ea0 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8e212b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa8dc110e30 con 0x7fa8dc1025d0 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101820 0x7fa8dc199560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101820 0x7fa8dc199560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60588/0 (socket says 172.21.15.103:60588) 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 -- 172.21.15.103:0/538588927 learned_addr learned my addr 172.21.15.103:0/538588927 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8dbfff640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8dc1025d0 0x7fa8dc1a40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8db7fe640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc100ea0 0x7fa8dc199020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.631 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 -- 172.21.15.103:0/538588927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8dc1025d0 msgr2=0x7fa8dc1a40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8dc1025d0 0x7fa8dc1a40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 -- 172.21.15.103:0/538588927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc100ea0 msgr2=0x7fa8dc199020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc100ea0 0x7fa8dc199020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 -- 172.21.15.103:0/538588927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa8dc1a45e0 con 0x7fa8dc101820 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.626+0000 7fa8daffd640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101820 0x7fa8dc199560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0006010 tx=0x7fa8d00040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.627+0000 7fa8d8ff9640 1 -- 172.21.15.103:0/538588927 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d003f030 con 0x7fa8dc101820 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.627+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa8dc1a47b0 con 0x7fa8dc101820 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.627+0000 7fa8d8ff9640 1 -- 172.21.15.103:0/538588927 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa8d00044c0 con 0x7fa8dc101820 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.627+0000 7fa8d8ff9640 1 -- 172.21.15.103:0/538588927 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0035070 con 0x7fa8dc101820 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.627+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa8dc1a4cf0 con 0x7fa8dc101820 2024-08-02T18:49:51.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.628+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa8dc101eb0 con 0x7fa8dc101820 2024-08-02T18:49:51.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.629+0000 7fa8d8ff9640 1 -- 172.21.15.103:0/538588927 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7fa8d0042030 con 0x7fa8dc101820 2024-08-02T18:49:51.633 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.630+0000 7fa8d8ff9640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa8c40a2e40 0x7fa8c40a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.630+0000 7fa8d8ff9640 1 -- 172.21.15.103:0/538588927 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa8d00f0280 con 0x7fa8dc101820 2024-08-02T18:49:51.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.630+0000 7fa8db7fe640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa8c40a2e40 0x7fa8c40a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.630+0000 7fa8db7fe640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa8c40a2e40 0x7fa8c40a5300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009b30 tx=0x7fa8cc005f90 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.634+0000 7fa8d8ff9640 1 -- 172.21.15.103:0/538588927 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa8d00bc3a0 con 0x7fa8dc101820 2024-08-02T18:49:51.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 -- 172.21.15.103:0/1440590978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1741022a0 msgr2=0x7ff1741026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 --2- 172.21.15.103:0/1440590978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1741022a0 0x7ff1741026e0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009900 tx=0x7ff15c02a480 comp rx=0 tx=0).stop 2024-08-02T18:49:51.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 -- 172.21.15.103:0/1440590978 shutdown_connections 2024-08-02T18:49:51.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 --2- 172.21.15.103:0/1440590978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff174102c20 0x7ff17410d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 --2- 172.21.15.103:0/1440590978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff1741022a0 0x7ff1741026e0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.661 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 --2- 172.21.15.103:0/1440590978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff174100b50 0x7ff174100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 -- 172.21.15.103:0/1440590978 >> 172.21.15.103:0/1440590978 conn(0x7ff1740fc500 msgr2=0x7ff1740fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 -- 172.21.15.103:0/1440590978 shutdown_connections 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 -- 172.21.15.103:0/1440590978 wait complete. 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.646+0000 7ff179b7c640 1 Processor -- start 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff179b7c640 1 -- start start 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff179b7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff174100b50 0x7ff1741991a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff179b7c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1741022a0 0x7ff1741996e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff179b7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff174102c20 0x7ff1741a4220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff179b7c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff174110dd0 con 0x7ff174102c20 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff179b7c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff174110c50 con 0x7ff1741022a0 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff179b7c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff174110f50 con 0x7ff174100b50 2024-08-02T18:49:51.662 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff174102c20 0x7ff1741a4220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff174100b50 0x7ff1741991a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff174102c20 0x7ff1741a4220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60604/0 (socket says 172.21.15.103:60604) 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff174100b50 0x7ff1741991a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:35468/0 (socket says 172.21.15.103:35468) 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 -- 172.21.15.103:0/4277042973 learned_addr learned my addr 172.21.15.103:0/4277042973 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff16bfff640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1741022a0 0x7ff1741996e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 -- 172.21.15.103:0/4277042973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff174100b50 msgr2=0x7ff1741991a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff174100b50 0x7ff1741991a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 -- 172.21.15.103:0/4277042973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1741022a0 msgr2=0x7ff1741996e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1741022a0 0x7ff1741996e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 -- 172.21.15.103:0/4277042973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff1741a4760 con 0x7ff174102c20 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff1737fe640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff174100b50 0x7ff1741991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:49:51.663 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.647+0000 7ff173fff640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff174102c20 0x7ff1741a4220 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009fd0 tx=0x7ff16c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.648+0000 7ff1717fa640 1 -- 172.21.15.103:0/4277042973 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c017070 con 0x7ff174102c20 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.648+0000 7ff179b7c640 1 -- 172.21.15.103:0/4277042973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff174196f90 con 0x7ff174102c20 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.648+0000 7ff1717fa640 1 -- 172.21.15.103:0/4277042973 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff16c004020 con 0x7ff174102c20 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.648+0000 7ff1717fa640 1 -- 172.21.15.103:0/4277042973 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16c0106c0 con 0x7ff174102c20 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.648+0000 7ff179b7c640 1 -- 172.21.15.103:0/4277042973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff174197450 con 0x7ff174102c20 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.650+0000 7ff1717fa640 1 -- 172.21.15.103:0/4277042973 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7ff16c0041d0 con 0x7ff174102c20 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.650+0000 7ff17bf7a740 1 Processor -- start 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.650+0000 7ff17bf7a740 1 -- start start 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405200 0x56203d4055e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40fea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 0x56203d4127d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56203d3c8e40 con 0x56203d405b20 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56203d36a7f0 con 0x56203d4103e0 2024-08-02T18:49:51.664 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56203d311fb0 con 0x56203d405200 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60618/0 (socket says 172.21.15.103:60618) 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 -- 172.21.15.103:0/13757261 learned_addr learned my addr 172.21.15.103:0/13757261 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff16bfff640 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405200 0x56203d4055e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1717fa640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff1600a2d80 0x7ff1600a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff16bfff640 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 0x56203d4127d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 -- 172.21.15.103:0/13757261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405200 msgr2=0x56203d4055e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405200 0x56203d4055e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 -- 172.21.15.103:0/13757261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 msgr2=0x56203d4127d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff173fff640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff1600a2d80 0x7ff1600a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 0x56203d4127d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1717fa640 1 -- 172.21.15.103:0/4277042973 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff16c0cf520 con 0x7ff174102c20 2024-08-02T18:49:51.665 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 -- 172.21.15.103:0/13757261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203d0dc6a0 con 0x56203d405b20 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.651+0000 7ff1737fe640 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40fea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff164009850 tx=0x7ff164005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e4e76cbe97b28e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff169ffb640 1 -- 172.21.15.103:0/13757261 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16401e020 con 0x56203d405b20 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff173fff640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff1600a2d80 0x7ff1600a5240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0cc8d0 tx=0x7ff16c050db0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff169ffb640 1 -- 172.21.15.103:0/13757261 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff16401a400 con 0x56203d405b20 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff169ffb640 1 -- 172.21.15.103:0/13757261 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff1640195c0 con 0x56203d405b20 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff17bf7a740 1 -- 172.21.15.103:0/13757261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 msgr2=0x56203d40fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40fea0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7ff164009850 tx=0x7ff164005f90 comp rx=0 tx=0).stop 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff17bf7a740 1 -- 172.21.15.103:0/13757261 shutdown_connections 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 0x56203d4127d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40fea0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.652+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/13757261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405200 0x56203d4055e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 -- 172.21.15.103:0/13757261 >> 172.21.15.103:0/13757261 conn(0x56203d401790 msgr2=0x56203d401b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.666 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 -- 172.21.15.103:0/13757261 shutdown_connections 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 -- 172.21.15.103:0/13757261 wait complete. 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 -- start start 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 Processor -- start 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d40d230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40d770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d40dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56203d325cb0 con 0x56203d405b20 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56203d3667b0 con 0x56203d405200 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.653+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56203d412fb0 con 0x56203d4103e0 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff17bf7a740 10 client.0 _ll_register_callbacks cb 0x56203d079ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40d770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60624/0 (socket says 172.21.15.103:60624) 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 -- 172.21.15.103:0/2355347692 learned_addr learned my addr 172.21.15.103:0/2355347692 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:51.667 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d40d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d40dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 -- 172.21.15.103:0/2355347692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 msgr2=0x56203d40dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d40dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 -- 172.21.15.103:0/2355347692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 msgr2=0x56203d40d230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d40d230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 -- 172.21.15.103:0/2355347692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56203d324bc0 con 0x56203d405b20 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d40dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff1737fe640 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40d770 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff164012010 tx=0x7ff16400bad0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc0029552d36255f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff152ffd640 1 -- 172.21.15.103:0/2355347692 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16401e070 con 0x56203d405b20 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff152ffd640 1 -- 172.21.15.103:0/2355347692 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff164005250 con 0x56203d405b20 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.654+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2355347692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff16401a400 con 0x56203d405b20 2024-08-02T18:49:51.668 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff152ffd640 1 -- 172.21.15.103:0/2355347692 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff164036050 con 0x56203d405b20 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff17bf7a740 10 client.15396 fetch_fsmap learned FSMap version 26 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2355347692 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56203d41edd0 con 0x56203d405b20 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff152ffd640 1 -- 172.21.15.103:0/2355347692 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff16401a400 con 0x56203d405b20 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff152ffd640 1 -- 172.21.15.103:0/2355347692 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff16402b020 con 0x56203d405b20 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff17bf7a740 10 client.15396 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff17bf7a740 10 client.15396 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff17bf7a740 20 client.15396 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56203d420290 0x56203d422680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff17bf7a740 4 client.15396 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2355347692 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56203d377d60 con 0x56203d420290 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.655+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56203d420290 0x56203d422680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56203d420290 0x56203d422680 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19585d338b3ca709 server_cookie=3128bbda8de7d262 in_seq=0 out_seq=0 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff152ffd640 10 client.15396 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:51.669 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff152ffd640 1 -- 172.21.15.103:0/2355347692 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56203d377d60 con 0x56203d420290 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff152ffd640 10 client.15396 handle_command_reply: tid=0 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff17bf7a740 1 client.15396 shutdown 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2355347692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 msgr2=0x56203d40d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40d770 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7ff164012010 tx=0x7ff16400bad0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2355347692 shutdown_connections 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.656+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56203d420290 0x56203d422680 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.657+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d40dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.657+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40d770 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.657+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2355347692 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d40d230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.657+0000 7ff152ffd640 0 client.15396 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.657+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2355347692 >> 172.21.15.103:0/2355347692 conn(0x56203d401790 msgr2=0x56203d407470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.657+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2355347692 shutdown_connections 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.657+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2355347692 wait complete. 2024-08-02T18:49:51.670 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.657+0000 7ff17bf7a740 20 client.15396 trim_cache size 0 max 16384 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.674+0000 7ff17bf7a740 1 Processor -- start 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.674+0000 7ff17bf7a740 1 -- start start 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405200 0x56203d427e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405b20 0x56203d428350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 0x56203d4000d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff1741af320 con 0x56203d405200 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff1741acbf0 con 0x56203d4103e0 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1741aaa40 con 0x56203d405b20 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405200 0x56203d427e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405200 0x56203d427e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60626/0 (socket says 172.21.15.103:60626) 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 -- 172.21.15.103:0/2191421743 learned_addr learned my addr 172.21.15.103:0/2191421743 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:51.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff1737fe640 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405b20 0x56203d428350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 0x56203d4000d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 -- 172.21.15.103:0/2191421743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405b20 msgr2=0x56203d428350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405b20 0x56203d428350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 -- 172.21.15.103:0/2191421743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 msgr2=0x56203d4000d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 0x56203d4000d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 -- 172.21.15.103:0/2191421743 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56203d40b780 con 0x56203d405200 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.675+0000 7ff16bfff640 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405200 0x56203d427e10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009230 tx=0x7ff15c009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e9ac064112f0d39d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff1697fa640 1 -- 172.21.15.103:0/2191421743 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c000e60 con 0x56203d405200 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff1697fa640 1 -- 172.21.15.103:0/2191421743 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff15c04f030 con 0x56203d405200 2024-08-02T18:49:51.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff1697fa640 1 -- 172.21.15.103:0/2191421743 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff15c035040 con 0x56203d405200 2024-08-02T18:49:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2191421743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405200 msgr2=0x56203d427e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405200 0x56203d427e10 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7ff15c009230 tx=0x7ff15c009260 comp rx=0 tx=0).stop 2024-08-02T18:49:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2191421743 shutdown_connections 2024-08-02T18:49:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d4103e0 0x56203d4000d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d405b20 0x56203d428350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/2191421743 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405200 0x56203d427e10 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.676+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2191421743 >> 172.21.15.103:0/2191421743 conn(0x56203d401790 msgr2=0x56203d40c320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2191421743 shutdown_connections 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 -- 172.21.15.103:0/2191421743 wait complete. 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 -- start start 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 Processor -- start 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d409c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d417200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff1741ab0b0 con 0x56203d405b20 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff1741ac520 con 0x56203d405200 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff1741ab780 con 0x56203d4103e0 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff17bf7a740 10 client.0 _ll_register_callbacks cb 0x7ff164009750 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.677+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff1737fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60636/0 (socket says 172.21.15.103:60636) 2024-08-02T18:49:51.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff1737fe640 1 -- 172.21.15.103:0/1874877261 learned_addr learned my addr 172.21.15.103:0/1874877261 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff16bfff640 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d417200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff16bfff640 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d409c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff1737fe640 1 -- 172.21.15.103:0/1874877261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 msgr2=0x56203d417200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff1737fe640 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d417200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff1737fe640 1 -- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 msgr2=0x56203d409c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff1737fe640 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d409c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff1737fe640 1 -- 172.21.15.103:0/1874877261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56203d4177c0 con 0x56203d405b20 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff16bfff640 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d409c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff1737fe640 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40a160 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff164004ef0 tx=0x7ff16401ab70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88af94b8dbddbe94 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff152ffd640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff152ffd640 1 -- 172.21.15.103:0/1874877261 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff16401e040 con 0x56203d405b20 2024-08-02T18:49:51.684 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff152ffd640 1 -- 172.21.15.103:0/1874877261 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff164005410 con 0x56203d405b20 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff17bf7a740 1 -- 172.21.15.103:0/1874877261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff15c04f030 con 0x56203d405b20 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff152ffd640 1 -- 172.21.15.103:0/1874877261 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff164048050 con 0x56203d405b20 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff17bf7a740 10 client.15402 fetch_fsmap learned FSMap version 26 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.678+0000 7ff17bf7a740 1 -- 172.21.15.103:0/1874877261 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56203d418ae0 con 0x56203d405b20 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff152ffd640 1 -- 172.21.15.103:0/1874877261 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff15c04f030 con 0x56203d405b20 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff152ffd640 1 -- 172.21.15.103:0/1874877261 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff164039070 con 0x56203d405b20 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff17bf7a740 10 client.15402 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff17bf7a740 10 client.15402 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff17bf7a740 20 client.15402 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56203d420290 0x56203d48d000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff17bf7a740 4 client.15402 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff17bf7a740 1 -- 172.21.15.103:0/1874877261 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x56203d372270 con 0x56203d420290 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.679+0000 7ff16bfff640 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56203d420290 0x56203d48d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.680+0000 7ff152ffd640 10 client.15402 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.680+0000 7ff16bfff640 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56203d420290 0x56203d48d000 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=181c1b6eda2a1578 server_cookie=8cc4e929743f886 in_seq=0 out_seq=0 2024-08-02T18:49:51.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff152ffd640 1 -- 172.21.15.103:0/1874877261 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x56203d372270 con 0x56203d420290 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff152ffd640 10 client.15402 handle_command_reply: tid=0 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 client.15402 shutdown 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 -- 172.21.15.103:0/1874877261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 msgr2=0x56203d40a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40a160 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7ff164004ef0 tx=0x7ff16401ab70 comp rx=0 tx=0).stop 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 -- 172.21.15.103:0/1874877261 shutdown_connections 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56203d420290 0x56203d48d000 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56203d4103e0 0x56203d417200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56203d405b20 0x56203d40a160 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 --2- 172.21.15.103:0/1874877261 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56203d405200 0x56203d409c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff152ffd640 0 client.15402 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 -- 172.21.15.103:0/1874877261 >> 172.21.15.103:0/1874877261 conn(0x56203d401790 msgr2=0x56203d40ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 -- 172.21.15.103:0/1874877261 shutdown_connections 2024-08-02T18:49:51.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 1 -- 172.21.15.103:0/1874877261 wait complete. 2024-08-02T18:49:51.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.681+0000 7ff17bf7a740 20 client.15402 trim_cache size 0 max 16384 2024-08-02T18:49:51.688 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:49:51.688 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-08-02T18:49:51.688 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "34341632-eca3-499e-9cf8-4e2b6bc7d10e", 2024-08-02T18:49:51.688 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-08-02T18:49:51.688 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:49:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 -- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff1600a2d80 msgr2=0x7ff1600a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff1600a2d80 0x7ff1600a5240 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7ff16c0cc8d0 tx=0x7ff16c050db0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 -- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff174102c20 msgr2=0x7ff1741a4220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff174102c20 0x7ff1741a4220 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7ff16c009fd0 tx=0x7ff16c00b260 comp rx=0 tx=0).stop 2024-08-02T18:49:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 -- 172.21.15.103:0/4277042973 shutdown_connections 2024-08-02T18:49:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff1600a2d80 0x7ff1600a5240 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff174102c20 0x7ff1741a4220 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff1741022a0 0x7ff1741996e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 --2- 172.21.15.103:0/4277042973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff174100b50 0x7ff1741991a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 -- 172.21.15.103:0/4277042973 >> 172.21.15.103:0/4277042973 conn(0x7ff1740fc500 msgr2=0x7ff1740fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 -- 172.21.15.103:0/4277042973 shutdown_connections 2024-08-02T18:49:51.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.682+0000 7ff179b7c640 1 -- 172.21.15.103:0/4277042973 wait complete. 2024-08-02T18:49:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:51 smithi121 ceph-mon[37236]: pgmap v6: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T18:49:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:51 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1135302253' entity='client.admin' 2024-08-02T18:49:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:51 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:51 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:51 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:51.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:51 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:51.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.822+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command([{prefix=config set, name=mgr/snap_schedule/dump_on_update}] v 0) -- 0x7fa8dc1a4fb0 con 0x7fa8dc101820 2024-08-02T18:49:51.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.829+0000 7fa8d8ff9640 1 -- 172.21.15.103:0/538588927 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/snap_schedule/dump_on_update}]=0 v30)=0 v30) ==== 133+0+0 (secure 0 0 0) 0x7fa8d00c06a0 con 0x7fa8dc101820 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa8c40a2e40 msgr2=0x7fa8c40a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa8c40a2e40 0x7fa8c40a5300 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fa8cc009b30 tx=0x7fa8cc005f90 comp rx=0 tx=0).stop 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101820 msgr2=0x7fa8dc199560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101820 0x7fa8dc199560 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0006010 tx=0x7fa8d00040c0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 shutdown_connections 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa8c40a2e40 0x7fa8c40a5300 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa8dc1025d0 0x7fa8dc1a40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa8dc101820 0x7fa8dc199560 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 --2- 172.21.15.103:0/538588927 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa8dc100ea0 0x7fa8dc199020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 >> 172.21.15.103:0/538588927 conn(0x7fa8dc076e20 msgr2=0x7fa8dc0fe4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 shutdown_connections 2024-08-02T18:49:51.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.831+0000 7fa8e212b640 1 -- 172.21.15.103:0/538588927 wait complete. 2024-08-02T18:49:51.845 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule add --fs=cephfs --path=/ --snap_schedule=1m' 2024-08-02T18:49:51.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 -- 172.21.15.103:0/3776823362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118103370 msgr2=0x7fe11810b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/3776823362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118103370 0x7fe11810b850 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe104009900 tx=0x7fe10402a480 comp rx=0 tx=0).stop 2024-08-02T18:49:51.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 -- 172.21.15.103:0/3776823362 shutdown_connections 2024-08-02T18:49:51.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/3776823362 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe11810be20 0x7fe11810e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/3776823362 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118103370 0x7fe11810b850 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/3776823362 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe118102a50 0x7fe118102e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 -- 172.21.15.103:0/3776823362 >> 172.21.15.103:0/3776823362 conn(0x7fe1180776c0 msgr2=0x7fe1180fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:51.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 -- 172.21.15.103:0/3776823362 shutdown_connections 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.949+0000 7fe11f0e3640 1 -- 172.21.15.103:0/3776823362 wait complete. 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11f0e3640 1 Processor -- start 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11f0e3640 1 -- start start 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11f0e3640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118102a50 0x7fe118198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11f0e3640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe118103370 0x7fe118198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11f0e3640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe11810be20 0x7fe11819c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11f0e3640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe118111d60 con 0x7fe118102a50 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11f0e3640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe118111be0 con 0x7fe118103370 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11f0e3640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe118111ee0 con 0x7fe11810be20 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11ce7f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118102a50 0x7fe118198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11ce7f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118102a50 0x7fe118198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60658/0 (socket says 172.21.15.103:60658) 2024-08-02T18:49:51.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11ce7f640 1 -- 172.21.15.103:0/4259874802 learned_addr learned my addr 172.21.15.103:0/4259874802 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:51.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe11d680640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe11810be20 0x7fe11819c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.950+0000 7fe117fff640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe118103370 0x7fe118198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11ce7f640 1 -- 172.21.15.103:0/4259874802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe11810be20 msgr2=0x7fe11819c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11ce7f640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe11810be20 0x7fe11819c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11ce7f640 1 -- 172.21.15.103:0/4259874802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe118103370 msgr2=0x7fe118198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11ce7f640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe118103370 0x7fe118198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11ce7f640 1 -- 172.21.15.103:0/4259874802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe11819d100 con 0x7fe118102a50 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11d680640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe11810be20 0x7fe11819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11ce7f640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118102a50 0x7fe118198110 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00e9f0 tx=0x7fe10c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe115ffb640 1 -- 172.21.15.103:0/4259874802 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c00cd80 con 0x7fe118102a50 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe115ffb640 1 -- 172.21.15.103:0/4259874802 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe10c005520 con 0x7fe118102a50 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe11819d3f0 con 0x7fe118102a50 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe115ffb640 1 -- 172.21.15.103:0/4259874802 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe10c010690 con 0x7fe118102a50 2024-08-02T18:49:51.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.951+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1181a4c80 con 0x7fe118102a50 2024-08-02T18:49:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.952+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe118102e30 con 0x7fe118102a50 2024-08-02T18:49:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.953+0000 7fe115ffb640 1 -- 172.21.15.103:0/4259874802 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7fe10c0046c0 con 0x7fe118102a50 2024-08-02T18:49:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.954+0000 7fe115ffb640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe1080a2e40 0x7fe1080a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.954+0000 7fe117fff640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe1080a2e40 0x7fe1080a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.954+0000 7fe115ffb640 1 -- 172.21.15.103:0/4259874802 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fe10c0cfeb0 con 0x7fe118102a50 2024-08-02T18:49:51.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.954+0000 7fe117fff640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe1080a2e40 0x7fe1080a5300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe104000c00 tx=0x7fe104005a20 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:51.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:51.958+0000 7fe115ffb640 1 -- 172.21.15.103:0/4259874802 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe10c09c620 con 0x7fe118102a50 2024-08-02T18:49:52.162 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.160+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}) -- 0x7fe1180fd350 con 0x7fe1080a2e40 2024-08-02T18:49:52.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.224+0000 7fe115ffb640 1 -- 172.21.15.103:0/4259874802 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+24 (secure 0 0 0) 0x7fe1180fd350 con 0x7fe1080a2e40 2024-08-02T18:49:52.227 INFO:teuthology.orchestra.run.smithi103.stdout:Schedule set for path / 2024-08-02T18:49:52.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe1080a2e40 msgr2=0x7fe1080a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe1080a2e40 0x7fe1080a5300 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fe104000c00 tx=0x7fe104005a20 comp rx=0 tx=0).stop 2024-08-02T18:49:52.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118102a50 msgr2=0x7fe118198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118102a50 0x7fe118198110 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe10c00e9f0 tx=0x7fe10c00edf0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 shutdown_connections 2024-08-02T18:49:52.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe1080a2e40 0x7fe1080a5300 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe11810be20 0x7fe11819c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe118103370 0x7fe118198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 --2- 172.21.15.103:0/4259874802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe118102a50 0x7fe118198110 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 >> 172.21.15.103:0/4259874802 conn(0x7fe1180776c0 msgr2=0x7fe1180fcc40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 shutdown_connections 2024-08-02T18:49:52.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.227+0000 7fe11f0e3640 1 -- 172.21.15.103:0/4259874802 wait complete. 2024-08-02T18:49:52.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule retention add --fs=cephfs --path=/ --retention-spec-or-period=6m3h' 2024-08-02T18:49:52.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.344+0000 7fdac5f65640 1 -- 172.21.15.103:0/2393063994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac00ffc90 msgr2=0x7fdac01000d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.344+0000 7fdac5f65640 1 --2- 172.21.15.103:0/2393063994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac00ffc90 0x7fdac01000d0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7fdab0009900 tx=0x7fdab002a410 comp rx=0 tx=0).stop 2024-08-02T18:49:52.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.345+0000 7fdac5f65640 1 -- 172.21.15.103:0/2393063994 shutdown_connections 2024-08-02T18:49:52.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.345+0000 7fdac5f65640 1 --2- 172.21.15.103:0/2393063994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac0100610 0x7fdac010e770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.345+0000 7fdac5f65640 1 --2- 172.21.15.103:0/2393063994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac00ffc90 0x7fdac01000d0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.345+0000 7fdac5f65640 1 --2- 172.21.15.103:0/2393063994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdac01068e0 0x7fdac0106cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.354 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.345+0000 7fdac5f65640 1 -- 172.21.15.103:0/2393063994 >> 172.21.15.103:0/2393063994 conn(0x7fdac0076e20 msgr2=0x7fdac00fe1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:52.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.345+0000 7fdac5f65640 1 -- 172.21.15.103:0/2393063994 shutdown_connections 2024-08-02T18:49:52.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.345+0000 7fdac5f65640 1 -- 172.21.15.103:0/2393063994 wait complete. 2024-08-02T18:49:52.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.345+0000 7fdac5f65640 1 Processor -- start 2024-08-02T18:49:52.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdac5f65640 1 -- start start 2024-08-02T18:49:52.355 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdac5f65640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdac00ffc90 0x7fdac0198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdac5f65640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac0100610 0x7fdac01987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdac5f65640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac01068e0 0x7fdac019cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdac5f65640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdac0111e70 con 0x7fdac01068e0 2024-08-02T18:49:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdac5f65640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdac0111cf0 con 0x7fdac00ffc90 2024-08-02T18:49:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdac5f65640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdac0111ff0 con 0x7fdac0100610 2024-08-02T18:49:52.356 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdabffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac01068e0 0x7fdac019cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdabffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac01068e0 0x7fdac019cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60682/0 (socket says 172.21.15.103:60682) 2024-08-02T18:49:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdabffff640 1 -- 172.21.15.103:0/3620810191 learned_addr learned my addr 172.21.15.103:0/3620810191 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdabf7fe640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdac00ffc90 0x7fdac0198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.346+0000 7fdabeffd640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac0100610 0x7fdac01987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabffff640 1 -- 172.21.15.103:0/3620810191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac0100610 msgr2=0x7fdac01987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.357 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabffff640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac0100610 0x7fdac01987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabffff640 1 -- 172.21.15.103:0/3620810191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdac00ffc90 msgr2=0x7fdac0198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabffff640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdac00ffc90 0x7fdac0198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabffff640 1 -- 172.21.15.103:0/3620810191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdac019d270 con 0x7fdac01068e0 2024-08-02T18:49:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabeffd640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac0100610 0x7fdac01987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabf7fe640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdac00ffc90 0x7fdac0198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:52.358 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabffff640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac01068e0 0x7fdac019cb40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdab800e9f0 tx=0x7fdab800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabcff9640 1 -- 172.21.15.103:0/3620810191 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab800cd80 con 0x7fdac01068e0 2024-08-02T18:49:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdac019d560 con 0x7fdac01068e0 2024-08-02T18:49:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabcff9640 1 -- 172.21.15.103:0/3620810191 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdab8004b20 con 0x7fdac01068e0 2024-08-02T18:49:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdabcff9640 1 -- 172.21.15.103:0/3620810191 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdab80117a0 con 0x7fdac01068e0 2024-08-02T18:49:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.347+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdac01a4df0 con 0x7fdac01068e0 2024-08-02T18:49:52.359 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.348+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdac01000d0 con 0x7fdac01068e0 2024-08-02T18:49:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.349+0000 7fdabcff9640 1 -- 172.21.15.103:0/3620810191 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7fdab8004cd0 con 0x7fdac01068e0 2024-08-02T18:49:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.350+0000 7fdabcff9640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa80a2e40 0x7fdaa80a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.350+0000 7fdabf7fe640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa80a2e40 0x7fdaa80a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.351+0000 7fdabcff9640 1 -- 172.21.15.103:0/3620810191 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fdab80cff20 con 0x7fdac01068e0 2024-08-02T18:49:52.360 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.351+0000 7fdabf7fe640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa80a2e40 0x7fdaa80a5300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdab4005d70 tx=0x7fdab4005d00 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:52.361 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.353+0000 7fdabcff9640 1 -- 172.21.15.103:0/3620810191 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdab8016030 con 0x7fdac01068e0 2024-08-02T18:49:52.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-02T18:49:52.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2411731054' entity='client.admin' 2024-08-02T18:49:52.504 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:52.569 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.567+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}) -- 0x7fdac0104d00 con 0x7fdaa80a2e40 2024-08-02T18:49:52.632 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.630+0000 7fdabcff9640 1 -- 172.21.15.103:0/3620810191 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+26 (secure 0 0 0) 0x7fdac0104d00 con 0x7fdaa80a2e40 2024-08-02T18:49:52.632 INFO:teuthology.orchestra.run.smithi103.stdout:Retention added to path / 2024-08-02T18:49:52.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa80a2e40 msgr2=0x7fdaa80a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa80a2e40 0x7fdaa80a5300 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fdab4005d70 tx=0x7fdab4005d00 comp rx=0 tx=0).stop 2024-08-02T18:49:52.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac01068e0 msgr2=0x7fdac019cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac01068e0 0x7fdac019cb40 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7fdab800e9f0 tx=0x7fdab800eeb0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 shutdown_connections 2024-08-02T18:49:52.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa80a2e40 0x7fdaa80a5300 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdac01068e0 0x7fdac019cb40 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdac0100610 0x7fdac01987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 --2- 172.21.15.103:0/3620810191 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdac00ffc90 0x7fdac0198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 >> 172.21.15.103:0/3620810191 conn(0x7fdac0076e20 msgr2=0x7fdac01045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:52.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 shutdown_connections 2024-08-02T18:49:52.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.633+0000 7fdac5f65640 1 -- 172.21.15.103:0/3620810191 wait complete. 2024-08-02T18:49:52.642 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:52.647 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-02T18:49:52.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 -- 172.21.15.103:0/220551224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c1010c0 msgr2=0x7fd95c10d5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.752 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 --2- 172.21.15.103:0/220551224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c1010c0 0x7fd95c10d5f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7fd954009cd0 tx=0x7fd95402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 -- 172.21.15.103:0/220551224 shutdown_connections 2024-08-02T18:49:52.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 --2- 172.21.15.103:0/220551224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c1010c0 0x7fd95c10d5f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 --2- 172.21.15.103:0/220551224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd95c100720 0x7fd95c100b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 --2- 172.21.15.103:0/220551224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd95c106730 0x7fd95c106b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 -- 172.21.15.103:0/220551224 >> 172.21.15.103:0/220551224 conn(0x7fd95c0fc3e0 msgr2=0x7fd95c0fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:52.753 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 -- 172.21.15.103:0/220551224 shutdown_connections 2024-08-02T18:49:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.747+0000 7fd960823640 1 -- 172.21.15.103:0/220551224 wait complete. 2024-08-02T18:49:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd960823640 1 Processor -- start 2024-08-02T18:49:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd960823640 1 -- start start 2024-08-02T18:49:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd960823640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c100720 0x7fd95c196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd960823640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd95c1010c0 0x7fd95c197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd960823640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd95c106730 0x7fd95c19b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:52.754 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd960823640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c110c90 con 0x7fd95c100720 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd960823640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c110b10 con 0x7fd95c1010c0 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd960823640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd95c110e10 con 0x7fd95c106730 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.748+0000 7fd95a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c100720 0x7fd95c196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c100720 0x7fd95c196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60692/0 (socket says 172.21.15.103:60692) 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95a59c640 1 -- 172.21.15.103:0/1821409213 learned_addr learned my addr 172.21.15.103:0/1821409213 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95ad9d640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd95c106730 0x7fd95c19b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd959d9b640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd95c1010c0 0x7fd95c197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95a59c640 1 -- 172.21.15.103:0/1821409213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd95c106730 msgr2=0x7fd95c19b800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.755 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95a59c640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd95c106730 0x7fd95c19b800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95a59c640 1 -- 172.21.15.103:0/1821409213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd95c1010c0 msgr2=0x7fd95c197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95a59c640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd95c1010c0 0x7fd95c197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95a59c640 1 -- 172.21.15.103:0/1821409213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd95c19bf30 con 0x7fd95c100720 2024-08-02T18:49:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd95a59c640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c100720 0x7fd95c196f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00c920 tx=0x7fd94c00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd94b7fe640 1 -- 172.21.15.103:0/1821409213 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c007c70 con 0x7fd95c100720 2024-08-02T18:49:52.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd94b7fe640 1 -- 172.21.15.103:0/1821409213 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd94c007e10 con 0x7fd95c100720 2024-08-02T18:49:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd95c19c220 con 0x7fd95c100720 2024-08-02T18:49:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd94b7fe640 1 -- 172.21.15.103:0/1821409213 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd94c018940 con 0x7fd95c100720 2024-08-02T18:49:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.749+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd95c1a3ab0 con 0x7fd95c100720 2024-08-02T18:49:52.757 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.750+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd95c100b80 con 0x7fd95c100720 2024-08-02T18:49:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.751+0000 7fd94b7fe640 1 -- 172.21.15.103:0/1821409213 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7fd94c018b20 con 0x7fd95c100720 2024-08-02T18:49:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.752+0000 7fd94b7fe640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9440a2ec0 0x7fd9440a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.752+0000 7fd959d9b640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9440a2ec0 0x7fd9440a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.752+0000 7fd94b7fe640 1 -- 172.21.15.103:0/1821409213 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fd94c0cfa10 con 0x7fd95c100720 2024-08-02T18:49:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.752+0000 7fd959d9b640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9440a2ec0 0x7fd9440a5380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd950005e10 tx=0x7fd950005da0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:52.759 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.756+0000 7fd94b7fe640 1 -- 172.21.15.103:0/1821409213 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fd94c014030 con 0x7fd95c100720 2024-08-02T18:49:52.764 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:52.764 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:52.764 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:52.764 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/538588927' entity='client.admin' 2024-08-02T18:49:52.764 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:52.765 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:52.765 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:52.765 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:52.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2411731054' entity='client.admin' 2024-08-02T18:49:52.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:52.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:52.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:52.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:52.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/538588927' entity='client.admin' 2024-08-02T18:49:52.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:52.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:52.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:52.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:52.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.966+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7fd95c0fced0 con 0x7fd9440a2ec0 2024-08-02T18:49:53.203 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2411731054' entity='client.admin' 2024-08-02T18:49:53.203 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:53.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:53.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:53.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:53.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/538588927' entity='client.admin' 2024-08-02T18:49:53.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:49:53.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:49:53.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:49:53.204 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:49:53.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.973+0000 7fd94b7fe640 1 -- 172.21.15.103:0/1821409213 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+298 (secure 0 0 0) 0x7fd95c0fced0 con 0x7fd9440a2ec0 2024-08-02T18:49:53.205 INFO:teuthology.orchestra.run.smithi103.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-02T00:00:00", "created": "2024-08-02T18:49:52", "first": null, "last": null, "last_pruned": null, "created_count": 0, "pruned_count": 0, "active": true} 2024-08-02T18:49:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9440a2ec0 msgr2=0x7fd9440a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9440a2ec0 0x7fd9440a5380 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7fd950005e10 tx=0x7fd950005da0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c100720 msgr2=0x7fd95c196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c100720 0x7fd95c196f40 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fd94c00c920 tx=0x7fd94c00cde0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 shutdown_connections 2024-08-02T18:49:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9440a2ec0 0x7fd9440a5380 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd95c106730 0x7fd95c19b800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd95c1010c0 0x7fd95c197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 --2- 172.21.15.103:0/1821409213 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd95c100720 0x7fd95c196f40 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 >> 172.21.15.103:0/1821409213 conn(0x7fd95c0fc3e0 msgr2=0x7fd95c0fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 shutdown_connections 2024-08-02T18:49:53.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:52.975+0000 7fd960823640 1 -- 172.21.15.103:0/1821409213 wait complete. 2024-08-02T18:49:53.209 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-02T18:49:53.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 -- 172.21.15.103:0/767901895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e8102250 msgr2=0x7f69e810e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 --2- 172.21.15.103:0/767901895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e8102250 0x7f69e810e780 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f69d8009cd0 tx=0x7f69d802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.217 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 -- 172.21.15.103:0/767901895 shutdown_connections 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 --2- 172.21.15.103:0/767901895 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e8102250 0x7f69e810e780 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 --2- 172.21.15.103:0/767901895 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69e81018b0 0x7f69e8101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 --2- 172.21.15.103:0/767901895 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69e81078b0 0x7f69e8107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 -- 172.21.15.103:0/767901895 >> 172.21.15.103:0/767901895 conn(0x7f69e80fd5f0 msgr2=0x7f69e80ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 -- 172.21.15.103:0/767901895 shutdown_connections 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.131+0000 7f69eefa4640 1 -- 172.21.15.103:0/767901895 wait complete. 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69eefa4640 1 Processor -- start 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69eefa4640 1 -- start start 2024-08-02T18:49:53.218 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69eefa4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69e81018b0 0x7f69e8198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69eefa4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69e8102250 0x7f69e8198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69eefa4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e81078b0 0x7f69e819cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69eefa4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8111dd0 con 0x7f69e81078b0 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69eefa4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8111c50 con 0x7f69e8102250 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69eefa4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f69e8111f50 con 0x7f69e81018b0 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69ed541640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e81078b0 0x7f69e819cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69ed541640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e81078b0 0x7f69e819cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60708/0 (socket says 172.21.15.103:60708) 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69ed541640 1 -- 172.21.15.103:0/294602902 learned_addr learned my addr 172.21.15.103:0/294602902 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69e7fff640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69e8102250 0x7f69e8198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.132+0000 7f69ecd40640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69e81018b0 0x7f69e8198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69ed541640 1 -- 172.21.15.103:0/294602902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69e81018b0 msgr2=0x7f69e8198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69ed541640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69e81018b0 0x7f69e8198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.219 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69ed541640 1 -- 172.21.15.103:0/294602902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69e8102250 msgr2=0x7f69e8198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69ed541640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69e8102250 0x7f69e8198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69ed541640 1 -- 172.21.15.103:0/294602902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e819d1c0 con 0x7f69e81078b0 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69ed541640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e81078b0 0x7f69e819cae0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f69d8006010 tx=0x7f69d8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69e5ffb640 1 -- 172.21.15.103:0/294602902 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8004040 con 0x7f69e81078b0 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69e5ffb640 1 -- 172.21.15.103:0/294602902 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69d80046e0 con 0x7f69e81078b0 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69eefa4640 1 -- 172.21.15.103:0/294602902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e819d450 con 0x7f69e81078b0 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69e5ffb640 1 -- 172.21.15.103:0/294602902 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d8046480 con 0x7f69e81078b0 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.133+0000 7f69eefa4640 1 -- 172.21.15.103:0/294602902 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e81a4d90 con 0x7f69e81078b0 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69f13a2740 1 Processor -- start 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69e5ffb640 1 -- 172.21.15.103:0/294602902 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7f69d8030630 con 0x7f69e81078b0 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69f13a2740 1 -- start start 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 0x55b6932bb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.220 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932bba10 0x55b6932ca2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932ca800 0x55b6932ccbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69f13a2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b693220980 con 0x55b6932bba10 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69f13a2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6931b8a70 con 0x55b6932ca800 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69f13a2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b69321c940 con 0x55b6932bb0f0 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.136+0000 7f69ecd40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932bba10 0x55b6932ca2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ecd40640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932bba10 0x55b6932ca2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60722/0 (socket says 172.21.15.103:60722) 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ecd40640 1 -- 172.21.15.103:0/1809815047 learned_addr learned my addr 172.21.15.103:0/1809815047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69e5ffb640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f69d40a2d80 0x7f69d40a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69e7fff640 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932ca800 0x55b6932ccbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ecd40640 1 -- 172.21.15.103:0/1809815047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 msgr2=0x55b6932bb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ecd40640 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 0x55b6932bb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ecd40640 1 -- 172.21.15.103:0/1809815047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932ca800 msgr2=0x55b6932ccbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:53.221 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ecd40640 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932ca800 0x55b6932ccbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ecd40640 1 -- 172.21.15.103:0/1809815047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b69321b6e0 con 0x55b6932bba10 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69e7fff640 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932ca800 0x55b6932ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ed541640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f69d40a2d80 0x7f69d40a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69ecd40640 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932bba10 0x55b6932ca2c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f69e000cb40 tx=0x7f69e000e350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d427364d6422c502 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69e5ffb640 1 -- 172.21.15.103:0/294602902 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f69d802e030 con 0x7f69e81078b0 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69deffd640 1 -- 172.21.15.103:0/1809815047 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e0010430 con 0x55b6932bba10 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69deffd640 1 -- 172.21.15.103:0/1809815047 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69e0010ad0 con 0x55b6932bba10 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.137+0000 7f69deffd640 1 -- 172.21.15.103:0/1809815047 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69e000fcb0 con 0x55b6932bba10 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 -- 172.21.15.103:0/1809815047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932bba10 msgr2=0x55b6932ca2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69ed541640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f69d40a2d80 0x7f69d40a5240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69d80ee260 tx=0x7f69d80a7a50 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932bba10 0x55b6932ca2c0 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f69e000cb40 tx=0x7f69e000e350 comp rx=0 tx=0).stop 2024-08-02T18:49:53.222 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 -- 172.21.15.103:0/1809815047 shutdown_connections 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932ca800 0x55b6932ccbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932bba10 0x55b6932ca2c0 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1809815047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 0x55b6932bb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 -- 172.21.15.103:0/1809815047 >> 172.21.15.103:0/1809815047 conn(0x55b6932b77a0 msgr2=0x55b6932b7b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 -- 172.21.15.103:0/1809815047 shutdown_connections 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 -- 172.21.15.103:0/1809815047 wait complete. 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.138+0000 7f69f13a2740 1 -- start start 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69f13a2740 1 Processor -- start 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 0x55b6932c7830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bba10 0x55b6932c7d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932c82b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69f13a2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b6932cd3d0 con 0x55b6932ca800 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69f13a2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b6931dbaa0 con 0x55b6932bba10 2024-08-02T18:49:53.223 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69f13a2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b6932cd550 con 0x55b6932bb0f0 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69f13a2740 10 client.0 _ll_register_callbacks cb 0x55b6931cae60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932c82b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932c82b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60730/0 (socket says 172.21.15.103:60730) 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69e7fff640 1 -- 172.21.15.103:0/313105226 learned_addr learned my addr 172.21.15.103:0/313105226 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69ecd40640 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bba10 0x55b6932c7d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69e7fff640 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 0x55b6932c7830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69e7fff640 1 -- 172.21.15.103:0/313105226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 msgr2=0x55b6932c7830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69e7fff640 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 0x55b6932c7830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69e7fff640 1 -- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bba10 msgr2=0x55b6932c7d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.139+0000 7f69e7fff640 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bba10 0x55b6932c7d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69e7fff640 1 -- 172.21.15.103:0/313105226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6931bf650 con 0x55b6932ca800 2024-08-02T18:49:53.224 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69ecd40640 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bba10 0x55b6932c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69e7fff640 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932c82b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f69d00137a0 tx=0x7f69d000b820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9637f6020f450d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69c7fff640 1 -- 172.21.15.103:0/313105226 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d000fa70 con 0x55b6932ca800 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 1 -- 172.21.15.103:0/313105226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69e0010ad0 con 0x55b6932ca800 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69c7fff640 1 -- 172.21.15.103:0/313105226 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f69d000fc10 con 0x55b6932ca800 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69c7fff640 1 -- 172.21.15.103:0/313105226 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f69d0025050 con 0x55b6932ca800 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 10 client.15432 fetch_fsmap learned FSMap version 26 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 1 -- 172.21.15.103:0/313105226 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b692f923c0 con 0x55b6932ca800 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69c7fff640 1 -- 172.21.15.103:0/313105226 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69e0010ad0 con 0x55b6932ca800 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69c7fff640 1 -- 172.21.15.103:0/313105226 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f69d001d020 con 0x55b6932ca800 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 10 client.15432 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 10 client.15432 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:49:53.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 20 client.15432 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b6932da470 0x55b6932dc860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 4 client.15432 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.140+0000 7f69f13a2740 1 -- 172.21.15.103:0/313105226 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b69322def0 con 0x55b6932da470 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.141+0000 7f69ecd40640 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b6932da470 0x55b6932dc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.141+0000 7f69ecd40640 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b6932da470 0x55b6932dc860 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1303d138f32afaa2 server_cookie=cbb4397c9b86b4ed in_seq=0 out_seq=0 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.141+0000 7f69c7fff640 10 client.15432 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69c7fff640 1 -- 172.21.15.103:0/313105226 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b69322def0 con 0x55b6932da470 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69c7fff640 10 client.15432 handle_command_reply: tid=0 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 client.15432 shutdown 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 -- 172.21.15.103:0/313105226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 msgr2=0x55b6932c82b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932c82b0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f69d00137a0 tx=0x7f69d000b820 comp rx=0 tx=0).stop 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 -- 172.21.15.103:0/313105226 shutdown_connections 2024-08-02T18:49:53.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b6932da470 0x55b6932dc860 crc :-1 s=READY pgs=39 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932c82b0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69c7fff640 0 client.15432 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bba10 0x55b6932c7d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 --2- 172.21.15.103:0/313105226 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bb0f0 0x55b6932c7830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 -- 172.21.15.103:0/313105226 >> 172.21.15.103:0/313105226 conn(0x55b6932b77a0 msgr2=0x55b6932bd500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 -- 172.21.15.103:0/313105226 shutdown_connections 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 1 -- 172.21.15.103:0/313105226 wait complete. 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.142+0000 7f69f13a2740 20 client.15432 trim_cache size 0 max 16384 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69f13a2740 1 Processor -- start 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69f13a2740 1 -- start start 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 0x55b6932c9690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 0x55b6932e2130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932e2670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69f13a2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69e81af230 con 0x55b6932ca800 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69f13a2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f69e81acb00 con 0x55b6932bb0f0 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69f13a2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f69e81aa950 con 0x55b6932bba10 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932e2670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932e2670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60742/0 (socket says 172.21.15.103:60742) 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.159+0000 7f69e7fff640 1 -- 172.21.15.103:0/4092809054 learned_addr learned my addr 172.21.15.103:0/4092809054 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69ecd40640 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 0x55b6932e2130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69e7fff640 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 0x55b6932c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69e7fff640 1 -- 172.21.15.103:0/4092809054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 msgr2=0x55b6932e2130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69e7fff640 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 0x55b6932e2130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69e7fff640 1 -- 172.21.15.103:0/4092809054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 msgr2=0x55b6932c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69e7fff640 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 0x55b6932c9690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69e7fff640 1 -- 172.21.15.103:0/4092809054 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6932d9010 con 0x55b6932ca800 2024-08-02T18:49:53.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69e7fff640 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932e2670 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f69d00057c0 tx=0x7f69d0005710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae15a7ef678104 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69de7fc640 1 -- 172.21.15.103:0/4092809054 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0000e60 con 0x55b6932ca800 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69de7fc640 1 -- 172.21.15.103:0/4092809054 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69d000b890 con 0x55b6932ca800 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.160+0000 7f69de7fc640 1 -- 172.21.15.103:0/4092809054 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0004260 con 0x55b6932ca800 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 -- 172.21.15.103:0/4092809054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 msgr2=0x55b6932e2670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932e2670 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f69d00057c0 tx=0x7f69d0005710 comp rx=0 tx=0).stop 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 -- 172.21.15.103:0/4092809054 shutdown_connections 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932e2670 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 0x55b6932e2130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 --2- 172.21.15.103:0/4092809054 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 0x55b6932c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 -- 172.21.15.103:0/4092809054 >> 172.21.15.103:0/4092809054 conn(0x55b6932b77a0 msgr2=0x55b6932c8f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 -- 172.21.15.103:0/4092809054 shutdown_connections 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 -- 172.21.15.103:0/4092809054 wait complete. 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 -- start start 2024-08-02T18:49:53.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.161+0000 7f69f13a2740 1 Processor -- start 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 0x55b6932c4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 0x55b6932c4680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69f13a2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932d17d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69f13a2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f69e81aafc0 con 0x55b6932ca800 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69f13a2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f69e81ac430 con 0x55b6932bb0f0 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69f13a2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f69e81ab690 con 0x55b6932bba10 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69f13a2740 10 client.0 _ll_register_callbacks cb 0x7f69d000b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932d17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932d17d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60754/0 (socket says 172.21.15.103:60754) 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 -- 172.21.15.103:0/1331587241 learned_addr learned my addr 172.21.15.103:0/1331587241 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69ecd40640 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 0x55b6932c4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 0x55b6932c4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 -- 172.21.15.103:0/1331587241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 msgr2=0x55b6932c4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 0x55b6932c4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 -- 172.21.15.103:0/1331587241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 msgr2=0x55b6932c4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 0x55b6932c4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 -- 172.21.15.103:0/1331587241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b6932c4f80 con 0x55b6932ca800 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69e7fff640 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932d17d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f69d0003be0 tx=0x7f69d000fe00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42ff5fd40bdc7a9a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69c7fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69c7fff640 1 -- 172.21.15.103:0/1331587241 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d00037f0 con 0x55b6932ca800 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69c7fff640 1 -- 172.21.15.103:0/1331587241 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f69d0005110 con 0x55b6932ca800 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.162+0000 7f69f13a2740 1 -- 172.21.15.103:0/1331587241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d000b890 con 0x55b6932ca800 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69c7fff640 1 -- 172.21.15.103:0/1331587241 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f69d0005310 con 0x55b6932ca800 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69f13a2740 10 client.15438 fetch_fsmap learned FSMap version 26 2024-08-02T18:49:53.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69f13a2740 1 -- 172.21.15.103:0/1331587241 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b6932d2e50 con 0x55b6932ca800 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69c7fff640 1 -- 172.21.15.103:0/1331587241 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f69d000b890 con 0x55b6932ca800 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69c7fff640 1 -- 172.21.15.103:0/1331587241 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f69d0035040 con 0x55b6932ca800 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69f13a2740 10 client.15438 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69f13a2740 10 client.15438 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69f13a2740 20 client.15438 populate_metadata read hostname 'smithi103' 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b6933498f0 0x55b69334bce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69f13a2740 4 client.15438 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69f13a2740 1 -- 172.21.15.103:0/1331587241 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55b693228400 con 0x55b6933498f0 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69ecd40640 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b6933498f0 0x55b69334bce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69c7fff640 10 client.15438 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.163+0000 7f69ecd40640 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b6933498f0 0x55b69334bce0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=467cb36dafde350d server_cookie=87e5baa156eaac7a in_seq=0 out_seq=0 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69c7fff640 1 -- 172.21.15.103:0/1331587241 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55b693228400 con 0x55b6933498f0 2024-08-02T18:49:53.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69c7fff640 10 client.15438 handle_command_reply: tid=0 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 client.15438 shutdown 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 -- 172.21.15.103:0/1331587241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 msgr2=0x55b6932d17d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932d17d0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7f69d0003be0 tx=0x7f69d000fe00 comp rx=0 tx=0).stop 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 -- 172.21.15.103:0/1331587241 shutdown_connections 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b6933498f0 0x55b69334bce0 crc :-1 s=READY pgs=40 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b6932ca800 0x55b6932d17d0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b6932bba10 0x55b6932c4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69c7fff640 0 client.15438 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 --2- 172.21.15.103:0/1331587241 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b6932bb0f0 0x55b6932c4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 -- 172.21.15.103:0/1331587241 >> 172.21.15.103:0/1331587241 conn(0x55b6932b77a0 msgr2=0x55b6932c8010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 -- 172.21.15.103:0/1331587241 shutdown_connections 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 1 -- 172.21.15.103:0/1331587241 wait complete. 2024-08-02T18:49:53.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.164+0000 7f69f13a2740 20 client.15438 trim_cache size 0 max 16384 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout: "34341632-eca3-499e-9cf8-4e2b6bc7d10e": { 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/", 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "34341632-eca3-499e-9cf8-4e2b6bc7d10e", 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:49:53.234 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:49:53.235 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:49:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 -- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f69d40a2d80 msgr2=0x7f69d40a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f69d40a2d80 0x7f69d40a5240 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f69d80ee260 tx=0x7f69d80a7a50 comp rx=0 tx=0).stop 2024-08-02T18:49:53.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 -- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e81078b0 msgr2=0x7f69e819cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e81078b0 0x7f69e819cae0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f69d8006010 tx=0x7f69d8003f10 comp rx=0 tx=0).stop 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 -- 172.21.15.103:0/294602902 shutdown_connections 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f69d40a2d80 0x7f69d40a5240 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f69e81078b0 0x7f69e819cae0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f69e8102250 0x7f69e8198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 --2- 172.21.15.103:0/294602902 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f69e81018b0 0x7f69e8198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 -- 172.21.15.103:0/294602902 >> 172.21.15.103:0/294602902 conn(0x7f69e80fd5f0 msgr2=0x7f69e80fdcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 -- 172.21.15.103:0/294602902 shutdown_connections 2024-08-02T18:49:53.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.165+0000 7f69eefa4640 1 -- 172.21.15.103:0/294602902 wait complete. 2024-08-02T18:49:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 -- 172.21.15.103:0/1487028715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de81021a0 msgr2=0x7f2de810e6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 --2- 172.21.15.103:0/1487028715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de81021a0 0x7f2de810e6d0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f2de0009cd0 tx=0x7f2de002a8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 -- 172.21.15.103:0/1487028715 shutdown_connections 2024-08-02T18:49:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 --2- 172.21.15.103:0/1487028715 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de81021a0 0x7f2de810e6d0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 --2- 172.21.15.103:0/1487028715 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de8101800 0x7f2de8101c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 --2- 172.21.15.103:0/1487028715 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8107810 0x7f2de8107bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 -- 172.21.15.103:0/1487028715 >> 172.21.15.103:0/1487028715 conn(0x7f2de80fd500 msgr2=0x7f2de80ff920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.347 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 -- 172.21.15.103:0/1487028715 shutdown_connections 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 -- 172.21.15.103:0/1487028715 wait complete. 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 Processor -- start 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.343+0000 7f2ded295640 1 -- start start 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2ded295640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8101800 0x7f2de8198120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2ded295640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de81021a0 0x7f2de8198660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2ded295640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de8107810 0x7f2de819c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2ded295640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8111d70 con 0x7f2de8107810 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2ded295640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8111bf0 con 0x7f2de8101800 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2ded295640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2de8111ef0 con 0x7f2de81021a0 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de8107810 0x7f2de819c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de8107810 0x7f2de819c9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60780/0 (socket says 172.21.15.103:60780) 2024-08-02T18:49:53.348 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de67fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de81021a0 0x7f2de8198660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 -- 172.21.15.103:0/2097579149 learned_addr learned my addr 172.21.15.103:0/2097579149 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de6ffd640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8101800 0x7f2de8198120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 -- 172.21.15.103:0/2097579149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de81021a0 msgr2=0x7f2de8198660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de81021a0 0x7f2de8198660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 -- 172.21.15.103:0/2097579149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8101800 msgr2=0x7f2de8198120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8101800 0x7f2de8198120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 -- 172.21.15.103:0/2097579149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2de819d110 con 0x7f2de8107810 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.344+0000 7f2de77fe640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de8107810 0x7f2de819c9e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2de0006010 tx=0x7f2de0003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.345+0000 7f2dcffff640 1 -- 172.21.15.103:0/2097579149 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0031c80 con 0x7f2de8107810 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.345+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2de819d3a0 con 0x7f2de8107810 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.345+0000 7f2dcffff640 1 -- 172.21.15.103:0/2097579149 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2de0031e20 con 0x7f2de8107810 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.345+0000 7f2dcffff640 1 -- 172.21.15.103:0/2097579149 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2de0030cb0 con 0x7f2de8107810 2024-08-02T18:49:53.349 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.345+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2de81a4c90 con 0x7f2de8107810 2024-08-02T18:49:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.346+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2de8101c60 con 0x7f2de8107810 2024-08-02T18:49:53.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.347+0000 7f2dcffff640 1 -- 172.21.15.103:0/2097579149 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7f2de0004040 con 0x7f2de8107810 2024-08-02T18:49:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.348+0000 7f2dcffff640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f2dd00a2e40 0x7f2dd00a5300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.348+0000 7f2de6ffd640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f2dd00a2e40 0x7f2dd00a5300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.348+0000 7f2dcffff640 1 -- 172.21.15.103:0/2097579149 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f2de002e030 con 0x7f2de8107810 2024-08-02T18:49:53.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.348+0000 7f2de6ffd640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f2dd00a2e40 0x7f2dd00a5300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009b50 tx=0x7f2dd8005f90 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:53.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.351+0000 7f2dcffff640 1 -- 172.21.15.103:0/2097579149 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f2de00bd270 con 0x7f2de8107810 2024-08-02T18:49:53.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.570+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7f2de80fe1b0 con 0x7f2dd00a2e40 2024-08-02T18:49:53.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.577+0000 7f2dcffff640 1 -- 172.21.15.103:0/2097579149 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7f2de80fe1b0 con 0x7f2dd00a2e40 2024-08-02T18:49:53.579 INFO:teuthology.orchestra.run.smithi103.stdout:/ 1m 6m3h 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f2dd00a2e40 msgr2=0x7f2dd00a5300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f2dd00a2e40 0x7f2dd00a5300 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f2dd8009b50 tx=0x7f2dd8005f90 comp rx=0 tx=0).stop 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de8107810 msgr2=0x7f2de819c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de8107810 0x7f2de819c9e0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f2de0006010 tx=0x7f2de0003f10 comp rx=0 tx=0).stop 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 shutdown_connections 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f2dd00a2e40 0x7f2dd00a5300 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2de8107810 0x7f2de819c9e0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2de81021a0 0x7f2de8198660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 --2- 172.21.15.103:0/2097579149 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2de8101800 0x7f2de8198120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:53.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.579+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 >> 172.21.15.103:0/2097579149 conn(0x7f2de80fd500 msgr2=0x7f2de80fdaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:53.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.580+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 shutdown_connections 2024-08-02T18:49:53.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:53.580+0000 7f2ded295640 1 -- 172.21.15.103:0/2097579149 wait complete. 2024-08-02T18:49:53.593 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > START_TIME' 2024-08-02T18:49:53.620 INFO:teuthology.run_tasks:Running task full_sequential_finally... 2024-08-02T18:49:53.632 INFO:teuthology.run_tasks:Running task background_exec... 2024-08-02T18:49:53.643 INFO:teuthology.task.background_exec:Running background command on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:49:53.644 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest daemon-helper kill --kill-group bash -c 'while sleep 13; do ceph tell mds.cephfs:0 flush journal; done' 2024-08-02T18:49:53.664 INFO:teuthology.run_tasks:Running task quiescer... 2024-08-02T18:49:53.680 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-08-02T18:49:53.680 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-02T18:49:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:53 smithi151 ceph-mon[37155]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 0 B/s wr, 22 op/s 2024-08-02T18:49:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:53 smithi151 ceph-mon[37155]: scrub queued for path: / 2024-08-02T18:49:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:53 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:49:53.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:53 smithi151 ceph-mon[37155]: scrub summary: active paths [/] 2024-08-02T18:49:53.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:53 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:49:53.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:53 smithi151 ceph-mon[37155]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:53 smithi103 ceph-mon[32753]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 0 B/s wr, 22 op/s 2024-08-02T18:49:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:53 smithi103 ceph-mon[32753]: scrub queued for path: / 2024-08-02T18:49:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:53 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:49:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:53 smithi103 ceph-mon[32753]: scrub summary: active paths [/] 2024-08-02T18:49:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:53 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:49:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:53 smithi103 ceph-mon[32753]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:53 smithi121 ceph-mon[37236]: pgmap v7: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 0 B/s wr, 22 op/s 2024-08-02T18:49:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:53 smithi121 ceph-mon[37236]: scrub queued for path: / 2024-08-02T18:49:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:53 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:49:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:53 smithi121 ceph-mon[37236]: scrub summary: active paths [/] 2024-08-02T18:49:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:53 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:49:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:53 smithi121 ceph-mon[37236]: from='client.15408 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule add", "fs": "cephfs", "path": "/", "snap_schedule": "1m", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:54.022 INFO:tasks.cephfs.filesystem:scrub status for tag:34341632-eca3-499e-9cf8-4e2b6bc7d10e - {'path': '/', 'tag': '34341632-eca3-499e-9cf8-4e2b6bc7d10e', 'options': 'recursive,force'} 2024-08-02T18:49:54.076 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:54.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.580+0000 7fa21c2f2640 1 -- 172.21.15.103:0/2393288605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214101150 msgr2=0x7fa21410d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:54.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.580+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/2393288605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214101150 0x7fa21410d680 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fa20c009cd0 tx=0x7fa20c02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.580+0000 7fa21c2f2640 1 -- 172.21.15.103:0/2393288605 shutdown_connections 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.580+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/2393288605 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa214101150 0x7fa21410d680 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.580+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/2393288605 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2141007b0 0x7fa214100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.580+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/2393288605 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2141067b0 0x7fa214106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.580+0000 7fa21c2f2640 1 -- 172.21.15.103:0/2393288605 >> 172.21.15.103:0/2393288605 conn(0x7fa2140fc4d0 msgr2=0x7fa2140fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.580+0000 7fa21c2f2640 1 -- 172.21.15.103:0/2393288605 shutdown_connections 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.581+0000 7fa21c2f2640 1 -- 172.21.15.103:0/2393288605 wait complete. 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.581+0000 7fa21c2f2640 1 Processor -- start 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.581+0000 7fa21c2f2640 1 -- start start 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21c2f2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2141007b0 0x7fa214197140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21c2f2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa214101150 0x7fa214197680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21c2f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2141067b0 0x7fa21419ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21c2f2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa214110d10 con 0x7fa2141007b0 2024-08-02T18:49:54.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21c2f2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa214110b90 con 0x7fa2141067b0 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21c2f2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa214110e90 con 0x7fa214101150 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2141007b0 0x7fa214197140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2141007b0 0x7fa214197140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60802/0 (socket says 172.21.15.103:60802) 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 -- 172.21.15.103:0/4097940185 learned_addr learned my addr 172.21.15.103:0/4097940185 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21988d640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa214101150 0x7fa214197680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a88f640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2141067b0 0x7fa21419ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 -- 172.21.15.103:0/4097940185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa214101150 msgr2=0x7fa214197680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa214101150 0x7fa214197680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 -- 172.21.15.103:0/4097940185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2141067b0 msgr2=0x7fa21419ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2141067b0 0x7fa21419ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 -- 172.21.15.103:0/4097940185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa21419c0f0 con 0x7fa2141007b0 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.582+0000 7fa21a08e640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2141007b0 0x7fa214197140 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa21000b4a0 tx=0x7fa21000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.583+0000 7fa20b7fe640 1 -- 172.21.15.103:0/4097940185 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210014070 con 0x7fa2141007b0 2024-08-02T18:49:54.608 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.583+0000 7fa20b7fe640 1 -- 172.21.15.103:0/4097940185 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa210010b10 con 0x7fa2141007b0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.583+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa21419c3e0 con 0x7fa2141007b0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.583+0000 7fa20b7fe640 1 -- 172.21.15.103:0/4097940185 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa210017d60 con 0x7fa2141007b0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.583+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2141a3cc0 con 0x7fa2141007b0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.584+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa214100c10 con 0x7fa2141007b0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.585+0000 7fa20b7fe640 1 -- 172.21.15.103:0/4097940185 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7fa210017070 con 0x7fa2141007b0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.585+0000 7fa20b7fe640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2000a2d80 0x7fa2000a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.585+0000 7fa21988d640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2000a2d80 0x7fa2000a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.585+0000 7fa20b7fe640 1 -- 172.21.15.103:0/4097940185 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa2100cebc0 con 0x7fa2141007b0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.586+0000 7fa21988d640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2000a2d80 0x7fa2000a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa214105d80 tx=0x7fa20400a2d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:54.609 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.589+0000 7fa20b7fe640 1 -- 172.21.15.103:0/4097940185 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fa21009b440 con 0x7fa2141007b0 2024-08-02T18:49:54.756 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.755+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fa2140fe280 con 0x7fa2000a2d80 2024-08-02T18:49:54.756 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:54 smithi103 ceph-mon[32753]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:54.756 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:54 smithi103 ceph-mon[32753]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:54.765 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.764+0000 7fa20b7fe640 1 -- 172.21.15.103:0/4097940185 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339392 (secure 0 0 0) 0x7fa2140fe280 con 0x7fa2000a2d80 2024-08-02T18:49:54.769 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:54.770 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:49:54.772 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2000a2d80 msgr2=0x7fa2000a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2000a2d80 0x7fa2000a5240 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa214105d80 tx=0x7fa20400a2d0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2141007b0 msgr2=0x7fa214197140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2141007b0 0x7fa214197140 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fa21000b4a0 tx=0x7fa21000b960 comp rx=0 tx=0).stop 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 shutdown_connections 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2000a2d80 0x7fa2000a5240 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2141067b0 0x7fa21419ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa214101150 0x7fa214197680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 --2- 172.21.15.103:0/4097940185 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2141007b0 0x7fa214197140 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 >> 172.21.15.103:0/4097940185 conn(0x7fa2140fc4d0 msgr2=0x7fa2140fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 shutdown_connections 2024-08-02T18:49:54.773 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:54.767+0000 7fa21c2f2640 1 -- 172.21.15.103:0/4097940185 wait complete. 2024-08-02T18:49:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:54 smithi151 ceph-mon[37155]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:54 smithi151 ceph-mon[37155]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:55.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:54 smithi121 ceph-mon[37236]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule retention add", "fs": "cephfs", "path": "/", "retention_spec_or_period": "6m3h", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:55.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:54 smithi121 ceph-mon[37236]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:55.481 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":8,"stamp":"2024-08-02T18:49:53.576758+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1190746,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":999,"num_read_kb":824,"num_write":504,"num_write_kb":4387,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":885,"ondisk_log_size":885,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":377368,"kb_used_data":15704,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124564456,"statfs":{"total":1151940427776,"available":1151554002944,"internally_reserved":0,"allocated":16080896,"data_stored":9662108,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":134,"num_read_kb":229,"num_write":20,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.988158"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.655030+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:49:43.655030+0000","last_peered":"2024-08-02T18:49:43.655030+0000","last_clean":"2024-08-02T18:49:43.655030+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:49:43.655030+0000","last_undegraded":"2024-08-02T18:49:43.655030+0000","last_fullsized":"2024-08-02T18:49:43.655030+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654228+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:49:43.654228+0000","last_peered":"2024-08-02T18:49:43.654228+0000","last_clean":"2024-08-02T18:49:43.654228+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:49:43.654228+0000","last_undegraded":"2024-08-02T18:49:43.654228+0000","last_fullsized":"2024-08-02T18:49:43.654228+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828991+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:49:43.828991+0000","last_peered":"2024-08-02T18:49:43.828991+0000","last_clean":"2024-08-02T18:49:43.828991+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:49:43.828991+0000","last_undegraded":"2024-08-02T18:49:43.828991+0000","last_fullsized":"2024-08-02T18:49:43.828991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609787+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:49:43.609787+0000","last_peered":"2024-08-02T18:49:43.609787+0000","last_clean":"2024-08-02T18:49:43.609787+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:49:43.609787+0000","last_undegraded":"2024-08-02T18:49:43.609787+0000","last_fullsized":"2024-08-02T18:49:43.609787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957153+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:49:43.957153+0000","last_peered":"2024-08-02T18:49:43.957153+0000","last_clean":"2024-08-02T18:49:43.957153+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:49:43.957153+0000","last_undegraded":"2024-08-02T18:49:43.957153+0000","last_fullsized":"2024-08-02T18:49:43.957153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609177+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:49:43.609177+0000","last_peered":"2024-08-02T18:49:43.609177+0000","last_clean":"2024-08-02T18:49:43.609177+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:49:43.609177+0000","last_undegraded":"2024-08-02T18:49:43.609177+0000","last_fullsized":"2024-08-02T18:49:43.609177+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921278+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:49:43.921278+0000","last_peered":"2024-08-02T18:49:43.921278+0000","last_clean":"2024-08-02T18:49:43.921278+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:49:43.921278+0000","last_undegraded":"2024-08-02T18:49:43.921278+0000","last_fullsized":"2024-08-02T18:49:43.921278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562754+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:49:43.562754+0000","last_peered":"2024-08-02T18:49:43.562754+0000","last_clean":"2024-08-02T18:49:43.562754+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:49:43.562754+0000","last_undegraded":"2024-08-02T18:49:43.562754+0000","last_fullsized":"2024-08-02T18:49:43.562754+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609407+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:49:43.609407+0000","last_peered":"2024-08-02T18:49:43.609407+0000","last_clean":"2024-08-02T18:49:43.609407+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:49:43.609407+0000","last_undegraded":"2024-08-02T18:49:43.609407+0000","last_fullsized":"2024-08-02T18:49:43.609407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656824+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:49:43.656824+0000","last_peered":"2024-08-02T18:49:43.656824+0000","last_clean":"2024-08-02T18:49:43.656824+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:49:43.656824+0000","last_undegraded":"2024-08-02T18:49:43.656824+0000","last_fullsized":"2024-08-02T18:49:43.656824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":45,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563340+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:49:43.563340+0000","last_peered":"2024-08-02T18:49:43.563340+0000","last_clean":"2024-08-02T18:49:43.563340+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:49:43.563340+0000","last_undegraded":"2024-08-02T18:49:43.563340+0000","last_fullsized":"2024-08-02T18:49:43.563340+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609317+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:49:43.609317+0000","last_peered":"2024-08-02T18:49:43.609317+0000","last_clean":"2024-08-02T18:49:43.609317+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:49:43.609317+0000","last_undegraded":"2024-08-02T18:49:43.609317+0000","last_fullsized":"2024-08-02T18:49:43.609317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826836+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:49:43.826836+0000","last_peered":"2024-08-02T18:49:43.826836+0000","last_clean":"2024-08-02T18:49:43.826836+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:49:43.826836+0000","last_undegraded":"2024-08-02T18:49:43.826836+0000","last_fullsized":"2024-08-02T18:49:43.826836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656491+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:49:43.656491+0000","last_peered":"2024-08-02T18:49:43.656491+0000","last_clean":"2024-08-02T18:49:43.656491+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:49:43.656491+0000","last_undegraded":"2024-08-02T18:49:43.656491+0000","last_fullsized":"2024-08-02T18:49:43.656491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609487+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:49:43.609487+0000","last_peered":"2024-08-02T18:49:43.609487+0000","last_clean":"2024-08-02T18:49:43.609487+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:49:43.609487+0000","last_undegraded":"2024-08-02T18:49:43.609487+0000","last_fullsized":"2024-08-02T18:49:43.609487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609390+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:49:43.609390+0000","last_peered":"2024-08-02T18:49:43.609390+0000","last_clean":"2024-08-02T18:49:43.609390+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:49:43.609390+0000","last_undegraded":"2024-08-02T18:49:43.609390+0000","last_fullsized":"2024-08-02T18:49:43.609390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829268+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:49:43.829268+0000","last_peered":"2024-08-02T18:49:43.829268+0000","last_clean":"2024-08-02T18:49:43.829268+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:49:43.829268+0000","last_undegraded":"2024-08-02T18:49:43.829268+0000","last_fullsized":"2024-08-02T18:49:43.829268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609555+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:49:43.609555+0000","last_peered":"2024-08-02T18:49:43.609555+0000","last_clean":"2024-08-02T18:49:43.609555+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:49:43.609555+0000","last_undegraded":"2024-08-02T18:49:43.609555+0000","last_fullsized":"2024-08-02T18:49:43.609555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921113+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:49:43.921113+0000","last_peered":"2024-08-02T18:49:43.921113+0000","last_clean":"2024-08-02T18:49:43.921113+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:49:43.921113+0000","last_undegraded":"2024-08-02T18:49:43.921113+0000","last_fullsized":"2024-08-02T18:49:43.921113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609233+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:49:43.609233+0000","last_peered":"2024-08-02T18:49:43.609233+0000","last_clean":"2024-08-02T18:49:43.609233+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:49:43.609233+0000","last_undegraded":"2024-08-02T18:49:43.609233+0000","last_fullsized":"2024-08-02T18:49:43.609233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654077+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:49:43.654077+0000","last_peered":"2024-08-02T18:49:43.654077+0000","last_clean":"2024-08-02T18:49:43.654077+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:49:43.654077+0000","last_undegraded":"2024-08-02T18:49:43.654077+0000","last_fullsized":"2024-08-02T18:49:43.654077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656381+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:49:43.656381+0000","last_peered":"2024-08-02T18:49:43.656381+0000","last_clean":"2024-08-02T18:49:43.656381+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:49:43.656381+0000","last_undegraded":"2024-08-02T18:49:43.656381+0000","last_fullsized":"2024-08-02T18:49:43.656381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562686+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:49:43.562686+0000","last_peered":"2024-08-02T18:49:43.562686+0000","last_clean":"2024-08-02T18:49:43.562686+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:49:43.562686+0000","last_undegraded":"2024-08-02T18:49:43.562686+0000","last_fullsized":"2024-08-02T18:49:43.562686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609606+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:49:43.609606+0000","last_peered":"2024-08-02T18:49:43.609606+0000","last_clean":"2024-08-02T18:49:43.609606+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:49:43.609606+0000","last_undegraded":"2024-08-02T18:49:43.609606+0000","last_fullsized":"2024-08-02T18:49:43.609606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957022+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:49:43.957022+0000","last_peered":"2024-08-02T18:49:43.957022+0000","last_clean":"2024-08-02T18:49:43.957022+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:49:43.957022+0000","last_undegraded":"2024-08-02T18:49:43.957022+0000","last_fullsized":"2024-08-02T18:49:43.957022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609883+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:49:43.609883+0000","last_peered":"2024-08-02T18:49:43.609883+0000","last_clean":"2024-08-02T18:49:43.609883+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:49:43.609883+0000","last_undegraded":"2024-08-02T18:49:43.609883+0000","last_fullsized":"2024-08-02T18:49:43.609883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828996+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:49:43.828996+0000","last_peered":"2024-08-02T18:49:43.828996+0000","last_clean":"2024-08-02T18:49:43.828996+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:49:43.828996+0000","last_undegraded":"2024-08-02T18:49:43.828996+0000","last_fullsized":"2024-08-02T18:49:43.828996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609859+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:49:43.609859+0000","last_peered":"2024-08-02T18:49:43.609859+0000","last_clean":"2024-08-02T18:49:43.609859+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:49:43.609859+0000","last_undegraded":"2024-08-02T18:49:43.609859+0000","last_fullsized":"2024-08-02T18:49:43.609859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'48","reported_seq":108,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.787197+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:49:43.787197+0000","last_peered":"2024-08-02T18:49:43.787197+0000","last_clean":"2024-08-02T18:49:43.787197+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:49:43.787197+0000","last_undegraded":"2024-08-02T18:49:43.787197+0000","last_fullsized":"2024-08-02T18:49:43.787197+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":82,"num_read_kb":70,"num_write":86,"num_write_kb":838,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608943+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:49:43.608943+0000","last_peered":"2024-08-02T18:49:43.608943+0000","last_clean":"2024-08-02T18:49:43.608943+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:49:43.608943+0000","last_undegraded":"2024-08-02T18:49:43.608943+0000","last_fullsized":"2024-08-02T18:49:43.608943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561962+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:49:43.561962+0000","last_peered":"2024-08-02T18:49:43.561962+0000","last_clean":"2024-08-02T18:49:43.561962+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:49:43.561962+0000","last_undegraded":"2024-08-02T18:49:43.561962+0000","last_fullsized":"2024-08-02T18:49:43.561962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656835+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:49:43.656835+0000","last_peered":"2024-08-02T18:49:43.656835+0000","last_clean":"2024-08-02T18:49:43.656835+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:49:43.656835+0000","last_undegraded":"2024-08-02T18:49:43.656835+0000","last_fullsized":"2024-08-02T18:49:43.656835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921219+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:49:43.921219+0000","last_peered":"2024-08-02T18:49:43.921219+0000","last_clean":"2024-08-02T18:49:43.921219+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:49:43.921219+0000","last_undegraded":"2024-08-02T18:49:43.921219+0000","last_fullsized":"2024-08-02T18:49:43.921219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608457+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:49:43.608457+0000","last_peered":"2024-08-02T18:49:43.608457+0000","last_clean":"2024-08-02T18:49:43.608457+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:49:43.608457+0000","last_undegraded":"2024-08-02T18:49:43.608457+0000","last_fullsized":"2024-08-02T18:49:43.608457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654589+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:49:43.654589+0000","last_peered":"2024-08-02T18:49:43.654589+0000","last_clean":"2024-08-02T18:49:43.654589+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:49:43.654589+0000","last_undegraded":"2024-08-02T18:49:43.654589+0000","last_fullsized":"2024-08-02T18:49:43.654589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656388+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:49:43.656388+0000","last_peered":"2024-08-02T18:49:43.656388+0000","last_clean":"2024-08-02T18:49:43.656388+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:49:43.656388+0000","last_undegraded":"2024-08-02T18:49:43.656388+0000","last_fullsized":"2024-08-02T18:49:43.656388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608451+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:49:43.608451+0000","last_peered":"2024-08-02T18:49:43.608451+0000","last_clean":"2024-08-02T18:49:43.608451+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:49:43.608451+0000","last_undegraded":"2024-08-02T18:49:43.608451+0000","last_fullsized":"2024-08-02T18:49:43.608451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826989+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:49:43.826989+0000","last_peered":"2024-08-02T18:49:43.826989+0000","last_clean":"2024-08-02T18:49:43.826989+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:49:43.826989+0000","last_undegraded":"2024-08-02T18:49:43.826989+0000","last_fullsized":"2024-08-02T18:49:43.826989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561871+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:49:43.561871+0000","last_peered":"2024-08-02T18:49:43.561871+0000","last_clean":"2024-08-02T18:49:43.561871+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:49:43.561871+0000","last_undegraded":"2024-08-02T18:49:43.561871+0000","last_fullsized":"2024-08-02T18:49:43.561871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562994+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:49:43.562994+0000","last_peered":"2024-08-02T18:49:43.562994+0000","last_clean":"2024-08-02T18:49:43.562994+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:49:43.562994+0000","last_undegraded":"2024-08-02T18:49:43.562994+0000","last_fullsized":"2024-08-02T18:49:43.562994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":147,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:47.614124+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:49:47.614124+0000","last_peered":"2024-08-02T18:49:47.614124+0000","last_clean":"2024-08-02T18:49:47.614124+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:49:47.614124+0000","last_undegraded":"2024-08-02T18:49:47.614124+0000","last_fullsized":"2024-08-02T18:49:47.614124+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562217+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:49:43.562217+0000","last_peered":"2024-08-02T18:49:43.562217+0000","last_clean":"2024-08-02T18:49:43.562217+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:49:43.562217+0000","last_undegraded":"2024-08-02T18:49:43.562217+0000","last_fullsized":"2024-08-02T18:49:43.562217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561158+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:49:43.561158+0000","last_peered":"2024-08-02T18:49:43.561158+0000","last_clean":"2024-08-02T18:49:43.561158+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:49:43.561158+0000","last_undegraded":"2024-08-02T18:49:43.561158+0000","last_fullsized":"2024-08-02T18:49:43.561158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826778+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:49:43.826778+0000","last_peered":"2024-08-02T18:49:43.826778+0000","last_clean":"2024-08-02T18:49:43.826778+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.826778+0000","last_undegraded":"2024-08-02T18:49:43.826778+0000","last_fullsized":"2024-08-02T18:49:43.826778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563541+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:49:43.563541+0000","last_peered":"2024-08-02T18:49:43.563541+0000","last_clean":"2024-08-02T18:49:43.563541+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:49:43.563541+0000","last_undegraded":"2024-08-02T18:49:43.563541+0000","last_fullsized":"2024-08-02T18:49:43.563541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609341+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:49:43.609341+0000","last_peered":"2024-08-02T18:49:43.609341+0000","last_clean":"2024-08-02T18:49:43.609341+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:49:43.609341+0000","last_undegraded":"2024-08-02T18:49:43.609341+0000","last_fullsized":"2024-08-02T18:49:43.609341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609676+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:49:43.609676+0000","last_peered":"2024-08-02T18:49:43.609676+0000","last_clean":"2024-08-02T18:49:43.609676+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:49:43.609676+0000","last_undegraded":"2024-08-02T18:49:43.609676+0000","last_fullsized":"2024-08-02T18:49:43.609676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":404,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:45.664818+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:49:45.664818+0000","last_peered":"2024-08-02T18:49:45.664818+0000","last_clean":"2024-08-02T18:49:45.664818+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:49:45.664818+0000","last_undegraded":"2024-08-02T18:49:45.664818+0000","last_fullsized":"2024-08-02T18:49:45.664818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827013+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:49:43.827013+0000","last_peered":"2024-08-02T18:49:43.827013+0000","last_clean":"2024-08-02T18:49:43.827013+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:49:43.827013+0000","last_undegraded":"2024-08-02T18:49:43.827013+0000","last_fullsized":"2024-08-02T18:49:43.827013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827183+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:49:43.827183+0000","last_peered":"2024-08-02T18:49:43.827183+0000","last_clean":"2024-08-02T18:49:43.827183+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:49:43.827183+0000","last_undegraded":"2024-08-02T18:49:43.827183+0000","last_fullsized":"2024-08-02T18:49:43.827183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829351+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:49:43.829351+0000","last_peered":"2024-08-02T18:49:43.829351+0000","last_clean":"2024-08-02T18:49:43.829351+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:49:43.829351+0000","last_undegraded":"2024-08-02T18:49:43.829351+0000","last_fullsized":"2024-08-02T18:49:43.829351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562654+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:49:43.562654+0000","last_peered":"2024-08-02T18:49:43.562654+0000","last_clean":"2024-08-02T18:49:43.562654+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:49:43.562654+0000","last_undegraded":"2024-08-02T18:49:43.562654+0000","last_fullsized":"2024-08-02T18:49:43.562654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826971+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:49:43.826971+0000","last_peered":"2024-08-02T18:49:43.826971+0000","last_clean":"2024-08-02T18:49:43.826971+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:49:43.826971+0000","last_undegraded":"2024-08-02T18:49:43.826971+0000","last_fullsized":"2024-08-02T18:49:43.826971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'39","reported_seq":83,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.783745+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:49:43.783745+0000","last_peered":"2024-08-02T18:49:43.783745+0000","last_clean":"2024-08-02T18:49:43.783745+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:49:43.783745+0000","last_undegraded":"2024-08-02T18:49:43.783745+0000","last_fullsized":"2024-08-02T18:49:43.783745+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":131670,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":10,"num_write":49,"num_write_kb":475,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956875+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:49:43.956875+0000","last_peered":"2024-08-02T18:49:43.956875+0000","last_clean":"2024-08-02T18:49:43.956875+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:49:43.956875+0000","last_undegraded":"2024-08-02T18:49:43.956875+0000","last_fullsized":"2024-08-02T18:49:43.956875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827238+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:49:43.827238+0000","last_peered":"2024-08-02T18:49:43.827238+0000","last_clean":"2024-08-02T18:49:43.827238+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:49:43.827238+0000","last_undegraded":"2024-08-02T18:49:43.827238+0000","last_fullsized":"2024-08-02T18:49:43.827238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562375+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:49:43.562375+0000","last_peered":"2024-08-02T18:49:43.562375+0000","last_clean":"2024-08-02T18:49:43.562375+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:49:43.562375+0000","last_undegraded":"2024-08-02T18:49:43.562375+0000","last_fullsized":"2024-08-02T18:49:43.562375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562856+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:49:43.562856+0000","last_peered":"2024-08-02T18:49:43.562856+0000","last_clean":"2024-08-02T18:49:43.562856+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:49:43.562856+0000","last_undegraded":"2024-08-02T18:49:43.562856+0000","last_fullsized":"2024-08-02T18:49:43.562856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921519+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:49:43.921519+0000","last_peered":"2024-08-02T18:49:43.921519+0000","last_clean":"2024-08-02T18:49:43.921519+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:49:43.921519+0000","last_undegraded":"2024-08-02T18:49:43.921519+0000","last_fullsized":"2024-08-02T18:49:43.921519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656937+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:49:43.656937+0000","last_peered":"2024-08-02T18:49:43.656937+0000","last_clean":"2024-08-02T18:49:43.656937+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:49:43.656937+0000","last_undegraded":"2024-08-02T18:49:43.656937+0000","last_fullsized":"2024-08-02T18:49:43.656937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562946+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:49:43.562946+0000","last_peered":"2024-08-02T18:49:43.562946+0000","last_clean":"2024-08-02T18:49:43.562946+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:49:43.562946+0000","last_undegraded":"2024-08-02T18:49:43.562946+0000","last_fullsized":"2024-08-02T18:49:43.562946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563145+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:49:43.563145+0000","last_peered":"2024-08-02T18:49:43.563145+0000","last_clean":"2024-08-02T18:49:43.563145+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:49:43.563145+0000","last_undegraded":"2024-08-02T18:49:43.563145+0000","last_fullsized":"2024-08-02T18:49:43.563145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656450+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:49:43.656450+0000","last_peered":"2024-08-02T18:49:43.656450+0000","last_clean":"2024-08-02T18:49:43.656450+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:49:43.656450+0000","last_undegraded":"2024-08-02T18:49:43.656450+0000","last_fullsized":"2024-08-02T18:49:43.656450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562360+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:49:43.562360+0000","last_peered":"2024-08-02T18:49:43.562360+0000","last_clean":"2024-08-02T18:49:43.562360+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:49:43.562360+0000","last_undegraded":"2024-08-02T18:49:43.562360+0000","last_fullsized":"2024-08-02T18:49:43.562360+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826765+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:49:43.826765+0000","last_peered":"2024-08-02T18:49:43.826765+0000","last_clean":"2024-08-02T18:49:43.826765+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:49:43.826765+0000","last_undegraded":"2024-08-02T18:49:43.826765+0000","last_fullsized":"2024-08-02T18:49:43.826765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:47.614511+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:49:47.614511+0000","last_peered":"2024-08-02T18:49:47.614511+0000","last_clean":"2024-08-02T18:49:47.614511+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:49:47.614511+0000","last_undegraded":"2024-08-02T18:49:47.614511+0000","last_fullsized":"2024-08-02T18:49:47.614511+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1676,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654895+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:49:43.654895+0000","last_peered":"2024-08-02T18:49:43.654895+0000","last_clean":"2024-08-02T18:49:43.654895+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:49:43.654895+0000","last_undegraded":"2024-08-02T18:49:43.654895+0000","last_fullsized":"2024-08-02T18:49:43.654895+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826962+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:49:43.826962+0000","last_peered":"2024-08-02T18:49:43.826962+0000","last_clean":"2024-08-02T18:49:43.826962+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:49:43.826962+0000","last_undegraded":"2024-08-02T18:49:43.826962+0000","last_fullsized":"2024-08-02T18:49:43.826962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563270+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:49:43.563270+0000","last_peered":"2024-08-02T18:49:43.563270+0000","last_clean":"2024-08-02T18:49:43.563270+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:49:43.563270+0000","last_undegraded":"2024-08-02T18:49:43.563270+0000","last_fullsized":"2024-08-02T18:49:43.563270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921244+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:49:43.921244+0000","last_peered":"2024-08-02T18:49:43.921244+0000","last_clean":"2024-08-02T18:49:43.921244+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:49:43.921244+0000","last_undegraded":"2024-08-02T18:49:43.921244+0000","last_fullsized":"2024-08-02T18:49:43.921244+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561546+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:49:43.561546+0000","last_peered":"2024-08-02T18:49:43.561546+0000","last_clean":"2024-08-02T18:49:43.561546+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:49:43.561546+0000","last_undegraded":"2024-08-02T18:49:43.561546+0000","last_fullsized":"2024-08-02T18:49:43.561546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921110+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:49:43.921110+0000","last_peered":"2024-08-02T18:49:43.921110+0000","last_clean":"2024-08-02T18:49:43.921110+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:49:43.921110+0000","last_undegraded":"2024-08-02T18:49:43.921110+0000","last_fullsized":"2024-08-02T18:49:43.921110+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608422+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:49:43.608422+0000","last_peered":"2024-08-02T18:49:43.608422+0000","last_clean":"2024-08-02T18:49:43.608422+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:49:43.608422+0000","last_undegraded":"2024-08-02T18:49:43.608422+0000","last_fullsized":"2024-08-02T18:49:43.608422+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656771+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:49:43.656771+0000","last_peered":"2024-08-02T18:49:43.656771+0000","last_clean":"2024-08-02T18:49:43.656771+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:49:43.656771+0000","last_undegraded":"2024-08-02T18:49:43.656771+0000","last_fullsized":"2024-08-02T18:49:43.656771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'40","reported_seq":300,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:48.615097+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:49:48.615097+0000","last_peered":"2024-08-02T18:49:48.615097+0000","last_clean":"2024-08-02T18:49:48.615097+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:48.615097+0000","last_undegraded":"2024-08-02T18:49:48.615097+0000","last_fullsized":"2024-08-02T18:49:48.615097+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69709,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":224,"num_read_kb":181,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654063+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:49:43.654063+0000","last_peered":"2024-08-02T18:49:43.654063+0000","last_clean":"2024-08-02T18:49:43.654063+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:49:43.654063+0000","last_undegraded":"2024-08-02T18:49:43.654063+0000","last_fullsized":"2024-08-02T18:49:43.654063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562852+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:49:43.562852+0000","last_peered":"2024-08-02T18:49:43.562852+0000","last_clean":"2024-08-02T18:49:43.562852+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:49:43.562852+0000","last_undegraded":"2024-08-02T18:49:43.562852+0000","last_fullsized":"2024-08-02T18:49:43.562852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563483+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:49:43.563483+0000","last_peered":"2024-08-02T18:49:43.563483+0000","last_clean":"2024-08-02T18:49:43.563483+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:49:43.563483+0000","last_undegraded":"2024-08-02T18:49:43.563483+0000","last_fullsized":"2024-08-02T18:49:43.563483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609613+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:49:43.609613+0000","last_peered":"2024-08-02T18:49:43.609613+0000","last_clean":"2024-08-02T18:49:43.609613+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:49:43.609613+0000","last_undegraded":"2024-08-02T18:49:43.609613+0000","last_fullsized":"2024-08-02T18:49:43.609613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957216+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:49:43.957216+0000","last_peered":"2024-08-02T18:49:43.957216+0000","last_clean":"2024-08-02T18:49:43.957216+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:49:43.957216+0000","last_undegraded":"2024-08-02T18:49:43.957216+0000","last_fullsized":"2024-08-02T18:49:43.957216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827184+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:49:43.827184+0000","last_peered":"2024-08-02T18:49:43.827184+0000","last_clean":"2024-08-02T18:49:43.827184+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:49:43.827184+0000","last_undegraded":"2024-08-02T18:49:43.827184+0000","last_fullsized":"2024-08-02T18:49:43.827184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653715+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:49:43.653715+0000","last_peered":"2024-08-02T18:49:43.653715+0000","last_clean":"2024-08-02T18:49:43.653715+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:49:43.653715+0000","last_undegraded":"2024-08-02T18:49:43.653715+0000","last_fullsized":"2024-08-02T18:49:43.653715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563248+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:49:43.563248+0000","last_peered":"2024-08-02T18:49:43.563248+0000","last_clean":"2024-08-02T18:49:43.563248+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:49:43.563248+0000","last_undegraded":"2024-08-02T18:49:43.563248+0000","last_fullsized":"2024-08-02T18:49:43.563248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":146,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:48.615362+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:49:48.615362+0000","last_peered":"2024-08-02T18:49:48.615362+0000","last_clean":"2024-08-02T18:49:48.615362+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:49:48.615362+0000","last_undegraded":"2024-08-02T18:49:48.615362+0000","last_fullsized":"2024-08-02T18:49:48.615362+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":106,"num_read_kb":106,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609101+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:49:43.609101+0000","last_peered":"2024-08-02T18:49:43.609101+0000","last_clean":"2024-08-02T18:49:43.609101+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:49:43.609101+0000","last_undegraded":"2024-08-02T18:49:43.609101+0000","last_fullsized":"2024-08-02T18:49:43.609101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956951+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:49:43.956951+0000","last_peered":"2024-08-02T18:49:43.956951+0000","last_clean":"2024-08-02T18:49:43.956951+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:49:43.956951+0000","last_undegraded":"2024-08-02T18:49:43.956951+0000","last_fullsized":"2024-08-02T18:49:43.956951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653949+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:49:43.653949+0000","last_peered":"2024-08-02T18:49:43.653949+0000","last_clean":"2024-08-02T18:49:43.653949+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:49:43.653949+0000","last_undegraded":"2024-08-02T18:49:43.653949+0000","last_fullsized":"2024-08-02T18:49:43.653949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563227+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:49:43.563227+0000","last_peered":"2024-08-02T18:49:43.563227+0000","last_clean":"2024-08-02T18:49:43.563227+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:49:43.563227+0000","last_undegraded":"2024-08-02T18:49:43.563227+0000","last_fullsized":"2024-08-02T18:49:43.563227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921505+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:49:43.921505+0000","last_peered":"2024-08-02T18:49:43.921505+0000","last_clean":"2024-08-02T18:49:43.921505+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:49:43.921505+0000","last_undegraded":"2024-08-02T18:49:43.921505+0000","last_fullsized":"2024-08-02T18:49:43.921505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609123+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:49:43.609123+0000","last_peered":"2024-08-02T18:49:43.609123+0000","last_clean":"2024-08-02T18:49:43.609123+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:49:43.609123+0000","last_undegraded":"2024-08-02T18:49:43.609123+0000","last_fullsized":"2024-08-02T18:49:43.609123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561228+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:49:43.561228+0000","last_peered":"2024-08-02T18:49:43.561228+0000","last_clean":"2024-08-02T18:49:43.561228+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:49:43.561228+0000","last_undegraded":"2024-08-02T18:49:43.561228+0000","last_fullsized":"2024-08-02T18:49:43.561228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608673+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:49:43.608673+0000","last_peered":"2024-08-02T18:49:43.608673+0000","last_clean":"2024-08-02T18:49:43.608673+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:49:43.608673+0000","last_undegraded":"2024-08-02T18:49:43.608673+0000","last_fullsized":"2024-08-02T18:49:43.608673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654071+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:49:43.654071+0000","last_peered":"2024-08-02T18:49:43.654071+0000","last_clean":"2024-08-02T18:49:43.654071+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:49:43.654071+0000","last_undegraded":"2024-08-02T18:49:43.654071+0000","last_fullsized":"2024-08-02T18:49:43.654071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829094+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:49:43.829094+0000","last_peered":"2024-08-02T18:49:43.829094+0000","last_clean":"2024-08-02T18:49:43.829094+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:49:43.829094+0000","last_undegraded":"2024-08-02T18:49:43.829094+0000","last_fullsized":"2024-08-02T18:49:43.829094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":155,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:48.616019+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:49:48.616019+0000","last_peered":"2024-08-02T18:49:48.616019+0000","last_clean":"2024-08-02T18:49:48.616019+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:49:48.616019+0000","last_undegraded":"2024-08-02T18:49:48.616019+0000","last_fullsized":"2024-08-02T18:49:48.616019+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656593+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:49:43.656593+0000","last_peered":"2024-08-02T18:49:43.656593+0000","last_clean":"2024-08-02T18:49:43.656593+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:49:43.656593+0000","last_undegraded":"2024-08-02T18:49:43.656593+0000","last_fullsized":"2024-08-02T18:49:43.656593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829250+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:49:43.829250+0000","last_peered":"2024-08-02T18:49:43.829250+0000","last_clean":"2024-08-02T18:49:43.829250+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:49:43.829250+0000","last_undegraded":"2024-08-02T18:49:43.829250+0000","last_fullsized":"2024-08-02T18:49:43.829250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921020+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:49:43.921020+0000","last_peered":"2024-08-02T18:49:43.921020+0000","last_clean":"2024-08-02T18:49:43.921020+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:49:43.921020+0000","last_undegraded":"2024-08-02T18:49:43.921020+0000","last_fullsized":"2024-08-02T18:49:43.921020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829253+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:49:43.829253+0000","last_peered":"2024-08-02T18:49:43.829253+0000","last_clean":"2024-08-02T18:49:43.829253+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:49:43.829253+0000","last_undegraded":"2024-08-02T18:49:43.829253+0000","last_fullsized":"2024-08-02T18:49:43.829253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829051+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:49:43.829051+0000","last_peered":"2024-08-02T18:49:43.829051+0000","last_clean":"2024-08-02T18:49:43.829051+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:49:43.829051+0000","last_undegraded":"2024-08-02T18:49:43.829051+0000","last_fullsized":"2024-08-02T18:49:43.829051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956830+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:49:43.956830+0000","last_peered":"2024-08-02T18:49:43.956830+0000","last_clean":"2024-08-02T18:49:43.956830+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:49:43.956830+0000","last_undegraded":"2024-08-02T18:49:43.956830+0000","last_fullsized":"2024-08-02T18:49:43.956830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561943+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:49:43.561943+0000","last_peered":"2024-08-02T18:49:43.561943+0000","last_clean":"2024-08-02T18:49:43.561943+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:49:43.561943+0000","last_undegraded":"2024-08-02T18:49:43.561943+0000","last_fullsized":"2024-08-02T18:49:43.561943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921458+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:49:43.921458+0000","last_peered":"2024-08-02T18:49:43.921458+0000","last_clean":"2024-08-02T18:49:43.921458+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:49:43.921458+0000","last_undegraded":"2024-08-02T18:49:43.921458+0000","last_fullsized":"2024-08-02T18:49:43.921458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829511+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:49:43.829511+0000","last_peered":"2024-08-02T18:49:43.829511+0000","last_clean":"2024-08-02T18:49:43.829511+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:49:43.829511+0000","last_undegraded":"2024-08-02T18:49:43.829511+0000","last_fullsized":"2024-08-02T18:49:43.829511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609765+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:49:43.609765+0000","last_peered":"2024-08-02T18:49:43.609765+0000","last_clean":"2024-08-02T18:49:43.609765+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:49:43.609765+0000","last_undegraded":"2024-08-02T18:49:43.609765+0000","last_fullsized":"2024-08-02T18:49:43.609765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562988+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:49:43.562988+0000","last_peered":"2024-08-02T18:49:43.562988+0000","last_clean":"2024-08-02T18:49:43.562988+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:49:43.562988+0000","last_undegraded":"2024-08-02T18:49:43.562988+0000","last_fullsized":"2024-08-02T18:49:43.562988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609160+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:49:43.609160+0000","last_peered":"2024-08-02T18:49:43.609160+0000","last_clean":"2024-08-02T18:49:43.609160+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:49:43.609160+0000","last_undegraded":"2024-08-02T18:49:43.609160+0000","last_fullsized":"2024-08-02T18:49:43.609160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562877+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:49:43.562877+0000","last_peered":"2024-08-02T18:49:43.562877+0000","last_clean":"2024-08-02T18:49:43.562877+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:49:43.562877+0000","last_undegraded":"2024-08-02T18:49:43.562877+0000","last_fullsized":"2024-08-02T18:49:43.562877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561703+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:49:43.561703+0000","last_peered":"2024-08-02T18:49:43.561703+0000","last_clean":"2024-08-02T18:49:43.561703+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:49:43.561703+0000","last_undegraded":"2024-08-02T18:49:43.561703+0000","last_fullsized":"2024-08-02T18:49:43.561703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921328+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:49:43.921328+0000","last_peered":"2024-08-02T18:49:43.921328+0000","last_clean":"2024-08-02T18:49:43.921328+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:49:43.921328+0000","last_undegraded":"2024-08-02T18:49:43.921328+0000","last_fullsized":"2024-08-02T18:49:43.921328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829407+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:49:43.829407+0000","last_peered":"2024-08-02T18:49:43.829407+0000","last_clean":"2024-08-02T18:49:43.829407+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:49:43.829407+0000","last_undegraded":"2024-08-02T18:49:43.829407+0000","last_fullsized":"2024-08-02T18:49:43.829407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654732+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:49:43.654732+0000","last_peered":"2024-08-02T18:49:43.654732+0000","last_clean":"2024-08-02T18:49:43.654732+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:49:43.654732+0000","last_undegraded":"2024-08-02T18:49:43.654732+0000","last_fullsized":"2024-08-02T18:49:43.654732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921678+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:49:43.921678+0000","last_peered":"2024-08-02T18:49:43.921678+0000","last_clean":"2024-08-02T18:49:43.921678+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:49:43.921678+0000","last_undegraded":"2024-08-02T18:49:43.921678+0000","last_fullsized":"2024-08-02T18:49:43.921678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562579+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:49:43.562579+0000","last_peered":"2024-08-02T18:49:43.562579+0000","last_clean":"2024-08-02T18:49:43.562579+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:49:43.562579+0000","last_undegraded":"2024-08-02T18:49:43.562579+0000","last_fullsized":"2024-08-02T18:49:43.562579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.955905+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:49:43.955905+0000","last_peered":"2024-08-02T18:49:43.955905+0000","last_clean":"2024-08-02T18:49:43.955905+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:49:43.955905+0000","last_undegraded":"2024-08-02T18:49:43.955905+0000","last_fullsized":"2024-08-02T18:49:43.955905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956586+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:49:43.956586+0000","last_peered":"2024-08-02T18:49:43.956586+0000","last_clean":"2024-08-02T18:49:43.956586+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:49:43.956586+0000","last_undegraded":"2024-08-02T18:49:43.956586+0000","last_fullsized":"2024-08-02T18:49:43.956586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561566+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:49:43.561566+0000","last_peered":"2024-08-02T18:49:43.561566+0000","last_clean":"2024-08-02T18:49:43.561566+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:49:43.561566+0000","last_undegraded":"2024-08-02T18:49:43.561566+0000","last_fullsized":"2024-08-02T18:49:43.561566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609731+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:49:43.609731+0000","last_peered":"2024-08-02T18:49:43.609731+0000","last_clean":"2024-08-02T18:49:43.609731+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:49:43.609731+0000","last_undegraded":"2024-08-02T18:49:43.609731+0000","last_fullsized":"2024-08-02T18:49:43.609731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827166+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:49:43.827166+0000","last_peered":"2024-08-02T18:49:43.827166+0000","last_clean":"2024-08-02T18:49:43.827166+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:49:43.827166+0000","last_undegraded":"2024-08-02T18:49:43.827166+0000","last_fullsized":"2024-08-02T18:49:43.827166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608836+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:49:43.608836+0000","last_peered":"2024-08-02T18:49:43.608836+0000","last_clean":"2024-08-02T18:49:43.608836+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:49:43.608836+0000","last_undegraded":"2024-08-02T18:49:43.608836+0000","last_fullsized":"2024-08-02T18:49:43.608836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563210+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:49:43.563210+0000","last_peered":"2024-08-02T18:49:43.563210+0000","last_clean":"2024-08-02T18:49:43.563210+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:49:43.563210+0000","last_undegraded":"2024-08-02T18:49:43.563210+0000","last_fullsized":"2024-08-02T18:49:43.563210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609115+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:49:43.609115+0000","last_peered":"2024-08-02T18:49:43.609115+0000","last_clean":"2024-08-02T18:49:43.609115+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:49:43.609115+0000","last_undegraded":"2024-08-02T18:49:43.609115+0000","last_fullsized":"2024-08-02T18:49:43.609115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826709+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:49:43.826709+0000","last_peered":"2024-08-02T18:49:43.826709+0000","last_clean":"2024-08-02T18:49:43.826709+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:49:43.826709+0000","last_undegraded":"2024-08-02T18:49:43.826709+0000","last_fullsized":"2024-08-02T18:49:43.826709+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608483+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:49:43.608483+0000","last_peered":"2024-08-02T18:49:43.608483+0000","last_clean":"2024-08-02T18:49:43.608483+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:49:43.608483+0000","last_undegraded":"2024-08-02T18:49:43.608483+0000","last_fullsized":"2024-08-02T18:49:43.608483+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":34,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656457+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:49:43.656457+0000","last_peered":"2024-08-02T18:49:43.656457+0000","last_clean":"2024-08-02T18:49:43.656457+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:49:43.656457+0000","last_undegraded":"2024-08-02T18:49:43.656457+0000","last_fullsized":"2024-08-02T18:49:43.656457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654397+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:49:43.654397+0000","last_peered":"2024-08-02T18:49:43.654397+0000","last_clean":"2024-08-02T18:49:43.654397+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:49:43.654397+0000","last_undegraded":"2024-08-02T18:49:43.654397+0000","last_fullsized":"2024-08-02T18:49:43.654397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956825+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:49:43.956825+0000","last_peered":"2024-08-02T18:49:43.956825+0000","last_clean":"2024-08-02T18:49:43.956825+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:49:43.956825+0000","last_undegraded":"2024-08-02T18:49:43.956825+0000","last_fullsized":"2024-08-02T18:49:43.956825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956976+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:49:43.956976+0000","last_peered":"2024-08-02T18:49:43.956976+0000","last_clean":"2024-08-02T18:49:43.956976+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:49:43.956976+0000","last_undegraded":"2024-08-02T18:49:43.956976+0000","last_fullsized":"2024-08-02T18:49:43.956976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921644+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:49:43.921644+0000","last_peered":"2024-08-02T18:49:43.921644+0000","last_clean":"2024-08-02T18:49:43.921644+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:49:43.921644+0000","last_undegraded":"2024-08-02T18:49:43.921644+0000","last_fullsized":"2024-08-02T18:49:43.921644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":600144,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":762,"num_read_kb":494,"num_write":301,"num_write_kb":1447,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2027520,"data_stored":1800432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":235,"ondisk_log_size":235,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547243,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":509529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776175,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28832,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716320,"statfs":{"total":95995035648,"available":95965511680,"internally_reserved":0,"allocated":1859584,"data_stored":1299160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939698,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28428,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716724,"statfs":{"total":95995035648,"available":95965925376,"internally_reserved":0,"allocated":1441792,"data_stored":907043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168633,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1437696,"data_stored":902867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397566,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1638400,"data_stored":1107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561090,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":504907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822726,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28756,"kb_used_data":1740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716396,"statfs":{"total":95995035648,"available":95965589504,"internally_reserved":0,"allocated":1781760,"data_stored":1233278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986251,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":510645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215183,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28544,"kb_used_data":1528,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716608,"statfs":{"total":95995035648,"available":95965806592,"internally_reserved":0,"allocated":1564672,"data_stored":1029917,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411412,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":576763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":574526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738461,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1048576,"data_stored":506295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":544768,"data_stored":525100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":163840,"data_stored":133997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":245760,"data_stored":203975,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:49:55.487 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-02T18:49:55.746 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:55.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:55 smithi151 ceph-mon[37155]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:55.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:55 smithi151 ceph-mon[37155]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 17 op/s 2024-08-02T18:49:55.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:55 smithi103 ceph-mon[32753]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:55.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:55 smithi103 ceph-mon[32753]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 17 op/s 2024-08-02T18:49:56.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:55 smithi121 ceph-mon[37236]: from='client.15444 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:49:56.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:55 smithi121 ceph-mon[37236]: pgmap v8: 129 pgs: 129 active+clean; 1.1 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 25 KiB/s rd, 0 B/s wr, 17 op/s 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 -- 172.21.15.103:0/3349906827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c103390 msgr2=0x7f357c10b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 --2- 172.21.15.103:0/3349906827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c103390 0x7f357c10b880 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3570009900 tx=0x7f357002a480 comp rx=0 tx=0).stop 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 -- 172.21.15.103:0/3349906827 shutdown_connections 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 --2- 172.21.15.103:0/3349906827 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c10bea0 0x7f357c10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 --2- 172.21.15.103:0/3349906827 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c103390 0x7f357c10b880 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 --2- 172.21.15.103:0/3349906827 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c102a70 0x7f357c102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 -- 172.21.15.103:0/3349906827 >> 172.21.15.103:0/3349906827 conn(0x7f357c0fc4d0 msgr2=0x7f357c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 -- 172.21.15.103:0/3349906827 shutdown_connections 2024-08-02T18:49:56.249 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.226+0000 7f3582277640 1 -- 172.21.15.103:0/3349906827 wait complete. 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3582277640 1 Processor -- start 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3582277640 1 -- start start 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3582277640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c102a70 0x7f357c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3582277640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c103390 0x7f357c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3582277640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c10bea0 0x7f357c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3582277640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f357c111dc0 con 0x7f357c10bea0 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3582277640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f357c111c40 con 0x7f357c103390 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3582277640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f357c111f40 con 0x7f357c102a70 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3580814640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c10bea0 0x7f357c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3580814640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c10bea0 0x7f357c19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60832/0 (socket says 172.21.15.103:60832) 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f3580814640 1 -- 172.21.15.103:0/2253653479 learned_addr learned my addr 172.21.15.103:0/2253653479 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:56.250 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f357bfff640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c102a70 0x7f357c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.227+0000 7f357b7fe640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c103390 0x7f357c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f3580814640 1 -- 172.21.15.103:0/2253653479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c102a70 msgr2=0x7f357c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f3580814640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c102a70 0x7f357c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f3580814640 1 -- 172.21.15.103:0/2253653479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c103390 msgr2=0x7f357c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f3580814640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c103390 0x7f357c198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f3580814640 1 -- 172.21.15.103:0/2253653479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f357c19d290 con 0x7f357c10bea0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f3580814640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c10bea0 0x7f357c19cbb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f357400eaa0 tx=0x7f357400ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f35797fa640 1 -- 172.21.15.103:0/2253653479 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f357400cdb0 con 0x7f357c10bea0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f35797fa640 1 -- 172.21.15.103:0/2253653479 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3574004b20 con 0x7f357c10bea0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f357c19d580 con 0x7f357c10bea0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f35797fa640 1 -- 172.21.15.103:0/2253653479 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3574011760 con 0x7f357c10bea0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.228+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f357c1a4e60 con 0x7f357c10bea0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.229+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f357c102e50 con 0x7f357c10bea0 2024-08-02T18:49:56.251 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.231+0000 7f35797fa640 1 -- 172.21.15.103:0/2253653479 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7f3574011900 con 0x7f357c10bea0 2024-08-02T18:49:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.231+0000 7f35797fa640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f35640a2d80 0x7f35640a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.232+0000 7f357bfff640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f35640a2d80 0x7f35640a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.232+0000 7f35797fa640 1 -- 172.21.15.103:0/2253653479 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f35740cff80 con 0x7f357c10bea0 2024-08-02T18:49:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.232+0000 7f357bfff640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f35640a2d80 0x7f35640a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f356c005fd0 tx=0x7f356c005850 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:56.252 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.235+0000 7f35797fa640 1 -- 172.21.15.103:0/2253653479 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f3574016030 con 0x7f357c10bea0 2024-08-02T18:49:56.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.399+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f357c106f80 con 0x7f35640a2d80 2024-08-02T18:49:56.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.407+0000 7f35797fa640 1 -- 172.21.15.103:0/2253653479 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339413 (secure 0 0 0) 0x7f356c00fb30 con 0x7f35640a2d80 2024-08-02T18:49:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:56.413 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:49:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f35640a2d80 msgr2=0x7f35640a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f35640a2d80 0x7f35640a5240 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f356c005fd0 tx=0x7f356c005850 comp rx=0 tx=0).stop 2024-08-02T18:49:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c10bea0 msgr2=0x7f357c19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c10bea0 0x7f357c19cbb0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f357400eaa0 tx=0x7f357400ef60 comp rx=0 tx=0).stop 2024-08-02T18:49:56.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 shutdown_connections 2024-08-02T18:49:56.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f35640a2d80 0x7f35640a5240 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f357c10bea0 0x7f357c19cbb0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f357c103390 0x7f357c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 --2- 172.21.15.103:0/2253653479 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f357c102a70 0x7f357c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:56.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 >> 172.21.15.103:0/2253653479 conn(0x7f357c0fc4d0 msgr2=0x7f357c0fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:56.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 shutdown_connections 2024-08-02T18:49:56.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:56.410+0000 7f3582277640 1 -- 172.21.15.103:0/2253653479 wait complete. 2024-08-02T18:49:56.727 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:56 smithi103 ceph-mon[32753]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:56.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:56 smithi151 ceph-mon[37155]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:57.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:56 smithi121 ceph-mon[37236]: from='client.15450 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:57.120 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":9,"stamp":"2024-08-02T18:49:55.577088+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1387378,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1284,"num_read_kb":1071,"num_write":630,"num_write_kb":5301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378296,"kb_used_data":16280,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124563528,"statfs":{"total":1151940427776,"available":1151553052672,"internally_reserved":0,"allocated":16670720,"data_stored":10252004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":476,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.988488"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.655076+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:49:43.655076+0000","last_peered":"2024-08-02T18:49:43.655076+0000","last_clean":"2024-08-02T18:49:43.655076+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:49:43.655076+0000","last_undegraded":"2024-08-02T18:49:43.655076+0000","last_fullsized":"2024-08-02T18:49:43.655076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654228+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:49:43.654228+0000","last_peered":"2024-08-02T18:49:43.654228+0000","last_clean":"2024-08-02T18:49:43.654228+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:49:43.654228+0000","last_undegraded":"2024-08-02T18:49:43.654228+0000","last_fullsized":"2024-08-02T18:49:43.654228+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828991+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:49:43.828991+0000","last_peered":"2024-08-02T18:49:43.828991+0000","last_clean":"2024-08-02T18:49:43.828991+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:49:43.828991+0000","last_undegraded":"2024-08-02T18:49:43.828991+0000","last_fullsized":"2024-08-02T18:49:43.828991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609787+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:49:43.609787+0000","last_peered":"2024-08-02T18:49:43.609787+0000","last_clean":"2024-08-02T18:49:43.609787+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:49:43.609787+0000","last_undegraded":"2024-08-02T18:49:43.609787+0000","last_fullsized":"2024-08-02T18:49:43.609787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957153+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:49:43.957153+0000","last_peered":"2024-08-02T18:49:43.957153+0000","last_clean":"2024-08-02T18:49:43.957153+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:49:43.957153+0000","last_undegraded":"2024-08-02T18:49:43.957153+0000","last_fullsized":"2024-08-02T18:49:43.957153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609235+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:49:43.609235+0000","last_peered":"2024-08-02T18:49:43.609235+0000","last_clean":"2024-08-02T18:49:43.609235+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:49:43.609235+0000","last_undegraded":"2024-08-02T18:49:43.609235+0000","last_fullsized":"2024-08-02T18:49:43.609235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921278+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:49:43.921278+0000","last_peered":"2024-08-02T18:49:43.921278+0000","last_clean":"2024-08-02T18:49:43.921278+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:49:43.921278+0000","last_undegraded":"2024-08-02T18:49:43.921278+0000","last_fullsized":"2024-08-02T18:49:43.921278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562814+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:49:43.562814+0000","last_peered":"2024-08-02T18:49:43.562814+0000","last_clean":"2024-08-02T18:49:43.562814+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:49:43.562814+0000","last_undegraded":"2024-08-02T18:49:43.562814+0000","last_fullsized":"2024-08-02T18:49:43.562814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609407+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:49:43.609407+0000","last_peered":"2024-08-02T18:49:43.609407+0000","last_clean":"2024-08-02T18:49:43.609407+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:49:43.609407+0000","last_undegraded":"2024-08-02T18:49:43.609407+0000","last_fullsized":"2024-08-02T18:49:43.609407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656824+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:49:43.656824+0000","last_peered":"2024-08-02T18:49:43.656824+0000","last_clean":"2024-08-02T18:49:43.656824+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:49:43.656824+0000","last_undegraded":"2024-08-02T18:49:43.656824+0000","last_fullsized":"2024-08-02T18:49:43.656824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563387+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:49:43.563387+0000","last_peered":"2024-08-02T18:49:43.563387+0000","last_clean":"2024-08-02T18:49:43.563387+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:49:43.563387+0000","last_undegraded":"2024-08-02T18:49:43.563387+0000","last_fullsized":"2024-08-02T18:49:43.563387+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609317+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:49:43.609317+0000","last_peered":"2024-08-02T18:49:43.609317+0000","last_clean":"2024-08-02T18:49:43.609317+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:49:43.609317+0000","last_undegraded":"2024-08-02T18:49:43.609317+0000","last_fullsized":"2024-08-02T18:49:43.609317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826836+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:49:43.826836+0000","last_peered":"2024-08-02T18:49:43.826836+0000","last_clean":"2024-08-02T18:49:43.826836+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:49:43.826836+0000","last_undegraded":"2024-08-02T18:49:43.826836+0000","last_fullsized":"2024-08-02T18:49:43.826836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656491+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:49:43.656491+0000","last_peered":"2024-08-02T18:49:43.656491+0000","last_clean":"2024-08-02T18:49:43.656491+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:49:43.656491+0000","last_undegraded":"2024-08-02T18:49:43.656491+0000","last_fullsized":"2024-08-02T18:49:43.656491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609487+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:49:43.609487+0000","last_peered":"2024-08-02T18:49:43.609487+0000","last_clean":"2024-08-02T18:49:43.609487+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:49:43.609487+0000","last_undegraded":"2024-08-02T18:49:43.609487+0000","last_fullsized":"2024-08-02T18:49:43.609487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609390+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:49:43.609390+0000","last_peered":"2024-08-02T18:49:43.609390+0000","last_clean":"2024-08-02T18:49:43.609390+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:49:43.609390+0000","last_undegraded":"2024-08-02T18:49:43.609390+0000","last_fullsized":"2024-08-02T18:49:43.609390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829268+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:49:43.829268+0000","last_peered":"2024-08-02T18:49:43.829268+0000","last_clean":"2024-08-02T18:49:43.829268+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:49:43.829268+0000","last_undegraded":"2024-08-02T18:49:43.829268+0000","last_fullsized":"2024-08-02T18:49:43.829268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609555+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:49:43.609555+0000","last_peered":"2024-08-02T18:49:43.609555+0000","last_clean":"2024-08-02T18:49:43.609555+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:49:43.609555+0000","last_undegraded":"2024-08-02T18:49:43.609555+0000","last_fullsized":"2024-08-02T18:49:43.609555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921113+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:49:43.921113+0000","last_peered":"2024-08-02T18:49:43.921113+0000","last_clean":"2024-08-02T18:49:43.921113+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:49:43.921113+0000","last_undegraded":"2024-08-02T18:49:43.921113+0000","last_fullsized":"2024-08-02T18:49:43.921113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609233+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:49:43.609233+0000","last_peered":"2024-08-02T18:49:43.609233+0000","last_clean":"2024-08-02T18:49:43.609233+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:49:43.609233+0000","last_undegraded":"2024-08-02T18:49:43.609233+0000","last_fullsized":"2024-08-02T18:49:43.609233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654077+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:49:43.654077+0000","last_peered":"2024-08-02T18:49:43.654077+0000","last_clean":"2024-08-02T18:49:43.654077+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:49:43.654077+0000","last_undegraded":"2024-08-02T18:49:43.654077+0000","last_fullsized":"2024-08-02T18:49:43.654077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656381+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:49:43.656381+0000","last_peered":"2024-08-02T18:49:43.656381+0000","last_clean":"2024-08-02T18:49:43.656381+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:49:43.656381+0000","last_undegraded":"2024-08-02T18:49:43.656381+0000","last_fullsized":"2024-08-02T18:49:43.656381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562686+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:49:43.562686+0000","last_peered":"2024-08-02T18:49:43.562686+0000","last_clean":"2024-08-02T18:49:43.562686+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:49:43.562686+0000","last_undegraded":"2024-08-02T18:49:43.562686+0000","last_fullsized":"2024-08-02T18:49:43.562686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609606+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:49:43.609606+0000","last_peered":"2024-08-02T18:49:43.609606+0000","last_clean":"2024-08-02T18:49:43.609606+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:49:43.609606+0000","last_undegraded":"2024-08-02T18:49:43.609606+0000","last_fullsized":"2024-08-02T18:49:43.609606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957022+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:49:43.957022+0000","last_peered":"2024-08-02T18:49:43.957022+0000","last_clean":"2024-08-02T18:49:43.957022+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:49:43.957022+0000","last_undegraded":"2024-08-02T18:49:43.957022+0000","last_fullsized":"2024-08-02T18:49:43.957022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609883+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:49:43.609883+0000","last_peered":"2024-08-02T18:49:43.609883+0000","last_clean":"2024-08-02T18:49:43.609883+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:49:43.609883+0000","last_undegraded":"2024-08-02T18:49:43.609883+0000","last_fullsized":"2024-08-02T18:49:43.609883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828996+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:49:43.828996+0000","last_peered":"2024-08-02T18:49:43.828996+0000","last_clean":"2024-08-02T18:49:43.828996+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:49:43.828996+0000","last_undegraded":"2024-08-02T18:49:43.828996+0000","last_fullsized":"2024-08-02T18:49:43.828996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609859+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:49:43.609859+0000","last_peered":"2024-08-02T18:49:43.609859+0000","last_clean":"2024-08-02T18:49:43.609859+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:49:43.609859+0000","last_undegraded":"2024-08-02T18:49:43.609859+0000","last_fullsized":"2024-08-02T18:49:43.609859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'101","reported_seq":230,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:53.577022+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:49:53.577022+0000","last_peered":"2024-08-02T18:49:53.577022+0000","last_clean":"2024-08-02T18:49:53.577022+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:49:53.577022+0000","last_undegraded":"2024-08-02T18:49:53.577022+0000","last_fullsized":"2024-08-02T18:49:53.577022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":185,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608943+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:49:43.608943+0000","last_peered":"2024-08-02T18:49:43.608943+0000","last_clean":"2024-08-02T18:49:43.608943+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:49:43.608943+0000","last_undegraded":"2024-08-02T18:49:43.608943+0000","last_fullsized":"2024-08-02T18:49:43.608943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561962+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:49:43.561962+0000","last_peered":"2024-08-02T18:49:43.561962+0000","last_clean":"2024-08-02T18:49:43.561962+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:49:43.561962+0000","last_undegraded":"2024-08-02T18:49:43.561962+0000","last_fullsized":"2024-08-02T18:49:43.561962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656835+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:49:43.656835+0000","last_peered":"2024-08-02T18:49:43.656835+0000","last_clean":"2024-08-02T18:49:43.656835+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:49:43.656835+0000","last_undegraded":"2024-08-02T18:49:43.656835+0000","last_fullsized":"2024-08-02T18:49:43.656835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921219+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:49:43.921219+0000","last_peered":"2024-08-02T18:49:43.921219+0000","last_clean":"2024-08-02T18:49:43.921219+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:49:43.921219+0000","last_undegraded":"2024-08-02T18:49:43.921219+0000","last_fullsized":"2024-08-02T18:49:43.921219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608457+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:49:43.608457+0000","last_peered":"2024-08-02T18:49:43.608457+0000","last_clean":"2024-08-02T18:49:43.608457+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:49:43.608457+0000","last_undegraded":"2024-08-02T18:49:43.608457+0000","last_fullsized":"2024-08-02T18:49:43.608457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654589+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:49:43.654589+0000","last_peered":"2024-08-02T18:49:43.654589+0000","last_clean":"2024-08-02T18:49:43.654589+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:49:43.654589+0000","last_undegraded":"2024-08-02T18:49:43.654589+0000","last_fullsized":"2024-08-02T18:49:43.654589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656388+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:49:43.656388+0000","last_peered":"2024-08-02T18:49:43.656388+0000","last_clean":"2024-08-02T18:49:43.656388+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:49:43.656388+0000","last_undegraded":"2024-08-02T18:49:43.656388+0000","last_fullsized":"2024-08-02T18:49:43.656388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608451+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:49:43.608451+0000","last_peered":"2024-08-02T18:49:43.608451+0000","last_clean":"2024-08-02T18:49:43.608451+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:49:43.608451+0000","last_undegraded":"2024-08-02T18:49:43.608451+0000","last_fullsized":"2024-08-02T18:49:43.608451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826989+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:49:43.826989+0000","last_peered":"2024-08-02T18:49:43.826989+0000","last_clean":"2024-08-02T18:49:43.826989+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:49:43.826989+0000","last_undegraded":"2024-08-02T18:49:43.826989+0000","last_fullsized":"2024-08-02T18:49:43.826989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561871+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:49:43.561871+0000","last_peered":"2024-08-02T18:49:43.561871+0000","last_clean":"2024-08-02T18:49:43.561871+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:49:43.561871+0000","last_undegraded":"2024-08-02T18:49:43.561871+0000","last_fullsized":"2024-08-02T18:49:43.561871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562994+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:49:43.562994+0000","last_peered":"2024-08-02T18:49:43.562994+0000","last_clean":"2024-08-02T18:49:43.562994+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:49:43.562994+0000","last_undegraded":"2024-08-02T18:49:43.562994+0000","last_fullsized":"2024-08-02T18:49:43.562994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.620617+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:49:52.620617+0000","last_peered":"2024-08-02T18:49:52.620617+0000","last_clean":"2024-08-02T18:49:52.620617+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:49:52.620617+0000","last_undegraded":"2024-08-02T18:49:52.620617+0000","last_fullsized":"2024-08-02T18:49:52.620617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562217+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:49:43.562217+0000","last_peered":"2024-08-02T18:49:43.562217+0000","last_clean":"2024-08-02T18:49:43.562217+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:49:43.562217+0000","last_undegraded":"2024-08-02T18:49:43.562217+0000","last_fullsized":"2024-08-02T18:49:43.562217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561158+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:49:43.561158+0000","last_peered":"2024-08-02T18:49:43.561158+0000","last_clean":"2024-08-02T18:49:43.561158+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:49:43.561158+0000","last_undegraded":"2024-08-02T18:49:43.561158+0000","last_fullsized":"2024-08-02T18:49:43.561158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826778+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:49:43.826778+0000","last_peered":"2024-08-02T18:49:43.826778+0000","last_clean":"2024-08-02T18:49:43.826778+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.826778+0000","last_undegraded":"2024-08-02T18:49:43.826778+0000","last_fullsized":"2024-08-02T18:49:43.826778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563541+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:49:43.563541+0000","last_peered":"2024-08-02T18:49:43.563541+0000","last_clean":"2024-08-02T18:49:43.563541+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:49:43.563541+0000","last_undegraded":"2024-08-02T18:49:43.563541+0000","last_fullsized":"2024-08-02T18:49:43.563541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609341+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:49:43.609341+0000","last_peered":"2024-08-02T18:49:43.609341+0000","last_clean":"2024-08-02T18:49:43.609341+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:49:43.609341+0000","last_undegraded":"2024-08-02T18:49:43.609341+0000","last_fullsized":"2024-08-02T18:49:43.609341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609676+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:49:43.609676+0000","last_peered":"2024-08-02T18:49:43.609676+0000","last_clean":"2024-08-02T18:49:43.609676+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:49:43.609676+0000","last_undegraded":"2024-08-02T18:49:43.609676+0000","last_fullsized":"2024-08-02T18:49:43.609676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":404,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:45.664818+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:49:45.664818+0000","last_peered":"2024-08-02T18:49:45.664818+0000","last_clean":"2024-08-02T18:49:45.664818+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:49:45.664818+0000","last_undegraded":"2024-08-02T18:49:45.664818+0000","last_fullsized":"2024-08-02T18:49:45.664818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827013+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:49:43.827013+0000","last_peered":"2024-08-02T18:49:43.827013+0000","last_clean":"2024-08-02T18:49:43.827013+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:49:43.827013+0000","last_undegraded":"2024-08-02T18:49:43.827013+0000","last_fullsized":"2024-08-02T18:49:43.827013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827183+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:49:43.827183+0000","last_peered":"2024-08-02T18:49:43.827183+0000","last_clean":"2024-08-02T18:49:43.827183+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:49:43.827183+0000","last_undegraded":"2024-08-02T18:49:43.827183+0000","last_fullsized":"2024-08-02T18:49:43.827183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829351+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:49:43.829351+0000","last_peered":"2024-08-02T18:49:43.829351+0000","last_clean":"2024-08-02T18:49:43.829351+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:49:43.829351+0000","last_undegraded":"2024-08-02T18:49:43.829351+0000","last_fullsized":"2024-08-02T18:49:43.829351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562654+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:49:43.562654+0000","last_peered":"2024-08-02T18:49:43.562654+0000","last_clean":"2024-08-02T18:49:43.562654+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:49:43.562654+0000","last_undegraded":"2024-08-02T18:49:43.562654+0000","last_fullsized":"2024-08-02T18:49:43.562654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826971+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:49:43.826971+0000","last_peered":"2024-08-02T18:49:43.826971+0000","last_clean":"2024-08-02T18:49:43.826971+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:49:43.826971+0000","last_undegraded":"2024-08-02T18:49:43.826971+0000","last_fullsized":"2024-08-02T18:49:43.826971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'65","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.972552+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:49:52.972552+0000","last_peered":"2024-08-02T18:49:52.972552+0000","last_clean":"2024-08-02T18:49:52.972552+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:49:52.972552+0000","last_undegraded":"2024-08-02T18:49:52.972552+0000","last_fullsized":"2024-08-02T18:49:52.972552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956875+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:49:43.956875+0000","last_peered":"2024-08-02T18:49:43.956875+0000","last_clean":"2024-08-02T18:49:43.956875+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:49:43.956875+0000","last_undegraded":"2024-08-02T18:49:43.956875+0000","last_fullsized":"2024-08-02T18:49:43.956875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827238+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:49:43.827238+0000","last_peered":"2024-08-02T18:49:43.827238+0000","last_clean":"2024-08-02T18:49:43.827238+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:49:43.827238+0000","last_undegraded":"2024-08-02T18:49:43.827238+0000","last_fullsized":"2024-08-02T18:49:43.827238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562375+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:49:43.562375+0000","last_peered":"2024-08-02T18:49:43.562375+0000","last_clean":"2024-08-02T18:49:43.562375+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:49:43.562375+0000","last_undegraded":"2024-08-02T18:49:43.562375+0000","last_fullsized":"2024-08-02T18:49:43.562375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562856+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:49:43.562856+0000","last_peered":"2024-08-02T18:49:43.562856+0000","last_clean":"2024-08-02T18:49:43.562856+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:49:43.562856+0000","last_undegraded":"2024-08-02T18:49:43.562856+0000","last_fullsized":"2024-08-02T18:49:43.562856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921519+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:49:43.921519+0000","last_peered":"2024-08-02T18:49:43.921519+0000","last_clean":"2024-08-02T18:49:43.921519+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:49:43.921519+0000","last_undegraded":"2024-08-02T18:49:43.921519+0000","last_fullsized":"2024-08-02T18:49:43.921519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656937+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:49:43.656937+0000","last_peered":"2024-08-02T18:49:43.656937+0000","last_clean":"2024-08-02T18:49:43.656937+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:49:43.656937+0000","last_undegraded":"2024-08-02T18:49:43.656937+0000","last_fullsized":"2024-08-02T18:49:43.656937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562946+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:49:43.562946+0000","last_peered":"2024-08-02T18:49:43.562946+0000","last_clean":"2024-08-02T18:49:43.562946+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:49:43.562946+0000","last_undegraded":"2024-08-02T18:49:43.562946+0000","last_fullsized":"2024-08-02T18:49:43.562946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563145+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:49:43.563145+0000","last_peered":"2024-08-02T18:49:43.563145+0000","last_clean":"2024-08-02T18:49:43.563145+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:49:43.563145+0000","last_undegraded":"2024-08-02T18:49:43.563145+0000","last_fullsized":"2024-08-02T18:49:43.563145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656450+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:49:43.656450+0000","last_peered":"2024-08-02T18:49:43.656450+0000","last_clean":"2024-08-02T18:49:43.656450+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:49:43.656450+0000","last_undegraded":"2024-08-02T18:49:43.656450+0000","last_fullsized":"2024-08-02T18:49:43.656450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562402+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:49:43.562402+0000","last_peered":"2024-08-02T18:49:43.562402+0000","last_clean":"2024-08-02T18:49:43.562402+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:49:43.562402+0000","last_undegraded":"2024-08-02T18:49:43.562402+0000","last_fullsized":"2024-08-02T18:49:43.562402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826765+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:49:43.826765+0000","last_peered":"2024-08-02T18:49:43.826765+0000","last_clean":"2024-08-02T18:49:43.826765+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:49:43.826765+0000","last_undegraded":"2024-08-02T18:49:43.826765+0000","last_fullsized":"2024-08-02T18:49:43.826765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.621121+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:49:52.621121+0000","last_peered":"2024-08-02T18:49:52.621121+0000","last_clean":"2024-08-02T18:49:52.621121+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:49:52.621121+0000","last_undegraded":"2024-08-02T18:49:52.621121+0000","last_fullsized":"2024-08-02T18:49:52.621121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1676,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654944+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:49:43.654944+0000","last_peered":"2024-08-02T18:49:43.654944+0000","last_clean":"2024-08-02T18:49:43.654944+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:49:43.654944+0000","last_undegraded":"2024-08-02T18:49:43.654944+0000","last_fullsized":"2024-08-02T18:49:43.654944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826962+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:49:43.826962+0000","last_peered":"2024-08-02T18:49:43.826962+0000","last_clean":"2024-08-02T18:49:43.826962+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:49:43.826962+0000","last_undegraded":"2024-08-02T18:49:43.826962+0000","last_fullsized":"2024-08-02T18:49:43.826962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563270+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:49:43.563270+0000","last_peered":"2024-08-02T18:49:43.563270+0000","last_clean":"2024-08-02T18:49:43.563270+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:49:43.563270+0000","last_undegraded":"2024-08-02T18:49:43.563270+0000","last_fullsized":"2024-08-02T18:49:43.563270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921292+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:49:43.921292+0000","last_peered":"2024-08-02T18:49:43.921292+0000","last_clean":"2024-08-02T18:49:43.921292+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:49:43.921292+0000","last_undegraded":"2024-08-02T18:49:43.921292+0000","last_fullsized":"2024-08-02T18:49:43.921292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561546+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:49:43.561546+0000","last_peered":"2024-08-02T18:49:43.561546+0000","last_clean":"2024-08-02T18:49:43.561546+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:49:43.561546+0000","last_undegraded":"2024-08-02T18:49:43.561546+0000","last_fullsized":"2024-08-02T18:49:43.561546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921110+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:49:43.921110+0000","last_peered":"2024-08-02T18:49:43.921110+0000","last_clean":"2024-08-02T18:49:43.921110+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:49:43.921110+0000","last_undegraded":"2024-08-02T18:49:43.921110+0000","last_fullsized":"2024-08-02T18:49:43.921110+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608422+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:49:43.608422+0000","last_peered":"2024-08-02T18:49:43.608422+0000","last_clean":"2024-08-02T18:49:43.608422+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:49:43.608422+0000","last_undegraded":"2024-08-02T18:49:43.608422+0000","last_fullsized":"2024-08-02T18:49:43.608422+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656771+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:49:43.656771+0000","last_peered":"2024-08-02T18:49:43.656771+0000","last_clean":"2024-08-02T18:49:43.656771+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:49:43.656771+0000","last_undegraded":"2024-08-02T18:49:43.656771+0000","last_fullsized":"2024-08-02T18:49:43.656771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'40","reported_seq":311,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:53.621705+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:49:53.621705+0000","last_peered":"2024-08-02T18:49:53.621705+0000","last_clean":"2024-08-02T18:49:53.621705+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:53.621705+0000","last_undegraded":"2024-08-02T18:49:53.621705+0000","last_fullsized":"2024-08-02T18:49:53.621705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69709,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":187,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654063+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:49:43.654063+0000","last_peered":"2024-08-02T18:49:43.654063+0000","last_clean":"2024-08-02T18:49:43.654063+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:49:43.654063+0000","last_undegraded":"2024-08-02T18:49:43.654063+0000","last_fullsized":"2024-08-02T18:49:43.654063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562852+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:49:43.562852+0000","last_peered":"2024-08-02T18:49:43.562852+0000","last_clean":"2024-08-02T18:49:43.562852+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:49:43.562852+0000","last_undegraded":"2024-08-02T18:49:43.562852+0000","last_fullsized":"2024-08-02T18:49:43.562852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563483+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:49:43.563483+0000","last_peered":"2024-08-02T18:49:43.563483+0000","last_clean":"2024-08-02T18:49:43.563483+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:49:43.563483+0000","last_undegraded":"2024-08-02T18:49:43.563483+0000","last_fullsized":"2024-08-02T18:49:43.563483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609613+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:49:43.609613+0000","last_peered":"2024-08-02T18:49:43.609613+0000","last_clean":"2024-08-02T18:49:43.609613+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:49:43.609613+0000","last_undegraded":"2024-08-02T18:49:43.609613+0000","last_fullsized":"2024-08-02T18:49:43.609613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957216+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:49:43.957216+0000","last_peered":"2024-08-02T18:49:43.957216+0000","last_clean":"2024-08-02T18:49:43.957216+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:49:43.957216+0000","last_undegraded":"2024-08-02T18:49:43.957216+0000","last_fullsized":"2024-08-02T18:49:43.957216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827184+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:49:43.827184+0000","last_peered":"2024-08-02T18:49:43.827184+0000","last_clean":"2024-08-02T18:49:43.827184+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:49:43.827184+0000","last_undegraded":"2024-08-02T18:49:43.827184+0000","last_fullsized":"2024-08-02T18:49:43.827184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653715+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:49:43.653715+0000","last_peered":"2024-08-02T18:49:43.653715+0000","last_clean":"2024-08-02T18:49:43.653715+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:49:43.653715+0000","last_undegraded":"2024-08-02T18:49:43.653715+0000","last_fullsized":"2024-08-02T18:49:43.653715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563248+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:49:43.563248+0000","last_peered":"2024-08-02T18:49:43.563248+0000","last_clean":"2024-08-02T18:49:43.563248+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:49:43.563248+0000","last_undegraded":"2024-08-02T18:49:43.563248+0000","last_fullsized":"2024-08-02T18:49:43.563248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.620915+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:49:52.620915+0000","last_peered":"2024-08-02T18:49:52.620915+0000","last_clean":"2024-08-02T18:49:52.620915+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:49:52.620915+0000","last_undegraded":"2024-08-02T18:49:52.620915+0000","last_fullsized":"2024-08-02T18:49:52.620915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609101+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:49:43.609101+0000","last_peered":"2024-08-02T18:49:43.609101+0000","last_clean":"2024-08-02T18:49:43.609101+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:49:43.609101+0000","last_undegraded":"2024-08-02T18:49:43.609101+0000","last_fullsized":"2024-08-02T18:49:43.609101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956951+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:49:43.956951+0000","last_peered":"2024-08-02T18:49:43.956951+0000","last_clean":"2024-08-02T18:49:43.956951+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:49:43.956951+0000","last_undegraded":"2024-08-02T18:49:43.956951+0000","last_fullsized":"2024-08-02T18:49:43.956951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653949+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:49:43.653949+0000","last_peered":"2024-08-02T18:49:43.653949+0000","last_clean":"2024-08-02T18:49:43.653949+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:49:43.653949+0000","last_undegraded":"2024-08-02T18:49:43.653949+0000","last_fullsized":"2024-08-02T18:49:43.653949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563227+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:49:43.563227+0000","last_peered":"2024-08-02T18:49:43.563227+0000","last_clean":"2024-08-02T18:49:43.563227+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:49:43.563227+0000","last_undegraded":"2024-08-02T18:49:43.563227+0000","last_fullsized":"2024-08-02T18:49:43.563227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921505+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:49:43.921505+0000","last_peered":"2024-08-02T18:49:43.921505+0000","last_clean":"2024-08-02T18:49:43.921505+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:49:43.921505+0000","last_undegraded":"2024-08-02T18:49:43.921505+0000","last_fullsized":"2024-08-02T18:49:43.921505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609123+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:49:43.609123+0000","last_peered":"2024-08-02T18:49:43.609123+0000","last_clean":"2024-08-02T18:49:43.609123+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:49:43.609123+0000","last_undegraded":"2024-08-02T18:49:43.609123+0000","last_fullsized":"2024-08-02T18:49:43.609123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561228+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:49:43.561228+0000","last_peered":"2024-08-02T18:49:43.561228+0000","last_clean":"2024-08-02T18:49:43.561228+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:49:43.561228+0000","last_undegraded":"2024-08-02T18:49:43.561228+0000","last_fullsized":"2024-08-02T18:49:43.561228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608673+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:49:43.608673+0000","last_peered":"2024-08-02T18:49:43.608673+0000","last_clean":"2024-08-02T18:49:43.608673+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:49:43.608673+0000","last_undegraded":"2024-08-02T18:49:43.608673+0000","last_fullsized":"2024-08-02T18:49:43.608673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654071+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:49:43.654071+0000","last_peered":"2024-08-02T18:49:43.654071+0000","last_clean":"2024-08-02T18:49:43.654071+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:49:43.654071+0000","last_undegraded":"2024-08-02T18:49:43.654071+0000","last_fullsized":"2024-08-02T18:49:43.654071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829094+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:49:43.829094+0000","last_peered":"2024-08-02T18:49:43.829094+0000","last_clean":"2024-08-02T18:49:43.829094+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:49:43.829094+0000","last_undegraded":"2024-08-02T18:49:43.829094+0000","last_fullsized":"2024-08-02T18:49:43.829094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.621354+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:49:52.621354+0000","last_peered":"2024-08-02T18:49:52.621354+0000","last_clean":"2024-08-02T18:49:52.621354+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:49:52.621354+0000","last_undegraded":"2024-08-02T18:49:52.621354+0000","last_fullsized":"2024-08-02T18:49:52.621354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656593+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:49:43.656593+0000","last_peered":"2024-08-02T18:49:43.656593+0000","last_clean":"2024-08-02T18:49:43.656593+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:49:43.656593+0000","last_undegraded":"2024-08-02T18:49:43.656593+0000","last_fullsized":"2024-08-02T18:49:43.656593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829250+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:49:43.829250+0000","last_peered":"2024-08-02T18:49:43.829250+0000","last_clean":"2024-08-02T18:49:43.829250+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:49:43.829250+0000","last_undegraded":"2024-08-02T18:49:43.829250+0000","last_fullsized":"2024-08-02T18:49:43.829250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921020+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:49:43.921020+0000","last_peered":"2024-08-02T18:49:43.921020+0000","last_clean":"2024-08-02T18:49:43.921020+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:49:43.921020+0000","last_undegraded":"2024-08-02T18:49:43.921020+0000","last_fullsized":"2024-08-02T18:49:43.921020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829253+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:49:43.829253+0000","last_peered":"2024-08-02T18:49:43.829253+0000","last_clean":"2024-08-02T18:49:43.829253+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:49:43.829253+0000","last_undegraded":"2024-08-02T18:49:43.829253+0000","last_fullsized":"2024-08-02T18:49:43.829253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829051+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:49:43.829051+0000","last_peered":"2024-08-02T18:49:43.829051+0000","last_clean":"2024-08-02T18:49:43.829051+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:49:43.829051+0000","last_undegraded":"2024-08-02T18:49:43.829051+0000","last_fullsized":"2024-08-02T18:49:43.829051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956830+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:49:43.956830+0000","last_peered":"2024-08-02T18:49:43.956830+0000","last_clean":"2024-08-02T18:49:43.956830+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:49:43.956830+0000","last_undegraded":"2024-08-02T18:49:43.956830+0000","last_fullsized":"2024-08-02T18:49:43.956830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561943+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:49:43.561943+0000","last_peered":"2024-08-02T18:49:43.561943+0000","last_clean":"2024-08-02T18:49:43.561943+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:49:43.561943+0000","last_undegraded":"2024-08-02T18:49:43.561943+0000","last_fullsized":"2024-08-02T18:49:43.561943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921458+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:49:43.921458+0000","last_peered":"2024-08-02T18:49:43.921458+0000","last_clean":"2024-08-02T18:49:43.921458+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:49:43.921458+0000","last_undegraded":"2024-08-02T18:49:43.921458+0000","last_fullsized":"2024-08-02T18:49:43.921458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829511+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:49:43.829511+0000","last_peered":"2024-08-02T18:49:43.829511+0000","last_clean":"2024-08-02T18:49:43.829511+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:49:43.829511+0000","last_undegraded":"2024-08-02T18:49:43.829511+0000","last_fullsized":"2024-08-02T18:49:43.829511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609765+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:49:43.609765+0000","last_peered":"2024-08-02T18:49:43.609765+0000","last_clean":"2024-08-02T18:49:43.609765+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:49:43.609765+0000","last_undegraded":"2024-08-02T18:49:43.609765+0000","last_fullsized":"2024-08-02T18:49:43.609765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562988+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:49:43.562988+0000","last_peered":"2024-08-02T18:49:43.562988+0000","last_clean":"2024-08-02T18:49:43.562988+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:49:43.562988+0000","last_undegraded":"2024-08-02T18:49:43.562988+0000","last_fullsized":"2024-08-02T18:49:43.562988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609160+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:49:43.609160+0000","last_peered":"2024-08-02T18:49:43.609160+0000","last_clean":"2024-08-02T18:49:43.609160+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:49:43.609160+0000","last_undegraded":"2024-08-02T18:49:43.609160+0000","last_fullsized":"2024-08-02T18:49:43.609160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562877+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:49:43.562877+0000","last_peered":"2024-08-02T18:49:43.562877+0000","last_clean":"2024-08-02T18:49:43.562877+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:49:43.562877+0000","last_undegraded":"2024-08-02T18:49:43.562877+0000","last_fullsized":"2024-08-02T18:49:43.562877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561703+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:49:43.561703+0000","last_peered":"2024-08-02T18:49:43.561703+0000","last_clean":"2024-08-02T18:49:43.561703+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:49:43.561703+0000","last_undegraded":"2024-08-02T18:49:43.561703+0000","last_fullsized":"2024-08-02T18:49:43.561703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921328+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:49:43.921328+0000","last_peered":"2024-08-02T18:49:43.921328+0000","last_clean":"2024-08-02T18:49:43.921328+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:49:43.921328+0000","last_undegraded":"2024-08-02T18:49:43.921328+0000","last_fullsized":"2024-08-02T18:49:43.921328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829407+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:49:43.829407+0000","last_peered":"2024-08-02T18:49:43.829407+0000","last_clean":"2024-08-02T18:49:43.829407+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:49:43.829407+0000","last_undegraded":"2024-08-02T18:49:43.829407+0000","last_fullsized":"2024-08-02T18:49:43.829407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654732+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:49:43.654732+0000","last_peered":"2024-08-02T18:49:43.654732+0000","last_clean":"2024-08-02T18:49:43.654732+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:49:43.654732+0000","last_undegraded":"2024-08-02T18:49:43.654732+0000","last_fullsized":"2024-08-02T18:49:43.654732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921678+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:49:43.921678+0000","last_peered":"2024-08-02T18:49:43.921678+0000","last_clean":"2024-08-02T18:49:43.921678+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:49:43.921678+0000","last_undegraded":"2024-08-02T18:49:43.921678+0000","last_fullsized":"2024-08-02T18:49:43.921678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562579+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:49:43.562579+0000","last_peered":"2024-08-02T18:49:43.562579+0000","last_clean":"2024-08-02T18:49:43.562579+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:49:43.562579+0000","last_undegraded":"2024-08-02T18:49:43.562579+0000","last_fullsized":"2024-08-02T18:49:43.562579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.955905+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:49:43.955905+0000","last_peered":"2024-08-02T18:49:43.955905+0000","last_clean":"2024-08-02T18:49:43.955905+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:49:43.955905+0000","last_undegraded":"2024-08-02T18:49:43.955905+0000","last_fullsized":"2024-08-02T18:49:43.955905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956586+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:49:43.956586+0000","last_peered":"2024-08-02T18:49:43.956586+0000","last_clean":"2024-08-02T18:49:43.956586+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:49:43.956586+0000","last_undegraded":"2024-08-02T18:49:43.956586+0000","last_fullsized":"2024-08-02T18:49:43.956586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561566+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:49:43.561566+0000","last_peered":"2024-08-02T18:49:43.561566+0000","last_clean":"2024-08-02T18:49:43.561566+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:49:43.561566+0000","last_undegraded":"2024-08-02T18:49:43.561566+0000","last_fullsized":"2024-08-02T18:49:43.561566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609731+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:49:43.609731+0000","last_peered":"2024-08-02T18:49:43.609731+0000","last_clean":"2024-08-02T18:49:43.609731+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:49:43.609731+0000","last_undegraded":"2024-08-02T18:49:43.609731+0000","last_fullsized":"2024-08-02T18:49:43.609731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827166+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:49:43.827166+0000","last_peered":"2024-08-02T18:49:43.827166+0000","last_clean":"2024-08-02T18:49:43.827166+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:49:43.827166+0000","last_undegraded":"2024-08-02T18:49:43.827166+0000","last_fullsized":"2024-08-02T18:49:43.827166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608836+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:49:43.608836+0000","last_peered":"2024-08-02T18:49:43.608836+0000","last_clean":"2024-08-02T18:49:43.608836+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:49:43.608836+0000","last_undegraded":"2024-08-02T18:49:43.608836+0000","last_fullsized":"2024-08-02T18:49:43.608836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563210+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:49:43.563210+0000","last_peered":"2024-08-02T18:49:43.563210+0000","last_clean":"2024-08-02T18:49:43.563210+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:49:43.563210+0000","last_undegraded":"2024-08-02T18:49:43.563210+0000","last_fullsized":"2024-08-02T18:49:43.563210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609115+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:49:43.609115+0000","last_peered":"2024-08-02T18:49:43.609115+0000","last_clean":"2024-08-02T18:49:43.609115+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:49:43.609115+0000","last_undegraded":"2024-08-02T18:49:43.609115+0000","last_fullsized":"2024-08-02T18:49:43.609115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826771+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:49:43.826771+0000","last_peered":"2024-08-02T18:49:43.826771+0000","last_clean":"2024-08-02T18:49:43.826771+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:49:43.826771+0000","last_undegraded":"2024-08-02T18:49:43.826771+0000","last_fullsized":"2024-08-02T18:49:43.826771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608541+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:49:43.608541+0000","last_peered":"2024-08-02T18:49:43.608541+0000","last_clean":"2024-08-02T18:49:43.608541+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:49:43.608541+0000","last_undegraded":"2024-08-02T18:49:43.608541+0000","last_fullsized":"2024-08-02T18:49:43.608541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656515+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:49:43.656515+0000","last_peered":"2024-08-02T18:49:43.656515+0000","last_clean":"2024-08-02T18:49:43.656515+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:49:43.656515+0000","last_undegraded":"2024-08-02T18:49:43.656515+0000","last_fullsized":"2024-08-02T18:49:43.656515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654397+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:49:43.654397+0000","last_peered":"2024-08-02T18:49:43.654397+0000","last_clean":"2024-08-02T18:49:43.654397+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:49:43.654397+0000","last_undegraded":"2024-08-02T18:49:43.654397+0000","last_fullsized":"2024-08-02T18:49:43.654397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956825+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:49:43.956825+0000","last_peered":"2024-08-02T18:49:43.956825+0000","last_clean":"2024-08-02T18:49:43.956825+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:49:43.956825+0000","last_undegraded":"2024-08-02T18:49:43.956825+0000","last_fullsized":"2024-08-02T18:49:43.956825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956976+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:49:43.956976+0000","last_peered":"2024-08-02T18:49:43.956976+0000","last_clean":"2024-08-02T18:49:43.956976+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:49:43.956976+0000","last_undegraded":"2024-08-02T18:49:43.956976+0000","last_fullsized":"2024-08-02T18:49:43.956976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921644+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:49:43.921644+0000","last_peered":"2024-08-02T18:49:43.921644+0000","last_clean":"2024-08-02T18:49:43.921644+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:49:43.921644+0000","last_undegraded":"2024-08-02T18:49:43.921644+0000","last_fullsized":"2024-08-02T18:49:43.921644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":796776,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1047,"num_read_kb":741,"num_write":427,"num_write_kb":2361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2390328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":314,"ondisk_log_size":314,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547244,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":509529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776176,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29144,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716008,"statfs":{"total":95995035648,"available":95965192192,"internally_reserved":0,"allocated":2056192,"data_stored":1495792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939699,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1441792,"data_stored":907043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168634,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1437696,"data_stored":902867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397567,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1638400,"data_stored":1107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561091,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":504907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822727,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29068,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716084,"statfs":{"total":95995035648,"available":95965270016,"internally_reserved":0,"allocated":1978368,"data_stored":1429910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":510645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215184,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28856,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716296,"statfs":{"total":95995035648,"available":95965487104,"internally_reserved":0,"allocated":1761280,"data_stored":1226549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":576763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":574526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1048576,"data_stored":506295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":330629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":400607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:49:57.125 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-08-02T18:49:57.125 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph pg dump --format=json 2024-08-02T18:49:57.383 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:57.783 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:57 smithi103 ceph-mon[32753]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 51 op/s 2024-08-02T18:49:57.783 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:57 smithi103 ceph-mon[32753]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:57.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:57 smithi151 ceph-mon[37155]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 51 op/s 2024-08-02T18:49:57.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:57 smithi151 ceph-mon[37155]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:57.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 -- 172.21.15.103:0/2102443394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef001078b0 msgr2=0x7fef00107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:57.875 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 --2- 172.21.15.103:0/2102443394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef001078b0 0x7fef00107c90 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7feef0009930 tx=0x7feef002a420 comp rx=0 tx=0).stop 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 -- 172.21.15.103:0/2102443394 shutdown_connections 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 --2- 172.21.15.103:0/2102443394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef00102250 0x7fef0010e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 --2- 172.21.15.103:0/2102443394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef001018b0 0x7fef00101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 --2- 172.21.15.103:0/2102443394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef001078b0 0x7fef00107c90 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 -- 172.21.15.103:0/2102443394 >> 172.21.15.103:0/2102443394 conn(0x7fef000fd5f0 msgr2=0x7fef000ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 -- 172.21.15.103:0/2102443394 shutdown_connections 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.862+0000 7fef04a1e640 1 -- 172.21.15.103:0/2102443394 wait complete. 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7fef04a1e640 1 Processor -- start 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7fef04a1e640 1 -- start start 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7fef04a1e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef001018b0 0x7fef001981d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7fef04a1e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef00102250 0x7fef00198710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:57.876 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7fef04a1e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef001078b0 0x7fef0019caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7fef04a1e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fef00111dd0 con 0x7fef00102250 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7fef04a1e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fef00111c50 con 0x7fef001018b0 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7fef04a1e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fef00111f50 con 0x7fef001078b0 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7feefdd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef00102250 0x7fef00198710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7feefdd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef00102250 0x7fef00198710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60848/0 (socket says 172.21.15.103:60848) 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.863+0000 7feefdd9b640 1 -- 172.21.15.103:0/3407105767 learned_addr learned my addr 172.21.15.103:0/3407105767 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefed9d640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef001078b0 0x7fef0019caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefe59c640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef001018b0 0x7fef001981d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefdd9b640 1 -- 172.21.15.103:0/3407105767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef001078b0 msgr2=0x7fef0019caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefdd9b640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef001078b0 0x7fef0019caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefdd9b640 1 -- 172.21.15.103:0/3407105767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef001018b0 msgr2=0x7fef001981d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefdd9b640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef001018b0 0x7fef001981d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:57.877 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefdd9b640 1 -- 172.21.15.103:0/3407105767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef0019d180 con 0x7fef00102250 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefe59c640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef001018b0 0x7fef001981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feefdd9b640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef00102250 0x7fef00198710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feef400c920 tx=0x7feef400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feeef7fe640 1 -- 172.21.15.103:0/3407105767 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4007c70 con 0x7fef00102250 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feeef7fe640 1 -- 172.21.15.103:0/3407105767 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7feef4007e10 con 0x7fef00102250 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef0019d470 con 0x7fef00102250 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7feeef7fe640 1 -- 172.21.15.103:0/3407105767 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feef4018940 con 0x7fef00102250 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.864+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef001a4d50 con 0x7fef00102250 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.865+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef00101d10 con 0x7fef00102250 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.866+0000 7feeef7fe640 1 -- 172.21.15.103:0/3407105767 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7feef4018b20 con 0x7fef00102250 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.867+0000 7feeef7fe640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7feee80a2d80 0x7feee80a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.867+0000 7feefe59c640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7feee80a2d80 0x7feee80a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:57.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.867+0000 7feeef7fe640 1 -- 172.21.15.103:0/3407105767 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7feef40cfab0 con 0x7fef00102250 2024-08-02T18:49:57.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.867+0000 7feefe59c640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7feee80a2d80 0x7feee80a5240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feef0000c00 tx=0x7feef0005a20 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:57.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:57.871+0000 7feeef7fe640 1 -- 172.21.15.103:0/3407105767 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7feef4014030 con 0x7fef00102250 2024-08-02T18:49:58.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:57 smithi121 ceph-mon[37236]: pgmap v9: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 43 KiB/s rd, 83 KiB/s wr, 51 op/s 2024-08-02T18:49:58.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:57 smithi121 ceph-mon[37236]: from='client.15456 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:58.035 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.034+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fef000fe3f0 con 0x7feee80a2d80 2024-08-02T18:49:58.043 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.042+0000 7feeef7fe640 1 -- 172.21.15.103:0/3407105767 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+339414 (secure 0 0 0) 0x7fef000fe3f0 con 0x7feee80a2d80 2024-08-02T18:49:58.046 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:58.048 INFO:teuthology.orchestra.run.smithi103.stderr:dumped all 2024-08-02T18:49:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7feee80a2d80 msgr2=0x7feee80a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7feee80a2d80 0x7feee80a5240 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7feef0000c00 tx=0x7feef0005a20 comp rx=0 tx=0).stop 2024-08-02T18:49:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef00102250 msgr2=0x7fef00198710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef00102250 0x7fef00198710 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7feef400c920 tx=0x7feef400cde0 comp rx=0 tx=0).stop 2024-08-02T18:49:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 shutdown_connections 2024-08-02T18:49:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7feee80a2d80 0x7feee80a5240 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:58.050 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fef001078b0 0x7fef0019caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fef00102250 0x7fef00198710 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 --2- 172.21.15.103:0/3407105767 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fef001018b0 0x7fef001981d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 >> 172.21.15.103:0/3407105767 conn(0x7fef000fd5f0 msgr2=0x7fef000fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 shutdown_connections 2024-08-02T18:49:58.051 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:58.045+0000 7fef04a1e640 1 -- 172.21.15.103:0/3407105767 wait complete. 2024-08-02T18:49:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:58 smithi103 ceph-mon[32753]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-08-02T18:49:58.731 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:49:58 smithi103 ceph-mon[32753]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:58.763 INFO:teuthology.orchestra.run.smithi103.stdout:{"pg_ready":true,"pg_map":{"version":10,"stamp":"2024-08-02T18:49:57.577707+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1387378,"num_objects":66,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":66,"num_whiteouts":0,"num_read":1284,"num_read_kb":1071,"num_write":630,"num_write_kb":5301,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":1180770,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":964,"ondisk_log_size":964,"up":419,"acting":419,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":419,"num_osds":12,"num_per_pool_osds":12,"num_per_pool_omap_osds":12,"kb":1124941824,"kb_used":378296,"kb_used_data":16280,"kb_used_omap":18,"kb_used_meta":361517,"kb_avail":1124563528,"statfs":{"total":1151940427776,"available":1151553052672,"internally_reserved":0,"allocated":16670720,"data_stored":10252004,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19143,"internal_metadata":370193721},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":196632,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":419,"num_read_kb":476,"num_write":146,"num_write_kb":914,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002870"},"pg_stats":[{"pgid":"2.1f","version":"87'9","reported_seq":48,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.655076+0000","last_change":"2024-08-02T18:47:19.311155+0000","last_active":"2024-08-02T18:49:43.655076+0000","last_peered":"2024-08-02T18:49:43.655076+0000","last_clean":"2024-08-02T18:49:43.655076+0000","last_became_active":"2024-08-02T18:47:19.310841+0000","last_became_peered":"2024-08-02T18:47:19.310841+0000","last_unstale":"2024-08-02T18:49:43.655076+0000","last_undegraded":"2024-08-02T18:49:43.655076+0000","last_fullsized":"2024-08-02T18:49:43.655076+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:18:10.447586+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,8],"acting":[9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.1e","version":"89'5","reported_seq":18,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654228+0000","last_change":"2024-08-02T18:48:06.478872+0000","last_active":"2024-08-02T18:49:43.654228+0000","last_peered":"2024-08-02T18:49:43.654228+0000","last_clean":"2024-08-02T18:49:43.654228+0000","last_became_active":"2024-08-02T18:48:06.478534+0000","last_became_peered":"2024-08-02T18:48:06.478534+0000","last_unstale":"2024-08-02T18:49:43.654228+0000","last_undegraded":"2024-08-02T18:49:43.654228+0000","last_fullsized":"2024-08-02T18:49:43.654228+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:59:17.542750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,5],"acting":[9,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828991+0000","last_change":"2024-08-02T18:47:28.366227+0000","last_active":"2024-08-02T18:49:43.828991+0000","last_peered":"2024-08-02T18:49:43.828991+0000","last_clean":"2024-08-02T18:49:43.828991+0000","last_became_active":"2024-08-02T18:47:28.364766+0000","last_became_peered":"2024-08-02T18:47:28.364766+0000","last_unstale":"2024-08-02T18:49:43.828991+0000","last_undegraded":"2024-08-02T18:49:43.828991+0000","last_fullsized":"2024-08-02T18:49:43.828991+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:15:54.276876+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,9,0],"acting":[2,3,9,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1e","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609787+0000","last_change":"2024-08-02T18:47:19.467972+0000","last_active":"2024-08-02T18:49:43.609787+0000","last_peered":"2024-08-02T18:49:43.609787+0000","last_clean":"2024-08-02T18:49:43.609787+0000","last_became_active":"2024-08-02T18:47:19.467636+0000","last_became_peered":"2024-08-02T18:47:19.467636+0000","last_unstale":"2024-08-02T18:49:43.609787+0000","last_undegraded":"2024-08-02T18:49:43.609787+0000","last_fullsized":"2024-08-02T18:49:43.609787+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:39:29.144413+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,5],"acting":[3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957153+0000","last_change":"2024-08-02T18:47:21.337885+0000","last_active":"2024-08-02T18:49:43.957153+0000","last_peered":"2024-08-02T18:49:43.957153+0000","last_clean":"2024-08-02T18:49:43.957153+0000","last_became_active":"2024-08-02T18:47:21.336644+0000","last_became_peered":"2024-08-02T18:47:21.336644+0000","last_unstale":"2024-08-02T18:49:43.957153+0000","last_undegraded":"2024-08-02T18:49:43.957153+0000","last_fullsized":"2024-08-02T18:49:43.957153+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:14:32.511762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,9],"acting":[0,1,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609235+0000","last_change":"2024-08-02T18:47:28.363225+0000","last_active":"2024-08-02T18:49:43.609235+0000","last_peered":"2024-08-02T18:49:43.609235+0000","last_clean":"2024-08-02T18:49:43.609235+0000","last_became_active":"2024-08-02T18:47:28.362768+0000","last_became_peered":"2024-08-02T18:47:28.362768+0000","last_unstale":"2024-08-02T18:49:43.609235+0000","last_undegraded":"2024-08-02T18:49:43.609235+0000","last_fullsized":"2024-08-02T18:49:43.609235+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:42.493897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,9,3],"acting":[4,6,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"87'4","reported_seq":19,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921278+0000","last_change":"2024-08-02T18:48:06.478787+0000","last_active":"2024-08-02T18:49:43.921278+0000","last_peered":"2024-08-02T18:49:43.921278+0000","last_clean":"2024-08-02T18:49:43.921278+0000","last_became_active":"2024-08-02T18:48:06.471144+0000","last_became_peered":"2024-08-02T18:48:06.471144+0000","last_unstale":"2024-08-02T18:49:43.921278+0000","last_undegraded":"2024-08-02T18:49:43.921278+0000","last_fullsized":"2024-08-02T18:49:43.921278+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:14:32.185600+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":10,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,7],"acting":[11,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.1c","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562814+0000","last_change":"2024-08-02T18:47:21.336567+0000","last_active":"2024-08-02T18:49:43.562814+0000","last_peered":"2024-08-02T18:49:43.562814+0000","last_clean":"2024-08-02T18:49:43.562814+0000","last_became_active":"2024-08-02T18:47:21.336077+0000","last_became_peered":"2024-08-02T18:47:21.336077+0000","last_unstale":"2024-08-02T18:49:43.562814+0000","last_undegraded":"2024-08-02T18:49:43.562814+0000","last_fullsized":"2024-08-02T18:49:43.562814+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:16:37.835294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,6],"acting":[1,10,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609407+0000","last_change":"2024-08-02T18:47:28.367894+0000","last_active":"2024-08-02T18:49:43.609407+0000","last_peered":"2024-08-02T18:49:43.609407+0000","last_clean":"2024-08-02T18:49:43.609407+0000","last_became_active":"2024-08-02T18:47:28.367411+0000","last_became_peered":"2024-08-02T18:47:28.367411+0000","last_unstale":"2024-08-02T18:49:43.609407+0000","last_undegraded":"2024-08-02T18:49:43.609407+0000","last_fullsized":"2024-08-02T18:49:43.609407+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:50:36.080701+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,9,5],"acting":[4,3,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656824+0000","last_change":"2024-08-02T18:47:19.314047+0000","last_active":"2024-08-02T18:49:43.656824+0000","last_peered":"2024-08-02T18:49:43.656824+0000","last_clean":"2024-08-02T18:49:43.656824+0000","last_became_active":"2024-08-02T18:47:19.313395+0000","last_became_peered":"2024-08-02T18:47:19.313395+0000","last_unstale":"2024-08-02T18:49:43.656824+0000","last_undegraded":"2024-08-02T18:49:43.656824+0000","last_fullsized":"2024-08-02T18:49:43.656824+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:15:32.883063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,1,5],"acting":[8,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.1d","version":"89'15","reported_seq":46,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563387+0000","last_change":"2024-08-02T18:47:21.333291+0000","last_active":"2024-08-02T18:49:43.563387+0000","last_peered":"2024-08-02T18:49:43.563387+0000","last_clean":"2024-08-02T18:49:43.563387+0000","last_became_active":"2024-08-02T18:47:21.332923+0000","last_became_peered":"2024-08-02T18:47:21.332923+0000","last_unstale":"2024-08-02T18:49:43.563387+0000","last_undegraded":"2024-08-02T18:49:43.563387+0000","last_fullsized":"2024-08-02T18:49:43.563387+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:38:11.112105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609317+0000","last_change":"2024-08-02T18:47:28.371233+0000","last_active":"2024-08-02T18:49:43.609317+0000","last_peered":"2024-08-02T18:49:43.609317+0000","last_clean":"2024-08-02T18:49:43.609317+0000","last_became_active":"2024-08-02T18:47:28.370872+0000","last_became_peered":"2024-08-02T18:47:28.370872+0000","last_unstale":"2024-08-02T18:49:43.609317+0000","last_undegraded":"2024-08-02T18:49:43.609317+0000","last_fullsized":"2024-08-02T18:49:43.609317+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:46.829059+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,5,3],"acting":[4,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"89'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826836+0000","last_change":"2024-08-02T18:47:21.330254+0000","last_active":"2024-08-02T18:49:43.826836+0000","last_peered":"2024-08-02T18:49:43.826836+0000","last_clean":"2024-08-02T18:49:43.826836+0000","last_became_active":"2024-08-02T18:47:21.329834+0000","last_became_peered":"2024-08-02T18:47:21.329834+0000","last_unstale":"2024-08-02T18:49:43.826836+0000","last_undegraded":"2024-08-02T18:49:43.826836+0000","last_fullsized":"2024-08-02T18:49:43.826836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:56:27.878742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,6],"acting":[7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.b","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656491+0000","last_change":"2024-08-02T18:47:19.317425+0000","last_active":"2024-08-02T18:49:43.656491+0000","last_peered":"2024-08-02T18:49:43.656491+0000","last_clean":"2024-08-02T18:49:43.656491+0000","last_became_active":"2024-08-02T18:47:19.317099+0000","last_became_peered":"2024-08-02T18:47:19.317099+0000","last_unstale":"2024-08-02T18:49:43.656491+0000","last_undegraded":"2024-08-02T18:49:43.656491+0000","last_fullsized":"2024-08-02T18:49:43.656491+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:05:33.972466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,2,7],"acting":[8,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609487+0000","last_change":"2024-08-02T18:47:28.482994+0000","last_active":"2024-08-02T18:49:43.609487+0000","last_peered":"2024-08-02T18:49:43.609487+0000","last_clean":"2024-08-02T18:49:43.609487+0000","last_became_active":"2024-08-02T18:47:28.482514+0000","last_became_peered":"2024-08-02T18:47:28.482514+0000","last_unstale":"2024-08-02T18:49:43.609487+0000","last_undegraded":"2024-08-02T18:49:43.609487+0000","last_fullsized":"2024-08-02T18:49:43.609487+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:56.739450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,10,3],"acting":[4,2,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609390+0000","last_change":"2024-08-02T18:47:21.325969+0000","last_active":"2024-08-02T18:49:43.609390+0000","last_peered":"2024-08-02T18:49:43.609390+0000","last_clean":"2024-08-02T18:49:43.609390+0000","last_became_active":"2024-08-02T18:47:21.325679+0000","last_became_peered":"2024-08-02T18:47:21.325679+0000","last_unstale":"2024-08-02T18:49:43.609390+0000","last_undegraded":"2024-08-02T18:49:43.609390+0000","last_fullsized":"2024-08-02T18:49:43.609390+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:57:34.194845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,10],"acting":[3,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"90'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829268+0000","last_change":"2024-08-02T18:47:19.318321+0000","last_active":"2024-08-02T18:49:43.829268+0000","last_peered":"2024-08-02T18:49:43.829268+0000","last_clean":"2024-08-02T18:49:43.829268+0000","last_became_active":"2024-08-02T18:47:19.316646+0000","last_became_peered":"2024-08-02T18:47:19.316646+0000","last_unstale":"2024-08-02T18:49:43.829268+0000","last_undegraded":"2024-08-02T18:49:43.829268+0000","last_fullsized":"2024-08-02T18:49:43.829268+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:02:25.058088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,8],"acting":[2,3,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609555+0000","last_change":"2024-08-02T18:47:28.364022+0000","last_active":"2024-08-02T18:49:43.609555+0000","last_peered":"2024-08-02T18:49:43.609555+0000","last_clean":"2024-08-02T18:49:43.609555+0000","last_became_active":"2024-08-02T18:47:28.363553+0000","last_became_peered":"2024-08-02T18:47:28.363553+0000","last_unstale":"2024-08-02T18:49:43.609555+0000","last_undegraded":"2024-08-02T18:49:43.609555+0000","last_fullsized":"2024-08-02T18:49:43.609555+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:11:50.222927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,9,7,8],"acting":[4,9,7,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921113+0000","last_change":"2024-08-02T18:47:21.339064+0000","last_active":"2024-08-02T18:49:43.921113+0000","last_peered":"2024-08-02T18:49:43.921113+0000","last_clean":"2024-08-02T18:49:43.921113+0000","last_became_active":"2024-08-02T18:47:21.338443+0000","last_became_peered":"2024-08-02T18:47:21.338443+0000","last_unstale":"2024-08-02T18:49:43.921113+0000","last_undegraded":"2024-08-02T18:49:43.921113+0000","last_fullsized":"2024-08-02T18:49:43.921113+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:11:25.909024+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,0,2],"acting":[11,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.9","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609233+0000","last_change":"2024-08-02T18:47:19.314267+0000","last_active":"2024-08-02T18:49:43.609233+0000","last_peered":"2024-08-02T18:49:43.609233+0000","last_clean":"2024-08-02T18:49:43.609233+0000","last_became_active":"2024-08-02T18:47:19.313969+0000","last_became_peered":"2024-08-02T18:47:19.313969+0000","last_unstale":"2024-08-02T18:49:43.609233+0000","last_undegraded":"2024-08-02T18:49:43.609233+0000","last_fullsized":"2024-08-02T18:49:43.609233+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:07:40.719935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,9,10],"acting":[3,9,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654077+0000","last_change":"2024-08-02T18:47:28.369174+0000","last_active":"2024-08-02T18:49:43.654077+0000","last_peered":"2024-08-02T18:49:43.654077+0000","last_clean":"2024-08-02T18:49:43.654077+0000","last_became_active":"2024-08-02T18:47:28.368834+0000","last_became_peered":"2024-08-02T18:47:28.368834+0000","last_unstale":"2024-08-02T18:49:43.654077+0000","last_undegraded":"2024-08-02T18:49:43.654077+0000","last_fullsized":"2024-08-02T18:49:43.654077+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:53:49.578867+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,2,5],"acting":[9,3,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.9","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656381+0000","last_change":"2024-08-02T18:47:21.331951+0000","last_active":"2024-08-02T18:49:43.656381+0000","last_peered":"2024-08-02T18:49:43.656381+0000","last_clean":"2024-08-02T18:49:43.656381+0000","last_became_active":"2024-08-02T18:47:21.331625+0000","last_became_peered":"2024-08-02T18:47:21.331625+0000","last_unstale":"2024-08-02T18:49:43.656381+0000","last_undegraded":"2024-08-02T18:49:43.656381+0000","last_fullsized":"2024-08-02T18:49:43.656381+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:44:50.941211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,10],"acting":[8,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.8","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562686+0000","last_change":"2024-08-02T18:47:19.468186+0000","last_active":"2024-08-02T18:49:43.562686+0000","last_peered":"2024-08-02T18:49:43.562686+0000","last_clean":"2024-08-02T18:49:43.562686+0000","last_became_active":"2024-08-02T18:47:19.467863+0000","last_became_peered":"2024-08-02T18:47:19.467863+0000","last_unstale":"2024-08-02T18:49:43.562686+0000","last_undegraded":"2024-08-02T18:49:43.562686+0000","last_fullsized":"2024-08-02T18:49:43.562686+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:49:40.849365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0],"acting":[1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609606+0000","last_change":"2024-08-02T18:48:06.478332+0000","last_active":"2024-08-02T18:49:43.609606+0000","last_peered":"2024-08-02T18:49:43.609606+0000","last_clean":"2024-08-02T18:49:43.609606+0000","last_became_active":"2024-08-02T18:48:06.477855+0000","last_became_peered":"2024-08-02T18:48:06.477855+0000","last_unstale":"2024-08-02T18:49:43.609606+0000","last_undegraded":"2024-08-02T18:49:43.609606+0000","last_fullsized":"2024-08-02T18:49:43.609606+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:43:38.111252+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,10,11],"acting":[4,5,10,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"89'7","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957022+0000","last_change":"2024-08-02T18:48:06.475960+0000","last_active":"2024-08-02T18:49:43.957022+0000","last_peered":"2024-08-02T18:49:43.957022+0000","last_clean":"2024-08-02T18:49:43.957022+0000","last_became_active":"2024-08-02T18:48:06.475625+0000","last_became_peered":"2024-08-02T18:48:06.475625+0000","last_unstale":"2024-08-02T18:49:43.957022+0000","last_undegraded":"2024-08-02T18:49:43.957022+0000","last_fullsized":"2024-08-02T18:49:43.957022+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:14:44.480067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,6],"acting":[0,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"87'4","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609883+0000","last_change":"2024-08-02T18:47:19.831886+0000","last_active":"2024-08-02T18:49:43.609883+0000","last_peered":"2024-08-02T18:49:43.609883+0000","last_clean":"2024-08-02T18:49:43.609883+0000","last_became_active":"2024-08-02T18:47:19.831488+0000","last_became_peered":"2024-08-02T18:47:19.831488+0000","last_unstale":"2024-08-02T18:49:43.609883+0000","last_undegraded":"2024-08-02T18:49:43.609883+0000","last_fullsized":"2024-08-02T18:49:43.609883+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:58:18.880645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,11,6],"acting":[4,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.828996+0000","last_change":"2024-08-02T18:47:28.366050+0000","last_active":"2024-08-02T18:49:43.828996+0000","last_peered":"2024-08-02T18:49:43.828996+0000","last_clean":"2024-08-02T18:49:43.828996+0000","last_became_active":"2024-08-02T18:47:28.365477+0000","last_became_peered":"2024-08-02T18:47:28.365477+0000","last_unstale":"2024-08-02T18:49:43.828996+0000","last_undegraded":"2024-08-02T18:49:43.828996+0000","last_fullsized":"2024-08-02T18:49:43.828996+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:19.714856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,4,7],"acting":[2,1,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609859+0000","last_change":"2024-08-02T18:47:21.339151+0000","last_active":"2024-08-02T18:49:43.609859+0000","last_peered":"2024-08-02T18:49:43.609859+0000","last_clean":"2024-08-02T18:49:43.609859+0000","last_became_active":"2024-08-02T18:47:21.338838+0000","last_became_peered":"2024-08-02T18:47:21.338838+0000","last_unstale":"2024-08-02T18:49:43.609859+0000","last_undegraded":"2024-08-02T18:49:43.609859+0000","last_fullsized":"2024-08-02T18:49:43.609859+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:42:11.864685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,7],"acting":[3,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"90'101","reported_seq":230,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:53.577022+0000","last_change":"2024-08-02T18:47:19.313739+0000","last_active":"2024-08-02T18:49:53.577022+0000","last_peered":"2024-08-02T18:49:53.577022+0000","last_clean":"2024-08-02T18:49:53.577022+0000","last_became_active":"2024-08-02T18:47:19.313336+0000","last_became_peered":"2024-08-02T18:47:19.313336+0000","last_unstale":"2024-08-02T18:49:53.577022+0000","last_undegraded":"2024-08-02T18:49:53.577022+0000","last_fullsized":"2024-08-02T18:49:53.577022+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":101,"log_dups_size":0,"ondisk_log_size":101,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:14:34.263543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":393216,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":312,"num_read_kb":277,"num_write":185,"num_write_kb":1286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,3],"acting":[9,8,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608943+0000","last_change":"2024-08-02T18:47:28.482881+0000","last_active":"2024-08-02T18:49:43.608943+0000","last_peered":"2024-08-02T18:49:43.608943+0000","last_clean":"2024-08-02T18:49:43.608943+0000","last_became_active":"2024-08-02T18:47:28.482471+0000","last_became_peered":"2024-08-02T18:47:28.482471+0000","last_unstale":"2024-08-02T18:49:43.608943+0000","last_undegraded":"2024-08-02T18:49:43.608943+0000","last_fullsized":"2024-08-02T18:49:43.608943+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:31:18.120191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,10,0,7],"acting":[3,10,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561962+0000","last_change":"2024-08-02T18:47:21.328855+0000","last_active":"2024-08-02T18:49:43.561962+0000","last_peered":"2024-08-02T18:49:43.561962+0000","last_clean":"2024-08-02T18:49:43.561962+0000","last_became_active":"2024-08-02T18:47:21.328492+0000","last_became_peered":"2024-08-02T18:47:21.328492+0000","last_unstale":"2024-08-02T18:49:43.561962+0000","last_undegraded":"2024-08-02T18:49:43.561962+0000","last_fullsized":"2024-08-02T18:49:43.561962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:30:03.581117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,9],"acting":[6,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656835+0000","last_change":"2024-08-02T18:47:19.468219+0000","last_active":"2024-08-02T18:49:43.656835+0000","last_peered":"2024-08-02T18:49:43.656835+0000","last_clean":"2024-08-02T18:49:43.656835+0000","last_became_active":"2024-08-02T18:47:19.467823+0000","last_became_peered":"2024-08-02T18:47:19.467823+0000","last_unstale":"2024-08-02T18:49:43.656835+0000","last_undegraded":"2024-08-02T18:49:43.656835+0000","last_fullsized":"2024-08-02T18:49:43.656835+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:44:07.361443+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,9],"acting":[8,0,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921219+0000","last_change":"2024-08-02T18:47:28.373067+0000","last_active":"2024-08-02T18:49:43.921219+0000","last_peered":"2024-08-02T18:49:43.921219+0000","last_clean":"2024-08-02T18:49:43.921219+0000","last_became_active":"2024-08-02T18:47:28.372726+0000","last_became_peered":"2024-08-02T18:47:28.372726+0000","last_unstale":"2024-08-02T18:49:43.921219+0000","last_undegraded":"2024-08-02T18:49:43.921219+0000","last_fullsized":"2024-08-02T18:49:43.921219+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:45.356906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,7,6],"acting":[11,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.5","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608457+0000","last_change":"2024-08-02T18:47:21.327969+0000","last_active":"2024-08-02T18:49:43.608457+0000","last_peered":"2024-08-02T18:49:43.608457+0000","last_clean":"2024-08-02T18:49:43.608457+0000","last_became_active":"2024-08-02T18:47:21.327618+0000","last_became_peered":"2024-08-02T18:47:21.327618+0000","last_unstale":"2024-08-02T18:49:43.608457+0000","last_undegraded":"2024-08-02T18:49:43.608457+0000","last_fullsized":"2024-08-02T18:49:43.608457+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:23:37.359638+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,3,6],"acting":[10,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654589+0000","last_change":"2024-08-02T18:47:19.468115+0000","last_active":"2024-08-02T18:49:43.654589+0000","last_peered":"2024-08-02T18:49:43.654589+0000","last_clean":"2024-08-02T18:49:43.654589+0000","last_became_active":"2024-08-02T18:47:19.467805+0000","last_became_peered":"2024-08-02T18:47:19.467805+0000","last_unstale":"2024-08-02T18:49:43.654589+0000","last_undegraded":"2024-08-02T18:49:43.654589+0000","last_fullsized":"2024-08-02T18:49:43.654589+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:30.053040+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,2,0],"acting":[9,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656388+0000","last_change":"2024-08-02T18:47:28.483157+0000","last_active":"2024-08-02T18:49:43.656388+0000","last_peered":"2024-08-02T18:49:43.656388+0000","last_clean":"2024-08-02T18:49:43.656388+0000","last_became_active":"2024-08-02T18:47:28.482601+0000","last_became_peered":"2024-08-02T18:47:28.482601+0000","last_unstale":"2024-08-02T18:49:43.656388+0000","last_undegraded":"2024-08-02T18:49:43.656388+0000","last_fullsized":"2024-08-02T18:49:43.656388+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:58.232882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,10,11,9],"acting":[8,10,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608451+0000","last_change":"2024-08-02T18:47:21.329893+0000","last_active":"2024-08-02T18:49:43.608451+0000","last_peered":"2024-08-02T18:49:43.608451+0000","last_clean":"2024-08-02T18:49:43.608451+0000","last_became_active":"2024-08-02T18:47:21.329562+0000","last_became_peered":"2024-08-02T18:47:21.329562+0000","last_unstale":"2024-08-02T18:49:43.608451+0000","last_undegraded":"2024-08-02T18:49:43.608451+0000","last_fullsized":"2024-08-02T18:49:43.608451+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:00:12.010751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,4,0],"acting":[10,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"2.2","version":"87'1","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826989+0000","last_change":"2024-08-02T18:47:19.316572+0000","last_active":"2024-08-02T18:49:43.826989+0000","last_peered":"2024-08-02T18:49:43.826989+0000","last_clean":"2024-08-02T18:49:43.826989+0000","last_became_active":"2024-08-02T18:47:19.316111+0000","last_became_peered":"2024-08-02T18:47:19.316111+0000","last_unstale":"2024-08-02T18:49:43.826989+0000","last_undegraded":"2024-08-02T18:49:43.826989+0000","last_fullsized":"2024-08-02T18:49:43.826989+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:43:30.339688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6,1],"acting":[7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561871+0000","last_change":"2024-08-02T18:47:28.363853+0000","last_active":"2024-08-02T18:49:43.561871+0000","last_peered":"2024-08-02T18:49:43.561871+0000","last_clean":"2024-08-02T18:49:43.561871+0000","last_became_active":"2024-08-02T18:47:28.363514+0000","last_became_peered":"2024-08-02T18:47:28.363514+0000","last_unstale":"2024-08-02T18:49:43.561871+0000","last_undegraded":"2024-08-02T18:49:43.561871+0000","last_fullsized":"2024-08-02T18:49:43.561871+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:19:11.716050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,1,8],"acting":[6,0,1,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562994+0000","last_change":"2024-08-02T18:47:21.332394+0000","last_active":"2024-08-02T18:49:43.562994+0000","last_peered":"2024-08-02T18:49:43.562994+0000","last_clean":"2024-08-02T18:49:43.562994+0000","last_became_active":"2024-08-02T18:47:21.332050+0000","last_became_peered":"2024-08-02T18:47:21.332050+0000","last_unstale":"2024-08-02T18:49:43.562994+0000","last_undegraded":"2024-08-02T18:49:43.562994+0000","last_fullsized":"2024-08-02T18:49:43.562994+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:06:14.144511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,4],"acting":[5,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"89'5","reported_seq":152,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.620617+0000","last_change":"2024-08-02T18:47:19.467942+0000","last_active":"2024-08-02T18:49:52.620617+0000","last_peered":"2024-08-02T18:49:52.620617+0000","last_clean":"2024-08-02T18:49:52.620617+0000","last_became_active":"2024-08-02T18:47:19.467562+0000","last_became_peered":"2024-08-02T18:47:19.467562+0000","last_unstale":"2024-08-02T18:49:52.620617+0000","last_undegraded":"2024-08-02T18:49:52.620617+0000","last_fullsized":"2024-08-02T18:49:52.620617+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:37:12.956114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,0],"acting":[6,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562217+0000","last_change":"2024-08-02T18:47:28.483286+0000","last_active":"2024-08-02T18:49:43.562217+0000","last_peered":"2024-08-02T18:49:43.562217+0000","last_clean":"2024-08-02T18:49:43.562217+0000","last_became_active":"2024-08-02T18:47:28.482414+0000","last_became_peered":"2024-08-02T18:47:28.482414+0000","last_unstale":"2024-08-02T18:49:43.562217+0000","last_undegraded":"2024-08-02T18:49:43.562217+0000","last_fullsized":"2024-08-02T18:49:43.562217+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:00:52.647053+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,10,0],"acting":[6,5,10,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561158+0000","last_change":"2024-08-02T18:47:21.335364+0000","last_active":"2024-08-02T18:49:43.561158+0000","last_peered":"2024-08-02T18:49:43.561158+0000","last_clean":"2024-08-02T18:49:43.561158+0000","last_became_active":"2024-08-02T18:47:21.335084+0000","last_became_peered":"2024-08-02T18:47:21.335084+0000","last_unstale":"2024-08-02T18:49:43.561158+0000","last_undegraded":"2024-08-02T18:49:43.561158+0000","last_fullsized":"2024-08-02T18:49:43.561158+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:40:43.577475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,2],"acting":[6,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.0","version":"87'3","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826778+0000","last_change":"2024-08-02T18:47:19.315034+0000","last_active":"2024-08-02T18:49:43.826778+0000","last_peered":"2024-08-02T18:49:43.826778+0000","last_clean":"2024-08-02T18:49:43.826778+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:43.826778+0000","last_undegraded":"2024-08-02T18:49:43.826778+0000","last_fullsized":"2024-08-02T18:49:43.826778+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:35:31.590255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,8],"acting":[7,5,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563541+0000","last_change":"2024-08-02T18:47:28.483489+0000","last_active":"2024-08-02T18:49:43.563541+0000","last_peered":"2024-08-02T18:49:43.563541+0000","last_clean":"2024-08-02T18:49:43.563541+0000","last_became_active":"2024-08-02T18:47:28.482793+0000","last_became_peered":"2024-08-02T18:47:28.482793+0000","last_unstale":"2024-08-02T18:49:43.563541+0000","last_undegraded":"2024-08-02T18:49:43.563541+0000","last_fullsized":"2024-08-02T18:49:43.563541+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:26:50.754235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,6,10],"acting":[5,9,6,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609341+0000","last_change":"2024-08-02T18:47:21.329303+0000","last_active":"2024-08-02T18:49:43.609341+0000","last_peered":"2024-08-02T18:49:43.609341+0000","last_clean":"2024-08-02T18:49:43.609341+0000","last_became_active":"2024-08-02T18:47:21.328996+0000","last_became_peered":"2024-08-02T18:47:21.328996+0000","last_unstale":"2024-08-02T18:49:43.609341+0000","last_undegraded":"2024-08-02T18:49:43.609341+0000","last_fullsized":"2024-08-02T18:49:43.609341+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:35:04.111798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,1],"acting":[3,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609676+0000","last_change":"2024-08-02T18:47:19.314837+0000","last_active":"2024-08-02T18:49:43.609676+0000","last_peered":"2024-08-02T18:49:43.609676+0000","last_clean":"2024-08-02T18:49:43.609676+0000","last_became_active":"2024-08-02T18:47:19.314459+0000","last_became_peered":"2024-08-02T18:47:19.314459+0000","last_unstale":"2024-08-02T18:49:43.609676+0000","last_undegraded":"2024-08-02T18:49:43.609676+0000","last_fullsized":"2024-08-02T18:49:43.609676+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:03:35.981129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,9],"acting":[4,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"90'148","reported_seq":404,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:45.664818+0000","last_change":"2024-08-02T18:46:10.767950+0000","last_active":"2024-08-02T18:49:45.664818+0000","last_peered":"2024-08-02T18:49:45.664818+0000","last_clean":"2024-08-02T18:49:45.664818+0000","last_became_active":"2024-08-02T18:46:10.767511+0000","last_became_peered":"2024-08-02T18:46:10.767511+0000","last_unstale":"2024-08-02T18:49:45.664818+0000","last_undegraded":"2024-08-02T18:49:45.664818+0000","last_fullsized":"2024-08-02T18:49:45.664818+0000","mapping_epoch":71,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":72,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:43:06.077432+0000","last_clean_scrub_stamp":"2024-08-02T18:43:06.077432+0000","objects_scrubbed":0,"log_size":148,"log_dups_size":0,"ondisk_log_size":148,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:37:38.904154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"89'1","reported_seq":25,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827013+0000","last_change":"2024-08-02T18:47:28.370414+0000","last_active":"2024-08-02T18:49:43.827013+0000","last_peered":"2024-08-02T18:49:43.827013+0000","last_clean":"2024-08-02T18:49:43.827013+0000","last_became_active":"2024-08-02T18:47:28.369996+0000","last_became_peered":"2024-08-02T18:47:28.369996+0000","last_unstale":"2024-08-02T18:49:43.827013+0000","last_undegraded":"2024-08-02T18:49:43.827013+0000","last_fullsized":"2024-08-02T18:49:43.827013+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:07:51.734076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,11,9],"acting":[7,5,11,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827183+0000","last_change":"2024-08-02T18:47:21.335312+0000","last_active":"2024-08-02T18:49:43.827183+0000","last_peered":"2024-08-02T18:49:43.827183+0000","last_clean":"2024-08-02T18:49:43.827183+0000","last_became_active":"2024-08-02T18:47:21.334917+0000","last_became_peered":"2024-08-02T18:47:21.334917+0000","last_unstale":"2024-08-02T18:49:43.827183+0000","last_undegraded":"2024-08-02T18:49:43.827183+0000","last_fullsized":"2024-08-02T18:49:43.827183+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:20:54.069015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,11],"acting":[7,1,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"87'3","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829351+0000","last_change":"2024-08-02T18:47:19.832159+0000","last_active":"2024-08-02T18:49:43.829351+0000","last_peered":"2024-08-02T18:49:43.829351+0000","last_clean":"2024-08-02T18:49:43.829351+0000","last_became_active":"2024-08-02T18:47:19.831606+0000","last_became_peered":"2024-08-02T18:47:19.831606+0000","last_unstale":"2024-08-02T18:49:43.829351+0000","last_undegraded":"2024-08-02T18:49:43.829351+0000","last_fullsized":"2024-08-02T18:49:43.829351+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:24:59.069207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,11,0],"acting":[2,11,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562654+0000","last_change":"2024-08-02T18:47:28.368044+0000","last_active":"2024-08-02T18:49:43.562654+0000","last_peered":"2024-08-02T18:49:43.562654+0000","last_clean":"2024-08-02T18:49:43.562654+0000","last_became_active":"2024-08-02T18:47:28.367538+0000","last_became_peered":"2024-08-02T18:47:28.367538+0000","last_unstale":"2024-08-02T18:49:43.562654+0000","last_undegraded":"2024-08-02T18:49:43.562654+0000","last_fullsized":"2024-08-02T18:49:43.562654+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:31:57.896567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,6,7],"acting":[1,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826971+0000","last_change":"2024-08-02T18:47:21.330978+0000","last_active":"2024-08-02T18:49:43.826971+0000","last_peered":"2024-08-02T18:49:43.826971+0000","last_clean":"2024-08-02T18:49:43.826971+0000","last_became_active":"2024-08-02T18:47:21.330607+0000","last_became_peered":"2024-08-02T18:47:21.330607+0000","last_unstale":"2024-08-02T18:49:43.826971+0000","last_undegraded":"2024-08-02T18:49:43.826971+0000","last_fullsized":"2024-08-02T18:49:43.826971+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:43:37.229227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,5],"acting":[7,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"90'65","reported_seq":132,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.972552+0000","last_change":"2024-08-02T18:47:19.311383+0000","last_active":"2024-08-02T18:49:52.972552+0000","last_peered":"2024-08-02T18:49:52.972552+0000","last_clean":"2024-08-02T18:49:52.972552+0000","last_became_active":"2024-08-02T18:47:19.310977+0000","last_became_peered":"2024-08-02T18:47:19.310977+0000","last_unstale":"2024-08-02T18:49:52.972552+0000","last_undegraded":"2024-08-02T18:49:52.972552+0000","last_fullsized":"2024-08-02T18:49:52.972552+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:41.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":328302,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":34,"num_read_kb":33,"num_write":76,"num_write_kb":941,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,10,3],"acting":[5,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956875+0000","last_change":"2024-08-02T18:47:28.367503+0000","last_active":"2024-08-02T18:49:43.956875+0000","last_peered":"2024-08-02T18:49:43.956875+0000","last_clean":"2024-08-02T18:49:43.956875+0000","last_became_active":"2024-08-02T18:47:28.367136+0000","last_became_peered":"2024-08-02T18:47:28.367136+0000","last_unstale":"2024-08-02T18:49:43.956875+0000","last_undegraded":"2024-08-02T18:49:43.956875+0000","last_fullsized":"2024-08-02T18:49:43.956875+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:41:14.583326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,9,1,4],"acting":[0,9,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827238+0000","last_change":"2024-08-02T18:47:21.339286+0000","last_active":"2024-08-02T18:49:43.827238+0000","last_peered":"2024-08-02T18:49:43.827238+0000","last_clean":"2024-08-02T18:49:43.827238+0000","last_became_active":"2024-08-02T18:47:21.338976+0000","last_became_peered":"2024-08-02T18:47:21.338976+0000","last_unstale":"2024-08-02T18:49:43.827238+0000","last_undegraded":"2024-08-02T18:49:43.827238+0000","last_fullsized":"2024-08-02T18:49:43.827238+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:00:52.965768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,11,8],"acting":[7,11,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"81'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562375+0000","last_change":"2024-08-02T18:47:19.314444+0000","last_active":"2024-08-02T18:49:43.562375+0000","last_peered":"2024-08-02T18:49:43.562375+0000","last_clean":"2024-08-02T18:49:43.562375+0000","last_became_active":"2024-08-02T18:47:19.314096+0000","last_became_peered":"2024-08-02T18:47:19.314096+0000","last_unstale":"2024-08-02T18:49:43.562375+0000","last_undegraded":"2024-08-02T18:49:43.562375+0000","last_fullsized":"2024-08-02T18:49:43.562375+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:16:56.950992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,2],"acting":[6,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562856+0000","last_change":"2024-08-02T18:47:28.372200+0000","last_active":"2024-08-02T18:49:43.562856+0000","last_peered":"2024-08-02T18:49:43.562856+0000","last_clean":"2024-08-02T18:49:43.562856+0000","last_became_active":"2024-08-02T18:47:28.371785+0000","last_became_peered":"2024-08-02T18:47:28.371785+0000","last_unstale":"2024-08-02T18:49:43.562856+0000","last_undegraded":"2024-08-02T18:49:43.562856+0000","last_fullsized":"2024-08-02T18:49:43.562856+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:21:30.898687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7,1],"acting":[5,2,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"89'5","reported_seq":36,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921519+0000","last_change":"2024-08-02T18:47:21.342581+0000","last_active":"2024-08-02T18:49:43.921519+0000","last_peered":"2024-08-02T18:49:43.921519+0000","last_clean":"2024-08-02T18:49:43.921519+0000","last_became_active":"2024-08-02T18:47:21.342189+0000","last_became_peered":"2024-08-02T18:47:21.342189+0000","last_unstale":"2024-08-02T18:49:43.921519+0000","last_undegraded":"2024-08-02T18:49:43.921519+0000","last_fullsized":"2024-08-02T18:49:43.921519+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:29:19.028671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,5,4],"acting":[11,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"2.f","version":"90'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656937+0000","last_change":"2024-08-02T18:47:19.313088+0000","last_active":"2024-08-02T18:49:43.656937+0000","last_peered":"2024-08-02T18:49:43.656937+0000","last_clean":"2024-08-02T18:49:43.656937+0000","last_became_active":"2024-08-02T18:47:19.312738+0000","last_became_peered":"2024-08-02T18:47:19.312738+0000","last_unstale":"2024-08-02T18:49:43.656937+0000","last_undegraded":"2024-08-02T18:49:43.656937+0000","last_fullsized":"2024-08-02T18:49:43.656937+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:49:44.467630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,5,4],"acting":[8,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562946+0000","last_change":"2024-08-02T18:47:28.372753+0000","last_active":"2024-08-02T18:49:43.562946+0000","last_peered":"2024-08-02T18:49:43.562946+0000","last_clean":"2024-08-02T18:49:43.562946+0000","last_became_active":"2024-08-02T18:47:28.372338+0000","last_became_peered":"2024-08-02T18:47:28.372338+0000","last_unstale":"2024-08-02T18:49:43.562946+0000","last_undegraded":"2024-08-02T18:49:43.562946+0000","last_fullsized":"2024-08-02T18:49:43.562946+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:15:02.834928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,3,1],"acting":[5,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.11","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563145+0000","last_change":"2024-08-02T18:47:21.332107+0000","last_active":"2024-08-02T18:49:43.563145+0000","last_peered":"2024-08-02T18:49:43.563145+0000","last_clean":"2024-08-02T18:49:43.563145+0000","last_became_active":"2024-08-02T18:47:21.331790+0000","last_became_peered":"2024-08-02T18:47:21.331790+0000","last_unstale":"2024-08-02T18:49:43.563145+0000","last_undegraded":"2024-08-02T18:49:43.563145+0000","last_fullsized":"2024-08-02T18:49:43.563145+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:47:44.561227+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.10","version":"87'15","reported_seq":52,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656450+0000","last_change":"2024-08-02T18:47:19.468338+0000","last_active":"2024-08-02T18:49:43.656450+0000","last_peered":"2024-08-02T18:49:43.656450+0000","last_clean":"2024-08-02T18:49:43.656450+0000","last_became_active":"2024-08-02T18:47:19.467975+0000","last_became_peered":"2024-08-02T18:47:19.467975+0000","last_unstale":"2024-08-02T18:49:43.656450+0000","last_undegraded":"2024-08-02T18:49:43.656450+0000","last_fullsized":"2024-08-02T18:49:43.656450+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:53:37.614587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,0,2],"acting":[8,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562402+0000","last_change":"2024-08-02T18:47:28.362886+0000","last_active":"2024-08-02T18:49:43.562402+0000","last_peered":"2024-08-02T18:49:43.562402+0000","last_clean":"2024-08-02T18:49:43.562402+0000","last_became_active":"2024-08-02T18:47:28.362518+0000","last_became_peered":"2024-08-02T18:47:28.362518+0000","last_unstale":"2024-08-02T18:49:43.562402+0000","last_undegraded":"2024-08-02T18:49:43.562402+0000","last_fullsized":"2024-08-02T18:49:43.562402+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:45:07.897235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,9,11],"acting":[6,3,9,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826765+0000","last_change":"2024-08-02T18:47:21.332259+0000","last_active":"2024-08-02T18:49:43.826765+0000","last_peered":"2024-08-02T18:49:43.826765+0000","last_clean":"2024-08-02T18:49:43.826765+0000","last_became_active":"2024-08-02T18:47:21.331930+0000","last_became_peered":"2024-08-02T18:47:21.331930+0000","last_unstale":"2024-08-02T18:49:43.826765+0000","last_undegraded":"2024-08-02T18:49:43.826765+0000","last_fullsized":"2024-08-02T18:49:43.826765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:10:40.593991+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,10],"acting":[7,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"90'6","reported_seq":157,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.621121+0000","last_change":"2024-08-02T18:47:19.313348+0000","last_active":"2024-08-02T18:49:52.621121+0000","last_peered":"2024-08-02T18:49:52.621121+0000","last_clean":"2024-08-02T18:49:52.621121+0000","last_became_active":"2024-08-02T18:47:19.313026+0000","last_became_peered":"2024-08-02T18:47:19.313026+0000","last_unstale":"2024-08-02T18:49:52.621121+0000","last_undegraded":"2024-08-02T18:49:52.621121+0000","last_fullsized":"2024-08-02T18:49:52.621121+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:15:29.211382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1676,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":5,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,10],"acting":[4,7,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654944+0000","last_change":"2024-08-02T18:47:28.365978+0000","last_active":"2024-08-02T18:49:43.654944+0000","last_peered":"2024-08-02T18:49:43.654944+0000","last_clean":"2024-08-02T18:49:43.654944+0000","last_became_active":"2024-08-02T18:47:28.364653+0000","last_became_peered":"2024-08-02T18:47:28.364653+0000","last_unstale":"2024-08-02T18:49:43.654944+0000","last_undegraded":"2024-08-02T18:49:43.654944+0000","last_fullsized":"2024-08-02T18:49:43.654944+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:10:48.814929+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,7,0,3],"acting":[9,7,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.13","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826962+0000","last_change":"2024-08-02T18:47:21.329030+0000","last_active":"2024-08-02T18:49:43.826962+0000","last_peered":"2024-08-02T18:49:43.826962+0000","last_clean":"2024-08-02T18:49:43.826962+0000","last_became_active":"2024-08-02T18:47:21.328708+0000","last_became_peered":"2024-08-02T18:47:21.328708+0000","last_unstale":"2024-08-02T18:49:43.826962+0000","last_undegraded":"2024-08-02T18:49:43.826962+0000","last_fullsized":"2024-08-02T18:49:43.826962+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:39:11.247893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563270+0000","last_change":"2024-08-02T18:47:19.312679+0000","last_active":"2024-08-02T18:49:43.563270+0000","last_peered":"2024-08-02T18:49:43.563270+0000","last_clean":"2024-08-02T18:49:43.563270+0000","last_became_active":"2024-08-02T18:47:19.312164+0000","last_became_peered":"2024-08-02T18:47:19.312164+0000","last_unstale":"2024-08-02T18:49:43.563270+0000","last_undegraded":"2024-08-02T18:49:43.563270+0000","last_fullsized":"2024-08-02T18:49:43.563270+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:20:17.257658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,7],"acting":[5,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921292+0000","last_change":"2024-08-02T18:47:28.369496+0000","last_active":"2024-08-02T18:49:43.921292+0000","last_peered":"2024-08-02T18:49:43.921292+0000","last_clean":"2024-08-02T18:49:43.921292+0000","last_became_active":"2024-08-02T18:47:28.369029+0000","last_became_peered":"2024-08-02T18:47:28.369029+0000","last_unstale":"2024-08-02T18:49:43.921292+0000","last_undegraded":"2024-08-02T18:49:43.921292+0000","last_fullsized":"2024-08-02T18:49:43.921292+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:13:07.293102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,9,7,6],"acting":[11,9,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.12","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561546+0000","last_change":"2024-08-02T18:47:21.335061+0000","last_active":"2024-08-02T18:49:43.561546+0000","last_peered":"2024-08-02T18:49:43.561546+0000","last_clean":"2024-08-02T18:49:43.561546+0000","last_became_active":"2024-08-02T18:47:21.334752+0000","last_became_peered":"2024-08-02T18:47:21.334752+0000","last_unstale":"2024-08-02T18:49:43.561546+0000","last_undegraded":"2024-08-02T18:49:43.561546+0000","last_fullsized":"2024-08-02T18:49:43.561546+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:39.542944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.13","version":"87'6","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921110+0000","last_change":"2024-08-02T18:48:06.485388+0000","last_active":"2024-08-02T18:49:43.921110+0000","last_peered":"2024-08-02T18:49:43.921110+0000","last_clean":"2024-08-02T18:49:43.921110+0000","last_became_active":"2024-08-02T18:48:06.472793+0000","last_became_peered":"2024-08-02T18:48:06.472793+0000","last_unstale":"2024-08-02T18:49:43.921110+0000","last_undegraded":"2024-08-02T18:49:43.921110+0000","last_fullsized":"2024-08-02T18:49:43.921110+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:05:10.081446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":4,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":34,"num_keys_recovered":10,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,10,3],"acting":[11,10,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608422+0000","last_change":"2024-08-02T18:48:06.475734+0000","last_active":"2024-08-02T18:49:43.608422+0000","last_peered":"2024-08-02T18:49:43.608422+0000","last_clean":"2024-08-02T18:49:43.608422+0000","last_became_active":"2024-08-02T18:48:06.475387+0000","last_became_peered":"2024-08-02T18:48:06.475387+0000","last_unstale":"2024-08-02T18:49:43.608422+0000","last_undegraded":"2024-08-02T18:49:43.608422+0000","last_fullsized":"2024-08-02T18:49:43.608422+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:31:32.017785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,3,6],"acting":[10,8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.15","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656771+0000","last_change":"2024-08-02T18:47:21.336064+0000","last_active":"2024-08-02T18:49:43.656771+0000","last_peered":"2024-08-02T18:49:43.656771+0000","last_clean":"2024-08-02T18:49:43.656771+0000","last_became_active":"2024-08-02T18:47:21.335691+0000","last_became_peered":"2024-08-02T18:47:21.335691+0000","last_unstale":"2024-08-02T18:49:43.656771+0000","last_undegraded":"2024-08-02T18:49:43.656771+0000","last_fullsized":"2024-08-02T18:49:43.656771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:36:34.876229+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,11,7],"acting":[8,11,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"2.14","version":"90'40","reported_seq":311,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:53.621705+0000","last_change":"2024-08-02T18:47:19.315001+0000","last_active":"2024-08-02T18:49:53.621705+0000","last_peered":"2024-08-02T18:49:53.621705+0000","last_clean":"2024-08-02T18:49:53.621705+0000","last_became_active":"2024-08-02T18:47:19.314632+0000","last_became_peered":"2024-08-02T18:47:19.314632+0000","last_unstale":"2024-08-02T18:49:53.621705+0000","last_undegraded":"2024-08-02T18:49:53.621705+0000","last_fullsized":"2024-08-02T18:49:53.621705+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:45:55.230729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69709,"num_objects":5,"num_object_clones":0,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":235,"num_read_kb":187,"num_write":41,"num_write_kb":89,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,1,2],"acting":[10,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654063+0000","last_change":"2024-08-02T18:47:28.371563+0000","last_active":"2024-08-02T18:49:43.654063+0000","last_peered":"2024-08-02T18:49:43.654063+0000","last_clean":"2024-08-02T18:49:43.654063+0000","last_became_active":"2024-08-02T18:47:28.371200+0000","last_became_peered":"2024-08-02T18:47:28.371200+0000","last_unstale":"2024-08-02T18:49:43.654063+0000","last_undegraded":"2024-08-02T18:49:43.654063+0000","last_fullsized":"2024-08-02T18:49:43.654063+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:30:39.938575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,11,5],"acting":[9,8,11,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.14","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562852+0000","last_change":"2024-08-02T18:47:21.335093+0000","last_active":"2024-08-02T18:49:43.562852+0000","last_peered":"2024-08-02T18:49:43.562852+0000","last_clean":"2024-08-02T18:49:43.562852+0000","last_became_active":"2024-08-02T18:47:21.332603+0000","last_became_peered":"2024-08-02T18:47:21.332603+0000","last_unstale":"2024-08-02T18:49:43.562852+0000","last_undegraded":"2024-08-02T18:49:43.562852+0000","last_fullsized":"2024-08-02T18:49:43.562852+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:43:43.604008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,8,4],"acting":[1,8,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.15","version":"87'4","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563483+0000","last_change":"2024-08-02T18:47:19.469550+0000","last_active":"2024-08-02T18:49:43.563483+0000","last_peered":"2024-08-02T18:49:43.563483+0000","last_clean":"2024-08-02T18:49:43.563483+0000","last_became_active":"2024-08-02T18:47:19.469039+0000","last_became_peered":"2024-08-02T18:47:19.469039+0000","last_unstale":"2024-08-02T18:49:43.563483+0000","last_undegraded":"2024-08-02T18:49:43.563483+0000","last_fullsized":"2024-08-02T18:49:43.563483+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:54:43.100851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":3,"num_object_clones":0,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,10],"acting":[5,0,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609613+0000","last_change":"2024-08-02T18:47:28.369286+0000","last_active":"2024-08-02T18:49:43.609613+0000","last_peered":"2024-08-02T18:49:43.609613+0000","last_clean":"2024-08-02T18:49:43.609613+0000","last_became_active":"2024-08-02T18:47:28.368681+0000","last_became_peered":"2024-08-02T18:47:28.368681+0000","last_unstale":"2024-08-02T18:49:43.609613+0000","last_undegraded":"2024-08-02T18:49:43.609613+0000","last_fullsized":"2024-08-02T18:49:43.609613+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:20:48.574418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,2,9],"acting":[4,1,2,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.957216+0000","last_change":"2024-08-02T18:47:21.338326+0000","last_active":"2024-08-02T18:49:43.957216+0000","last_peered":"2024-08-02T18:49:43.957216+0000","last_clean":"2024-08-02T18:49:43.957216+0000","last_became_active":"2024-08-02T18:47:21.338031+0000","last_became_peered":"2024-08-02T18:47:21.338031+0000","last_unstale":"2024-08-02T18:49:43.957216+0000","last_undegraded":"2024-08-02T18:49:43.957216+0000","last_fullsized":"2024-08-02T18:49:43.957216+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:27:22.347641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,5],"acting":[0,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"87'2","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827184+0000","last_change":"2024-08-02T18:47:19.317594+0000","last_active":"2024-08-02T18:49:43.827184+0000","last_peered":"2024-08-02T18:49:43.827184+0000","last_clean":"2024-08-02T18:49:43.827184+0000","last_became_active":"2024-08-02T18:47:19.317098+0000","last_became_peered":"2024-08-02T18:47:19.317098+0000","last_unstale":"2024-08-02T18:49:43.827184+0000","last_undegraded":"2024-08-02T18:49:43.827184+0000","last_fullsized":"2024-08-02T18:49:43.827184+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:19:14.449496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2],"acting":[7,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653715+0000","last_change":"2024-08-02T18:47:28.364002+0000","last_active":"2024-08-02T18:49:43.653715+0000","last_peered":"2024-08-02T18:49:43.653715+0000","last_clean":"2024-08-02T18:49:43.653715+0000","last_became_active":"2024-08-02T18:47:28.363643+0000","last_became_peered":"2024-08-02T18:47:28.363643+0000","last_unstale":"2024-08-02T18:49:43.653715+0000","last_undegraded":"2024-08-02T18:49:43.653715+0000","last_fullsized":"2024-08-02T18:49:43.653715+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:36:48.950288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,0,2,4],"acting":[9,0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.16","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563248+0000","last_change":"2024-08-02T18:47:21.336470+0000","last_active":"2024-08-02T18:49:43.563248+0000","last_peered":"2024-08-02T18:49:43.563248+0000","last_clean":"2024-08-02T18:49:43.563248+0000","last_became_active":"2024-08-02T18:47:21.336130+0000","last_became_peered":"2024-08-02T18:47:21.336130+0000","last_unstale":"2024-08-02T18:49:43.563248+0000","last_undegraded":"2024-08-02T18:49:43.563248+0000","last_fullsized":"2024-08-02T18:49:43.563248+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:35:29.250334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,10,9],"acting":[1,10,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"89'4","reported_seq":151,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.620915+0000","last_change":"2024-08-02T18:47:19.313247+0000","last_active":"2024-08-02T18:49:52.620915+0000","last_peered":"2024-08-02T18:49:52.620915+0000","last_clean":"2024-08-02T18:49:52.620915+0000","last_became_active":"2024-08-02T18:47:19.312898+0000","last_became_peered":"2024-08-02T18:47:19.312898+0000","last_unstale":"2024-08-02T18:49:52.620915+0000","last_undegraded":"2024-08-02T18:49:52.620915+0000","last_fullsized":"2024-08-02T18:49:52.620915+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:36:24.581668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":111,"num_read_kb":111,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,5,9],"acting":[10,5,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609101+0000","last_change":"2024-08-02T18:47:28.371674+0000","last_active":"2024-08-02T18:49:43.609101+0000","last_peered":"2024-08-02T18:49:43.609101+0000","last_clean":"2024-08-02T18:49:43.609101+0000","last_became_active":"2024-08-02T18:47:28.371260+0000","last_became_peered":"2024-08-02T18:47:28.371260+0000","last_unstale":"2024-08-02T18:49:43.609101+0000","last_undegraded":"2024-08-02T18:49:43.609101+0000","last_fullsized":"2024-08-02T18:49:43.609101+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:58:13.678194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,5],"acting":[3,7,1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":24,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956951+0000","last_change":"2024-08-02T18:47:28.365189+0000","last_active":"2024-08-02T18:49:43.956951+0000","last_peered":"2024-08-02T18:49:43.956951+0000","last_clean":"2024-08-02T18:49:43.956951+0000","last_became_active":"2024-08-02T18:47:28.364815+0000","last_became_peered":"2024-08-02T18:47:28.364815+0000","last_unstale":"2024-08-02T18:49:43.956951+0000","last_undegraded":"2024-08-02T18:49:43.956951+0000","last_fullsized":"2024-08-02T18:49:43.956951+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:28:55.436578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,6,1],"acting":[0,7,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.653949+0000","last_change":"2024-08-02T18:47:21.335402+0000","last_active":"2024-08-02T18:49:43.653949+0000","last_peered":"2024-08-02T18:49:43.653949+0000","last_clean":"2024-08-02T18:49:43.653949+0000","last_became_active":"2024-08-02T18:47:21.334685+0000","last_became_peered":"2024-08-02T18:47:21.334685+0000","last_unstale":"2024-08-02T18:49:43.653949+0000","last_undegraded":"2024-08-02T18:49:43.653949+0000","last_fullsized":"2024-08-02T18:49:43.653949+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:56:17.192250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,3,10],"acting":[9,3,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"2.18","version":"87'1","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563227+0000","last_change":"2024-08-02T18:47:19.310401+0000","last_active":"2024-08-02T18:49:43.563227+0000","last_peered":"2024-08-02T18:49:43.563227+0000","last_clean":"2024-08-02T18:49:43.563227+0000","last_became_active":"2024-08-02T18:47:19.310056+0000","last_became_peered":"2024-08-02T18:47:19.310056+0000","last_unstale":"2024-08-02T18:49:43.563227+0000","last_undegraded":"2024-08-02T18:49:43.563227+0000","last_fullsized":"2024-08-02T18:49:43.563227+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:55:23.299432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7],"acting":[5,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":31,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921505+0000","last_change":"2024-08-02T18:48:06.474720+0000","last_active":"2024-08-02T18:49:43.921505+0000","last_peered":"2024-08-02T18:49:43.921505+0000","last_clean":"2024-08-02T18:49:43.921505+0000","last_became_active":"2024-08-02T18:48:06.474108+0000","last_became_peered":"2024-08-02T18:48:06.474108+0000","last_unstale":"2024-08-02T18:49:43.921505+0000","last_undegraded":"2024-08-02T18:49:43.921505+0000","last_fullsized":"2024-08-02T18:49:43.921505+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:52:15.285013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8,0],"acting":[11,4,8,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.18","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609123+0000","last_change":"2024-08-02T18:47:21.328422+0000","last_active":"2024-08-02T18:49:43.609123+0000","last_peered":"2024-08-02T18:49:43.609123+0000","last_clean":"2024-08-02T18:49:43.609123+0000","last_became_active":"2024-08-02T18:47:21.327993+0000","last_became_peered":"2024-08-02T18:47:21.327993+0000","last_unstale":"2024-08-02T18:49:43.609123+0000","last_undegraded":"2024-08-02T18:49:43.609123+0000","last_fullsized":"2024-08-02T18:49:43.609123+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:36:55.197479+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,11,6],"acting":[3,11,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"87'2","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561228+0000","last_change":"2024-08-02T18:47:19.309888+0000","last_active":"2024-08-02T18:49:43.561228+0000","last_peered":"2024-08-02T18:49:43.561228+0000","last_clean":"2024-08-02T18:49:43.561228+0000","last_became_active":"2024-08-02T18:47:19.309559+0000","last_became_peered":"2024-08-02T18:47:19.309559+0000","last_unstale":"2024-08-02T18:49:43.561228+0000","last_undegraded":"2024-08-02T18:49:43.561228+0000","last_fullsized":"2024-08-02T18:49:43.561228+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:13:22.299758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,9],"acting":[6,4,9],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1a","version":"87'3","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608673+0000","last_change":"2024-08-02T18:47:19.312612+0000","last_active":"2024-08-02T18:49:43.608673+0000","last_peered":"2024-08-02T18:49:43.608673+0000","last_clean":"2024-08-02T18:49:43.608673+0000","last_became_active":"2024-08-02T18:47:19.312239+0000","last_became_peered":"2024-08-02T18:47:19.312239+0000","last_unstale":"2024-08-02T18:49:43.608673+0000","last_undegraded":"2024-08-02T18:49:43.608673+0000","last_fullsized":"2024-08-02T18:49:43.608673+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:39:17.392230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":3,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,8,6],"acting":[10,8,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.1b","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654071+0000","last_change":"2024-08-02T18:48:06.472745+0000","last_active":"2024-08-02T18:49:43.654071+0000","last_peered":"2024-08-02T18:49:43.654071+0000","last_clean":"2024-08-02T18:49:43.654071+0000","last_became_active":"2024-08-02T18:48:06.472369+0000","last_became_peered":"2024-08-02T18:48:06.472369+0000","last_unstale":"2024-08-02T18:49:43.654071+0000","last_undegraded":"2024-08-02T18:49:43.654071+0000","last_fullsized":"2024-08-02T18:49:43.654071+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:39.519287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,4,3],"acting":[9,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":30,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829094+0000","last_change":"2024-08-02T18:48:06.478161+0000","last_active":"2024-08-02T18:49:43.829094+0000","last_peered":"2024-08-02T18:49:43.829094+0000","last_clean":"2024-08-02T18:49:43.829094+0000","last_became_active":"2024-08-02T18:48:06.477561+0000","last_became_peered":"2024-08-02T18:48:06.477561+0000","last_unstale":"2024-08-02T18:49:43.829094+0000","last_undegraded":"2024-08-02T18:49:43.829094+0000","last_fullsized":"2024-08-02T18:49:43.829094+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:09:12.905122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6,8,5],"acting":[2,6,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"90'8","reported_seq":160,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:52.621354+0000","last_change":"2024-08-02T18:47:19.314826+0000","last_active":"2024-08-02T18:49:52.621354+0000","last_peered":"2024-08-02T18:49:52.621354+0000","last_clean":"2024-08-02T18:49:52.621354+0000","last_became_active":"2024-08-02T18:47:19.313985+0000","last_became_peered":"2024-08-02T18:47:19.313985+0000","last_unstale":"2024-08-02T18:49:52.621354+0000","last_undegraded":"2024-08-02T18:49:52.621354+0000","last_fullsized":"2024-08-02T18:49:52.621354+0000","mapping_epoch":77,"log_start":"0'0","ondisk_log_start":"0'0","created":77,"last_epoch_clean":78,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:18.294534+0000","last_clean_scrub_stamp":"2024-08-02T18:47:18.294534+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T18:52:51.900188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1543,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":5,"num_write":5,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1a","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656593+0000","last_change":"2024-08-02T18:47:21.334349+0000","last_active":"2024-08-02T18:49:43.656593+0000","last_peered":"2024-08-02T18:49:43.656593+0000","last_clean":"2024-08-02T18:49:43.656593+0000","last_became_active":"2024-08-02T18:47:21.334034+0000","last_became_peered":"2024-08-02T18:47:21.334034+0000","last_unstale":"2024-08-02T18:49:43.656593+0000","last_undegraded":"2024-08-02T18:49:43.656593+0000","last_fullsized":"2024-08-02T18:49:43.656593+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:27:36.763393+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,9,5],"acting":[8,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":23,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829250+0000","last_change":"2024-08-02T18:47:28.372123+0000","last_active":"2024-08-02T18:49:43.829250+0000","last_peered":"2024-08-02T18:49:43.829250+0000","last_clean":"2024-08-02T18:49:43.829250+0000","last_became_active":"2024-08-02T18:47:28.371224+0000","last_became_peered":"2024-08-02T18:47:28.371224+0000","last_unstale":"2024-08-02T18:49:43.829250+0000","last_undegraded":"2024-08-02T18:49:43.829250+0000","last_fullsized":"2024-08-02T18:49:43.829250+0000","mapping_epoch":84,"log_start":"0'0","ondisk_log_start":"0'0","created":84,"last_epoch_clean":85,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:27.347530+0000","last_clean_scrub_stamp":"2024-08-02T18:47:27.347530+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:16:44.076110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,7,11],"acting":[2,5,7,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921020+0000","last_change":"2024-08-02T18:47:21.339677+0000","last_active":"2024-08-02T18:49:43.921020+0000","last_peered":"2024-08-02T18:49:43.921020+0000","last_clean":"2024-08-02T18:49:43.921020+0000","last_became_active":"2024-08-02T18:47:21.339286+0000","last_became_peered":"2024-08-02T18:47:21.339286+0000","last_unstale":"2024-08-02T18:49:43.921020+0000","last_undegraded":"2024-08-02T18:49:43.921020+0000","last_fullsized":"2024-08-02T18:49:43.921020+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:28:41.268997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,2,5],"acting":[11,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.21","version":"89'12","reported_seq":44,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829253+0000","last_change":"2024-08-02T18:47:21.338837+0000","last_active":"2024-08-02T18:49:43.829253+0000","last_peered":"2024-08-02T18:49:43.829253+0000","last_clean":"2024-08-02T18:49:43.829253+0000","last_became_active":"2024-08-02T18:47:21.338280+0000","last_became_peered":"2024-08-02T18:47:21.338280+0000","last_unstale":"2024-08-02T18:49:43.829253+0000","last_undegraded":"2024-08-02T18:49:43.829253+0000","last_fullsized":"2024-08-02T18:49:43.829253+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:02:25.268352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,4],"acting":[2,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"89'8","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829051+0000","last_change":"2024-08-02T18:47:21.340749+0000","last_active":"2024-08-02T18:49:43.829051+0000","last_peered":"2024-08-02T18:49:43.829051+0000","last_clean":"2024-08-02T18:49:43.829051+0000","last_became_active":"2024-08-02T18:47:21.340363+0000","last_became_peered":"2024-08-02T18:47:21.340363+0000","last_unstale":"2024-08-02T18:49:43.829051+0000","last_undegraded":"2024-08-02T18:49:43.829051+0000","last_fullsized":"2024-08-02T18:49:43.829051+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:04:39.991947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.23","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956830+0000","last_change":"2024-08-02T18:47:21.334933+0000","last_active":"2024-08-02T18:49:43.956830+0000","last_peered":"2024-08-02T18:49:43.956830+0000","last_clean":"2024-08-02T18:49:43.956830+0000","last_became_active":"2024-08-02T18:47:21.334620+0000","last_became_peered":"2024-08-02T18:47:21.334620+0000","last_unstale":"2024-08-02T18:49:43.956830+0000","last_undegraded":"2024-08-02T18:49:43.956830+0000","last_fullsized":"2024-08-02T18:49:43.956830+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:14:59.516490+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6,4],"acting":[0,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561943+0000","last_change":"2024-08-02T18:47:21.336046+0000","last_active":"2024-08-02T18:49:43.561943+0000","last_peered":"2024-08-02T18:49:43.561943+0000","last_clean":"2024-08-02T18:49:43.561943+0000","last_became_active":"2024-08-02T18:47:21.335734+0000","last_became_peered":"2024-08-02T18:47:21.335734+0000","last_unstale":"2024-08-02T18:49:43.561943+0000","last_undegraded":"2024-08-02T18:49:43.561943+0000","last_fullsized":"2024-08-02T18:49:43.561943+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:26:24.751742+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,0],"acting":[6,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921458+0000","last_change":"2024-08-02T18:47:21.340791+0000","last_active":"2024-08-02T18:49:43.921458+0000","last_peered":"2024-08-02T18:49:43.921458+0000","last_clean":"2024-08-02T18:49:43.921458+0000","last_became_active":"2024-08-02T18:47:21.340449+0000","last_became_peered":"2024-08-02T18:47:21.340449+0000","last_unstale":"2024-08-02T18:49:43.921458+0000","last_undegraded":"2024-08-02T18:49:43.921458+0000","last_fullsized":"2024-08-02T18:49:43.921458+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T01:55:44.633892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,8,5],"acting":[11,8,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.26","version":"89'15","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829511+0000","last_change":"2024-08-02T18:47:21.331683+0000","last_active":"2024-08-02T18:49:43.829511+0000","last_peered":"2024-08-02T18:49:43.829511+0000","last_clean":"2024-08-02T18:49:43.829511+0000","last_became_active":"2024-08-02T18:47:21.331386+0000","last_became_peered":"2024-08-02T18:47:21.331386+0000","last_unstale":"2024-08-02T18:49:43.829511+0000","last_undegraded":"2024-08-02T18:49:43.829511+0000","last_fullsized":"2024-08-02T18:49:43.829511+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:13:40.646892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,8,1],"acting":[2,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.27","version":"89'2","reported_seq":33,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609765+0000","last_change":"2024-08-02T18:47:21.334390+0000","last_active":"2024-08-02T18:49:43.609765+0000","last_peered":"2024-08-02T18:49:43.609765+0000","last_clean":"2024-08-02T18:49:43.609765+0000","last_became_active":"2024-08-02T18:47:21.331838+0000","last_became_peered":"2024-08-02T18:47:21.331838+0000","last_unstale":"2024-08-02T18:49:43.609765+0000","last_undegraded":"2024-08-02T18:49:43.609765+0000","last_fullsized":"2024-08-02T18:49:43.609765+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:55:13.634814+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,2],"acting":[3,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562988+0000","last_change":"2024-08-02T18:47:21.330316+0000","last_active":"2024-08-02T18:49:43.562988+0000","last_peered":"2024-08-02T18:49:43.562988+0000","last_clean":"2024-08-02T18:49:43.562988+0000","last_became_active":"2024-08-02T18:47:21.329805+0000","last_became_peered":"2024-08-02T18:47:21.329805+0000","last_unstale":"2024-08-02T18:49:43.562988+0000","last_undegraded":"2024-08-02T18:49:43.562988+0000","last_fullsized":"2024-08-02T18:49:43.562988+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:23:01.911722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,9,3],"acting":[5,9,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609160+0000","last_change":"2024-08-02T18:47:21.332115+0000","last_active":"2024-08-02T18:49:43.609160+0000","last_peered":"2024-08-02T18:49:43.609160+0000","last_clean":"2024-08-02T18:49:43.609160+0000","last_became_active":"2024-08-02T18:47:21.331844+0000","last_became_peered":"2024-08-02T18:47:21.331844+0000","last_unstale":"2024-08-02T18:49:43.609160+0000","last_undegraded":"2024-08-02T18:49:43.609160+0000","last_fullsized":"2024-08-02T18:49:43.609160+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:33:45.863984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,11],"acting":[3,2,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562877+0000","last_change":"2024-08-02T18:47:21.340951+0000","last_active":"2024-08-02T18:49:43.562877+0000","last_peered":"2024-08-02T18:49:43.562877+0000","last_clean":"2024-08-02T18:49:43.562877+0000","last_became_active":"2024-08-02T18:47:21.340626+0000","last_became_peered":"2024-08-02T18:47:21.340626+0000","last_unstale":"2024-08-02T18:49:43.562877+0000","last_undegraded":"2024-08-02T18:49:43.562877+0000","last_fullsized":"2024-08-02T18:49:43.562877+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T22:51:35.252057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,3],"acting":[1,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"89'11","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561703+0000","last_change":"2024-08-02T18:47:21.325880+0000","last_active":"2024-08-02T18:49:43.561703+0000","last_peered":"2024-08-02T18:49:43.561703+0000","last_clean":"2024-08-02T18:49:43.561703+0000","last_became_active":"2024-08-02T18:47:21.325569+0000","last_became_peered":"2024-08-02T18:47:21.325569+0000","last_unstale":"2024-08-02T18:49:43.561703+0000","last_undegraded":"2024-08-02T18:49:43.561703+0000","last_fullsized":"2024-08-02T18:49:43.561703+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:06:14.262458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,0],"acting":[6,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2c","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921328+0000","last_change":"2024-08-02T18:47:21.342018+0000","last_active":"2024-08-02T18:49:43.921328+0000","last_peered":"2024-08-02T18:49:43.921328+0000","last_clean":"2024-08-02T18:49:43.921328+0000","last_became_active":"2024-08-02T18:47:21.341681+0000","last_became_peered":"2024-08-02T18:47:21.341681+0000","last_unstale":"2024-08-02T18:49:43.921328+0000","last_undegraded":"2024-08-02T18:49:43.921328+0000","last_fullsized":"2024-08-02T18:49:43.921328+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:06:15.389361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,4,8],"acting":[11,4,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.2d","version":"89'7","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.829407+0000","last_change":"2024-08-02T18:47:21.328740+0000","last_active":"2024-08-02T18:49:43.829407+0000","last_peered":"2024-08-02T18:49:43.829407+0000","last_clean":"2024-08-02T18:49:43.829407+0000","last_became_active":"2024-08-02T18:47:21.328414+0000","last_became_peered":"2024-08-02T18:47:21.328414+0000","last_unstale":"2024-08-02T18:49:43.829407+0000","last_undegraded":"2024-08-02T18:49:43.829407+0000","last_fullsized":"2024-08-02T18:49:43.829407+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:10:57.697893+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,6],"acting":[2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2e","version":"89'10","reported_seq":42,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654732+0000","last_change":"2024-08-02T18:47:21.329567+0000","last_active":"2024-08-02T18:49:43.654732+0000","last_peered":"2024-08-02T18:49:43.654732+0000","last_clean":"2024-08-02T18:49:43.654732+0000","last_became_active":"2024-08-02T18:47:21.329291+0000","last_became_peered":"2024-08-02T18:47:21.329291+0000","last_unstale":"2024-08-02T18:49:43.654732+0000","last_undegraded":"2024-08-02T18:49:43.654732+0000","last_fullsized":"2024-08-02T18:49:43.654732+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T19:19:28.170812+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,1,10],"acting":[9,1,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.2f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921678+0000","last_change":"2024-08-02T18:47:21.344133+0000","last_active":"2024-08-02T18:49:43.921678+0000","last_peered":"2024-08-02T18:49:43.921678+0000","last_clean":"2024-08-02T18:49:43.921678+0000","last_became_active":"2024-08-02T18:47:21.343747+0000","last_became_peered":"2024-08-02T18:47:21.343747+0000","last_unstale":"2024-08-02T18:49:43.921678+0000","last_undegraded":"2024-08-02T18:49:43.921678+0000","last_fullsized":"2024-08-02T18:49:43.921678+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T00:13:51.211245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]},{"pgid":"3.30","version":"89'9","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.562579+0000","last_change":"2024-08-02T18:47:21.331927+0000","last_active":"2024-08-02T18:49:43.562579+0000","last_peered":"2024-08-02T18:49:43.562579+0000","last_clean":"2024-08-02T18:49:43.562579+0000","last_became_active":"2024-08-02T18:47:21.331578+0000","last_became_peered":"2024-08-02T18:47:21.331578+0000","last_unstale":"2024-08-02T18:49:43.562579+0000","last_undegraded":"2024-08-02T18:49:43.562579+0000","last_fullsized":"2024-08-02T18:49:43.562579+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:57:10.864518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7,0],"acting":[1,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.31","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.955905+0000","last_change":"2024-08-02T18:47:21.336193+0000","last_active":"2024-08-02T18:49:43.955905+0000","last_peered":"2024-08-02T18:49:43.955905+0000","last_clean":"2024-08-02T18:49:43.955905+0000","last_became_active":"2024-08-02T18:47:21.335831+0000","last_became_peered":"2024-08-02T18:47:21.335831+0000","last_unstale":"2024-08-02T18:49:43.955905+0000","last_undegraded":"2024-08-02T18:49:43.955905+0000","last_fullsized":"2024-08-02T18:49:43.955905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T20:33:25.622504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,2],"acting":[0,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.32","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956586+0000","last_change":"2024-08-02T18:47:21.329765+0000","last_active":"2024-08-02T18:49:43.956586+0000","last_peered":"2024-08-02T18:49:43.956586+0000","last_clean":"2024-08-02T18:49:43.956586+0000","last_became_active":"2024-08-02T18:47:21.329468+0000","last_became_peered":"2024-08-02T18:47:21.329468+0000","last_unstale":"2024-08-02T18:49:43.956586+0000","last_undegraded":"2024-08-02T18:49:43.956586+0000","last_fullsized":"2024-08-02T18:49:43.956586+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:16:48.436256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,8,10],"acting":[0,8,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"89'10","reported_seq":41,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.561566+0000","last_change":"2024-08-02T18:47:21.330451+0000","last_active":"2024-08-02T18:49:43.561566+0000","last_peered":"2024-08-02T18:49:43.561566+0000","last_clean":"2024-08-02T18:49:43.561566+0000","last_became_active":"2024-08-02T18:47:21.330009+0000","last_became_peered":"2024-08-02T18:47:21.330009+0000","last_unstale":"2024-08-02T18:49:43.561566+0000","last_undegraded":"2024-08-02T18:49:43.561566+0000","last_fullsized":"2024-08-02T18:49:43.561566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:43:20.364657+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,10,5],"acting":[6,10,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609731+0000","last_change":"2024-08-02T18:47:21.337086+0000","last_active":"2024-08-02T18:49:43.609731+0000","last_peered":"2024-08-02T18:49:43.609731+0000","last_clean":"2024-08-02T18:49:43.609731+0000","last_became_active":"2024-08-02T18:47:21.336751+0000","last_became_peered":"2024-08-02T18:47:21.336751+0000","last_unstale":"2024-08-02T18:49:43.609731+0000","last_undegraded":"2024-08-02T18:49:43.609731+0000","last_fullsized":"2024-08-02T18:49:43.609731+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T02:19:09.189260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,10,8],"acting":[4,10,8],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"89'6","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.827166+0000","last_change":"2024-08-02T18:47:21.332221+0000","last_active":"2024-08-02T18:49:43.827166+0000","last_peered":"2024-08-02T18:49:43.827166+0000","last_clean":"2024-08-02T18:49:43.827166+0000","last_became_active":"2024-08-02T18:47:21.331899+0000","last_became_peered":"2024-08-02T18:47:21.331899+0000","last_unstale":"2024-08-02T18:49:43.827166+0000","last_undegraded":"2024-08-02T18:49:43.827166+0000","last_fullsized":"2024-08-02T18:49:43.827166+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:07:19.175907+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,8,1],"acting":[7,8,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"89'16","reported_seq":47,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608836+0000","last_change":"2024-08-02T18:47:21.337618+0000","last_active":"2024-08-02T18:49:43.608836+0000","last_peered":"2024-08-02T18:49:43.608836+0000","last_clean":"2024-08-02T18:49:43.608836+0000","last_became_active":"2024-08-02T18:47:21.337287+0000","last_became_peered":"2024-08-02T18:47:21.337287+0000","last_unstale":"2024-08-02T18:49:43.608836+0000","last_undegraded":"2024-08-02T18:49:43.608836+0000","last_fullsized":"2024-08-02T18:49:43.608836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:04:42.056016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,2,4],"acting":[10,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.37","version":"89'11","reported_seq":43,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.563210+0000","last_change":"2024-08-02T18:47:21.335570+0000","last_active":"2024-08-02T18:49:43.563210+0000","last_peered":"2024-08-02T18:49:43.563210+0000","last_clean":"2024-08-02T18:49:43.563210+0000","last_became_active":"2024-08-02T18:47:21.334822+0000","last_became_peered":"2024-08-02T18:47:21.334822+0000","last_unstale":"2024-08-02T18:49:43.563210+0000","last_undegraded":"2024-08-02T18:49:43.563210+0000","last_fullsized":"2024-08-02T18:49:43.563210+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:05:28.110125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,11],"acting":[1,5,11],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"89'9","reported_seq":40,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.609115+0000","last_change":"2024-08-02T18:47:21.326238+0000","last_active":"2024-08-02T18:49:43.609115+0000","last_peered":"2024-08-02T18:49:43.609115+0000","last_clean":"2024-08-02T18:49:43.609115+0000","last_became_active":"2024-08-02T18:47:21.325186+0000","last_became_peered":"2024-08-02T18:47:21.325186+0000","last_unstale":"2024-08-02T18:49:43.609115+0000","last_undegraded":"2024-08-02T18:49:43.609115+0000","last_fullsized":"2024-08-02T18:49:43.609115+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T06:44:39.565483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,10],"acting":[3,5,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"89'5","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.826771+0000","last_change":"2024-08-02T18:47:21.325566+0000","last_active":"2024-08-02T18:49:43.826771+0000","last_peered":"2024-08-02T18:49:43.826771+0000","last_clean":"2024-08-02T18:49:43.826771+0000","last_became_active":"2024-08-02T18:47:21.325195+0000","last_became_peered":"2024-08-02T18:47:21.325195+0000","last_unstale":"2024-08-02T18:49:43.826771+0000","last_undegraded":"2024-08-02T18:49:43.826771+0000","last_fullsized":"2024-08-02T18:49:43.826771+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:35:01.730799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,9,5],"acting":[7,9,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"89'6","reported_seq":37,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.608541+0000","last_change":"2024-08-02T18:47:21.333758+0000","last_active":"2024-08-02T18:49:43.608541+0000","last_peered":"2024-08-02T18:49:43.608541+0000","last_clean":"2024-08-02T18:49:43.608541+0000","last_became_active":"2024-08-02T18:47:21.333031+0000","last_became_peered":"2024-08-02T18:47:21.333031+0000","last_unstale":"2024-08-02T18:49:43.608541+0000","last_undegraded":"2024-08-02T18:49:43.608541+0000","last_fullsized":"2024-08-02T18:49:43.608541+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T04:00:53.989081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[10,9,4],"acting":[10,9,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":10,"acting_primary":10,"purged_snaps":[]},{"pgid":"3.3b","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.656515+0000","last_change":"2024-08-02T18:47:21.329677+0000","last_active":"2024-08-02T18:49:43.656515+0000","last_peered":"2024-08-02T18:49:43.656515+0000","last_clean":"2024-08-02T18:49:43.656515+0000","last_became_active":"2024-08-02T18:47:21.329207+0000","last_became_peered":"2024-08-02T18:47:21.329207+0000","last_unstale":"2024-08-02T18:49:43.656515+0000","last_undegraded":"2024-08-02T18:49:43.656515+0000","last_fullsized":"2024-08-02T18:49:43.656515+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T23:52:32.774304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[8,3,6],"acting":[8,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":8,"acting_primary":8,"purged_snaps":[]},{"pgid":"3.3c","version":"89'8","reported_seq":21,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.654397+0000","last_change":"2024-08-02T18:48:06.473562+0000","last_active":"2024-08-02T18:49:43.654397+0000","last_peered":"2024-08-02T18:49:43.654397+0000","last_clean":"2024-08-02T18:49:43.654397+0000","last_became_active":"2024-08-02T18:48:06.473254+0000","last_became_peered":"2024-08-02T18:48:06.473254+0000","last_unstale":"2024-08-02T18:49:43.654397+0000","last_undegraded":"2024-08-02T18:49:43.654397+0000","last_fullsized":"2024-08-02T18:49:43.654397+0000","mapping_epoch":88,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":89,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:42:42.012897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[9,8,2],"acting":[9,8,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":9,"acting_primary":9,"purged_snaps":[]},{"pgid":"3.3d","version":"89'7","reported_seq":38,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956825+0000","last_change":"2024-08-02T18:47:21.330187+0000","last_active":"2024-08-02T18:49:43.956825+0000","last_peered":"2024-08-02T18:49:43.956825+0000","last_clean":"2024-08-02T18:49:43.956825+0000","last_became_active":"2024-08-02T18:47:21.329888+0000","last_became_peered":"2024-08-02T18:47:21.329888+0000","last_unstale":"2024-08-02T18:49:43.956825+0000","last_undegraded":"2024-08-02T18:49:43.956825+0000","last_fullsized":"2024-08-02T18:49:43.956825+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T03:59:18.188293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1],"acting":[0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"89'4","reported_seq":35,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.956976+0000","last_change":"2024-08-02T18:47:21.333164+0000","last_active":"2024-08-02T18:49:43.956976+0000","last_peered":"2024-08-02T18:49:43.956976+0000","last_clean":"2024-08-02T18:49:43.956976+0000","last_became_active":"2024-08-02T18:47:21.332887+0000","last_became_peered":"2024-08-02T18:47:21.332887+0000","last_unstale":"2024-08-02T18:49:43.956976+0000","last_undegraded":"2024-08-02T18:49:43.956976+0000","last_fullsized":"2024-08-02T18:49:43.956976+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-04T05:33:58.568911+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,11,10],"acting":[0,11,10],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3f","version":"89'8","reported_seq":39,"reported_epoch":90,"state":"active+clean","last_fresh":"2024-08-02T18:49:43.921644+0000","last_change":"2024-08-02T18:47:21.344068+0000","last_active":"2024-08-02T18:49:43.921644+0000","last_peered":"2024-08-02T18:49:43.921644+0000","last_clean":"2024-08-02T18:49:43.921644+0000","last_became_active":"2024-08-02T18:47:21.343725+0000","last_became_peered":"2024-08-02T18:47:21.343725+0000","last_unstale":"2024-08-02T18:49:43.921644+0000","last_undegraded":"2024-08-02T18:49:43.921644+0000","last_fullsized":"2024-08-02T18:49:43.921644+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-08-02T18:47:20.299856+0000","last_clean_scrub_stamp":"2024-08-02T18:47:20.299856+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-08-03T21:28:15.843284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[11,1,0],"acting":[11,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":11,"acting_primary":11,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":234,"num_objects":2,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":32768,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2,"ondisk_log_size":2,"up":128,"acting":128,"num_store_stats":12},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":192,"acting":192,"num_store_stats":12},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":796776,"num_objects":62,"num_object_clones":0,"num_object_copies":186,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":62,"num_whiteouts":0,"num_read":1047,"num_read_kb":741,"num_write":427,"num_write_kb":2361,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":34,"num_keys_recovered":20,"num_objects_omap":40,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2617344,"data_stored":2390328,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":314,"ondisk_log_size":314,"up":96,"acting":96,"num_store_stats":12},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":237,"num_read_kb":330,"num_write":201,"num_write_kb":2938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":148,"ondisk_log_size":148,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":11,"up_from":75,"seq":322122547244,"num_pgs":29,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":32188,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93712964,"statfs":{"total":95995035648,"available":95962075136,"internally_reserved":0,"allocated":1032192,"data_stored":509529,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1596,"internal_metadata":31914436},"hb_peers":[0,1,2,3,4,5,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":10,"up_from":68,"seq":292057776176,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29144,"kb_used_data":2008,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716008,"statfs":{"total":95995035648,"available":95965192192,"internally_reserved":0,"allocated":2056192,"data_stored":1495792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,6,8,9,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":9,"up_from":63,"seq":270582939699,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28424,"kb_used_data":1408,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716728,"statfs":{"total":95995035648,"available":95965929472,"internally_reserved":0,"allocated":1441792,"data_stored":907043,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1600,"internal_metadata":27654592},"hb_peers":[0,1,2,3,4,5,7,8,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":8,"up_from":56,"seq":240518168634,"num_pgs":30,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28420,"kb_used_data":1404,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716732,"statfs":{"total":95995035648,"available":95965933568,"internally_reserved":0,"allocated":1437696,"data_stored":902867,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":7,"up_from":49,"seq":210453397567,"num_pgs":37,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36936,"kb_used_data":1600,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708216,"statfs":{"total":95995035648,"available":95957213184,"internally_reserved":0,"allocated":1638400,"data_stored":1107178,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[1,2,3,4,5,6,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":44,"seq":188978561091,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36340,"kb_used_data":1000,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708812,"statfs":{"total":95995035648,"available":95957823488,"internally_reserved":0,"allocated":1024000,"data_stored":504907,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":36,"seq":154618822727,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":29068,"kb_used_data":1932,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716084,"statfs":{"total":95995035648,"available":95965270016,"internally_reserved":0,"allocated":1978368,"data_stored":1429910,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7,8,9,10],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":31,"seq":133143986252,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28032,"kb_used_data":1012,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717120,"statfs":{"total":95995035648,"available":95966330880,"internally_reserved":0,"allocated":1036288,"data_stored":510645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":24,"seq":103079215184,"num_pgs":39,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28856,"kb_used_data":1720,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93716296,"statfs":{"total":95995035648,"available":95965487104,"internally_reserved":0,"allocated":1761280,"data_stored":1226549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":18,"seq":77309411413,"num_pgs":36,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36432,"kb_used_data":1092,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708720,"statfs":{"total":95995035648,"available":95957729280,"internally_reserved":0,"allocated":1118208,"data_stored":576763,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574936,"num_pgs":33,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":28092,"kb_used_data":1072,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":93717060,"statfs":{"total":95995035648,"available":95966269440,"internally_reserved":0,"allocated":1097728,"data_stored":574526,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":8,"seq":34359738462,"num_pgs":35,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":36364,"kb_used_data":1024,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93708788,"statfs":{"total":95995035648,"available":95957798912,"internally_reserved":0,"allocated":1048576,"data_stored":506295,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7,8,9,10,11],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1478,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":69709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":71946,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":741376,"data_stored":721732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1732,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":360448,"data_stored":330629,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":3801,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":393954,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":413696,"data_stored":394034,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":442368,"data_stored":400607,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":616,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":8,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":9,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":8192,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":10,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":11,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":4096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-08-02T18:49:58.769 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:49:58.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:58 smithi151 ceph-mon[37155]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-08-02T18:49:58.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:49:58 smithi151 ceph-mon[37155]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:59.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:58 smithi121 ceph-mon[37236]: pgmap v10: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-08-02T18:49:59.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:49:58 smithi121 ceph-mon[37236]: from='client.15462 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-08-02T18:49:59.029 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:49:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 -- 172.21.15.103:0/1663207436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a0102240 msgr2=0x7f09a010e770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 --2- 172.21.15.103:0/1663207436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a0102240 0x7f09a010e770 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f0998009cd0 tx=0x7f099802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 -- 172.21.15.103:0/1663207436 shutdown_connections 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 --2- 172.21.15.103:0/1663207436 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a0102240 0x7f09a010e770 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 --2- 172.21.15.103:0/1663207436 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09a01018a0 0x7f09a0101d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 --2- 172.21.15.103:0/1663207436 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a01078a0 0x7f09a0107c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 -- 172.21.15.103:0/1663207436 >> 172.21.15.103:0/1663207436 conn(0x7f09a00fd5e0 msgr2=0x7f09a00ffa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 -- 172.21.15.103:0/1663207436 shutdown_connections 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 -- 172.21.15.103:0/1663207436 wait complete. 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 Processor -- start 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.506+0000 7f09a6540640 1 -- start start 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a6540640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09a01018a0 0x7f09a0198220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a6540640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a0102240 0x7f09a0198760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a6540640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a01078a0 0x7f09a019caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:59.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a6540640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0111dc0 con 0x7f09a01078a0 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a6540640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0111c40 con 0x7f09a01018a0 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a6540640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f09a0111f40 con 0x7f09a0102240 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a01078a0 0x7f09a019caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a01078a0 0x7f09a019caf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52446/0 (socket says 172.21.15.103:52446) 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 -- 172.21.15.103:0/476473525 learned_addr learned my addr 172.21.15.103:0/476473525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f0997fff640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a0102240 0x7f09a0198760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f099ffff640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09a01018a0 0x7f09a0198220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 -- 172.21.15.103:0/476473525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a0102240 msgr2=0x7f09a0198760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a0102240 0x7f09a0198760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 -- 172.21.15.103:0/476473525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09a01018a0 msgr2=0x7f09a0198220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09a01018a0 0x7f09a0198220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 -- 172.21.15.103:0/476473525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f09a019d1d0 con 0x7f09a01078a0 2024-08-02T18:49:59.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f099ffff640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09a01018a0 0x7f09a0198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a4add640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a01078a0 0x7f09a019caf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0998006010 tx=0x7f0998003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f099dffb640 1 -- 172.21.15.103:0/476473525 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998004040 con 0x7f09a01078a0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f09a019d460 con 0x7f09a01078a0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f099dffb640 1 -- 172.21.15.103:0/476473525 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f09980046e0 con 0x7f09a01078a0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.507+0000 7f099dffb640 1 -- 172.21.15.103:0/476473525 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0998046480 con 0x7f09a01078a0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.508+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f09a01a4da0 con 0x7f09a01078a0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.508+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f09a0101d00 con 0x7f09a01078a0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.510+0000 7f099dffb640 1 -- 172.21.15.103:0/476473525 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7f0998030630 con 0x7f09a01078a0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.510+0000 7f099dffb640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f098c0a2d80 0x7f098c0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.511+0000 7f099ffff640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f098c0a2d80 0x7f098c0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.511+0000 7f099dffb640 1 -- 172.21.15.103:0/476473525 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f099802e030 con 0x7f09a01078a0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.511+0000 7f099ffff640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f098c0a2d80 0x7f098c0a5240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0990005fd0 tx=0x7f09900094d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:49:59.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.513+0000 7f099dffb640 1 -- 172.21.15.103:0/476473525 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f099804b060 con 0x7f09a01078a0 2024-08-02T18:49:59.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.719+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f09a01a4fd0 con 0x7f09a01078a0 2024-08-02T18:49:59.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.720+0000 7f099dffb640 1 -- 172.21.15.103:0/476473525 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7f09980bd9e0 con 0x7f09a01078a0 2024-08-02T18:49:59.722 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:49:59.722 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:49:59.722 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:49:59.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f098c0a2d80 msgr2=0x7f098c0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:59.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f098c0a2d80 0x7f098c0a5240 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f0990005fd0 tx=0x7f09900094d0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a01078a0 msgr2=0x7f09a019caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a01078a0 0x7f09a019caf0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f0998006010 tx=0x7f0998003f10 comp rx=0 tx=0).stop 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 shutdown_connections 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f098c0a2d80 0x7f098c0a5240 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f09a01078a0 0x7f09a019caf0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f09a0102240 0x7f09a0198760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 --2- 172.21.15.103:0/476473525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f09a01018a0 0x7f09a0198220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 >> 172.21.15.103:0/476473525 conn(0x7f09a00fd5e0 msgr2=0x7f09a00fdd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 shutdown_connections 2024-08-02T18:49:59.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:49:59.722+0000 7f09a6540640 1 -- 172.21.15.103:0/476473525 wait complete. 2024-08-02T18:50:00.412 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:50:00.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:00 smithi103 ceph-mon[32753]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-08-02T18:50:00.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:00 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/476473525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:00.642 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:00 smithi103 ceph-mon[32753]: overall HEALTH_OK 2024-08-02T18:50:00.674 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:00.944 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:50:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:50:00.640+0000 7f7833587640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:50:00.945 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:50:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:50:00.640+0000 7f7833587640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:50:00.945 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:50:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:50:00.640+0000 7f7833587640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:50:00.945 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:50:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:50:00.640+0000 7f7833587640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:50:00.945 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 18:50:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T18:50:00.640+0000 7f7833587640 -1 client.0 error registering admin socket command: (17) File exists 2024-08-02T18:50:01.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:00 smithi121 ceph-mon[37236]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-08-02T18:50:01.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:00 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/476473525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:01.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:00 smithi121 ceph-mon[37236]: overall HEALTH_OK 2024-08-02T18:50:01.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:00 smithi151 ceph-mon[37155]: pgmap v11: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 40 KiB/s rd, 76 KiB/s wr, 47 op/s 2024-08-02T18:50:01.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:00 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/476473525' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:01.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:00 smithi151 ceph-mon[37155]: overall HEALTH_OK 2024-08-02T18:50:01.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2237805240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e0101150 msgr2=0x7fb6e010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:01.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2237805240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e0101150 0x7fb6e010d680 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8009cd0 tx=0x7fb6d802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2237805240 shutdown_connections 2024-08-02T18:50:01.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2237805240 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e0101150 0x7fb6e010d680 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2237805240 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6e01007b0 0x7fb6e0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2237805240 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e01067b0 0x7fb6e0106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2237805240 >> 172.21.15.103:0/2237805240 conn(0x7fb6e00fc4d0 msgr2=0x7fb6e00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2237805240 shutdown_connections 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2237805240 wait complete. 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.167+0000 7fb6e5d4c640 1 Processor -- start 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6e5d4c640 1 -- start start 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6e5d4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e01007b0 0x7fb6e01981f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6e5d4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6e0101150 0x7fb6e0198730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6e5d4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e01067b0 0x7fb6e019cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6e5d4c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0110cd0 con 0x7fb6e01067b0 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6e5d4c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0110b50 con 0x7fb6e0101150 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6e5d4c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb6e0110e50 con 0x7fb6e01007b0 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6dffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e01067b0 0x7fb6e019cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6dffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e01067b0 0x7fb6e019cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52476/0 (socket says 172.21.15.103:52476) 2024-08-02T18:50:01.188 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6dffff640 1 -- 172.21.15.103:0/2294103344 learned_addr learned my addr 172.21.15.103:0/2294103344 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6df7fe640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e01007b0 0x7fb6e01981f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6deffd640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6e0101150 0x7fb6e0198730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6dffff640 1 -- 172.21.15.103:0/2294103344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e01007b0 msgr2=0x7fb6e01981f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6dffff640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e01007b0 0x7fb6e01981f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6dffff640 1 -- 172.21.15.103:0/2294103344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6e0101150 msgr2=0x7fb6e0198730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6dffff640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6e0101150 0x7fb6e0198730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6dffff640 1 -- 172.21.15.103:0/2294103344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb6e019d1a0 con 0x7fb6e01067b0 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.168+0000 7fb6deffd640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6e0101150 0x7fb6e0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.169+0000 7fb6dffff640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e01067b0 0x7fb6e019cac0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8006010 tx=0x7fb6d8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.169+0000 7fb6dcff9640 1 -- 172.21.15.103:0/2294103344 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8031c80 con 0x7fb6e01067b0 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.169+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb6e019d430 con 0x7fb6e01067b0 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.169+0000 7fb6dcff9640 1 -- 172.21.15.103:0/2294103344 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb6d8031e20 con 0x7fb6e01067b0 2024-08-02T18:50:01.189 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.169+0000 7fb6dcff9640 1 -- 172.21.15.103:0/2294103344 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6d8030cf0 con 0x7fb6e01067b0 2024-08-02T18:50:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.169+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb6e01a4d70 con 0x7fb6e01067b0 2024-08-02T18:50:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.170+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb6e0100c10 con 0x7fb6e01067b0 2024-08-02T18:50:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.171+0000 7fb6dcff9640 1 -- 172.21.15.103:0/2294103344 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 24) ==== 138010+0+0 (secure 0 0 0) 0x7fb6d8004040 con 0x7fb6e01067b0 2024-08-02T18:50:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.172+0000 7fb6dcff9640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb6cc0a2d80 0x7fb6cc0a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.172+0000 7fb6df7fe640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb6cc0a2d80 0x7fb6cc0a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.172+0000 7fb6dcff9640 1 -- 172.21.15.103:0/2294103344 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fb6d802e030 con 0x7fb6e01067b0 2024-08-02T18:50:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.172+0000 7fb6df7fe640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb6cc0a2d80 0x7fb6cc0a5240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0005e00 tx=0x7fb6d0005c50 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:01.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.175+0000 7fb6dcff9640 1 -- 172.21.15.103:0/2294103344 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb6d80bd610 con 0x7fb6e01067b0 2024-08-02T18:50:01.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.382+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb6e0109d80 con 0x7fb6e01067b0 2024-08-02T18:50:01.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.383+0000 7fb6dcff9640 1 -- 172.21.15.103:0/2294103344 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7fb6d80bcf10 con 0x7fb6e01067b0 2024-08-02T18:50:01.385 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:50:01.385 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:50:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:50:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb6cc0a2d80 msgr2=0x7fb6cc0a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb6cc0a2d80 0x7fb6cc0a5240 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fb6d0005e00 tx=0x7fb6d0005c50 comp rx=0 tx=0).stop 2024-08-02T18:50:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e01067b0 msgr2=0x7fb6e019cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e01067b0 0x7fb6e019cac0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7fb6d8006010 tx=0x7fb6d8003f10 comp rx=0 tx=0).stop 2024-08-02T18:50:01.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 shutdown_connections 2024-08-02T18:50:01.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb6cc0a2d80 0x7fb6cc0a5240 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb6e01067b0 0x7fb6e019cac0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb6e0101150 0x7fb6e0198730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 --2- 172.21.15.103:0/2294103344 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb6e01007b0 0x7fb6e01981f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:01.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 >> 172.21.15.103:0/2294103344 conn(0x7fb6e00fc4d0 msgr2=0x7fb6e006a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:01.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 shutdown_connections 2024-08-02T18:50:01.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:01.385+0000 7fb6e5d4c640 1 -- 172.21.15.103:0/2294103344 wait complete. 2024-08-02T18:50:02.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:01 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2294103344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:02.008 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:01 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2294103344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:02.038 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T18:50:02.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:01 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2294103344' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:02.293 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:02.729 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:02 smithi103 ceph-mon[32753]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-08-02T18:50:02.730 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:02 smithi103 ceph-mon[32753]: mgrmap e25: x(active, since 18s), standbys: z, y 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 -- 172.21.15.103:0/461612419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 msgr2=0x7f094c10e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 --2- 172.21.15.103:0/461612419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 0x7f094c10e340 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f0944009ca0 tx=0x7f094402a950 comp rx=0 tx=0).stop 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 -- 172.21.15.103:0/461612419 shutdown_connections 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 --2- 172.21.15.103:0/461612419 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 0x7f094c10e340 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 --2- 172.21.15.103:0/461612419 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f094c103390 0x7f094c10b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 --2- 172.21.15.103:0/461612419 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f094c102a70 0x7f094c102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 -- 172.21.15.103:0/461612419 >> 172.21.15.103:0/461612419 conn(0x7f094c0fc4d0 msgr2=0x7f094c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 -- 172.21.15.103:0/461612419 shutdown_connections 2024-08-02T18:50:02.830 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.807+0000 7f095319e640 1 -- 172.21.15.103:0/461612419 wait complete. 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095319e640 1 Processor -- start 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095319e640 1 -- start start 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095319e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f094c102a70 0x7f094c19a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095319e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f094c103390 0x7f094c19a950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095319e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 0x7f094c19ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095319e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f094c111dc0 con 0x7f094c10bea0 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095319e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f094c111c40 con 0x7f094c103390 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095319e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f094c111f40 con 0x7f094c102a70 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095173b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 0x7f094c19ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095173b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 0x7f094c19ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52492/0 (socket says 172.21.15.103:52492) 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095173b640 1 -- 172.21.15.103:0/19862449 learned_addr learned my addr 172.21.15.103:0/19862449 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:02.831 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f0943fff640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f094c103390 0x7f094c19a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f0950f3a640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f094c102a70 0x7f094c19a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095173b640 1 -- 172.21.15.103:0/19862449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f094c102a70 msgr2=0x7f094c19a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095173b640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f094c102a70 0x7f094c19a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095173b640 1 -- 172.21.15.103:0/19862449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f094c103390 msgr2=0x7f094c19a950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095173b640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f094c103390 0x7f094c19a950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.808+0000 7f095173b640 1 -- 172.21.15.103:0/19862449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f094c19f3c0 con 0x7f094c10bea0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.809+0000 7f095173b640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 0x7f094c19ece0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0944005cc0 tx=0x7f094402f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.809+0000 7f0941ffb640 1 -- 172.21.15.103:0/19862449 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0944034040 con 0x7f094c10bea0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.809+0000 7f0941ffb640 1 -- 172.21.15.103:0/19862449 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0944030940 con 0x7f094c10bea0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.809+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f094c19f650 con 0x7f094c10bea0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.809+0000 7f0941ffb640 1 -- 172.21.15.103:0/19862449 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f09440456e0 con 0x7f094c10bea0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.809+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f094c1a6f90 con 0x7f094c10bea0 2024-08-02T18:50:02.832 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.810+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f094c06ada0 con 0x7f094c10bea0 2024-08-02T18:50:02.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.811+0000 7f0941ffb640 1 -- 172.21.15.103:0/19862449 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f0944037020 con 0x7f094c10bea0 2024-08-02T18:50:02.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.812+0000 7f0941ffb640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f09340a2e10 0x7f09340a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:02.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.812+0000 7f0950f3a640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f09340a2e10 0x7f09340a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:02.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.812+0000 7f0941ffb640 1 -- 172.21.15.103:0/19862449 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f09440f0890 con 0x7f094c10bea0 2024-08-02T18:50:02.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.812+0000 7f0950f3a640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f09340a2e10 0x7f09340a52d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f094800bbe0 tx=0x7f094800b390 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:02.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.816+0000 7f0941ffb640 1 -- 172.21.15.103:0/19862449 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f09440bd030 con 0x7f094c10bea0 2024-08-02T18:50:02.983 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.982+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f094c1a7160 con 0x7f094c10bea0 2024-08-02T18:50:02.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.983+0000 7f0941ffb640 1 -- 172.21.15.103:0/19862449 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v90) ==== 74+0+25083 (secure 0 0 0) 0x7f09440bc930 con 0x7f094c10bea0 2024-08-02T18:50:02.985 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:50:02.986 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":90,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:49:43.556886+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"87","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/3303960029":"2024-08-03T18:49:43.556859+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/433411047":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/2738010911":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/15319849":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/3303960029":"2024-08-03T18:49:43.556859+0000","172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/592081832":"2024-08-03T18:49:43.556859+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:50:02.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f09340a2e10 msgr2=0x7f09340a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:02.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f09340a2e10 0x7f09340a52d0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f094800bbe0 tx=0x7f094800b390 comp rx=0 tx=0).stop 2024-08-02T18:50:02.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 msgr2=0x7f094c19ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:02.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 0x7f094c19ece0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f0944005cc0 tx=0x7f094402f790 comp rx=0 tx=0).stop 2024-08-02T18:50:02.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 shutdown_connections 2024-08-02T18:50:02.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f09340a2e10 0x7f09340a52d0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f094c10bea0 0x7f094c19ece0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f094c103390 0x7f094c19a950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 --2- 172.21.15.103:0/19862449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f094c102a70 0x7f094c19a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:02.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 >> 172.21.15.103:0/19862449 conn(0x7f094c0fc4d0 msgr2=0x7f094c10d110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:02.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 shutdown_connections 2024-08-02T18:50:02.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:02.986+0000 7f095319e640 1 -- 172.21.15.103:0/19862449 wait complete. 2024-08-02T18:50:03.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:02 smithi121 ceph-mon[37236]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-08-02T18:50:03.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:02 smithi121 ceph-mon[37236]: mgrmap e25: x(active, since 18s), standbys: z, y 2024-08-02T18:50:03.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:02 smithi151 ceph-mon[37155]: pgmap v12: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 41 KiB/s rd, 76 KiB/s wr, 49 op/s 2024-08-02T18:50:03.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:02 smithi151 ceph-mon[37155]: mgrmap e25: x(active, since 18s), standbys: z, y 2024-08-02T18:50:03.722 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:03 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/19862449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:50:03.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mon.a --format=json config get run_dir 2024-08-02T18:50:04.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:03 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/19862449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:50:04.008 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:04.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:03 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/19862449' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:50:04.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:04 smithi103 ceph-mon[32753]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-08-02T18:50:04.902 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:04 smithi121 ceph-mon[37236]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-08-02T18:50:05.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:04 smithi151 ceph-mon[37155]: pgmap v13: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 22 KiB/s rd, 76 KiB/s wr, 36 op/s 2024-08-02T18:50:05.210 INFO:teuthology.orchestra.run.smithi103.stdout:{"run_dir":"/var/run/ceph"} 2024-08-02T18:50:05.211 DEBUG:tasks.cephfs.filesystem:_json_asok output { "run_dir": "/var/run/ceph" } 2024-08-02T18:50:05.211 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with seed 4941 2024-08-02T18:50:05.211 DEBUG:tasks.quiescer:Yielding 2024-08-02T18:50:05.212 INFO:teuthology.run_tasks:Running task workunit... 2024-08-02T18:50:05.226 INFO:tasks.workunit:Pulling workunits from ref 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:50:05.227 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-08-02T18:50:05.227 INFO:tasks.workunit:timeout=3h 2024-08-02T18:50:05.227 INFO:tasks.workunit:cleanup=True 2024-08-02T18:50:05.227 DEBUG:teuthology.orchestra.run.smithi103:> stat -- /home/ubuntu/cephtest/mnt.0 2024-08-02T18:50:05.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: Size: 0 Blocks: 0 IO Block: 65536 directory 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout:Device: 77h/119d Inode: 1099511628283 Links: 2 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout:Context: system_u:object_r:unlabeled_t:s0 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout:Access: 2024-08-02 18:48:12.436385805 +0000 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout:Modify: 2024-08-02 18:48:12.436385805 +0000 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout:Change: 2024-08-02 18:49:41.479059991 +0000 2024-08-02T18:50:05.246 INFO:teuthology.orchestra.run.smithi103.stdout: Birth: 2024-08-02 18:48:12.436385805 +0000 2024-08-02T18:50:05.246 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-08-02T18:50:05.247 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-08-02T18:50:05.319 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea 2024-08-02T18:50:05.378 INFO:tasks.workunit.client.0.smithi103.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-08-02T18:50:05.493 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:06.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 -- 172.21.15.103:0/3011269719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c103390 msgr2=0x7fae8c10b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 --2- 172.21.15.103:0/3011269719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c103390 0x7fae8c10b880 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fae80009900 tx=0x7fae8002a480 comp rx=0 tx=0).stop 2024-08-02T18:50:06.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 -- 172.21.15.103:0/3011269719 shutdown_connections 2024-08-02T18:50:06.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 --2- 172.21.15.103:0/3011269719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae8c10bea0 0x7fae8c10e340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 --2- 172.21.15.103:0/3011269719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c103390 0x7fae8c10b880 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 --2- 172.21.15.103:0/3011269719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8c102a70 0x7fae8c102e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 -- 172.21.15.103:0/3011269719 >> 172.21.15.103:0/3011269719 conn(0x7fae8c0fc4d0 msgr2=0x7fae8c0fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 -- 172.21.15.103:0/3011269719 shutdown_connections 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 -- 172.21.15.103:0/3011269719 wait complete. 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.954+0000 7fae91cc4640 1 Processor -- start 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae91cc4640 1 -- start start 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae91cc4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8c102a70 0x7fae8c1006d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae91cc4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c103390 0x7fae8c100c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae91cc4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae8c10bea0 0x7fae8c101150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae91cc4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c111dc0 con 0x7fae8c102a70 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae91cc4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c111c40 con 0x7fae8c103390 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae91cc4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fae8c111f40 con 0x7fae8c10bea0 2024-08-02T18:50:06.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8c102a70 0x7fae8c1006d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8c102a70 0x7fae8c1006d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52522/0 (socket says 172.21.15.103:52522) 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 -- 172.21.15.103:0/2617183168 learned_addr learned my addr 172.21.15.103:0/2617183168 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8affd640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c103390 0x7fae8c100c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8bfff640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae8c10bea0 0x7fae8c101150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 -- 172.21.15.103:0/2617183168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae8c10bea0 msgr2=0x7fae8c101150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae8c10bea0 0x7fae8c101150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 -- 172.21.15.103:0/2617183168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c103390 msgr2=0x7fae8c100c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c103390 0x7fae8c100c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 -- 172.21.15.103:0/2617183168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae8c1a6720 con 0x7fae8c102a70 2024-08-02T18:50:06.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8bfff640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae8c10bea0 0x7fae8c101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.955+0000 7fae8b7fe640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8c102a70 0x7fae8c1006d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00ebc0 tx=0x7fae7c00c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.956+0000 7fae88ff9640 1 -- 172.21.15.103:0/2617183168 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c010630 con 0x7fae8c102a70 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.956+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae8c1a6a10 con 0x7fae8c102a70 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.956+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae8c1a6f70 con 0x7fae8c102a70 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.956+0000 7fae88ff9640 1 -- 172.21.15.103:0/2617183168 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fae7c010cd0 con 0x7fae8c102a70 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.956+0000 7fae88ff9640 1 -- 172.21.15.103:0/2617183168 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae7c018c60 con 0x7fae8c102a70 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.957+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae78005290 con 0x7fae8c102a70 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.958+0000 7fae88ff9640 1 -- 172.21.15.103:0/2617183168 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7fae7c018420 con 0x7fae8c102a70 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.958+0000 7fae88ff9640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fae740a2e90 0x7fae740a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.958+0000 7fae8affd640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fae740a2e90 0x7fae740a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.959+0000 7fae88ff9640 1 -- 172.21.15.103:0/2617183168 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fae7c018e00 con 0x7fae8c102a70 2024-08-02T18:50:06.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.959+0000 7fae8affd640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fae740a2e90 0x7fae740a5350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae80009230 tx=0x7fae800058d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:06.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:05.962+0000 7fae88ff9640 1 -- 172.21.15.103:0/2617183168 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fae7c09c8e0 con 0x7fae8c102a70 2024-08-02T18:50:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.164+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fae78005580 con 0x7fae8c102a70 2024-08-02T18:50:06.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.165+0000 7fae88ff9640 1 -- 172.21.15.103:0/2617183168 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7fae7c0bae20 con 0x7fae8c102a70 2024-08-02T18:50:06.167 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:50:06.167 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:50:06.167 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:50:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fae740a2e90 msgr2=0x7fae740a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fae740a2e90 0x7fae740a5350 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fae80009230 tx=0x7fae800058d0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8c102a70 msgr2=0x7fae8c1006d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8c102a70 0x7fae8c1006d0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fae7c00ebc0 tx=0x7fae7c00c6a0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 shutdown_connections 2024-08-02T18:50:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fae740a2e90 0x7fae740a5350 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fae8c10bea0 0x7fae8c101150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fae8c103390 0x7fae8c100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 --2- 172.21.15.103:0/2617183168 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fae8c102a70 0x7fae8c1006d0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.167+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 >> 172.21.15.103:0/2617183168 conn(0x7fae8c0fc4d0 msgr2=0x7fae8c0fd130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:06.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.168+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 shutdown_connections 2024-08-02T18:50:06.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:06.168+0000 7fae91cc4640 1 -- 172.21.15.103:0/2617183168 wait complete. 2024-08-02T18:50:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 -- 172.21.15.103:0/2600019675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f01006e0 msgr2=0x7fc2f0100b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/2600019675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f01006e0 0x7fc2f0100b40 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009930 tx=0x7fc2e002a420 comp rx=0 tx=0).stop 2024-08-02T18:50:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 -- 172.21.15.103:0/2600019675 shutdown_connections 2024-08-02T18:50:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/2600019675 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f0101080 0x7fc2f010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.798 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/2600019675 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f01006e0 0x7fc2f0100b40 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/2600019675 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f01066f0 0x7fc2f0106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 -- 172.21.15.103:0/2600019675 >> 172.21.15.103:0/2600019675 conn(0x7fc2f00776c0 msgr2=0x7fc2f00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 -- 172.21.15.103:0/2600019675 shutdown_connections 2024-08-02T18:50:06.799 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 -- 172.21.15.103:0/2600019675 wait complete. 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 Processor -- start 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.797+0000 7fc2f7e74640 1 -- start start 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f7e74640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f01006e0 0x7fc2f0196f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f7e74640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f0101080 0x7fc2f0197440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f7e74640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f01066f0 0x7fc2f019b7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f7e74640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0110c50 con 0x7fc2f0101080 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f7e74640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0110ad0 con 0x7fc2f01006e0 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f7e74640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f0110dd0 con 0x7fc2f01066f0 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f0101080 0x7fc2f0197440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f0101080 0x7fc2f0197440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52552/0 (socket says 172.21.15.103:52552) 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 -- 172.21.15.103:0/3620114883 learned_addr learned my addr 172.21.15.103:0/3620114883 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:06.801 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f01006e0 0x7fc2f0196f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f6411640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f01066f0 0x7fc2f019b7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 -- 172.21.15.103:0/3620114883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f01066f0 msgr2=0x7fc2f019b7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f01066f0 0x7fc2f019b7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 -- 172.21.15.103:0/3620114883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f01006e0 msgr2=0x7fc2f0196f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f01006e0 0x7fc2f0196f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 -- 172.21.15.103:0/3620114883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc2f019bef0 con 0x7fc2f0101080 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f6411640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f01066f0 0x7fc2f019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f540f640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f0101080 0x7fc2f0197440 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009a50 tx=0x7fc2e0004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2e6ffd640 1 -- 172.21.15.103:0/3620114883 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e003f030 con 0x7fc2f0101080 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2e6ffd640 1 -- 172.21.15.103:0/3620114883 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2e0003af0 con 0x7fc2f0101080 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2f7e74640 1 -- 172.21.15.103:0/3620114883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc2f019c180 con 0x7fc2f0101080 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.798+0000 7fc2e6ffd640 1 -- 172.21.15.103:0/3620114883 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0035070 con 0x7fc2f0101080 2024-08-02T18:50:06.802 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.799+0000 7fc2f7e74640 1 -- 172.21.15.103:0/3620114883 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc2f01a3a70 con 0x7fc2f0101080 2024-08-02T18:50:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.801+0000 7fc2e6ffd640 1 -- 172.21.15.103:0/3620114883 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7fc2e0042030 con 0x7fc2f0101080 2024-08-02T18:50:06.804 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.801+0000 7fc2fabca740 1 Processor -- start 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.801+0000 7fc2fabca740 1 -- start start 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45cf9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cff10 0x563dd45dc640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45dcb80 0x563dd45def70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2fabca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563dd45339b0 con 0x563dd45cf5f0 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2fabca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563dd44db800 con 0x563dd45dcb80 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2fabca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563dd452f970 con 0x563dd45cff10 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f6411640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45cf9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f540f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45dcb80 0x563dd45def70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2e6ffd640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fc2dc0a2ec0 0x7fc2dc0a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f6411640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45cf9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52568/0 (socket says 172.21.15.103:52568) 2024-08-02T18:50:06.805 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f6411640 1 -- 172.21.15.103:0/3797276460 learned_addr learned my addr 172.21.15.103:0/3797276460 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cff10 0x563dd45dc640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f6411640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fc2dc0a2ec0 0x7fc2dc0a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2e6ffd640 1 -- 172.21.15.103:0/3620114883 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fc2e00f0220 con 0x7fc2f0101080 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f5c10640 1 -- 172.21.15.103:0/3797276460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45dcb80 msgr2=0x563dd45def70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45dcb80 0x563dd45def70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f5c10640 1 -- 172.21.15.103:0/3797276460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 msgr2=0x563dd45cf9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45cf9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f5c10640 1 -- 172.21.15.103:0/3797276460 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd4247210 con 0x563dd45cff10 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f540f640 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45dcb80 0x563dd45def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cff10 0x563dd45dc640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00ab70 tx=0x7fc2ec00f790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1c2cf45b263d1d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.802+0000 7fc2f6411640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fc2dc0a2ec0 0x7fc2dc0a5380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8007fd0 tx=0x7fc2e8004ab0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:06.806 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.803+0000 7fc2dbfff640 1 -- 172.21.15.103:0/3797276460 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec005220 con 0x563dd45cff10 2024-08-02T18:50:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.803+0000 7fc2dbfff640 1 -- 172.21.15.103:0/3797276460 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2ec0047a0 con 0x563dd45cff10 2024-08-02T18:50:06.807 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.803+0000 7fc2dbfff640 1 -- 172.21.15.103:0/3797276460 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec018900 con 0x563dd45cff10 2024-08-02T18:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 -- 172.21.15.103:0/3797276460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cff10 msgr2=0x563dd45dc640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cff10 0x563dd45dc640 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec00ab70 tx=0x7fc2ec00f790 comp rx=0 tx=0).stop 2024-08-02T18:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 -- 172.21.15.103:0/3797276460 shutdown_connections 2024-08-02T18:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45dcb80 0x563dd45def70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cff10 0x563dd45dc640 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3797276460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45cf9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 -- 172.21.15.103:0/3797276460 >> 172.21.15.103:0/3797276460 conn(0x563dd45cbd20 msgr2=0x563dd45cc100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:06.812 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 -- 172.21.15.103:0/3797276460 shutdown_connections 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 -- 172.21.15.103:0/3797276460 wait complete. 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 -- start start 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.804+0000 7fc2fabca740 1 Processor -- start 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45d9a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45dcb80 0x563dd45da510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2fabca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563dd45df750 con 0x563dd45cf5f0 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2fabca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563dd44ef500 con 0x563dd45cff10 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2fabca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563dd45df8d0 con 0x563dd45dcb80 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2fabca740 10 client.0 _ll_register_callbacks cb 0x563dd4246a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f5c10640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45d9a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f5c10640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45d9a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52576/0 (socket says 172.21.15.103:52576) 2024-08-02T18:50:06.813 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f5c10640 1 -- 172.21.15.103:0/1477115211 learned_addr learned my addr 172.21.15.103:0/1477115211 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f540f640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f6411640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45dcb80 0x563dd45da510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f5c10640 1 -- 172.21.15.103:0/1477115211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45dcb80 msgr2=0x563dd45da510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45dcb80 0x563dd45da510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f5c10640 1 -- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 msgr2=0x563dd45d9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f5c10640 1 -- 172.21.15.103:0/1477115211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd4313620 con 0x563dd45cf5f0 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f540f640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.805+0000 7fc2f6411640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45dcb80 0x563dd45da510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45d9a90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec01a040 tx=0x7fc2ec018930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30e360db7c4b0765 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2d97fa640 1 -- 172.21.15.103:0/1477115211 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2ec027070 con 0x563dd45cf5f0 2024-08-02T18:50:06.814 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 1 -- 172.21.15.103:0/1477115211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2ec0047a0 con 0x563dd45cf5f0 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2d97fa640 1 -- 172.21.15.103:0/1477115211 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fc2ec018d30 con 0x563dd45cf5f0 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2d97fa640 1 -- 172.21.15.103:0/1477115211 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc2ec033050 con 0x563dd45cf5f0 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 10 client.15504 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 1 -- 172.21.15.103:0/1477115211 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563dd45eb3d0 con 0x563dd45cf5f0 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2d97fa640 1 -- 172.21.15.103:0/1477115211 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2ec0047a0 con 0x563dd45cf5f0 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2d97fa640 1 -- 172.21.15.103:0/1477115211 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc2ec023430 con 0x563dd45cf5f0 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 10 client.15504 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 10 client.15504 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 20 client.15504 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563dd45ec7e0 0x563dd45eebd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 4 client.15504 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.806+0000 7fc2fabca740 1 -- 172.21.15.103:0/1477115211 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563dd45410e0 con 0x563dd45ec7e0 2024-08-02T18:50:06.815 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.807+0000 7fc2f540f640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563dd45ec7e0 0x563dd45eebd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.807+0000 7fc2d97fa640 10 client.15504 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.807+0000 7fc2f540f640 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563dd45ec7e0 0x563dd45eebd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2f0e4271661ffce0 server_cookie=d10418e283ee7fdc in_seq=0 out_seq=0 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2d97fa640 1 -- 172.21.15.103:0/1477115211 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563dd45410e0 con 0x563dd45ec7e0 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2d97fa640 10 client.15504 handle_command_reply: tid=0 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 client.15504 shutdown 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 -- 172.21.15.103:0/1477115211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 msgr2=0x563dd45d9a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45d9a90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec01a040 tx=0x7fc2ec018930 comp rx=0 tx=0).stop 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 -- 172.21.15.103:0/1477115211 shutdown_connections 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563dd45ec7e0 0x563dd45eebd0 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45dcb80 0x563dd45da510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2d97fa640 0 client.15504 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.816 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 --2- 172.21.15.103:0/1477115211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45cf5f0 0x563dd45d9a90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 -- 172.21.15.103:0/1477115211 >> 172.21.15.103:0/1477115211 conn(0x563dd45cbd20 msgr2=0x563dd45d1a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 -- 172.21.15.103:0/1477115211 shutdown_connections 2024-08-02T18:50:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 1 -- 172.21.15.103:0/1477115211 wait complete. 2024-08-02T18:50:06.817 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.808+0000 7fc2fabca740 20 client.15504 trim_cache size 0 max 16384 2024-08-02T18:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2fabca740 1 Processor -- start 2024-08-02T18:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2fabca740 1 -- start start 2024-08-02T18:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 0x563dd45db8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45f4170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45f46b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.825 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2fabca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01af0e0 con 0x563dd45dcb80 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2fabca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01ac9b0 con 0x563dd45cff10 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2fabca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01aa800 con 0x563dd45cf5f0 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.823+0000 7fc2f6411640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45f46b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f6411640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45f46b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52588/0 (socket says 172.21.15.103:52588) 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f6411640 1 -- 172.21.15.103:0/3662880654 learned_addr learned my addr 172.21.15.103:0/3662880654 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f540f640 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45f4170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 0x563dd45db8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f6411640 1 -- 172.21.15.103:0/3662880654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 msgr2=0x563dd45db8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f6411640 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 0x563dd45db8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f6411640 1 -- 172.21.15.103:0/3662880654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 msgr2=0x563dd45f4170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f6411640 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45f4170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.826 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f6411640 1 -- 172.21.15.103:0/3662880654 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563dd45df2e0 con 0x563dd45dcb80 2024-08-02T18:50:06.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:06 smithi103 ceph-mon[32753]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 99 KiB/s wr, 54 op/s 2024-08-02T18:50:06.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:06 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2617183168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:06.827 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:06 smithi103 ceph-mon[32753]: scrub summary: idle 2024-08-02T18:50:06.830 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2f6411640 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45f46b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8007480 tx=0x7fc2e8007930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5284e497db65372e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2db7fe640 1 -- 172.21.15.103:0/3662880654 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8024070 con 0x563dd45dcb80 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2db7fe640 1 -- 172.21.15.103:0/3662880654 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2e8012e50 con 0x563dd45dcb80 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.824+0000 7fc2db7fe640 1 -- 172.21.15.103:0/3662880654 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e8004800 con 0x563dd45dcb80 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 -- 172.21.15.103:0/3662880654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 msgr2=0x563dd45f46b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45f46b0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8007480 tx=0x7fc2e8007930 comp rx=0 tx=0).stop 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 -- 172.21.15.103:0/3662880654 shutdown_connections 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45f46b0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45f4170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3662880654 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 0x563dd45db8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 -- 172.21.15.103:0/3662880654 >> 172.21.15.103:0/3662880654 conn(0x563dd45cbd20 msgr2=0x563dd45db1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 -- 172.21.15.103:0/3662880654 shutdown_connections 2024-08-02T18:50:06.831 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 -- 172.21.15.103:0/3662880654 wait complete. 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 -- start start 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.825+0000 7fc2fabca740 1 Processor -- start 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 0x563dd45e52c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d6850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2fabca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45d6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2fabca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01aae70 con 0x563dd45dcb80 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2fabca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01ac2e0 con 0x563dd45cff10 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2fabca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fc2f01ab540 con 0x563dd45cf5f0 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2fabca740 10 client.0 _ll_register_callbacks cb 0x7fc2e8007790 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f6411640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45d6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f540f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f540f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:49568/0 (socket says 172.21.15.103:49568) 2024-08-02T18:50:06.832 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f540f640 1 -- 172.21.15.103:0/3137061414 learned_addr learned my addr 172.21.15.103:0/3137061414 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f6411640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45d6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52600/0 (socket says 172.21.15.103:52600) 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f540f640 1 -- 172.21.15.103:0/3137061414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 msgr2=0x563dd45e52c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f540f640 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 0x563dd45e52c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f540f640 1 -- 172.21.15.103:0/3137061414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 msgr2=0x563dd45d6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f540f640 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45d6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f540f640 1 -- 172.21.15.103:0/3137061414 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563dd45d75c0 con 0x563dd45cff10 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.826+0000 7fc2f6411640 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45d6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2f540f640 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d6850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00b8c50 tx=0x7fc2e00bca40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46b60e1399d55b44 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2d97fa640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2d97fa640 1 -- 172.21.15.103:0/3137061414 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc2e0049040 con 0x563dd45cff10 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 1 -- 172.21.15.103:0/3137061414 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc2e8012e50 con 0x563dd45cff10 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2d97fa640 1 -- 172.21.15.103:0/3137061414 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fc2e003b460 con 0x563dd45cff10 2024-08-02T18:50:06.833 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2d97fa640 1 -- 172.21.15.103:0/3137061414 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc2e00bc280 con 0x563dd45cff10 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 10 client.25076 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 1 -- 172.21.15.103:0/3137061414 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563dd46571b0 con 0x563dd45cff10 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2d97fa640 1 -- 172.21.15.103:0/3137061414 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fc2e8012e50 con 0x563dd45cff10 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2d97fa640 1 -- 172.21.15.103:0/3137061414 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fc2e00c4a60 con 0x563dd45cff10 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 10 client.25076 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 10 client.25076 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 20 client.25076 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563dd4657830 0x563dd4659c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 4 client.25076 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2fabca740 1 -- 172.21.15.103:0/3137061414 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563dd453b430 con 0x563dd4657830 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.827+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563dd4657830 0x563dd4659c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.828+0000 7fc2d97fa640 10 client.25076 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:06.834 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.828+0000 7fc2f5c10640 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563dd4657830 0x563dd4659c50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=486170a4c8d00de4 server_cookie=68a02702b24341c9 in_seq=0 out_seq=0 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2d97fa640 1 -- 172.21.15.103:0/3137061414 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563dd453b430 con 0x563dd4657830 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2d97fa640 10 client.25076 handle_command_reply: tid=0 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 client.25076 shutdown 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 -- 172.21.15.103:0/3137061414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 msgr2=0x563dd45d6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d6850 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00b8c50 tx=0x7fc2e00bca40 comp rx=0 tx=0).stop 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 -- 172.21.15.103:0/3137061414 shutdown_connections 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563dd4657830 0x563dd4659c50 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563dd45dcb80 0x563dd45d6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563dd45cff10 0x563dd45d6850 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2d97fa640 0 client.25076 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 --2- 172.21.15.103:0/3137061414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563dd45cf5f0 0x563dd45e52c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.841 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 -- 172.21.15.103:0/3137061414 >> 172.21.15.103:0/3137061414 conn(0x563dd45cbd20 msgr2=0x563dd45cae80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 -- 172.21.15.103:0/3137061414 shutdown_connections 2024-08-02T18:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 1 -- 172.21.15.103:0/3137061414 wait complete. 2024-08-02T18:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.839+0000 7fc2fabca740 20 client.25076 trim_cache size 0 max 16384 2024-08-02T18:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:50:06.842 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 -- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fc2dc0a2ec0 msgr2=0x7fc2dc0a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fc2dc0a2ec0 0x7fc2dc0a5380 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fc2e8007fd0 tx=0x7fc2e8004ab0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 -- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f0101080 msgr2=0x7fc2f0197440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:06.843 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f0101080 0x7fc2f0197440 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7fc2e0009a50 tx=0x7fc2e0004270 comp rx=0 tx=0).stop 2024-08-02T18:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 -- 172.21.15.103:0/3620114883 shutdown_connections 2024-08-02T18:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fc2dc0a2ec0 0x7fc2dc0a5380 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fc2f01066f0 0x7fc2f019b7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fc2f0101080 0x7fc2f0197440 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 --2- 172.21.15.103:0/3620114883 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fc2f01006e0 0x7fc2f0196f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 -- 172.21.15.103:0/3620114883 >> 172.21.15.103:0/3620114883 conn(0x7fc2f00776c0 msgr2=0x7fc2f01031d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 -- 172.21.15.103:0/3620114883 shutdown_connections 2024-08-02T18:50:06.844 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:06.840+0000 7fc2f7e74640 1 -- 172.21.15.103:0/3620114883 wait complete. 2024-08-02T18:50:06.876 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 306, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': True, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': True}, 'ever_allowed_features': 32, 'explicitly_allowed_features': 32, 'created': '2024-08-02T18:47:22.067716+0000', 'modified': '2024-08-02T18:49:42.173778+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 3, 'in': [0, 1, 2], 'up': {'mds_0': 24473, 'mds_1': 24469, 'mds_2': 24454}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_24425': {'gid': 24425, 'name': 'e', 'rank': 2, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6835/1461531566', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6834', 'nonce': 1461531566}, {'type': 'v1', 'addr': '172.21.15.121:6835', 'nonce': 1461531566}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24442': {'gid': 24442, 'name': 'f', 'rank': 1, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.151:6835/126654937', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6834', 'nonce': 126654937}, {'type': 'v1', 'addr': '172.21.15.151:6835', 'nonce': 126654937}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24449': {'gid': 24449, 'name': 'h', 'rank': 0, 'incarnation': 0, 'state': 'up:standby-replay', 'state_seq': 1, 'addr': '172.21.15.121:6837/1633433490', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6836', 'nonce': 1633433490}, {'type': 'v1', 'addr': '172.21.15.121:6837', 'nonce': 1633433490}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24454': {'gid': 24454, 'name': 'c', 'rank': 2, 'incarnation': 22, 'state': 'up:active', 'state_seq': 18, 'addr': '172.21.15.151:6837/1434322363', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6836', 'nonce': 1434322363}, {'type': 'v1', 'addr': '172.21.15.151:6837', 'nonce': 1434322363}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24469': {'gid': 24469, 'name': 'i', 'rank': 1, 'incarnation': 20, 'state': 'up:active', 'state_seq': 16, 'addr': '172.21.15.151:6839/3705298051', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.151:6838', 'nonce': 3705298051}, {'type': 'v1', 'addr': '172.21.15.151:6839', 'nonce': 3705298051}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_24473': {'gid': 24473, 'name': 'b', 'rank': 0, 'incarnation': 14, 'state': 'up:active', 'state_seq': 4, 'addr': '172.21.15.121:6839/3512573309', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.121:6838', 'nonce': 3512573309}, {'type': 'v1', 'addr': '172.21.15.121:6839', 'nonce': 3512573309}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 24473, 'qdb_cluster': [24473, 24469, 24454]} 2024-08-02T18:50:06.877 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 3/3 2024-08-02T18:50:06.877 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.c status 2024-08-02T18:50:07.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:06 smithi121 ceph-mon[37236]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 99 KiB/s wr, 54 op/s 2024-08-02T18:50:07.002 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:06 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2617183168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:07.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:06 smithi121 ceph-mon[37236]: scrub summary: idle 2024-08-02T18:50:07.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:06 smithi151 ceph-mon[37155]: pgmap v14: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 33 KiB/s rd, 99 KiB/s wr, 54 op/s 2024-08-02T18:50:07.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:06 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2617183168' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:07.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:06 smithi151 ceph-mon[37155]: scrub summary: idle 2024-08-02T18:50:07.176 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:07.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 -- 172.21.15.103:0/1964981396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb120102250 msgr2=0x7fb12010e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 --2- 172.21.15.103:0/1964981396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb120102250 0x7fb12010e780 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fb118009cd0 tx=0x7fb11802a8f0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 -- 172.21.15.103:0/1964981396 shutdown_connections 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 --2- 172.21.15.103:0/1964981396 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb120102250 0x7fb12010e780 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 --2- 172.21.15.103:0/1964981396 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb1201018b0 0x7fb120101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 --2- 172.21.15.103:0/1964981396 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1201078b0 0x7fb120107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 -- 172.21.15.103:0/1964981396 >> 172.21.15.103:0/1964981396 conn(0x7fb1200fd5f0 msgr2=0x7fb1200ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 -- 172.21.15.103:0/1964981396 shutdown_connections 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.675+0000 7fb126c63640 1 -- 172.21.15.103:0/1964981396 wait complete. 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb126c63640 1 Processor -- start 2024-08-02T18:50:07.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb126c63640 1 -- start start 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb126c63640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1201018b0 0x7fb120198180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb126c63640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb120102250 0x7fb1201986c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb126c63640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1201078b0 0x7fb12019ca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb126c63640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb120111e20 con 0x7fb1201018b0 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb126c63640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb120111ca0 con 0x7fb1201078b0 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb126c63640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb120111fa0 con 0x7fb120102250 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb1249ff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1201018b0 0x7fb120198180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb1249ff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1201018b0 0x7fb120198180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52610/0 (socket says 172.21.15.103:52610) 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb1249ff640 1 -- 172.21.15.103:0/3312684493 learned_addr learned my addr 172.21.15.103:0/3312684493 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.676+0000 7fb11ffff640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb120102250 0x7fb1201986c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb125200640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1201078b0 0x7fb12019ca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb1249ff640 1 -- 172.21.15.103:0/3312684493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb120102250 msgr2=0x7fb1201986c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb1249ff640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb120102250 0x7fb1201986c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb1249ff640 1 -- 172.21.15.103:0/3312684493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1201078b0 msgr2=0x7fb12019ca50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb1249ff640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1201078b0 0x7fb12019ca50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb1249ff640 1 -- 172.21.15.103:0/3312684493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb12019d130 con 0x7fb1201018b0 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb125200640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1201078b0 0x7fb12019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb1249ff640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1201018b0 0x7fb120198180 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c920 tx=0x7fb11400cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb11dffb640 1 -- 172.21.15.103:0/3312684493 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114007c70 con 0x7fb1201018b0 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb126c63640 1 -- 172.21.15.103:0/3312684493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb12019d420 con 0x7fb1201018b0 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb11dffb640 1 -- 172.21.15.103:0/3312684493 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb114007e10 con 0x7fb1201018b0 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb11dffb640 1 -- 172.21.15.103:0/3312684493 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb114018940 con 0x7fb1201018b0 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.677+0000 7fb126c63640 1 -- 172.21.15.103:0/3312684493 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb1201a4d00 con 0x7fb1201018b0 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.680+0000 7fb11dffb640 1 -- 172.21.15.103:0/3312684493 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7fb114018b20 con 0x7fb1201018b0 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.680+0000 7fb129061740 1 Processor -- start 2024-08-02T18:50:07.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.680+0000 7fb129061740 1 -- start start 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb129061740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564039873630 0x564039873a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb129061740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x56403987e2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb129061740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56403987e810 0x564039880c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb129061740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5640397d8710 con 0x564039873630 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb129061740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564039770770 con 0x56403987e810 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb129061740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5640397d46d0 con 0x564039873f50 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564039873630 0x564039873a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564039873630 0x564039873a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52612/0 (socket says 172.21.15.103:52612) 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 -- 172.21.15.103:0/3308295658 learned_addr learned my addr 172.21.15.103:0/3308295658 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb1249ff640 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x56403987e2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb11ffff640 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56403987e810 0x564039880c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb11dffb640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb1100a2e10 0x7fb1100a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 -- 172.21.15.103:0/3308295658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 msgr2=0x56403987e2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x56403987e2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 -- 172.21.15.103:0/3308295658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56403987e810 msgr2=0x564039880c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56403987e810 0x564039880c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 -- 172.21.15.103:0/3308295658 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5640397773e0 con 0x564039873630 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb1249ff640 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x56403987e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb11dffb640 1 -- 172.21.15.103:0/3312684493 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fb1140cfbb0 con 0x7fb1201018b0 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb1100a2e10 0x7fb1100a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.681+0000 7fb125200640 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564039873630 0x564039873a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb118009df0 tx=0x7fb1180304d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2526fb2dafff8e9 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb10affd640 1 -- 172.21.15.103:0/3308295658 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118003c90 con 0x564039873630 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb10affd640 1 -- 172.21.15.103:0/3308295658 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb118036070 con 0x564039873630 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb10affd640 1 -- 172.21.15.103:0/3308295658 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118047680 con 0x564039873630 2024-08-02T18:50:07.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb129061740 1 -- 172.21.15.103:0/3308295658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564039873630 msgr2=0x564039873a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb125200640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb1100a2e10 0x7fb1100a52d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb11804b000 tx=0x7fb118048000 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb129061740 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564039873630 0x564039873a10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fb118009df0 tx=0x7fb1180304d0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb129061740 1 -- 172.21.15.103:0/3308295658 shutdown_connections 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb129061740 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56403987e810 0x564039880c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb129061740 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x56403987e2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb129061740 1 --2- 172.21.15.103:0/3308295658 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564039873630 0x564039873a10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb129061740 1 -- 172.21.15.103:0/3308295658 >> 172.21.15.103:0/3308295658 conn(0x56403986fbc0 msgr2=0x56403986ffa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.682+0000 7fb129061740 1 -- 172.21.15.103:0/3308295658 shutdown_connections 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 -- 172.21.15.103:0/3308295658 wait complete. 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 -- start start 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 Processor -- start 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873630 0x56403987b6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873f50 0x56403987bc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5640398813e0 con 0x56403987e810 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564039793970 con 0x564039873f50 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564039881560 con 0x564039873630 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb129061740 10 client.0 _ll_register_callbacks cb 0x5640394e77b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb125200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb125200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52618/0 (socket says 172.21.15.103:52618) 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.683+0000 7fb125200640 1 -- 172.21.15.103:0/623376286 learned_addr learned my addr 172.21.15.103:0/623376286 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb1249ff640 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873630 0x56403987b6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb11ffff640 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873f50 0x56403987bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb125200640 1 -- 172.21.15.103:0/623376286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873630 msgr2=0x56403987b6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb125200640 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873630 0x56403987b6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb125200640 1 -- 172.21.15.103:0/623376286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873f50 msgr2=0x56403987bc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb125200640 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873f50 0x56403987bc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb125200640 1 -- 172.21.15.103:0/623376286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56403954a2b0 con 0x56403987e810 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb11ffff640 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873f50 0x56403987bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb125200640 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987c150 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb118004af0 tx=0x7fb11802a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e62fac8eef3c71c server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb0fffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb0fffff640 1 -- 172.21.15.103:0/623376286 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118009800 con 0x56403987e810 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb129061740 1 -- 172.21.15.103:0/623376286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb118036070 con 0x56403987e810 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb0fffff640 1 -- 172.21.15.103:0/623376286 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fb11804d050 con 0x56403987e810 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb0fffff640 1 -- 172.21.15.103:0/623376286 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb118047c30 con 0x56403987e810 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb129061740 10 client.15522 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb129061740 1 -- 172.21.15.103:0/623376286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5640398813e0 con 0x56403987e810 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.684+0000 7fb0fffff640 1 -- 172.21.15.103:0/623376286 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb118036070 con 0x56403987e810 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.685+0000 7fb0fffff640 1 -- 172.21.15.103:0/623376286 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb118051600 con 0x56403987e810 2024-08-02T18:50:07.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.685+0000 7fb129061740 10 client.15522 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.685+0000 7fb129061740 10 client.15522 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.685+0000 7fb129061740 20 client.15522 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.685+0000 7fb129061740 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x56403988f110 0x564039890580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.685+0000 7fb129061740 4 client.15522 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.685+0000 7fb129061740 1 -- 172.21.15.103:0/623376286 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5640397e5c80 con 0x56403988f110 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.686+0000 7fb1249ff640 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x56403988f110 0x564039890580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.686+0000 7fb1249ff640 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x56403988f110 0x564039890580 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=49213d9b2623716a server_cookie=a2f41c83852a3cda in_seq=0 out_seq=0 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.686+0000 7fb0fffff640 10 client.15522 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb0fffff640 1 -- 172.21.15.103:0/623376286 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5640397e5c80 con 0x56403988f110 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb0fffff640 10 client.15522 handle_command_reply: tid=0 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 client.15522 shutdown 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 -- 172.21.15.103:0/623376286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 msgr2=0x56403987c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.702 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987c150 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fb118004af0 tx=0x7fb11802a8f0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 -- 172.21.15.103:0/623376286 shutdown_connections 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x56403988f110 0x564039890580 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987c150 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873f50 0x56403987bc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb0fffff640 0 client.15522 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 --2- 172.21.15.103:0/623376286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873630 0x56403987b6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 -- 172.21.15.103:0/623376286 >> 172.21.15.103:0/623376286 conn(0x56403986fbc0 msgr2=0x5640398758a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 -- 172.21.15.103:0/623376286 shutdown_connections 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 1 -- 172.21.15.103:0/623376286 wait complete. 2024-08-02T18:50:07.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.687+0000 7fb129061740 20 client.15522 trim_cache size 0 max 16384 2024-08-02T18:50:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb129061740 1 Processor -- start 2024-08-02T18:50:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb129061740 1 -- start start 2024-08-02T18:50:07.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb129061740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403988feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb129061740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x564039876090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb129061740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb129061740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56403988e8c0 con 0x56403987e810 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb129061740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56403988ef90 con 0x564039873630 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb129061740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56403988f660 con 0x564039873f50 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb125200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb125200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52626/0 (socket says 172.21.15.103:52626) 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb125200640 1 -- 172.21.15.103:0/1880594302 learned_addr learned my addr 172.21.15.103:0/1880594302 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb1249ff640 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403988feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb11ffff640 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x564039876090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb125200640 1 -- 172.21.15.103:0/1880594302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 msgr2=0x564039876090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:07.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.705+0000 7fb125200640 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x564039876090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.706+0000 7fb125200640 1 -- 172.21.15.103:0/1880594302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 msgr2=0x56403988feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.706+0000 7fb125200640 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403988feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.706+0000 7fb125200640 1 -- 172.21.15.103:0/1880594302 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56403986b130 con 0x56403987e810 2024-08-02T18:50:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.706+0000 7fb1249ff640 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403988feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.706+0000 7fb125200640 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987bfa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb118009a60 tx=0x7fb118030dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=685f36f964a943ed server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.706+0000 7fb10a7fc640 1 -- 172.21.15.103:0/1880594302 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118009800 con 0x56403987e810 2024-08-02T18:50:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.706+0000 7fb10a7fc640 1 -- 172.21.15.103:0/1880594302 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb118036040 con 0x56403987e810 2024-08-02T18:50:07.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.706+0000 7fb10a7fc640 1 -- 172.21.15.103:0/1880594302 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb1180044e0 con 0x56403987e810 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 -- 172.21.15.103:0/1880594302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 msgr2=0x56403987bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987bfa0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fb118009a60 tx=0x7fb118030dd0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 -- 172.21.15.103:0/1880594302 shutdown_connections 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x56403987bfa0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x564039876090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 --2- 172.21.15.103:0/1880594302 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403988feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 -- 172.21.15.103:0/1880594302 >> 172.21.15.103:0/1880594302 conn(0x56403986fbc0 msgr2=0x56403987d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 -- 172.21.15.103:0/1880594302 shutdown_connections 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 -- 172.21.15.103:0/1880594302 wait complete. 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 -- start start 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 Processor -- start 2024-08-02T18:50:07.713 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403987fae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x564039880020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x564039880560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.707+0000 7fb129061740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564039890400 con 0x56403987e810 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb129061740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56403988fd30 con 0x564039873630 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb129061740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564039890ad0 con 0x564039873f50 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb129061740 10 client.0 _ll_register_callbacks cb 0x7fb11804a020 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x564039880560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb11ffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x564039880020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x564039880560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:52642/0 (socket says 172.21.15.103:52642) 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 -- 172.21.15.103:0/363343667 learned_addr learned my addr 172.21.15.103:0/363343667 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb1249ff640 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403987fae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.714 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 -- 172.21.15.103:0/363343667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 msgr2=0x564039880020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x564039880020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 -- 172.21.15.103:0/363343667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 msgr2=0x56403987fae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403987fae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 -- 172.21.15.103:0/363343667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564039894f30 con 0x56403987e810 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb1249ff640 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403987fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb125200640 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x564039880560 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb118055010 tx=0x7fb1180011c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85ae2573c183428d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb0fffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb0fffff640 1 -- 172.21.15.103:0/363343667 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb118070030 con 0x56403987e810 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb129061740 1 -- 172.21.15.103:0/363343667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb118036040 con 0x56403987e810 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb0fffff640 1 -- 172.21.15.103:0/363343667 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fb118057050 con 0x56403987e810 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.708+0000 7fb0fffff640 1 -- 172.21.15.103:0/363343667 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb11807d050 con 0x56403987e810 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb129061740 10 client.15528 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:07.715 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb129061740 1 -- 172.21.15.103:0/363343667 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5640398f9ba0 con 0x56403987e810 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb0fffff640 1 -- 172.21.15.103:0/363343667 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb118036040 con 0x56403987e810 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb0fffff640 1 -- 172.21.15.103:0/363343667 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fb11805b540 con 0x56403987e810 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb129061740 10 client.15528 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb129061740 10 client.15528 resolve_mds: resolved name 'c' to daemon mds.c 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb129061740 20 client.15528 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb129061740 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x56403988f110 0x5640398fd0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb129061740 4 client.15528 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb129061740 1 -- 172.21.15.103:0/363343667 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "status"}) -- 0x5640397e0190 con 0x56403988f110 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.709+0000 7fb1249ff640 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x56403988f110 0x5640398fd0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb0fffff640 10 client.15528 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb1249ff640 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x56403988f110 0x5640398fd0d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=4bef95048c83b54a server_cookie=9414a34a5d88b679 in_seq=0 out_seq=0 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb0fffff640 1 -- 172.21.15.103:0/363343667 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x5640397e0190 con 0x56403988f110 2024-08-02T18:50:07.716 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb0fffff640 10 client.15528 handle_command_reply: tid=0 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 client.15528 shutdown 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 -- 172.21.15.103:0/363343667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 msgr2=0x564039880560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x564039880560 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fb118055010 tx=0x7fb1180011c0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 -- 172.21.15.103:0/363343667 shutdown_connections 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x56403988f110 0x5640398fd0d0 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56403987e810 0x564039880560 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564039873f50 0x564039880020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 --2- 172.21.15.103:0/363343667 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564039873630 0x56403987fae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 -- 172.21.15.103:0/363343667 >> 172.21.15.103:0/363343667 conn(0x56403986fbc0 msgr2=0x5640398897b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb0fffff640 0 client.15528 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 -- 172.21.15.103:0/363343667 shutdown_connections 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 1 -- 172.21.15.103:0/363343667 wait complete. 2024-08-02T18:50:07.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.710+0000 7fb129061740 20 client.15528 trim_cache size 0 max 16384 2024-08-02T18:50:07.718 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:07.718 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:50:07.718 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 2, 2024-08-02T18:50:07.718 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24454, 2024-08-02T18:50:07.718 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:50:07.718 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:50:07.718 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:50:07.718 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 125.268568047, 2024-08-02T18:50:07.719 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 26, 2024-08-02T18:50:07.719 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 90, 2024-08-02T18:50:07.719 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 89, 2024-08-02T18:50:07.719 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 191.36902213600001 2024-08-02T18:50:07.719 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:07.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 -- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb1100a2e10 msgr2=0x7fb1100a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb1100a2e10 0x7fb1100a52d0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fb11804b000 tx=0x7fb118048000 comp rx=0 tx=0).stop 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 -- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1201018b0 msgr2=0x7fb120198180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1201018b0 0x7fb120198180 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fb11400c920 tx=0x7fb11400cde0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 -- 172.21.15.103:0/3312684493 shutdown_connections 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb1100a2e10 0x7fb1100a52d0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb1201078b0 0x7fb12019ca50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb120102250 0x7fb1201986c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 --2- 172.21.15.103:0/3312684493 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb1201018b0 0x7fb120198180 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 -- 172.21.15.103:0/3312684493 >> 172.21.15.103:0/3312684493 conn(0x7fb1200fd5f0 msgr2=0x7fb1200fdb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 -- 172.21.15.103:0/3312684493 shutdown_connections 2024-08-02T18:50:07.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:07.711+0000 7fb126c63640 1 -- 172.21.15.103:0/3312684493 wait complete. 2024-08-02T18:50:08.419 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.i status 2024-08-02T18:50:08.677 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:08.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:08 smithi103 ceph-mon[32753]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-02T18:50:09.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:08 smithi121 ceph-mon[37236]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-02T18:50:09.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:08 smithi151 ceph-mon[37155]: pgmap v15: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 -- 172.21.15.103:0/3801664851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c1022a0 msgr2=0x7f653c1026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 --2- 172.21.15.103:0/3801664851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c1022a0 0x7f653c1026e0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f6530009900 tx=0x7f653002a480 comp rx=0 tx=0).stop 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 -- 172.21.15.103:0/3801664851 shutdown_connections 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 --2- 172.21.15.103:0/3801664851 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f653c102c20 0x7f653c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 --2- 172.21.15.103:0/3801664851 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c1022a0 0x7f653c1026e0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 --2- 172.21.15.103:0/3801664851 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c100b50 0x7f653c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 -- 172.21.15.103:0/3801664851 >> 172.21.15.103:0/3801664851 conn(0x7f653c0fc500 msgr2=0x7f653c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 -- 172.21.15.103:0/3801664851 shutdown_connections 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.186+0000 7f6540f51640 1 -- 172.21.15.103:0/3801664851 wait complete. 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.187+0000 7f6540f51640 1 Processor -- start 2024-08-02T18:50:09.198 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.187+0000 7f6540f51640 1 -- start start 2024-08-02T18:50:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f6540f51640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c100b50 0x7f653c198370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f6540f51640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f653c1022a0 0x7f653c1988b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f6540f51640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c102c20 0x7f653c19cc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f6540f51640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f653c110dd0 con 0x7f653c100b50 2024-08-02T18:50:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f6540f51640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f653c110c50 con 0x7f653c1022a0 2024-08-02T18:50:09.199 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f6540f51640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f653c110f50 con 0x7f653c102c20 2024-08-02T18:50:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c100b50 0x7f653c198370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c100b50 0x7f653c198370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59714/0 (socket says 172.21.15.103:59714) 2024-08-02T18:50:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 -- 172.21.15.103:0/1365615383 learned_addr learned my addr 172.21.15.103:0/1365615383 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f6539d9b640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f653c1022a0 0x7f653c1988b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653ad9d640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c102c20 0x7f653c19cc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 -- 172.21.15.103:0/1365615383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c102c20 msgr2=0x7f653c19cc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.200 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c102c20 0x7f653c19cc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 -- 172.21.15.103:0/1365615383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f653c1022a0 msgr2=0x7f653c1988b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f653c1022a0 0x7f653c1988b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 -- 172.21.15.103:0/1365615383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f653c19d320 con 0x7f653c100b50 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f653a59c640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c100b50 0x7f653c198370 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f652c00e9f0 tx=0x7f652c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.188+0000 7f652b7fe640 1 -- 172.21.15.103:0/1365615383 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c00cd80 con 0x7f653c100b50 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.189+0000 7f6540f51640 1 -- 172.21.15.103:0/1365615383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f653c19d610 con 0x7f653c100b50 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.189+0000 7f652b7fe640 1 -- 172.21.15.103:0/1365615383 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f652c005520 con 0x7f653c100b50 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.189+0000 7f652b7fe640 1 -- 172.21.15.103:0/1365615383 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c010690 con 0x7f653c100b50 2024-08-02T18:50:09.201 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.189+0000 7f6540f51640 1 -- 172.21.15.103:0/1365615383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f653c1a4ef0 con 0x7f653c100b50 2024-08-02T18:50:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.191+0000 7f652b7fe640 1 -- 172.21.15.103:0/1365615383 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f652c0046c0 con 0x7f653c100b50 2024-08-02T18:50:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.191+0000 7f654334f740 1 Processor -- start 2024-08-02T18:50:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f654334f740 1 -- start start 2024-08-02T18:50:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f654334f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67f5630 0x55bed67f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f654334f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed68002d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f654334f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed6802c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f654334f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bed675a710 con 0x55bed67f5f50 2024-08-02T18:50:09.202 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f654334f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bed66f2770 con 0x55bed6800810 2024-08-02T18:50:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f654334f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bed67566d0 con 0x55bed67f5630 2024-08-02T18:50:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed68002d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed68002d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59718/0 (socket says 172.21.15.103:59718) 2024-08-02T18:50:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653a59c640 1 -- 172.21.15.103:0/4169585007 learned_addr learned my addr 172.21.15.103:0/4169585007 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653ad9d640 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67f5630 0x55bed67f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f6539d9b640 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed6802c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.203 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653a59c640 1 -- 172.21.15.103:0/4169585007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67f5630 msgr2=0x55bed67f5a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f652b7fe640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f65240a2e10 0x7f65240a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653a59c640 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67f5630 0x55bed67f5a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653a59c640 1 -- 172.21.15.103:0/4169585007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 msgr2=0x55bed6802c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653a59c640 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed6802c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.192+0000 7f653a59c640 1 -- 172.21.15.103:0/4169585007 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed66f93e0 con 0x55bed67f5f50 2024-08-02T18:50:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.193+0000 7f653ad9d640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f65240a2e10 0x7f65240a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.193+0000 7f653a59c640 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed68002d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f652c0cd200 tx=0x7f652c097ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8bd40831eb7e4f6d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:09.204 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.193+0000 7f652b7fe640 1 -- 172.21.15.103:0/1365615383 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f652c0cfe60 con 0x7f653c100b50 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.193+0000 7f6528ff9640 1 -- 172.21.15.103:0/4169585007 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c09b930 con 0x55bed67f5f50 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.193+0000 7f6528ff9640 1 -- 172.21.15.103:0/4169585007 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f652c09c4f0 con 0x55bed67f5f50 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.193+0000 7f6528ff9640 1 -- 172.21.15.103:0/4169585007 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c09b750 con 0x55bed67f5f50 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 -- 172.21.15.103:0/4169585007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 msgr2=0x55bed68002d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f653ad9d640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f65240a2e10 0x7f65240a52d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6534005c40 tx=0x7f6534004a40 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed68002d0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f652c0cd200 tx=0x7f652c097ec0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 -- 172.21.15.103:0/4169585007 shutdown_connections 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed6802c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.205 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed68002d0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 --2- 172.21.15.103:0/4169585007 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67f5630 0x55bed67f5a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 -- 172.21.15.103:0/4169585007 >> 172.21.15.103:0/4169585007 conn(0x55bed67f1bc0 msgr2=0x55bed67f1fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 -- 172.21.15.103:0/4169585007 shutdown_connections 2024-08-02T18:50:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 -- 172.21.15.103:0/4169585007 wait complete. 2024-08-02T18:50:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.194+0000 7f654334f740 1 -- start start 2024-08-02T18:50:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f654334f740 1 Processor -- start 2024-08-02T18:50:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f654334f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5630 0x55bed67fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.206 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f654334f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 0x55bed67fdc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f654334f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed6800810 0x55bed67fe170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f654334f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bed68033e0 con 0x55bed67f5630 2024-08-02T18:50:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f654334f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bed6715970 con 0x55bed67f5f50 2024-08-02T18:50:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f654334f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bed6803560 con 0x55bed6800810 2024-08-02T18:50:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f654334f740 10 client.0 _ll_register_callbacks cb 0x55bed64697b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5630 0x55bed67fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5630 0x55bed67fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59732/0 (socket says 172.21.15.103:59732) 2024-08-02T18:50:09.207 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653a59c640 1 -- 172.21.15.103:0/1312957732 learned_addr learned my addr 172.21.15.103:0/1312957732 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f6539d9b640 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 0x55bed67fdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653ad9d640 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed6800810 0x55bed67fe170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653a59c640 1 -- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed6800810 msgr2=0x55bed67fe170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653a59c640 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed6800810 0x55bed67fe170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653a59c640 1 -- 172.21.15.103:0/1312957732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 msgr2=0x55bed67fdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653a59c640 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 0x55bed67fdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653a59c640 1 -- 172.21.15.103:0/1312957732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed64cc2b0 con 0x55bed67f5630 2024-08-02T18:50:09.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.195+0000 7f653ad9d640 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed6800810 0x55bed67fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f653a59c640 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5630 0x55bed67fd6f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f652c0cd200 tx=0x7f652c004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20723059cfc06af3 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f6521ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f6521ffb640 1 -- 172.21.15.103:0/1312957732 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c0b0060 con 0x55bed67f5630 2024-08-02T18:50:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 1 -- 172.21.15.103:0/1312957732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f652c09c4f0 con 0x55bed67f5630 2024-08-02T18:50:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f6521ffb640 1 -- 172.21.15.103:0/1312957732 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f652c09c050 con 0x55bed67f5630 2024-08-02T18:50:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f6521ffb640 1 -- 172.21.15.103:0/1312957732 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f652c09b750 con 0x55bed67f5630 2024-08-02T18:50:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 10 client.15540 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:09.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 1 -- 172.21.15.103:0/1312957732 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bed680efe0 con 0x55bed67f5630 2024-08-02T18:50:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f6521ffb640 1 -- 172.21.15.103:0/1312957732 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f652c09c4f0 con 0x55bed67f5630 2024-08-02T18:50:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f6521ffb640 1 -- 172.21.15.103:0/1312957732 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f652c0a45d0 con 0x55bed67f5630 2024-08-02T18:50:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 10 client.15540 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 10 client.15540 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-02T18:50:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 20 client.15540 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55bed68110f0 0x55bed6812560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 4 client.15540 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:09.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.196+0000 7f654334f740 1 -- 172.21.15.103:0/1312957732 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bed6767c80 con 0x55bed68110f0 2024-08-02T18:50:09.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.197+0000 7f6539d9b640 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55bed68110f0 0x55bed6812560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.197+0000 7f6521ffb640 10 client.15540 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:50:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.197+0000 7f6539d9b640 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55bed68110f0 0x55bed6812560 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=838af814a32085e6 server_cookie=5e86ad753db2ac06 in_seq=0 out_seq=0 2024-08-02T18:50:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f6521ffb640 1 -- 172.21.15.103:0/1312957732 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bed6767c80 con 0x55bed68110f0 2024-08-02T18:50:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f6521ffb640 10 client.15540 handle_command_reply: tid=0 2024-08-02T18:50:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 client.15540 shutdown 2024-08-02T18:50:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 -- 172.21.15.103:0/1312957732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5630 msgr2=0x55bed67fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5630 0x55bed67fd6f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f652c0cd200 tx=0x7f652c004c10 comp rx=0 tx=0).stop 2024-08-02T18:50:09.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 -- 172.21.15.103:0/1312957732 shutdown_connections 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed6800810 0x55bed67fe170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55bed68110f0 0x55bed6812560 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 0x55bed67fdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 --2- 172.21.15.103:0/1312957732 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5630 0x55bed67fd6f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f6521ffb640 0 client.15540 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 -- 172.21.15.103:0/1312957732 >> 172.21.15.103:0/1312957732 conn(0x55bed67f1bc0 msgr2=0x55bed67f78a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 -- 172.21.15.103:0/1312957732 shutdown_connections 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 1 -- 172.21.15.103:0/1312957732 wait complete. 2024-08-02T18:50:09.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.198+0000 7f654334f740 20 client.15540 trim_cache size 0 max 16384 2024-08-02T18:50:09.225 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f654334f740 1 Processor -- start 2024-08-02T18:50:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f654334f740 1 -- start start 2024-08-02T18:50:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f654334f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed6811e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f654334f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed67f8050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f654334f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed67fa950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f654334f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bed68108a0 con 0x55bed67f5f50 2024-08-02T18:50:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f654334f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bed6810f70 con 0x55bed6800810 2024-08-02T18:50:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f654334f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bed6811640 con 0x55bed67fdf90 2024-08-02T18:50:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f653a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed6811e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f653a59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed6811e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59734/0 (socket says 172.21.15.103:59734) 2024-08-02T18:50:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.216+0000 7f653a59c640 1 -- 172.21.15.103:0/3264140418 learned_addr learned my addr 172.21.15.103:0/3264140418 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f653ad9d640 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed67fa950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.227 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f6539d9b640 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed67f8050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f653a59c640 1 -- 172.21.15.103:0/3264140418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 msgr2=0x55bed67fa950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f653a59c640 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed67fa950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f653a59c640 1 -- 172.21.15.103:0/3264140418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 msgr2=0x55bed67f8050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:09.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f653a59c640 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed67f8050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f653a59c640 1 -- 172.21.15.103:0/3264140418 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bed67ed130 con 0x55bed67f5f50 2024-08-02T18:50:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f6539d9b640 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed67f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f653a59c640 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed6811e90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f652c0cd870 tx=0x7f652c005ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fa6f9963808676 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f6523fff640 1 -- 172.21.15.103:0/3264140418 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c0d7070 con 0x55bed67f5f50 2024-08-02T18:50:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f6523fff640 1 -- 172.21.15.103:0/3264140418 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f652c0cd030 con 0x55bed67f5f50 2024-08-02T18:50:09.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.217+0000 7f6523fff640 1 -- 172.21.15.103:0/3264140418 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f652c09b930 con 0x55bed67f5f50 2024-08-02T18:50:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 -- 172.21.15.103:0/3264140418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 msgr2=0x55bed6811e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed6811e90 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f652c0cd870 tx=0x7f652c005ab0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 -- 172.21.15.103:0/3264140418 shutdown_connections 2024-08-02T18:50:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed67fa950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.230 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed6800810 0x55bed67f8050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 --2- 172.21.15.103:0/3264140418 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed67f5f50 0x55bed6811e90 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 -- 172.21.15.103:0/3264140418 >> 172.21.15.103:0/3264140418 conn(0x55bed67f1bc0 msgr2=0x55bed67fc7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 -- 172.21.15.103:0/3264140418 shutdown_connections 2024-08-02T18:50:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 -- 172.21.15.103:0/3264140418 wait complete. 2024-08-02T18:50:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 -- start start 2024-08-02T18:50:09.231 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.218+0000 7f654334f740 1 Processor -- start 2024-08-02T18:50:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f654334f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 0x55bed6814880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f654334f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed6814dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f654334f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed6800810 0x55bed6819070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f654334f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bed68123e0 con 0x55bed6800810 2024-08-02T18:50:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f654334f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bed6811d10 con 0x55bed67f5f50 2024-08-02T18:50:09.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f654334f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bed6812ab0 con 0x55bed67fdf90 2024-08-02T18:50:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f654334f740 10 client.0 _ll_register_callbacks cb 0x7f652c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed6800810 0x55bed6819070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed6800810 0x55bed6819070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59736/0 (socket says 172.21.15.103:59736) 2024-08-02T18:50:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 -- 172.21.15.103:0/349661170 learned_addr learned my addr 172.21.15.103:0/349661170 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653a59c640 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 0x55bed6814880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f6539d9b640 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed6814dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 -- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 msgr2=0x55bed6814dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed6814dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 -- 172.21.15.103:0/349661170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 msgr2=0x55bed6814880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 0x55bed6814880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 -- 172.21.15.103:0/349661170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bed6815650 con 0x55bed6800810 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f6539d9b640 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed6814dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f653ad9d640 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed6800810 0x55bed6819070 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f653400fc50 tx=0x7f6534017000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=293d4c5549c83d2b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f6521ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f6521ffb640 1 -- 172.21.15.103:0/349661170 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f653401bb90 con 0x55bed6800810 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f6521ffb640 1 -- 172.21.15.103:0/349661170 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f653401bd30 con 0x55bed6800810 2024-08-02T18:50:09.234 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.219+0000 7f654334f740 1 -- 172.21.15.103:0/349661170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f652c0cd030 con 0x55bed6800810 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f6521ffb640 1 -- 172.21.15.103:0/349661170 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6534003970 con 0x55bed6800810 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f654334f740 10 client.15546 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f654334f740 1 -- 172.21.15.103:0/349661170 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bed687bdd0 con 0x55bed6800810 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f6521ffb640 1 -- 172.21.15.103:0/349661170 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f652c0cd030 con 0x55bed6800810 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f6521ffb640 1 -- 172.21.15.103:0/349661170 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6534028070 con 0x55bed6800810 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f654334f740 10 client.15546 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f654334f740 10 client.15546 resolve_mds: resolved name 'i' to daemon mds.i 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f654334f740 20 client.15546 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f654334f740 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55bed6880a30 0x55bed687f740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f654334f740 4 client.15546 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.220+0000 7f654334f740 1 -- 172.21.15.103:0/349661170 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "status"}) -- 0x55bed6762190 con 0x55bed6880a30 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f653a59c640 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55bed6880a30 0x55bed687f740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f6521ffb640 10 client.15546 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:50:09.235 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f653a59c640 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55bed6880a30 0x55bed687f740 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=3f3221ce6bcb3550 server_cookie=348e7a9599eaa8ec in_seq=0 out_seq=0 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f6521ffb640 1 -- 172.21.15.103:0/349661170 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+327 (crc 0 0 0) 0x55bed6762190 con 0x55bed6880a30 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f6521ffb640 10 client.15546 handle_command_reply: tid=0 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 client.15546 shutdown 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 -- 172.21.15.103:0/349661170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed6800810 msgr2=0x55bed6819070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed6800810 0x55bed6819070 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f653400fc50 tx=0x7f6534017000 comp rx=0 tx=0).stop 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 -- 172.21.15.103:0/349661170 shutdown_connections 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bed6800810 0x55bed6819070 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bed67fdf90 0x55bed6814dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55bed6880a30 0x55bed687f740 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 --2- 172.21.15.103:0/349661170 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bed67f5f50 0x55bed6814880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f6521ffb640 0 client.15546 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:50:09.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.221+0000 7f654334f740 1 -- 172.21.15.103:0/349661170 >> 172.21.15.103:0/349661170 conn(0x55bed67f1bc0 msgr2=0x55bed67f0520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:09.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f654334f740 1 -- 172.21.15.103:0/349661170 shutdown_connections 2024-08-02T18:50:09.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f654334f740 1 -- 172.21.15.103:0/349661170 wait complete. 2024-08-02T18:50:09.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f654334f740 20 client.15546 trim_cache size 0 max 16384 2024-08-02T18:50:09.237 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:09.237 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 1, 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24469, 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 127.785869905, 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 26, 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 90, 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 89, 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 187.46725588199999 2024-08-02T18:50:09.238 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:09.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 -- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f65240a2e10 msgr2=0x7f65240a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f65240a2e10 0x7f65240a52d0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6534005c40 tx=0x7f6534004a40 comp rx=0 tx=0).stop 2024-08-02T18:50:09.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 -- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c100b50 msgr2=0x7f653c198370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:09.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c100b50 0x7f653c198370 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f652c00e9f0 tx=0x7f652c00edf0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.239 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 -- 172.21.15.103:0/1365615383 shutdown_connections 2024-08-02T18:50:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f65240a2e10 0x7f65240a52d0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f653c102c20 0x7f653c19cc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f653c1022a0 0x7f653c1988b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 --2- 172.21.15.103:0/1365615383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f653c100b50 0x7f653c198370 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 -- 172.21.15.103:0/1365615383 >> 172.21.15.103:0/1365615383 conn(0x7f653c0fc500 msgr2=0x7f653c069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.222+0000 7f6540f51640 1 -- 172.21.15.103:0/1365615383 shutdown_connections 2024-08-02T18:50:09.240 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:09.223+0000 7f6540f51640 1 -- 172.21.15.103:0/1365615383 wait complete. 2024-08-02T18:50:10.040 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.b status 2024-08-02T18:50:10.308 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:10.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:10 smithi103 ceph-mon[32753]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-02T18:50:10.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 -- 172.21.15.103:0/3505105565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c100b50 msgr2=0x7f634c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 --2- 172.21.15.103:0/3505105565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c100b50 0x7f634c100f30 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f6348009900 tx=0x7f634802a480 comp rx=0 tx=0).stop 2024-08-02T18:50:10.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 -- 172.21.15.103:0/3505105565 shutdown_connections 2024-08-02T18:50:10.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 --2- 172.21.15.103:0/3505105565 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634c102c20 0x7f634c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 --2- 172.21.15.103:0/3505105565 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f634c1022a0 0x7f634c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 --2- 172.21.15.103:0/3505105565 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c100b50 0x7f634c100f30 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 -- 172.21.15.103:0/3505105565 >> 172.21.15.103:0/3505105565 conn(0x7f634c0fc500 msgr2=0x7f634c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 -- 172.21.15.103:0/3505105565 shutdown_connections 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.808+0000 7f6353e93640 1 -- 172.21.15.103:0/3505105565 wait complete. 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6353e93640 1 Processor -- start 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6353e93640 1 -- start start 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6353e93640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f634c100b50 0x7f634c198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6353e93640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634c1022a0 0x7f634c1987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6353e93640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c102c20 0x7f634c19cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6353e93640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f634c110e10 con 0x7f634c102c20 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6353e93640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f634c110c90 con 0x7f634c100b50 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6353e93640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f634c110f90 con 0x7f634c1022a0 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6352430640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c102c20 0x7f634c19cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6352430640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c102c20 0x7f634c19cb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59758/0 (socket says 172.21.15.103:59758) 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6352430640 1 -- 172.21.15.103:0/3675551354 learned_addr learned my addr 172.21.15.103:0/3675551354 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6351c2f640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f634c100b50 0x7f634c198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f635142e640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634c1022a0 0x7f634c1987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6352430640 1 -- 172.21.15.103:0/3675551354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634c1022a0 msgr2=0x7f634c1987c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6352430640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634c1022a0 0x7f634c1987c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6352430640 1 -- 172.21.15.103:0/3675551354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f634c100b50 msgr2=0x7f634c198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6352430640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f634c100b50 0x7f634c198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.809+0000 7f6352430640 1 -- 172.21.15.103:0/3675551354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f634c19d230 con 0x7f634c102c20 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.810+0000 7f6352430640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c102c20 0x7f634c19cb50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f634400b970 tx=0x7f634400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.810+0000 7f6342ffd640 1 -- 172.21.15.103:0/3675551354 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344019070 con 0x7f634c102c20 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.810+0000 7f6342ffd640 1 -- 172.21.15.103:0/3675551354 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f634400cb40 con 0x7f634c102c20 2024-08-02T18:50:10.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.810+0000 7f6353e93640 1 -- 172.21.15.103:0/3675551354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f634c19d520 con 0x7f634c102c20 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.810+0000 7f6342ffd640 1 -- 172.21.15.103:0/3675551354 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6344007700 con 0x7f634c102c20 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.810+0000 7f6353e93640 1 -- 172.21.15.103:0/3675551354 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f634c1a4e00 con 0x7f634c102c20 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.812+0000 7f6342ffd640 1 -- 172.21.15.103:0/3675551354 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f634401c070 con 0x7f634c102c20 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6356291740 1 Processor -- start 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6356291740 1 -- start start 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6342ffd640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f63380a2e10 0x7f63380a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6356291740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6356291740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 0x55bbe09d22d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6356291740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d4c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6356291740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bbe092c710 con 0x55bbe09d2810 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6356291740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bbe08c4770 con 0x55bbe09c7630 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6356291740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09286d0 con 0x55bbe09c7f50 2024-08-02T18:50:10.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6342ffd640 1 -- 172.21.15.103:0/3675551354 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f63440cef80 con 0x7f634c102c20 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f635142e640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f63380a2e10 0x7f63380a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6352430640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d4c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6352430640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d4c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59766/0 (socket says 172.21.15.103:59766) 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f6352430640 1 -- 172.21.15.103:0/2073421920 learned_addr learned my addr 172.21.15.103:0/2073421920 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.813+0000 7f635142e640 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 0x55bbe09d22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6351c2f640 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f635142e640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f63380a2e10 0x7f63380a52d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f634c104eb0 tx=0x7f633c0127c0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6352430640 1 -- 172.21.15.103:0/2073421920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 msgr2=0x55bbe09d22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6352430640 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 0x55bbe09d22d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6352430640 1 -- 172.21.15.103:0/2073421920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 msgr2=0x55bbe09c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6352430640 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6352430640 1 -- 172.21.15.103:0/2073421920 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe08cb3e0 con 0x55bbe09d2810 2024-08-02T18:50:10.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6352430640 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d4c00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f634409afb0 tx=0x7f634409aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6eaf62d0be44fb8c server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6337fff640 1 -- 172.21.15.103:0/2073421920 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440a3c90 con 0x55bbe09d2810 2024-08-02T18:50:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6337fff640 1 -- 172.21.15.103:0/2073421920 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63440bb070 con 0x55bbe09d2810 2024-08-02T18:50:10.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.814+0000 7f6337fff640 1 -- 172.21.15.103:0/2073421920 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440a3800 con 0x55bbe09d2810 2024-08-02T18:50:10.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 -- 172.21.15.103:0/2073421920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 msgr2=0x55bbe09d4c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d4c00 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7f634409afb0 tx=0x7f634409aa40 comp rx=0 tx=0).stop 2024-08-02T18:50:10.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 -- 172.21.15.103:0/2073421920 shutdown_connections 2024-08-02T18:50:10.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d4c00 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 0x55bbe09d22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 --2- 172.21.15.103:0/2073421920 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 -- 172.21.15.103:0/2073421920 >> 172.21.15.103:0/2073421920 conn(0x55bbe09c3bc0 msgr2=0x55bbe09c3fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 -- 172.21.15.103:0/2073421920 shutdown_connections 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.815+0000 7f6356291740 1 -- 172.21.15.103:0/2073421920 wait complete. 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 1 -- start start 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 1 Processor -- start 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09cf700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 0x55bbe09cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d0180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09d53e0 con 0x55bbe09d2810 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bbe08e7970 con 0x55bbe09c7f50 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09d5560 con 0x55bbe09c7630 2024-08-02T18:50:10.825 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6356291740 10 client.0 _ll_register_callbacks cb 0x55bbe063b7b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6352430640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6352430640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59768/0 (socket says 172.21.15.103:59768) 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.816+0000 7f6352430640 1 -- 172.21.15.103:0/851764536 learned_addr learned my addr 172.21.15.103:0/851764536 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f635142e640 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 0x55bbe09cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6351c2f640 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09cf700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6352430640 1 -- 172.21.15.103:0/851764536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 msgr2=0x55bbe09cf700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6352430640 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09cf700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6352430640 1 -- 172.21.15.103:0/851764536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 msgr2=0x55bbe09cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6352430640 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 0x55bbe09cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6352430640 1 -- 172.21.15.103:0/851764536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe069e2b0 con 0x55bbe09d2810 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6352430640 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d0180 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f63440cc990 tx=0x7f63440bb220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=105b2ddde2d42e9a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f63357fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:10.826 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f63357fa640 1 -- 172.21.15.103:0/851764536 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440b4020 con 0x55bbe09d2810 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f63357fa640 1 -- 172.21.15.103:0/851764536 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f63440a3800 con 0x55bbe09d2810 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6356291740 1 -- 172.21.15.103:0/851764536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f63440bb070 con 0x55bbe09d2810 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f63357fa640 1 -- 172.21.15.103:0/851764536 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f63440a3c90 con 0x55bbe09d2810 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6356291740 10 client.15558 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f6356291740 1 -- 172.21.15.103:0/851764536 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bbe09e5400 con 0x55bbe09d2810 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.817+0000 7f63357fa640 1 -- 172.21.15.103:0/851764536 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f63440bb070 con 0x55bbe09d2810 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f63357fa640 1 -- 172.21.15.103:0/851764536 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6344095b90 con 0x55bbe09d2810 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f6356291740 10 client.15558 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f6356291740 10 client.15558 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f6356291740 20 client.15558 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f6356291740 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55bbe09e6750 0x55bbe09e8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f6356291740 4 client.15558 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:10.827 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f6356291740 1 -- 172.21.15.103:0/851764536 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55bbe0939c80 con 0x55bbe09e6750 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f6351c2f640 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55bbe09e6750 0x55bbe09e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f63357fa640 10 client.15558 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.818+0000 7f6351c2f640 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55bbe09e6750 0x55bbe09e8910 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b1e4ca877fc8a555 server_cookie=1d99aec0b2d9a6ce in_seq=0 out_seq=0 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f63357fa640 1 -- 172.21.15.103:0/851764536 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55bbe0939c80 con 0x55bbe09e6750 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f63357fa640 10 client.15558 handle_command_reply: tid=0 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 client.15558 shutdown 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 -- 172.21.15.103:0/851764536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 msgr2=0x55bbe09d0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d0180 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f63440cc990 tx=0x7f63440bb220 comp rx=0 tx=0).stop 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 -- 172.21.15.103:0/851764536 shutdown_connections 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55bbe09e6750 0x55bbe09e8910 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09d0180 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 0x55bbe09cfc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.828 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 --2- 172.21.15.103:0/851764536 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09cf700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f63357fa640 0 client.15558 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:10.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 -- 172.21.15.103:0/851764536 >> 172.21.15.103:0/851764536 conn(0x55bbe09c3bc0 msgr2=0x55bbe09c2d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:10.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.819+0000 7f6356291740 1 -- 172.21.15.103:0/851764536 shutdown_connections 2024-08-02T18:50:10.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.820+0000 7f6356291740 1 -- 172.21.15.103:0/851764536 wait complete. 2024-08-02T18:50:10.829 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.820+0000 7f6356291740 20 client.15558 trim_cache size 0 max 16384 2024-08-02T18:50:10.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.837+0000 7f6356291740 1 Processor -- start 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.837+0000 7f6356291740 1 -- start start 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.837+0000 7f6356291740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09e8910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.837+0000 7f6356291740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 0x55bbe09d1560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.837+0000 7f6356291740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09cffd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.837+0000 7f6356291740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09e6c50 con 0x55bbe09d2810 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.837+0000 7f6356291740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09e7320 con 0x55bbe09c7630 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.837+0000 7f6356291740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09e79f0 con 0x55bbe09c7f50 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09e8910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09e8910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:44460/0 (socket says 172.21.15.103:44460) 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 -- 172.21.15.103:0/2319515278 learned_addr learned my addr 172.21.15.103:0/2319515278 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6352430640 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09cffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f635142e640 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 0x55bbe09d1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 -- 172.21.15.103:0/2319515278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 msgr2=0x55bbe09d1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 0x55bbe09d1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 -- 172.21.15.103:0/2319515278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 msgr2=0x55bbe09cffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09cffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 -- 172.21.15.103:0/2319515278 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55bbe09ce6b0 con 0x55bbe09c7630 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6352430640 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f6351c2f640 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09e8910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f634802a9a0 tx=0x7f63480319d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=77719b1029320709 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.838+0000 7f63377fe640 1 -- 172.21.15.103:0/2319515278 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f634804d020 con 0x55bbe09c7630 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f63377fe640 1 -- 172.21.15.103:0/2319515278 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6348004ca0 con 0x55bbe09c7630 2024-08-02T18:50:10.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f63377fe640 1 -- 172.21.15.103:0/2319515278 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6348035040 con 0x55bbe09c7630 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 -- 172.21.15.103:0/2319515278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 msgr2=0x55bbe09e8910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09e8910 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f634802a9a0 tx=0x7f63480319d0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 -- 172.21.15.103:0/2319515278 shutdown_connections 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09cffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7f50 0x55bbe09d1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 --2- 172.21.15.103:0/2319515278 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7630 0x55bbe09e8910 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 -- 172.21.15.103:0/2319515278 >> 172.21.15.103:0/2319515278 conn(0x55bbe09c3bc0 msgr2=0x55bbe09d0e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 -- 172.21.15.103:0/2319515278 shutdown_connections 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.839+0000 7f6356291740 1 -- 172.21.15.103:0/2319515278 wait complete. 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 1 -- start start 2024-08-02T18:50:10.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 1 Processor -- start 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09ea8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 0x55bbe09eae20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09eb360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09e8790 con 0x55bbe09d2810 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09e80c0 con 0x55bbe09c7f50 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55bbe09e8e60 con 0x55bbe09c7630 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6356291740 10 client.0 _ll_register_callbacks cb 0x7f63440b2070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6352430640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09eb360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6352430640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09eb360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59778/0 (socket says 172.21.15.103:59778) 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6352430640 1 -- 172.21.15.103:0/1460836092 learned_addr learned my addr 172.21.15.103:0/1460836092 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f635142e640 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 0x55bbe09eae20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.840+0000 7f6351c2f640 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09ea8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6352430640 1 -- 172.21.15.103:0/1460836092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 msgr2=0x55bbe09ea8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6352430640 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09ea8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6352430640 1 -- 172.21.15.103:0/1460836092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 msgr2=0x55bbe09eae20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6352430640 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 0x55bbe09eae20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6352430640 1 -- 172.21.15.103:0/1460836092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55bbe09ef080 con 0x55bbe09d2810 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6351c2f640 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6352430640 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09eb360 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f63440a3760 tx=0x7f634409aab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1998b0af888d3d23 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f63357fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f63357fa640 1 -- 172.21.15.103:0/1460836092 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f63440b4020 con 0x55bbe09d2810 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f63357fa640 1 -- 172.21.15.103:0/1460836092 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f6344084120 con 0x55bbe09d2810 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6356291740 1 -- 172.21.15.103:0/1460836092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6348004ca0 con 0x55bbe09d2810 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f63357fa640 1 -- 172.21.15.103:0/1460836092 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f63440972c0 con 0x55bbe09d2810 2024-08-02T18:50:10.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6356291740 10 client.15564 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f6356291740 1 -- 172.21.15.103:0/1460836092 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55bbe0a51de0 con 0x55bbe09d2810 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.841+0000 7f63357fa640 1 -- 172.21.15.103:0/1460836092 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6348004ca0 con 0x55bbe09d2810 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f63357fa640 1 -- 172.21.15.103:0/1460836092 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6344099ee0 con 0x55bbe09d2810 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f6356291740 10 client.15564 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f6356291740 10 client.15564 resolve_mds: resolved name 'b' to daemon mds.b 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f6356291740 20 client.15564 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f6356291740 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55bbe0a56710 0x55bbe0a55420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f6356291740 4 client.15564 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "status"}] 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f6356291740 1 -- 172.21.15.103:0/1460836092 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "status"}) -- 0x55bbe0934190 con 0x55bbe0a56710 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f6351c2f640 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55bbe0a56710 0x55bbe0a55420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f63357fa640 10 client.15564 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.842+0000 7f6351c2f640 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55bbe0a56710 0x55bbe0a55420 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6852d11d88f43e48 server_cookie=ab5f60c1d817fb0e in_seq=0 out_seq=0 2024-08-02T18:50:10.848 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f63357fa640 1 -- 172.21.15.103:0/1460836092 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+332 (crc 0 0 0) 0x55bbe0934190 con 0x55bbe0a56710 2024-08-02T18:50:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f63357fa640 10 client.15564 handle_command_reply: tid=0 2024-08-02T18:50:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 client.15564 shutdown 2024-08-02T18:50:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 -- 172.21.15.103:0/1460836092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 msgr2=0x55bbe09eb360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09eb360 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f63440a3760 tx=0x7f634409aab0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 -- 172.21.15.103:0/1460836092 shutdown_connections 2024-08-02T18:50:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55bbe0a56710 0x55bbe0a55420 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55bbe09d2810 0x55bbe09eb360 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55bbe09c7f50 0x55bbe09eae20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f63357fa640 0 client.15564 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 --2- 172.21.15.103:0/1460836092 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55bbe09c7630 0x55bbe09ea8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 -- 172.21.15.103:0/1460836092 >> 172.21.15.103:0/1460836092 conn(0x55bbe09c3bc0 msgr2=0x55bbe09ddfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 -- 172.21.15.103:0/1460836092 shutdown_connections 2024-08-02T18:50:10.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 1 -- 172.21.15.103:0/1460836092 wait complete. 2024-08-02T18:50:10.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.843+0000 7f6356291740 20 client.15564 trim_cache size 0 max 16384 2024-08-02T18:50:10.851 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:10.851 INFO:teuthology.orchestra.run.smithi103.stdout: "cluster_fsid": "7ef68402-50fe-11ef-bcca-c7b262605968", 2024-08-02T18:50:10.851 INFO:teuthology.orchestra.run.smithi103.stdout: "whoami": 0, 2024-08-02T18:50:10.851 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 24473, 2024-08-02T18:50:10.851 INFO:teuthology.orchestra.run.smithi103.stdout: "want_state": "up:active", 2024-08-02T18:50:10.851 INFO:teuthology.orchestra.run.smithi103.stdout: "state": "up:active", 2024-08-02T18:50:10.851 INFO:teuthology.orchestra.run.smithi103.stdout: "fs_name": "cephfs", 2024-08-02T18:50:10.852 INFO:teuthology.orchestra.run.smithi103.stdout: "rank_uptime": 168.52763463299999, 2024-08-02T18:50:10.852 INFO:teuthology.orchestra.run.smithi103.stdout: "mdsmap_epoch": 26, 2024-08-02T18:50:10.852 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch": 90, 2024-08-02T18:50:10.852 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_epoch_barrier": 89, 2024-08-02T18:50:10.852 INFO:teuthology.orchestra.run.smithi103.stdout: "uptime": 179.22076788300001 2024-08-02T18:50:10.852 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 -- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f63380a2e10 msgr2=0x7f63380a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f63380a2e10 0x7f63380a52d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f634c104eb0 tx=0x7f633c0127c0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 -- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c102c20 msgr2=0x7f634c19cb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c102c20 0x7f634c19cb50 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f634400b970 tx=0x7f634400be30 comp rx=0 tx=0).stop 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 -- 172.21.15.103:0/3675551354 shutdown_connections 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f63380a2e10 0x7f63380a52d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f634c102c20 0x7f634c19cb50 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f634c1022a0 0x7f634c1987c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 --2- 172.21.15.103:0/3675551354 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f634c100b50 0x7f634c198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 -- 172.21.15.103:0/3675551354 >> 172.21.15.103:0/3675551354 conn(0x7f634c0fc500 msgr2=0x7f634c069e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 -- 172.21.15.103:0/3675551354 shutdown_connections 2024-08-02T18:50:10.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:10.844+0000 7f6353e93640 1 -- 172.21.15.103:0/3675551354 wait complete. 2024-08-02T18:50:11.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:10 smithi121 ceph-mon[37236]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-02T18:50:11.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:10 smithi151 ceph-mon[37155]: pgmap v16: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 22 op/s 2024-08-02T18:50:11.563 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-08-02T18:50:13.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:12 smithi121 ceph-mon[37236]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-02T18:50:13.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:12 smithi151 ceph-mon[37155]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-02T18:50:13.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:12 smithi103 ceph-mon[32753]: pgmap v17: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-02T18:50:15.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:14 smithi121 ceph-mon[37236]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-02T18:50:15.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:14 smithi151 ceph-mon[37155]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-02T18:50:15.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:14 smithi103 ceph-mon[32753]: pgmap v18: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 25 KiB/s wr, 26 op/s 2024-08-02T18:50:17.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:16 smithi121 ceph-mon[37236]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-02T18:50:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:16 smithi151 ceph-mon[37155]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-02T18:50:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:16 smithi103 ceph-mon[32753]: pgmap v19: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 25 KiB/s wr, 28 op/s 2024-08-02T18:50:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:18 smithi121 ceph-mon[37236]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-02T18:50:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:18 smithi151 ceph-mon[37155]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-02T18:50:19.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:18 smithi103 ceph-mon[32753]: pgmap v20: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.6 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-02T18:50:19.945 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 -- 172.21.15.103:0/3617655967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e81066f0 msgr2=0x7ff4e8106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/3617655967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e81066f0 0x7ff4e8106ad0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8009930 tx=0x7ff4d802a420 comp rx=0 tx=0).stop 2024-08-02T18:50:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 -- 172.21.15.103:0/3617655967 shutdown_connections 2024-08-02T18:50:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/3617655967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e8101080 0x7ff4e810d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/3617655967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e81006e0 0x7ff4e8100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/3617655967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e81066f0 0x7ff4e8106ad0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 -- 172.21.15.103:0/3617655967 >> 172.21.15.103:0/3617655967 conn(0x7ff4e80776c0 msgr2=0x7ff4e80fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 -- 172.21.15.103:0/3617655967 shutdown_connections 2024-08-02T18:50:19.946 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.931+0000 7ff4eea4c640 1 -- 172.21.15.103:0/3617655967 wait complete. 2024-08-02T18:50:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4eea4c640 1 Processor -- start 2024-08-02T18:50:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4eea4c640 1 -- start start 2024-08-02T18:50:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4eea4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e81006e0 0x7ff4e8196fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4eea4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e8101080 0x7ff4e81974f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.947 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4eea4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e81066f0 0x7ff4e819b870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4eea4c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8110c10 con 0x7ff4e8101080 2024-08-02T18:50:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4eea4c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8110a90 con 0x7ff4e81066f0 2024-08-02T18:50:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4eea4c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e8110d90 con 0x7ff4e81006e0 2024-08-02T18:50:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.932+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e8101080 0x7ff4e81974f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.948 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e8101080 0x7ff4e81974f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54504/0 (socket says 172.21.15.103:54504) 2024-08-02T18:50:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e77fe640 1 -- 172.21.15.103:0/529531322 learned_addr learned my addr 172.21.15.103:0/529531322 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e81006e0 0x7ff4e8196fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e81066f0 0x7ff4e819b870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e77fe640 1 -- 172.21.15.103:0/529531322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e81006e0 msgr2=0x7ff4e8196fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e81006e0 0x7ff4e8196fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.949 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e77fe640 1 -- 172.21.15.103:0/529531322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e81066f0 msgr2=0x7ff4e819b870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e81066f0 0x7ff4e819b870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e77fe640 1 -- 172.21.15.103:0/529531322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4e819bfa0 con 0x7ff4e8101080 2024-08-02T18:50:19.950 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e8101080 0x7ff4e81974f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c920 tx=0x7ff4dc00cde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e57fa640 1 -- 172.21.15.103:0/529531322 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc007c70 con 0x7ff4e8101080 2024-08-02T18:50:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e57fa640 1 -- 172.21.15.103:0/529531322 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4dc007e10 con 0x7ff4e8101080 2024-08-02T18:50:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4eea4c640 1 -- 172.21.15.103:0/529531322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff4e819c290 con 0x7ff4e8101080 2024-08-02T18:50:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4e57fa640 1 -- 172.21.15.103:0/529531322 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc018940 con 0x7ff4e8101080 2024-08-02T18:50:19.951 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.933+0000 7ff4eea4c640 1 -- 172.21.15.103:0/529531322 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff4e81a3b20 con 0x7ff4e8101080 2024-08-02T18:50:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.936+0000 7ff4e57fa640 1 -- 172.21.15.103:0/529531322 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7ff4dc018b20 con 0x7ff4e8101080 2024-08-02T18:50:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.936+0000 7ff4e57fa640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff4d00a2ec0 0x7ff4d00a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.936+0000 7ff4e57fa640 1 -- 172.21.15.103:0/529531322 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff4dc0cfd00 con 0x7ff4e8101080 2024-08-02T18:50:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.936+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff4d00a2ec0 0x7ff4d00a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4f179b740 1 Processor -- start 2024-08-02T18:50:19.952 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4f179b740 1 -- start start 2024-08-02T18:50:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff4d00a2ec0 0x7ff4d00a5380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8000c00 tx=0x7ff4d8005a20 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c3b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696d0d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.953 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4f179b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5622696279b0 con 0x5622696ce970 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4f179b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5622695cf800 con 0x5622696c37b0 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4f179b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x562269623970 con 0x5622696c40d0 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4ecfe9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696d0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4ecfe9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696d0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54510/0 (socket says 172.21.15.103:54510) 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/1714381810 learned_addr learned my addr 172.21.15.103:0/1714381810 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c3b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/1714381810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 msgr2=0x5622696ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.937+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.954 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/1714381810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 msgr2=0x5622696c3b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c3b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/1714381810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56226933b210 con 0x5622696ce970 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696d0d60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009d70 tx=0x7ff4e000f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c07c1f0b27cd17b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4ce7fc640 1 -- 172.21.15.103:0/1714381810 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0003970 con 0x5622696ce970 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4ce7fc640 1 -- 172.21.15.103:0/1714381810 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4e0004530 con 0x5622696ce970 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.938+0000 7ff4ce7fc640 1 -- 172.21.15.103:0/1714381810 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0011800 con 0x5622696ce970 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 -- 172.21.15.103:0/1714381810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 msgr2=0x5622696d0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696d0d60 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009d70 tx=0x7ff4e000f730 comp rx=0 tx=0).stop 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 -- 172.21.15.103:0/1714381810 shutdown_connections 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696d0d60 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.955 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 --2- 172.21.15.103:0/1714381810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c3b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 -- 172.21.15.103:0/1714381810 >> 172.21.15.103:0/1714381810 conn(0x5622696bfd20 msgr2=0x5622696c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 -- 172.21.15.103:0/1714381810 shutdown_connections 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 -- 172.21.15.103:0/1714381810 wait complete. 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 -- start start 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 Processor -- start 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696ce430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696cb770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.939+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696cbf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4f179b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5622696d1540 con 0x5622696ce970 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4f179b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5622695e3500 con 0x5622696c37b0 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4f179b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5622696d16c0 con 0x5622696c40d0 2024-08-02T18:50:19.956 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4f179b740 10 client.0 _ll_register_callbacks cb 0x56226933aa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696cbf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696cbf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54516/0 (socket says 172.21.15.103:54516) 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/3481322224 learned_addr learned my addr 172.21.15.103:0/3481322224 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696ce430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/3481322224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 msgr2=0x5622696cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 msgr2=0x5622696ce430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696ce430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/3481322224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562269407620 con 0x5622696ce970 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:19.957 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696cbf00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0006010 tx=0x7ff4e0003b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8439b7cfc1d7b9 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4c77fe640 1 -- 172.21.15.103:0/3481322224 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e002a060 con 0x5622696ce970 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4c77fe640 1 -- 172.21.15.103:0/3481322224 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff4e00046e0 con 0x5622696ce970 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.940+0000 7ff4f179b740 1 -- 172.21.15.103:0/3481322224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e0004530 con 0x5622696ce970 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4c77fe640 1 -- 172.21.15.103:0/3481322224 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff4e0031050 con 0x5622696ce970 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4f179b740 10 client.15576 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4f179b740 1 -- 172.21.15.103:0/3481322224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5622696dd020 con 0x5622696ce970 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4c77fe640 1 -- 172.21.15.103:0/3481322224 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4e0004530 con 0x5622696ce970 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4c77fe640 1 -- 172.21.15.103:0/3481322224 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff4e001a430 con 0x5622696ce970 2024-08-02T18:50:19.958 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4f179b740 10 client.15576 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4f179b740 10 client.15576 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4f179b740 20 client.15576 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5622696de480 0x5622696e0870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4f179b740 4 client.15576 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4f179b740 1 -- 172.21.15.103:0/3481322224 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5622696350e0 con 0x5622696de480 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.941+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5622696de480 0x5622696e0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.942+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5622696de480 0x5622696e0870 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7e6d856916ef56ed server_cookie=7e5823239f78234 in_seq=0 out_seq=0 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.942+0000 7ff4c77fe640 10 client.15576 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.942+0000 7ff4c77fe640 1 -- 172.21.15.103:0/3481322224 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5622696350e0 con 0x5622696de480 2024-08-02T18:50:19.959 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.942+0000 7ff4c77fe640 10 client.15576 handle_command_reply: tid=0 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.942+0000 7ff4f179b740 1 client.15576 shutdown 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 -- 172.21.15.103:0/3481322224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 msgr2=0x5622696cbf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696cbf00 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0006010 tx=0x7ff4e0003b80 comp rx=0 tx=0).stop 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 -- 172.21.15.103:0/3481322224 shutdown_connections 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5622696de480 0x5622696e0870 crc :-1 s=READY pgs=46 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696cbf00 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3481322224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696ce430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 -- 172.21.15.103:0/3481322224 >> 172.21.15.103:0/3481322224 conn(0x5622696bfd20 msgr2=0x5622696c5a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4c77fe640 0 client.15576 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 -- 172.21.15.103:0/3481322224 shutdown_connections 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 1 -- 172.21.15.103:0/3481322224 wait complete. 2024-08-02T18:50:19.960 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.943+0000 7ff4f179b740 20 client.15576 trim_cache size 0 max 16384 2024-08-02T18:50:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4f179b740 1 Processor -- start 2024-08-02T18:50:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4f179b740 1 -- start start 2024-08-02T18:50:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c0810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.969 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696e5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696e6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4f179b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81b03a0 con 0x5622696ce970 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4f179b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81adc70 con 0x5622696c37b0 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4f179b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81abac0 con 0x5622696c40d0 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4ecfe9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696e6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4ecfe9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696e6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54530/0 (socket says 172.21.15.103:54530) 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/3523085398 learned_addr learned my addr 172.21.15.103:0/3523085398 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696e5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/3523085398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 msgr2=0x5622696e5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696e5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.970 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/3523085398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 msgr2=0x5622696c0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.966+0000 7ff4ecfe9640 1 -- 172.21.15.103:0/3523085398 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5622696bfb50 con 0x5622696ce970 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.967+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696e6350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009c90 tx=0x7ff4e000fc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b07d36e117527a5 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.967+0000 7ff4cdffb640 1 -- 172.21.15.103:0/3523085398 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e002a040 con 0x5622696ce970 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.967+0000 7ff4cdffb640 1 -- 172.21.15.103:0/3523085398 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4e0003e50 con 0x5622696ce970 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.967+0000 7ff4cdffb640 1 -- 172.21.15.103:0/3523085398 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4e0005820 con 0x5622696ce970 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 -- 172.21.15.103:0/3523085398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 msgr2=0x5622696e6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696e6350 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7ff4e0009c90 tx=0x7ff4e000fc70 comp rx=0 tx=0).stop 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 -- 172.21.15.103:0/3523085398 shutdown_connections 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696ce970 0x5622696e6350 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c40d0 0x5622696e5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.971 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 --2- 172.21.15.103:0/3523085398 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696c37b0 0x5622696c0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 -- 172.21.15.103:0/3523085398 >> 172.21.15.103:0/3523085398 conn(0x5622696bfd20 msgr2=0x5622696c0100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 -- 172.21.15.103:0/3523085398 shutdown_connections 2024-08-02T18:50:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 -- 172.21.15.103:0/3523085398 wait complete. 2024-08-02T18:50:19.972 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 -- start start 2024-08-02T18:50:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.968+0000 7ff4f179b740 1 Processor -- start 2024-08-02T18:50:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c37b0 0x5622696d6c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.976 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696c40d0 0x5622696d7190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4f179b740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696ce970 0x5622696cf550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4f179b740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81ac130 con 0x5622696c40d0 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4f179b740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81ad5a0 con 0x5622696ce970 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4f179b740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff4e81ac800 con 0x5622696c37b0 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4f179b740 10 client.0 _ll_register_callbacks cb 0x7ff4e0009bc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696c40d0 0x5622696d7190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696c40d0 0x5622696d7190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54544/0 (socket says 172.21.15.103:54544) 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 -- 172.21.15.103:0/2168079967 learned_addr learned my addr 172.21.15.103:0/2168079967 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:19.977 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c37b0 0x5622696d6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696ce970 0x5622696cf550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 -- 172.21.15.103:0/2168079967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c37b0 msgr2=0x5622696d6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c37b0 0x5622696d6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 -- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696ce970 msgr2=0x5622696cf550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696ce970 0x5622696cf550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 -- 172.21.15.103:0/2168079967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5622696cfd50 con 0x5622696c40d0 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4ecfe9640 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696ce970 0x5622696cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4e77fe640 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696c40d0 0x5622696d7190 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc098090 tx=0x7ff4dc09bcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7362655c345160d7 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:19.978 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.969+0000 7ff4c77fe640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4c77fe640 1 -- 172.21.15.103:0/2168079967 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff4dc0b9060 con 0x5622696c40d0 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4c77fe640 1 -- 172.21.15.103:0/2168079967 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff4dc0a4410 con 0x5622696c40d0 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 1 -- 172.21.15.103:0/2168079967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff4e0003e50 con 0x5622696c40d0 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4c77fe640 1 -- 172.21.15.103:0/2168079967 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff4dc086040 con 0x5622696c40d0 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 10 client.15582 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 1 -- 172.21.15.103:0/2168079967 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5622696d6670 con 0x5622696c40d0 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4c77fe640 1 -- 172.21.15.103:0/2168079967 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff4dc063030 con 0x5622696c40d0 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4c77fe640 1 -- 172.21.15.103:0/2168079967 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff4dc09b080 con 0x5622696c40d0 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 10 client.15582 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 10 client.15582 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 20 client.15582 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:19.979 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x562269749200 0x56226974b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 4 client.15582 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:50:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4f179b740 1 -- 172.21.15.103:0/2168079967 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x56226962f430 con 0x562269749200 2024-08-02T18:50:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.970+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x562269749200 0x56226974b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.971+0000 7ff4c77fe640 10 client.15582 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:19.980 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.971+0000 7ff4e7fff640 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x562269749200 0x56226974b620 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=41cafc9a63f11c99 server_cookie=ed164136ebd1c43a in_seq=0 out_seq=0 2024-08-02T18:50:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4c77fe640 1 -- 172.21.15.103:0/2168079967 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x56226962f430 con 0x562269749200 2024-08-02T18:50:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4c77fe640 10 client.15582 handle_command_reply: tid=0 2024-08-02T18:50:19.982 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 client.15582 shutdown 2024-08-02T18:50:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 -- 172.21.15.103:0/2168079967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696c40d0 msgr2=0x5622696d7190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696c40d0 0x5622696d7190 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc098090 tx=0x7ff4dc09bcf0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 -- 172.21.15.103:0/2168079967 shutdown_connections 2024-08-02T18:50:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x562269749200 0x56226974b620 crc :-1 s=READY pgs=47 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.983 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5622696ce970 0x5622696cf550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5622696c40d0 0x5622696d7190 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4c77fe640 0 client.15582 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 --2- 172.21.15.103:0/2168079967 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5622696c37b0 0x5622696d6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 -- 172.21.15.103:0/2168079967 >> 172.21.15.103:0/2168079967 conn(0x5622696bfd20 msgr2=0x5622696be660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 -- 172.21.15.103:0/2168079967 shutdown_connections 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 1 -- 172.21.15.103:0/2168079967 wait complete. 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.977+0000 7ff4f179b740 20 client.15582 trim_cache size 0 max 16384 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:50:19.984 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:50:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:50:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:50:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 -- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff4d00a2ec0 msgr2=0x7ff4d00a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.985 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff4d00a2ec0 0x7ff4d00a5380 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff4d8000c00 tx=0x7ff4d8005a20 comp rx=0 tx=0).stop 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 -- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e8101080 msgr2=0x7ff4e81974f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e8101080 0x7ff4e81974f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff4dc00c920 tx=0x7ff4dc00cde0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 -- 172.21.15.103:0/529531322 shutdown_connections 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff4d00a2ec0 0x7ff4d00a5380 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff4e81066f0 0x7ff4e819b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff4e8101080 0x7ff4e81974f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 --2- 172.21.15.103:0/529531322 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff4e81006e0 0x7ff4e8196fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 -- 172.21.15.103:0/529531322 >> 172.21.15.103:0/529531322 conn(0x7ff4e80776c0 msgr2=0x7ff4e8103390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 -- 172.21.15.103:0/529531322 shutdown_connections 2024-08-02T18:50:19.986 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:19.978+0000 7ff4eea4c640 1 -- 172.21.15.103:0/529531322 wait complete. 2024-08-02T18:50:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:20 smithi121 ceph-mon[37236]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-02T18:50:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:20 smithi151 ceph-mon[37155]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-02T18:50:21.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:20 smithi103 ceph-mon[32753]: pgmap v21: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 KiB/s rd, 2.9 KiB/s wr, 10 op/s 2024-08-02T18:50:23.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:22 smithi121 ceph-mon[37236]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-08-02T18:50:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:22 smithi151 ceph-mon[37155]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-08-02T18:50:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:22 smithi103 ceph-mon[32753]: pgmap v22: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 2.4 KiB/s wr, 11 op/s 2024-08-02T18:50:24.024 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-02T18:50:24.308 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:24.715 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:24 smithi103 ceph-mon[32753]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-02T18:50:24.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 -- 172.21.15.103:0/1073905072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4341078c0 msgr2=0x7fe434107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 --2- 172.21.15.103:0/1073905072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4341078c0 0x7fe434107ca0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fe424009930 tx=0x7fe42402a420 comp rx=0 tx=0).stop 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 -- 172.21.15.103:0/1073905072 shutdown_connections 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 --2- 172.21.15.103:0/1073905072 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe434102260 0x7fe43410e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 --2- 172.21.15.103:0/1073905072 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4341018c0 0x7fe434101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 --2- 172.21.15.103:0/1073905072 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe4341078c0 0x7fe434107ca0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 -- 172.21.15.103:0/1073905072 >> 172.21.15.103:0/1073905072 conn(0x7fe4340fd620 msgr2=0x7fe4340ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 -- 172.21.15.103:0/1073905072 shutdown_connections 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.818+0000 7fe4390cc640 1 -- 172.21.15.103:0/1073905072 wait complete. 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.819+0000 7fe4390cc640 1 Processor -- start 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe4390cc640 1 -- start start 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe4390cc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4341018c0 0x7fe434198280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe4390cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe434102260 0x7fe4341987c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe4390cc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4341078c0 0x7fe43419cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe4390cc640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe434111de0 con 0x7fe434102260 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe4390cc640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe434111c60 con 0x7fe4341078c0 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe4390cc640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe434111f60 con 0x7fe4341018c0 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe43259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe434102260 0x7fe4341987c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe43259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe434102260 0x7fe4341987c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54562/0 (socket says 172.21.15.103:54562) 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe43259c640 1 -- 172.21.15.103:0/911026378 learned_addr learned my addr 172.21.15.103:0/911026378 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.820+0000 7fe432d9d640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4341018c0 0x7fe434198280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe43259c640 1 -- 172.21.15.103:0/911026378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4341018c0 msgr2=0x7fe434198280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe43259c640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4341018c0 0x7fe434198280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe43259c640 1 -- 172.21.15.103:0/911026378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4341078c0 msgr2=0x7fe43419cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe43259c640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4341078c0 0x7fe43419cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe43259c640 1 -- 172.21.15.103:0/911026378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe43419d230 con 0x7fe434102260 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe43259c640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe434102260 0x7fe4341987c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe42800e9f0 tx=0x7fe42800eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe41bfff640 1 -- 172.21.15.103:0/911026378 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42800cd80 con 0x7fe434102260 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe4390cc640 1 -- 172.21.15.103:0/911026378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe43419d520 con 0x7fe434102260 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe4390cc640 1 -- 172.21.15.103:0/911026378 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4341a4e00 con 0x7fe434102260 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe41bfff640 1 -- 172.21.15.103:0/911026378 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe428010930 con 0x7fe434102260 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.821+0000 7fe41bfff640 1 -- 172.21.15.103:0/911026378 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe428018b00 con 0x7fe434102260 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43b4ca740 1 Processor -- start 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43b4ca740 1 -- start start 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c6f0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c6fa30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c82a90 0x556cf6c84e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556cf6bd4980 con 0x556cf6c70790 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556cf6b6ca70 con 0x556cf6c82a90 2024-08-02T18:50:24.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556cf6bd0940 con 0x556cf6c6f5f0 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c6f0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c6f0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54564/0 (socket says 172.21.15.103:54564) 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.824+0000 7fe43359e640 1 -- 172.21.15.103:0/1331604038 learned_addr learned my addr 172.21.15.103:0/1331604038 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.825+0000 7fe432d9d640 1 --2- 172.21.15.103:0/1331604038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c6fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.825+0000 7fe43359e640 1 -- 172.21.15.103:0/1331604038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 msgr2=0x556cf6c6fa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.825+0000 7fe43359e640 1 --2- 172.21.15.103:0/1331604038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c6fa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.825+0000 7fe43359e640 1 -- 172.21.15.103:0/1331604038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c82a90 msgr2=0x556cf6c84e80 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.825+0000 7fe43359e640 1 --2- 172.21.15.103:0/1331604038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c82a90 0x556cf6c84e80 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.825+0000 7fe43359e640 1 -- 172.21.15.103:0/1331604038 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf6bcf6e0 con 0x556cf6c70790 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.825+0000 7fe43359e640 1 --2- 172.21.15.103:0/1331604038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c6f0b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009e20 tx=0x7fe42c00e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d09bd7dd0c85e35a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.825+0000 7fe41bfff640 1 -- 172.21.15.103:0/911026378 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7fe428018ca0 con 0x7fe434102260 2024-08-02T18:50:24.846 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.826+0000 7fe4197fa640 1 -- 172.21.15.103:0/1331604038 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c004d20 con 0x556cf6c70790 2024-08-02T18:50:24.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.826+0000 7fe41bfff640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe41c0a2f10 0x7fe41c0a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.826+0000 7fe4197fa640 1 -- 172.21.15.103:0/1331604038 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe42c00ee70 con 0x556cf6c70790 2024-08-02T18:50:24.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.827+0000 7fe432d9d640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe41c0a2f10 0x7fe41c0a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.827+0000 7fe41bfff640 1 -- 172.21.15.103:0/911026378 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fe4280cffe0 con 0x7fe434102260 2024-08-02T18:50:24.847 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.827+0000 7fe432d9d640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe41c0a2f10 0x7fe41c0a53d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe424009900 tx=0x7fe4240058d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:24.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.827+0000 7fe4197fa640 1 -- 172.21.15.103:0/1331604038 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42c018a40 con 0x556cf6c70790 2024-08-02T18:50:24.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1331604038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 msgr2=0x556cf6c6f0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1331604038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c6f0b0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fe42c009e20 tx=0x7fe42c00e720 comp rx=0 tx=0).stop 2024-08-02T18:50:24.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1331604038 shutdown_connections 2024-08-02T18:50:24.849 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1331604038 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c82a90 0x556cf6c84e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1331604038 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c6fa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1331604038 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c6f0b0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1331604038 >> 172.21.15.103:0/1331604038 conn(0x556cf6c6b7a0 msgr2=0x556cf6c6bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1331604038 shutdown_connections 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.828+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1331604038 wait complete. 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 1 -- start start 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 1 Processor -- start 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c72f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c734c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c73a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.850 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c734c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c734c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54578/0 (socket says 172.21.15.103:54578) 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556cf6c85810 con 0x556cf6c70790 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556cf6b8faa0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556cf6c85990 con 0x556cf6c82a90 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe432d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c72f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe432d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c72f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:50042/0 (socket says 172.21.15.103:50042) 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe432d9d640 1 -- 172.21.15.103:0/1841550391 learned_addr learned my addr 172.21.15.103:0/1841550391 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.829+0000 7fe43b4ca740 10 client.0 _ll_register_callbacks cb 0x556cf6b7ee60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe43359e640 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c73a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe432d9d640 1 -- 172.21.15.103:0/1841550391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 msgr2=0x556cf6c73a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe432d9d640 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c73a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe432d9d640 1 -- 172.21.15.103:0/1841550391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 msgr2=0x556cf6c734c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:24.851 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe432d9d640 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c734c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe432d9d640 1 -- 172.21.15.103:0/1841550391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cf6b73650 con 0x556cf6c6f5f0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe43359e640 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c73a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe432d9d640 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c72f80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4240096c0 tx=0x7fe424009260 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5501c330f965dcf5 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe416ff5640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe416ff5640 1 -- 172.21.15.103:0/1841550391 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42404e070 con 0x556cf6c6f5f0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1841550391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe42c00ee70 con 0x556cf6c6f5f0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe416ff5640 1 -- 172.21.15.103:0/1841550391 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fe424003ac0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe416ff5640 1 -- 172.21.15.103:0/1841550391 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe42405a050 con 0x556cf6c6f5f0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe43b4ca740 10 client.25130 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.830+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1841550391 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556cf69463c0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe416ff5640 1 -- 172.21.15.103:0/1841550391 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe42c00ee70 con 0x556cf6c6f5f0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe416ff5640 1 -- 172.21.15.103:0/1841550391 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe42403d450 con 0x556cf6c6f5f0 2024-08-02T18:50:24.852 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe43b4ca740 10 client.25130 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe43b4ca740 10 client.25130 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe43b4ca740 20 client.25130 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x556cf6c92c10 0x556cf6c95070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe43b4ca740 4 client.25130 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1841550391 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556cf6be1ef0 con 0x556cf6c92c10 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.831+0000 7fe43259c640 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x556cf6c92c10 0x556cf6c95070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.832+0000 7fe416ff5640 10 client.25130 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.832+0000 7fe43259c640 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x556cf6c92c10 0x556cf6c95070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=457455bb9b81088a server_cookie=f116592920198a48 in_seq=0 out_seq=0 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.832+0000 7fe416ff5640 1 -- 172.21.15.103:0/1841550391 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556cf6be1ef0 con 0x556cf6c92c10 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.832+0000 7fe416ff5640 10 client.25130 handle_command_reply: tid=0 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.832+0000 7fe43b4ca740 1 client.25130 shutdown 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.832+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1841550391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 msgr2=0x556cf6c72f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.832+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c72f80 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe4240096c0 tx=0x7fe424009260 comp rx=0 tx=0).stop 2024-08-02T18:50:24.853 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1841550391 shutdown_connections 2024-08-02T18:50:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x556cf6c92c10 0x556cf6c95070 crc :-1 s=READY pgs=48 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c73a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe416ff5640 0 client.25130 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c734c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/1841550391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c72f80 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1841550391 >> 172.21.15.103:0/1841550391 conn(0x556cf6c6b7a0 msgr2=0x556cf6c714c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:24.854 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1841550391 shutdown_connections 2024-08-02T18:50:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 1 -- 172.21.15.103:0/1841550391 wait complete. 2024-08-02T18:50:24.855 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.833+0000 7fe43b4ca740 20 client.25130 trim_cache size 0 max 16384 2024-08-02T18:50:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.865+0000 7fe43b4ca740 1 Processor -- start 2024-08-02T18:50:24.868 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43b4ca740 1 -- start start 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c756e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c72840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c6bb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe4341af470 con 0x556cf6c70790 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4341acd40 con 0x556cf6c6f5f0 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe4341aab90 con 0x556cf6c82a90 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c72840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe432d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c756e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c72840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54594/0 (socket says 172.21.15.103:54594) 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.866+0000 7fe43259c640 1 -- 172.21.15.103:0/565064048 learned_addr learned my addr 172.21.15.103:0/565064048 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe43359e640 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c6bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe43259c640 1 -- 172.21.15.103:0/565064048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 msgr2=0x556cf6c6bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:24.869 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe43259c640 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c6bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe43259c640 1 -- 172.21.15.103:0/565064048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 msgr2=0x556cf6c756e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe43259c640 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c756e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe43259c640 1 -- 172.21.15.103:0/565064048 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556cf6c70000 con 0x556cf6c70790 2024-08-02T18:50:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe432d9d640 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c756e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe43259c640 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c72840 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe42809bbe0 tx=0x7fe428000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f8c85f5072cc213 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe418ff9640 1 -- 172.21.15.103:0/565064048 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe42809a230 con 0x556cf6c70790 2024-08-02T18:50:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe418ff9640 1 -- 172.21.15.103:0/565064048 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4280985a0 con 0x556cf6c70790 2024-08-02T18:50:24.870 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.867+0000 7fe418ff9640 1 -- 172.21.15.103:0/565064048 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4280cd510 con 0x556cf6c70790 2024-08-02T18:50:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.868+0000 7fe43b4ca740 1 -- 172.21.15.103:0/565064048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 msgr2=0x556cf6c72840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.868+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c72840 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fe42809bbe0 tx=0x7fe428000bc0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.872 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.869+0000 7fe43b4ca740 1 -- 172.21.15.103:0/565064048 shutdown_connections 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.869+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c82a90 0x556cf6c6bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.869+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c70790 0x556cf6c72840 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.869+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/565064048 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c6f5f0 0x556cf6c756e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.869+0000 7fe43b4ca740 1 -- 172.21.15.103:0/565064048 >> 172.21.15.103:0/565064048 conn(0x556cf6c6b7a0 msgr2=0x556cf6c84cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.869+0000 7fe43b4ca740 1 -- 172.21.15.103:0/565064048 shutdown_connections 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.869+0000 7fe43b4ca740 1 -- 172.21.15.103:0/565064048 wait complete. 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.869+0000 7fe43b4ca740 1 -- start start 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.870+0000 7fe43b4ca740 1 Processor -- start 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.870+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c83710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.870+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c70790 0x556cf6c83c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.870+0000 7fe43b4ca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c82a90 0x556cf6c89c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.873 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe43b4ca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe4341ab200 con 0x556cf6c82a90 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe43359e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c82a90 0x556cf6c89c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe432d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c83710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe432d9d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c83710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:59706/0 (socket says 172.21.15.103:59706) 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe432d9d640 1 -- 172.21.15.103:0/3304245212 learned_addr learned my addr 172.21.15.103:0/3304245212 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe43259c640 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c70790 0x556cf6c83c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe4341ac670 con 0x556cf6c70790 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe4341ab8d0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe43b4ca740 10 client.0 _ll_register_callbacks cb 0x7fe424009780 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe432d9d640 1 -- 172.21.15.103:0/3304245212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c70790 msgr2=0x556cf6c83c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe432d9d640 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c70790 0x556cf6c83c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe432d9d640 1 -- 172.21.15.103:0/3304245212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c82a90 msgr2=0x556cf6c89c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe432d9d640 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c82a90 0x556cf6c89c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.874 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.871+0000 7fe432d9d640 1 -- 172.21.15.103:0/3304245212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556cf6c6c0c0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.872+0000 7fe432d9d640 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c83710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe42403d8a0 tx=0x7fe4240092f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b7742335f59998fa server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.872+0000 7fe416ff5640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.872+0000 7fe416ff5640 1 -- 172.21.15.103:0/3304245212 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe424062070 con 0x556cf6c6f5f0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.872+0000 7fe416ff5640 1 -- 172.21.15.103:0/3304245212 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fe4240038c0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.872+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe4280985a0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.872+0000 7fe416ff5640 1 -- 172.21.15.103:0/3304245212 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fe42406e050 con 0x556cf6c6f5f0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.872+0000 7fe43b4ca740 10 client.25150 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.872+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556cf6c8b2a0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.873+0000 7fe416ff5640 1 -- 172.21.15.103:0/3304245212 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe4280985a0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.873+0000 7fe416ff5640 1 -- 172.21.15.103:0/3304245212 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fe42404aac0 con 0x556cf6c6f5f0 2024-08-02T18:50:24.878 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.873+0000 7fe43b4ca740 10 client.25150 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.873+0000 7fe43b4ca740 10 client.25150 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.873+0000 7fe43b4ca740 20 client.25150 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.873+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x556cf6cfd950 0x556cf6cffd40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.873+0000 7fe43b4ca740 4 client.25150 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.873+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub status"}) -- 0x556cf6bdc400 con 0x556cf6cfd950 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.874+0000 7fe43259c640 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x556cf6cfd950 0x556cf6cffd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.874+0000 7fe416ff5640 10 client.25150 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.874+0000 7fe43259c640 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x556cf6cfd950 0x556cf6cffd40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a96478e160ffe36 server_cookie=86450ccca584ade2 in_seq=0 out_seq=0 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.874+0000 7fe416ff5640 1 -- 172.21.15.103:0/3304245212 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x556cf6bdc400 con 0x556cf6cfd950 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.874+0000 7fe416ff5640 10 client.25150 handle_command_reply: tid=0 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.874+0000 7fe43b4ca740 1 client.25150 shutdown 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 msgr2=0x556cf6c83710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.879 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c83710 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7fe42403d8a0 tx=0x7fe4240092f0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 shutdown_connections 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x556cf6cfd950 0x556cf6cffd40 crc :-1 s=READY pgs=49 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556cf6c82a90 0x556cf6c89c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556cf6c70790 0x556cf6c83c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 --2- 172.21.15.103:0/3304245212 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556cf6c6f5f0 0x556cf6c83710 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 >> 172.21.15.103:0/3304245212 conn(0x556cf6c6b7a0 msgr2=0x556cf6c70ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe416ff5640 0 client.25150 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 shutdown_connections 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 1 -- 172.21.15.103:0/3304245212 wait complete. 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.875+0000 7fe43b4ca740 20 client.25150 trim_cache size 0 max 16384 2024-08-02T18:50:24.880 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:24.881 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-08-02T18:50:24.881 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-08-02T18:50:24.881 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:24.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 -- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe41c0a2f10 msgr2=0x7fe41c0a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe41c0a2f10 0x7fe41c0a53d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7fe424009900 tx=0x7fe4240058d0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.881 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 -- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe434102260 msgr2=0x7fe4341987c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe434102260 0x7fe4341987c0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fe42800e9f0 tx=0x7fe42800eeb0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 -- 172.21.15.103:0/911026378 shutdown_connections 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe41c0a2f10 0x7fe41c0a53d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe4341078c0 0x7fe43419cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe434102260 0x7fe4341987c0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 --2- 172.21.15.103:0/911026378 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe4341018c0 0x7fe434198280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 -- 172.21.15.103:0/911026378 >> 172.21.15.103:0/911026378 conn(0x7fe4340fd620 msgr2=0x7fe4340fde60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 -- 172.21.15.103:0/911026378 shutdown_connections 2024-08-02T18:50:24.882 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:24.876+0000 7fe4390cc640 1 -- 172.21.15.103:0/911026378 wait complete. 2024-08-02T18:50:25.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:24 smithi121 ceph-mon[37236]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-02T18:50:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:24 smithi151 ceph-mon[37155]: pgmap v23: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 4 op/s 2024-08-02T18:50:25.698 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-02T18:50:25.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:50:26.091 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:26.563 INFO:tasks.quiescer.fs.[cephfs]:Total duration (43.9) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-08-02T18:50:26.564 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.95 2024-08-02T18:50:26.564 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:50:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.678+0000 7f67b76db640 1 -- 172.21.15.103:0/2019628646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0101140 msgr2=0x7f67b010d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:26.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.678+0000 7f67b76db640 1 --2- 172.21.15.103:0/2019628646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0101140 0x7f67b010d670 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7f67a8009cd0 tx=0x7f67a802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:50:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.679+0000 7f67b76db640 1 -- 172.21.15.103:0/2019628646 shutdown_connections 2024-08-02T18:50:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.679+0000 7f67b76db640 1 --2- 172.21.15.103:0/2019628646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b0101140 0x7f67b010d670 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:26.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.679+0000 7f67b76db640 1 --2- 172.21.15.103:0/2019628646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b01007a0 0x7f67b0100c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.679+0000 7f67b76db640 1 --2- 172.21.15.103:0/2019628646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67b01067a0 0x7f67b0106b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.679+0000 7f67b76db640 1 -- 172.21.15.103:0/2019628646 >> 172.21.15.103:0/2019628646 conn(0x7f67b00fc4c0 msgr2=0x7f67b00fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.679+0000 7f67b76db640 1 -- 172.21.15.103:0/2019628646 shutdown_connections 2024-08-02T18:50:26.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.679+0000 7f67b76db640 1 -- 172.21.15.103:0/2019628646 wait complete. 2024-08-02T18:50:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b76db640 1 Processor -- start 2024-08-02T18:50:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b76db640 1 -- start start 2024-08-02T18:50:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b76db640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b01007a0 0x7f67b010df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b5477640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b01007a0 0x7f67b010df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:26.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b5477640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b01007a0 0x7f67b010df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:54626/0 (socket says 172.21.15.103:54626) 2024-08-02T18:50:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b5477640 1 -- 172.21.15.103:0/3714283769 learned_addr learned my addr 172.21.15.103:0/3714283769 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b76db640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67b0101140 0x7f67b010e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b76db640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b01067a0 0x7f67b010ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0111dc0 con 0x7f67b01007a0 2024-08-02T18:50:26.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0111c40 con 0x7f67b01067a0 2024-08-02T18:50:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.681+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f67b0111f40 con 0x7f67b0101140 2024-08-02T18:50:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.682+0000 7f67b4c76640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67b0101140 0x7f67b010e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.682+0000 7f67b5c78640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b01067a0 0x7f67b010ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.682+0000 7f67b5477640 1 -- 172.21.15.103:0/3714283769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67b0101140 msgr2=0x7f67b010e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.682+0000 7f67b5477640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67b0101140 0x7f67b010e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.682+0000 7f67b5477640 1 -- 172.21.15.103:0/3714283769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b01067a0 msgr2=0x7f67b010ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:26.687 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.682+0000 7f67b5477640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b01067a0 0x7f67b010ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.682+0000 7f67b5477640 1 -- 172.21.15.103:0/3714283769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f67b01aabf0 con 0x7f67b01007a0 2024-08-02T18:50:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.682+0000 7f67b5477640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b01007a0 0x7f67b010df80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00d950 tx=0x7f67ac00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.683+0000 7f67a67fc640 1 -- 172.21.15.103:0/3714283769 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac017070 con 0x7f67b01007a0 2024-08-02T18:50:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.683+0000 7f67a67fc640 1 -- 172.21.15.103:0/3714283769 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f67ac009c30 con 0x7f67b01007a0 2024-08-02T18:50:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.683+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f67b01aae20 con 0x7f67b01007a0 2024-08-02T18:50:26.688 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.684+0000 7f67a67fc640 1 -- 172.21.15.103:0/3714283769 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67ac00f740 con 0x7f67b01007a0 2024-08-02T18:50:26.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.685+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f67b01ab280 con 0x7f67b01007a0 2024-08-02T18:50:26.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.686+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f67b0101ee0 con 0x7f67b01007a0 2024-08-02T18:50:26.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.687+0000 7f67a67fc640 1 -- 172.21.15.103:0/3714283769 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f67ac00f8e0 con 0x7f67b01007a0 2024-08-02T18:50:26.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.688+0000 7f67a67fc640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f679c0a2e90 0x7f679c0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:26.691 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.690+0000 7f67b4c76640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f679c0a2e90 0x7f679c0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:26.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.694+0000 7f67a67fc640 1 -- 172.21.15.103:0/3714283769 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f67ac098a00 con 0x7f67b01007a0 2024-08-02T18:50:26.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.699+0000 7f67b4c76640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f679c0a2e90 0x7f679c0a5350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67b010f740 tx=0x7f67a000b390 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:26.705 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:26.703+0000 7f67a67fc640 1 -- 172.21.15.103:0/3714283769 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f67ac009de0 con 0x7f67b01007a0 2024-08-02T18:50:26.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:26 smithi103 ceph-mon[32753]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-02T18:50:26.981 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:27.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:26 smithi121 ceph-mon[37236]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-02T18:50:27.033 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.031+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f67b010f4b0 con 0x7f67b01007a0 2024-08-02T18:50:27.034 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.033+0000 7f67a67fc640 1 -- 172.21.15.103:0/3714283769 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7f67ac09b060 con 0x7f67b01007a0 2024-08-02T18:50:27.035 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:50:27.035 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:50:27.035 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:50:27.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f679c0a2e90 msgr2=0x7f679c0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:27.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f679c0a2e90 0x7f679c0a5350 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f67b010f740 tx=0x7f67a000b390 comp rx=0 tx=0).stop 2024-08-02T18:50:27.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b01007a0 msgr2=0x7f67b010df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:27.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b01007a0 0x7f67b010df80 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f67ac00d950 tx=0x7f67ac00de10 comp rx=0 tx=0).stop 2024-08-02T18:50:27.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 shutdown_connections 2024-08-02T18:50:27.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f679c0a2e90 0x7f679c0a5350 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f67b01067a0 0x7f67b010ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.037 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f67b0101140 0x7f67b010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.035+0000 7f67b76db640 1 --2- 172.21.15.103:0/3714283769 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f67b01007a0 0x7f67b010df80 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.036+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 >> 172.21.15.103:0/3714283769 conn(0x7f67b00fc4c0 msgr2=0x7f67b00fcbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:27.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.036+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 shutdown_connections 2024-08-02T18:50:27.038 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.036+0000 7f67b76db640 1 -- 172.21.15.103:0/3714283769 wait complete. 2024-08-02T18:50:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:26 smithi151 ceph-mon[37155]: pgmap v24: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-02T18:50:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.691+0000 7f6e8305a640 1 -- 172.21.15.103:0/4102144773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c100b50 msgr2=0x7f6e7c100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.691+0000 7f6e8305a640 1 --2- 172.21.15.103:0/4102144773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c100b50 0x7f6e7c100f30 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009900 tx=0x7f6e7002a480 comp rx=0 tx=0).stop 2024-08-02T18:50:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.691+0000 7f6e8305a640 1 -- 172.21.15.103:0/4102144773 shutdown_connections 2024-08-02T18:50:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.691+0000 7f6e8305a640 1 --2- 172.21.15.103:0/4102144773 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e7c102c20 0x7f6e7c10d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.691+0000 7f6e8305a640 1 --2- 172.21.15.103:0/4102144773 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e7c1022a0 0x7f6e7c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.691+0000 7f6e8305a640 1 --2- 172.21.15.103:0/4102144773 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c100b50 0x7f6e7c100f30 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.693 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.691+0000 7f6e8305a640 1 -- 172.21.15.103:0/4102144773 >> 172.21.15.103:0/4102144773 conn(0x7f6e7c0fc500 msgr2=0x7f6e7c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.692+0000 7f6e8305a640 1 -- 172.21.15.103:0/4102144773 shutdown_connections 2024-08-02T18:50:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.692+0000 7f6e8305a640 1 -- 172.21.15.103:0/4102144773 wait complete. 2024-08-02T18:50:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.692+0000 7f6e8305a640 1 Processor -- start 2024-08-02T18:50:27.694 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e8305a640 1 -- start start 2024-08-02T18:50:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e8305a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e7c100b50 0x7f6e7c10e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e8305a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c1022a0 0x7f6e7c10e740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e80df6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e7c100b50 0x7f6e7c10e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e80df6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e7c100b50 0x7f6e7c10e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:59732/0 (socket says 172.21.15.103:59732) 2024-08-02T18:50:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e8305a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e7c102c20 0x7f6e7c10ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e7bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c1022a0 0x7f6e7c10e740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:27.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e80df6640 1 -- 172.21.15.103:0/1725827992 learned_addr learned my addr 172.21.15.103:0/1725827992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e8305a640 1 -- 172.21.15.103:0/1725827992 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c111f20 con 0x7f6e7c1022a0 2024-08-02T18:50:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e8305a640 1 -- 172.21.15.103:0/1725827992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c111da0 con 0x7f6e7c102c20 2024-08-02T18:50:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.693+0000 7f6e8305a640 1 -- 172.21.15.103:0/1725827992 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7c1120a0 con 0x7f6e7c100b50 2024-08-02T18:50:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e815f7640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e7c102c20 0x7f6e7c10ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:27.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e80df6640 1 -- 172.21.15.103:0/1725827992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e7c102c20 msgr2=0x7f6e7c10ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e80df6640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e7c102c20 0x7f6e7c10ec80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e80df6640 1 -- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c1022a0 msgr2=0x7f6e7c10e740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e80df6640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c1022a0 0x7f6e7c10e740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e80df6640 1 -- 172.21.15.103:0/1725827992 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7c1aaad0 con 0x7f6e7c100b50 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e815f7640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e7c102c20 0x7f6e7c10ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e7bfff640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c1022a0 0x7f6e7c10e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.694+0000 7f6e80df6640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e7c100b50 0x7f6e7c10e200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009850 tx=0x7f6e70032820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.695+0000 7f6e79ffb640 1 -- 172.21.15.103:0/1725827992 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e7003f070 con 0x7f6e7c100b50 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.695+0000 7f6e8305a640 1 -- 172.21.15.103:0/1725827992 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7c1aaca0 con 0x7f6e7c100b50 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.695+0000 7f6e79ffb640 1 -- 172.21.15.103:0/1725827992 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6e70031400 con 0x7f6e7c100b50 2024-08-02T18:50:27.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.695+0000 7f6e79ffb640 1 -- 172.21.15.103:0/1725827992 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6e70035030 con 0x7f6e7c100b50 2024-08-02T18:50:27.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.695+0000 7f6e8305a640 1 -- 172.21.15.103:0/1725827992 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7c1ab180 con 0x7f6e7c100b50 2024-08-02T18:50:27.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.696+0000 7f6e677fe640 1 -- 172.21.15.103:0/1725827992 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e5c005290 con 0x7f6e7c100b50 2024-08-02T18:50:27.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.698+0000 7f6e79ffb640 1 -- 172.21.15.103:0/1725827992 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f6e70042070 con 0x7f6e7c100b50 2024-08-02T18:50:27.700 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.699+0000 7f6e79ffb640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6e6c0a2ed0 0x7f6e6c0a5390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:27.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.700+0000 7f6e79ffb640 1 -- 172.21.15.103:0/1725827992 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f6e700f0660 con 0x7f6e7c100b50 2024-08-02T18:50:27.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.700+0000 7f6e7bfff640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6e6c0a2ed0 0x7f6e6c0a5390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:27.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.700+0000 7f6e7bfff640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6e6c0a2ed0 0x7f6e6c0a5390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e68005d00 tx=0x7f6e68005c70 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:27.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:27.707+0000 7f6e79ffb640 1 -- 172.21.15.103:0/1725827992 <== mon.1 v2:172.21.15.151:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6e700bcd60 con 0x7f6e7c100b50 2024-08-02T18:50:27.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:27 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3714283769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:28.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:27 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3714283769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:28.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.000+0000 7f6e677fe640 1 -- 172.21.15.103:0/1725827992 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6e5c005850 con 0x7f6e7c100b50 2024-08-02T18:50:28.002 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.001+0000 7f6e79ffb640 1 -- 172.21.15.103:0/1725827992 <== mon.1 v2:172.21.15.151:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7f6e700bc660 con 0x7f6e7c100b50 2024-08-02T18:50:28.002 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:50:28.003 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:50:28.003 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:50:28.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 -- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6e6c0a2ed0 msgr2=0x7f6e6c0a5390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:28.004 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6e6c0a2ed0 0x7f6e6c0a5390 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e68005d00 tx=0x7f6e68005c70 comp rx=0 tx=0).stop 2024-08-02T18:50:28.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 -- 172.21.15.103:0/1725827992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e7c100b50 msgr2=0x7f6e7c10e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:28.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e7c100b50 0x7f6e7c10e200 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009850 tx=0x7f6e70032820 comp rx=0 tx=0).stop 2024-08-02T18:50:28.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 -- 172.21.15.103:0/1725827992 shutdown_connections 2024-08-02T18:50:28.005 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6e6c0a2ed0 0x7f6e6c0a5390 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:28.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6e7c102c20 0x7f6e7c10ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:28.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6e7c1022a0 0x7f6e7c10e740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:28.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 --2- 172.21.15.103:0/1725827992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6e7c100b50 0x7f6e7c10e200 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:28.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 -- 172.21.15.103:0/1725827992 >> 172.21.15.103:0/1725827992 conn(0x7f6e7c0fc500 msgr2=0x7f6e7c0fc8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:28.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 -- 172.21.15.103:0/1725827992 shutdown_connections 2024-08-02T18:50:28.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:28.003+0000 7f6e677fe640 1 -- 172.21.15.103:0/1725827992 wait complete. 2024-08-02T18:50:28.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:27 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3714283769' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:28.229 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-02T18:50:28.925 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:28 smithi103 ceph-mon[32753]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-02T18:50:28.926 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:28 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1725827992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:28.964 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 141.95 --await-for 45.0' 2024-08-02T18:50:28.964 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 141.95 --await-for 45.0 2024-08-02T18:50:29.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:28 smithi121 ceph-mon[37236]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-02T18:50:29.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:28 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1725827992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:29.020 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:29.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:28 smithi151 ceph-mon[37155]: pgmap v25: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-02T18:50:29.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:28 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1725827992' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:29.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.634+0000 7f7aabd97640 1 -- 172.21.15.103:0/1342422504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7aa40ffe30 msgr2=0x7f7aa4100290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.634+0000 7f7aabd97640 1 --2- 172.21.15.103:0/1342422504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7aa40ffe30 0x7f7aa4100290 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f7a94009860 tx=0x7f7a9402a340 comp rx=0 tx=0).stop 2024-08-02T18:50:29.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.635+0000 7f7aabd97640 1 -- 172.21.15.103:0/1342422504 shutdown_connections 2024-08-02T18:50:29.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.635+0000 7f7aabd97640 1 --2- 172.21.15.103:0/1342422504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7aa41007d0 0x7f7aa410e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.635+0000 7f7aabd97640 1 --2- 172.21.15.103:0/1342422504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7aa40ffe30 0x7f7aa4100290 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.635+0000 7f7aabd97640 1 --2- 172.21.15.103:0/1342422504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa41068b0 0x7f7aa4106c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.635+0000 7f7aabd97640 1 -- 172.21.15.103:0/1342422504 >> 172.21.15.103:0/1342422504 conn(0x7f7aa4076f60 msgr2=0x7f7aa40fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:29.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.636+0000 7f7aabd97640 1 -- 172.21.15.103:0/1342422504 shutdown_connections 2024-08-02T18:50:29.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.636+0000 7f7aabd97640 1 -- 172.21.15.103:0/1342422504 wait complete. 2024-08-02T18:50:29.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aabd97640 1 Processor -- start 2024-08-02T18:50:29.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aabd97640 1 -- start start 2024-08-02T18:50:29.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aabd97640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7aa40ffe30 0x7f7aa4073570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aabd97640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7aa41007d0 0x7f7aa4073ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aabd97640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa41068b0 0x7f7aa410d8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aabd97640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa4111e60 con 0x7f7aa41068b0 2024-08-02T18:50:29.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aabd97640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa4111ce0 con 0x7f7aa41007d0 2024-08-02T18:50:29.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aabd97640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7aa4111fe0 con 0x7f7aa40ffe30 2024-08-02T18:50:29.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.637+0000 7f7aaa334640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa41068b0 0x7f7aa410d8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aaa334640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa41068b0 0x7f7aa410d8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46118/0 (socket says 172.21.15.103:46118) 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aaa334640 1 -- 172.21.15.103:0/2888633391 learned_addr learned my addr 172.21.15.103:0/2888633391 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7aa40ffe30 0x7f7aa4073570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aa9332640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7aa41007d0 0x7f7aa4073ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aaa334640 1 -- 172.21.15.103:0/2888633391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7aa40ffe30 msgr2=0x7f7aa4073570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aaa334640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7aa40ffe30 0x7f7aa4073570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aaa334640 1 -- 172.21.15.103:0/2888633391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7aa41007d0 msgr2=0x7f7aa4073ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aaa334640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7aa41007d0 0x7f7aa4073ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aaa334640 1 -- 172.21.15.103:0/2888633391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7aa410e1a0 con 0x7f7aa41068b0 2024-08-02T18:50:29.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.638+0000 7f7aaa334640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa41068b0 0x7f7aa410d8e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00c5a0 tx=0x7f7a9c00ef90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.639+0000 7f7a9affd640 1 -- 172.21.15.103:0/2888633391 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c004b20 con 0x7f7aa41068b0 2024-08-02T18:50:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.639+0000 7f7a9affd640 1 -- 172.21.15.103:0/2888633391 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a9c004cc0 con 0x7f7aa41068b0 2024-08-02T18:50:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.639+0000 7f7aabd97640 1 -- 172.21.15.103:0/2888633391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7aa410e490 con 0x7f7aa41068b0 2024-08-02T18:50:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.639+0000 7f7aabd97640 1 -- 172.21.15.103:0/2888633391 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7aa406f190 con 0x7f7aa41068b0 2024-08-02T18:50:29.641 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.639+0000 7f7a9affd640 1 -- 172.21.15.103:0/2888633391 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c00b580 con 0x7f7aa41068b0 2024-08-02T18:50:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.643+0000 7f7aae195740 1 Processor -- start 2024-08-02T18:50:29.645 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.644+0000 7f7a9affd640 1 -- 172.21.15.103:0/2888633391 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f7a9c01d020 con 0x7f7aa41068b0 2024-08-02T18:50:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.645+0000 7f7aae195740 1 -- start start 2024-08-02T18:50:29.646 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.645+0000 7f7aae195740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e0b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.645+0000 7f7aae195740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e15c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.645+0000 7f7aae195740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e185c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.645+0000 7f7aae195740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564497d70a40 con 0x564497e161d0 2024-08-02T18:50:29.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.645+0000 7f7aae195740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564497d089d0 con 0x564497e0aff0 2024-08-02T18:50:29.647 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.645+0000 7f7aae195740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564497d6ca00 con 0x564497e0b910 2024-08-02T18:50:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9332640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e185c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9332640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e185c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46126/0 (socket says 172.21.15.103:46126) 2024-08-02T18:50:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9332640 1 -- 172.21.15.103:0/2643313936 learned_addr learned my addr 172.21.15.103:0/2643313936 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e15c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9332640 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e0b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.648 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9b33640 1 -- 172.21.15.103:0/2643313936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 msgr2=0x564497e0b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e0b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9b33640 1 -- 172.21.15.103:0/2643313936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 msgr2=0x564497e185c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e185c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7a9affd640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a900a2f10 0x7f7a900a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9b33640 1 -- 172.21.15.103:0/2643313936 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564497d0f650 con 0x564497e0b910 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.646+0000 7f7aa9332640 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e185c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.647+0000 7f7aa9332640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a900a2f10 0x7f7a900a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.647+0000 7f7a9affd640 1 -- 172.21.15.103:0/2888633391 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f7a9c0cf960 con 0x7f7aa41068b0 2024-08-02T18:50:29.649 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.647+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e15c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009af0 tx=0x7f7aa00113e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=138b2987dc7aef03 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.648+0000 7f7a8ffff640 1 -- 172.21.15.103:0/2643313936 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0011e10 con 0x564497e0b910 2024-08-02T18:50:29.650 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.648+0000 7f7a8ffff640 1 -- 172.21.15.103:0/2643313936 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7aa0012950 con 0x564497e0b910 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.648+0000 7f7a8ffff640 1 -- 172.21.15.103:0/2643313936 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa000fb20 con 0x564497e0b910 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 -- 172.21.15.103:0/2643313936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 msgr2=0x564497e15c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e15c90 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0009af0 tx=0x7f7aa00113e0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aa9332640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a900a2f10 0x7f7a900a53d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a940057c0 tx=0x7f7a94000bc0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 -- 172.21.15.103:0/2643313936 shutdown_connections 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e185c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e15c90 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 --2- 172.21.15.103:0/2643313936 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e0b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 -- 172.21.15.103:0/2643313936 >> 172.21.15.103:0/2643313936 conn(0x564497e07580 msgr2=0x564497e07960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 -- 172.21.15.103:0/2643313936 shutdown_connections 2024-08-02T18:50:29.651 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.649+0000 7f7aae195740 1 -- 172.21.15.103:0/2643313936 wait complete. 2024-08-02T18:50:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 1 -- start start 2024-08-02T18:50:29.652 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 1 Processor -- start 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e15c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e12f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e136f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564497e18da0 con 0x564497e161d0 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564497d2bb20 con 0x564497e0aff0 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564497e18f20 con 0x564497e0b910 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.650+0000 7f7aae195740 10 client.0 _ll_register_callbacks cb 0x564497d29bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9332640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e12f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9332640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e12f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:48520/0 (socket says 172.21.15.103:48520) 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9332640 1 -- 172.21.15.103:0/3689050958 learned_addr learned my addr 172.21.15.103:0/3689050958 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e15c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aaa334640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e136f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.653 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9b33640 1 -- 172.21.15.103:0/3689050958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 msgr2=0x564497e12f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:29.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e12f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9b33640 1 -- 172.21.15.103:0/3689050958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 msgr2=0x564497e136f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:29.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e136f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9b33640 1 -- 172.21.15.103:0/3689050958 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564497ae23c0 con 0x564497e0aff0 2024-08-02T18:50:29.654 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aa9332640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e12f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.651+0000 7f7aaa334640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.652+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e15c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0000c00 tx=0x7f7aa0012d90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f1912ca01dd0902c server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:29.655 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.652+0000 7f7a8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.652+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/3689050958 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0028070 con 0x564497e0aff0 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.652+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/3689050958 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f7aa000f8a0 con 0x564497e0aff0 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.652+0000 7f7aae195740 1 -- 172.21.15.103:0/3689050958 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7aa0012950 con 0x564497e0aff0 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.652+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/3689050958 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7aa0034050 con 0x564497e0aff0 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.652+0000 7f7aae195740 10 client.25157 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.652+0000 7f7aae195740 1 -- 172.21.15.103:0/3689050958 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564497e248e0 con 0x564497e0aff0 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.653+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/3689050958 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7aa00096c0 con 0x564497e0aff0 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.653+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/3689050958 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7aa0004680 con 0x564497e0aff0 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.653+0000 7f7aae195740 10 client.25157 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.653+0000 7f7aae195740 10 client.25157 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.653+0000 7f7aae195740 20 client.25157 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.653+0000 7f7aae195740 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x564497e25c90 0x564497e28080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.653+0000 7f7aae195740 4 client.25157 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:29.656 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.653+0000 7f7aae195740 1 -- 172.21.15.103:0/3689050958 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f7aa0012950 con 0x564497e25c90 2024-08-02T18:50:29.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.654+0000 7f7aa9332640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x564497e25c90 0x564497e28080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.654+0000 7f7aa9332640 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x564497e25c90 0x564497e28080 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=98c1a08c3d22b659 server_cookie=fdccd1112c34bd6 in_seq=0 out_seq=0 2024-08-02T18:50:29.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.654+0000 7f7a8d7fa640 10 client.25157 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:50:29.657 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.655+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/3689050958 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f7aa0012950 con 0x564497e25c90 2024-08-02T18:50:29.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.655+0000 7f7a8d7fa640 10 client.25157 handle_command_reply: tid=0 2024-08-02T18:50:29.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.655+0000 7f7aae195740 1 client.25157 shutdown 2024-08-02T18:50:29.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.655+0000 7f7aae195740 1 -- 172.21.15.103:0/3689050958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 msgr2=0x564497e15c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.658 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.655+0000 7f7aae195740 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e15c10 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7aa0000c00 tx=0x7f7aa0012d90 comp rx=0 tx=0).stop 2024-08-02T18:50:29.658 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:29.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 1 -- 172.21.15.103:0/3689050958 shutdown_connections 2024-08-02T18:50:29.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x564497e25c90 0x564497e28080 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7a8d7fa640 0 client.25157 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:50:29.659 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e161d0 0x564497e136f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e0b910 0x564497e12f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 1 --2- 172.21.15.103:0/3689050958 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e15c10 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 1 -- 172.21.15.103:0/3689050958 >> 172.21.15.103:0/3689050958 conn(0x564497e07580 msgr2=0x564497e0d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:29.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 1 -- 172.21.15.103:0/3689050958 shutdown_connections 2024-08-02T18:50:29.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 1 -- 172.21.15.103:0/3689050958 wait complete. 2024-08-02T18:50:29.660 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.656+0000 7f7aae195740 20 client.25157 trim_cache size 0 max 16384 2024-08-02T18:50:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.673+0000 7f7aae195740 1 Processor -- start 2024-08-02T18:50:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.674+0000 7f7aae195740 1 -- start start 2024-08-02T18:50:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.674+0000 7f7aae195740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 0x564497e11830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.674+0000 7f7aae195740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e11d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.674+0000 7f7aae195740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0b910 0x564497e12820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.674+0000 7f7aae195740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7a88012620 con 0x564497e0b910 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.674+0000 7f7aae195740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8800fef0 con 0x564497e0aff0 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.674+0000 7f7aae195740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8800dd40 con 0x564497e07580 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.674+0000 7f7aa9332640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e11d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0b910 0x564497e12820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0b910 0x564497e12820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46140/0 (socket says 172.21.15.103:46140) 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 -- 172.21.15.103:0/3106700229 learned_addr learned my addr 172.21.15.103:0/3106700229 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/3106700229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 0x564497e11830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 -- 172.21.15.103:0/3106700229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 msgr2=0x564497e11830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 --2- 172.21.15.103:0/3106700229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 0x564497e11830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 -- 172.21.15.103:0/3106700229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 msgr2=0x564497e11d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 --2- 172.21.15.103:0/3106700229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e11d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 -- 172.21.15.103:0/3106700229 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564497e0b740 con 0x564497e0b910 2024-08-02T18:50:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.675+0000 7f7aaa334640 1 --2- 172.21.15.103:0/3106700229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0b910 0x564497e12820 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c097cf0 tx=0x7f7a9c09bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2d03ed8c064e6e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.676+0000 7f7a8f7fe640 1 -- 172.21.15.103:0/3106700229 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0b4070 con 0x564497e0b910 2024-08-02T18:50:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.676+0000 7f7a8f7fe640 1 -- 172.21.15.103:0/3106700229 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a9c0a4500 con 0x564497e0b910 2024-08-02T18:50:29.678 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.676+0000 7f7a8f7fe640 1 -- 172.21.15.103:0/3106700229 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c01a070 con 0x564497e0b910 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.677+0000 7f7aae195740 1 -- 172.21.15.103:0/3106700229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0b910 msgr2=0x564497e12820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.677+0000 7f7aae195740 1 --2- 172.21.15.103:0/3106700229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0b910 0x564497e12820 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c097cf0 tx=0x7f7a9c09bf90 comp rx=0 tx=0).stop 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.677+0000 7f7aae195740 1 -- 172.21.15.103:0/3106700229 shutdown_connections 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.677+0000 7f7aae195740 1 --2- 172.21.15.103:0/3106700229 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0b910 0x564497e12820 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.677+0000 7f7aae195740 1 --2- 172.21.15.103:0/3106700229 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0aff0 0x564497e11d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.677+0000 7f7aae195740 1 --2- 172.21.15.103:0/3106700229 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 0x564497e11830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.677+0000 7f7aae195740 1 -- 172.21.15.103:0/3106700229 >> 172.21.15.103:0/3106700229 conn(0x564497e0e950 msgr2=0x564497e021b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.678+0000 7f7aae195740 1 -- 172.21.15.103:0/3106700229 shutdown_connections 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.678+0000 7f7aae195740 1 -- 172.21.15.103:0/3106700229 wait complete. 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.678+0000 7f7aae195740 1 -- start start 2024-08-02T18:50:29.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.678+0000 7f7aae195740 1 Processor -- start 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aae195740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 0x564497e1e7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aae195740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0aff0 0x564497e16f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aae195740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0b910 0x564497e17440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aae195740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8800e3b0 con 0x564497e0aff0 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aae195740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8800f820 con 0x564497e0b910 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aae195740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a8800ea80 con 0x564497e07580 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aae195740 10 client.0 _ll_register_callbacks cb 0x7f7aa0005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aaa334640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0b910 0x564497e17440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aa9332640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0aff0 0x564497e16f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aa9332640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0aff0 0x564497e16f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46156/0 (socket says 172.21.15.103:46156) 2024-08-02T18:50:29.682 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aaa334640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0b910 0x564497e17440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:40210/0 (socket says 172.21.15.103:40210) 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.679+0000 7f7aa9332640 1 -- 172.21.15.103:0/922697805 learned_addr learned my addr 172.21.15.103:0/922697805 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 0x564497e1e7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7aaa334640 1 -- 172.21.15.103:0/922697805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 msgr2=0x564497e1e7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7aaa334640 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 0x564497e1e7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7aaa334640 1 -- 172.21.15.103:0/922697805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0aff0 msgr2=0x564497e16f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7aaa334640 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0aff0 0x564497e16f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7aaa334640 1 -- 172.21.15.103:0/922697805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564497e17ab0 con 0x564497e0b910 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7aaa334640 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0b910 0x564497e17440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c099b40 tx=0x7f7a9c00b450 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e4eeaf8ed0d867a7 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7a8d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/922697805 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c0b8020 con 0x564497e0b910 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/922697805 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f7a9c0a4280 con 0x564497e0b910 2024-08-02T18:50:29.683 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.680+0000 7f7aae195740 1 -- 172.21.15.103:0/922697805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7a9c0a4500 con 0x564497e0b910 2024-08-02T18:50:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.681+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/922697805 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f7a9c083050 con 0x564497e0b910 2024-08-02T18:50:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.681+0000 7f7aae195740 10 client.25163 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.681+0000 7f7aae195740 1 -- 172.21.15.103:0/922697805 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x564497e90770 con 0x564497e0b910 2024-08-02T18:50:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.681+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/922697805 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a9c0a4500 con 0x564497e0b910 2024-08-02T18:50:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/922697805 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f7a9c00b040 con 0x564497e0b910 2024-08-02T18:50:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7aae195740 10 client.25163 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7aae195740 10 client.25163 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-02T18:50:29.685 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7aae195740 20 client.25163 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7aae195740 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x564497e161d0 0x564497e92c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7aae195740 4 client.25163 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7aae195740 1 -- 172.21.15.103:0/922697805 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564497d7dfb0 con 0x564497e161d0 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x564497e161d0 0x564497e92c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7aa9b33640 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x564497e161d0 0x564497e92c50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=7ee40f85e1dfd923 server_cookie=d3849b91fff417a8 in_seq=0 out_seq=0 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.682+0000 7f7a8d7fa640 10 client.25163 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7a8d7fa640 1 -- 172.21.15.103:0/922697805 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x564497d7dfb0 con 0x564497e161d0 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7a8d7fa640 10 client.25163 handle_command_reply: tid=0 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 client.25163 shutdown 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 -- 172.21.15.103:0/922697805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0b910 msgr2=0x564497e17440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0b910 0x564497e17440 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c099b40 tx=0x7f7a9c00b450 comp rx=0 tx=0).stop 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 -- 172.21.15.103:0/922697805 shutdown_connections 2024-08-02T18:50:29.686 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564497e0b910 0x564497e17440 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.687 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:50:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x564497e161d0 0x564497e92c50 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564497e0aff0 0x564497e16f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 --2- 172.21.15.103:0/922697805 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564497e07580 0x564497e1e7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 -- 172.21.15.103:0/922697805 >> 172.21.15.103:0/922697805 conn(0x564497e0e950 msgr2=0x564497e07960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7a8d7fa640 0 client.25163 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:50:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 -- 172.21.15.103:0/922697805 shutdown_connections 2024-08-02T18:50:29.689 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.683+0000 7f7aae195740 1 -- 172.21.15.103:0/922697805 wait complete. 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.684+0000 7f7aae195740 20 client.25163 trim_cache size 0 max 16384 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 -- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a900a2f10 msgr2=0x7f7a900a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a900a2f10 0x7f7a900a53d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f7a940057c0 tx=0x7f7a94000bc0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 -- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa41068b0 msgr2=0x7f7aa410d8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa41068b0 0x7f7aa410d8e0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c00c5a0 tx=0x7f7a9c00ef90 comp rx=0 tx=0).stop 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 -- 172.21.15.103:0/2888633391 shutdown_connections 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a900a2f10 0x7f7a900a53d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7aa41068b0 0x7f7aa410d8e0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7aa41007d0 0x7f7aa4073ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 --2- 172.21.15.103:0/2888633391 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7aa40ffe30 0x7f7aa4073570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 -- 172.21.15.103:0/2888633391 >> 172.21.15.103:0/2888633391 conn(0x7f7aa4076f60 msgr2=0x7f7aa4104690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 -- 172.21.15.103:0/2888633391 shutdown_connections 2024-08-02T18:50:29.690 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:29.685+0000 7f7aabd97640 1 -- 172.21.15.103:0/2888633391 wait complete. 2024-08-02T18:50:30.817 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-02T18:50:30.843 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:30 smithi103 ceph-mon[32753]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-02T18:50:31.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:30 smithi121 ceph-mon[37236]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-02T18:50:31.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:30 smithi151 ceph-mon[37155]: pgmap v26: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 511 B/s wr, 6 op/s 2024-08-02T18:50:31.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.089+0000 7ffaeac60640 1 -- 172.21.15.103:0/2794573650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41078b0 msgr2=0x7ffae4107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.089+0000 7ffaeac60640 1 --2- 172.21.15.103:0/2794573650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41078b0 0x7ffae4107c90 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7ffad8009930 tx=0x7ffad802a440 comp rx=0 tx=0).stop 2024-08-02T18:50:31.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.090+0000 7ffaeac60640 1 -- 172.21.15.103:0/2794573650 shutdown_connections 2024-08-02T18:50:31.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.090+0000 7ffaeac60640 1 --2- 172.21.15.103:0/2794573650 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae4102250 0x7ffae410e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.090+0000 7ffaeac60640 1 --2- 172.21.15.103:0/2794573650 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae41018b0 0x7ffae4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.090+0000 7ffaeac60640 1 --2- 172.21.15.103:0/2794573650 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41078b0 0x7ffae4107c90 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.091 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.090+0000 7ffaeac60640 1 -- 172.21.15.103:0/2794573650 >> 172.21.15.103:0/2794573650 conn(0x7ffae40fd5b0 msgr2=0x7ffae40ff9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:31.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.091+0000 7ffaeac60640 1 -- 172.21.15.103:0/2794573650 shutdown_connections 2024-08-02T18:50:31.093 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.092+0000 7ffaeac60640 1 -- 172.21.15.103:0/2794573650 wait complete. 2024-08-02T18:50:31.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.093+0000 7ffaeac60640 1 Processor -- start 2024-08-02T18:50:31.094 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.093+0000 7ffaeac60640 1 -- start start 2024-08-02T18:50:31.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.093+0000 7ffaeac60640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41018b0 0x7ffae41983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffaeac60640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae4102250 0x7ffae4198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.095 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffae89fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41018b0 0x7ffae41983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffae89fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41018b0 0x7ffae41983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46180/0 (socket says 172.21.15.103:46180) 2024-08-02T18:50:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffae89fc640 1 -- 172.21.15.103:0/1395750122 learned_addr learned my addr 172.21.15.103:0/1395750122 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffaeac60640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae41078b0 0x7ffae419cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4111ea0 con 0x7ffae41018b0 2024-08-02T18:50:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4111d20 con 0x7ffae41078b0 2024-08-02T18:50:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffae4112020 con 0x7ffae4102250 2024-08-02T18:50:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae4102250 0x7ffae4198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.096 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.094+0000 7ffae91fd640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae41078b0 0x7ffae419cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.095+0000 7ffae3fff640 1 -- 172.21.15.103:0/1395750122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae41078b0 msgr2=0x7ffae419cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.095+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae41078b0 0x7ffae419cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.095+0000 7ffae3fff640 1 -- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41018b0 msgr2=0x7ffae41983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.095+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41018b0 0x7ffae41983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.095+0000 7ffae3fff640 1 -- 172.21.15.103:0/1395750122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae419d370 con 0x7ffae4102250 2024-08-02T18:50:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.095+0000 7ffae89fc640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41018b0 0x7ffae41983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.096+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae4102250 0x7ffae4198900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffad000d720 tx=0x7ffad000dbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:31.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.096+0000 7ffae1ffb640 1 -- 172.21.15.103:0/1395750122 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0017070 con 0x7ffae4102250 2024-08-02T18:50:31.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.096+0000 7ffae1ffb640 1 -- 172.21.15.103:0/1395750122 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad000de30 con 0x7ffae4102250 2024-08-02T18:50:31.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.096+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffae419d660 con 0x7ffae4102250 2024-08-02T18:50:31.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.097+0000 7ffae1ffb640 1 -- 172.21.15.103:0/1395750122 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad0004a00 con 0x7ffae4102250 2024-08-02T18:50:31.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.097+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffae41a4f40 con 0x7ffae4102250 2024-08-02T18:50:31.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.100+0000 7ffae1ffb640 1 -- 172.21.15.103:0/1395750122 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7ffad0004ba0 con 0x7ffae4102250 2024-08-02T18:50:31.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.100+0000 7ffaed05e740 1 Processor -- start 2024-08-02T18:50:31.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.100+0000 7ffaed05e740 1 -- start start 2024-08-02T18:50:31.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28ec560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ecaa0 0x559aa28fb370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.103 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28fb8b0 0x559aa28fdca0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffaed05e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559aa2851810 con 0x559aa28ecaa0 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffaed05e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559aa27f8c70 con 0x559aa28ec180 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffaed05e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559aa284d7d0 con 0x559aa28fb8b0 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffae1ffb640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ffad40a2e90 0x7ffad40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffae91fd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28ec560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffae3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28fb8b0 0x559aa28fdca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffae3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28fb8b0 0x559aa28fdca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:48554/0 (socket says 172.21.15.103:48554) 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.101+0000 7ffae3fff640 1 -- 172.21.15.103:0/1332694704 learned_addr learned my addr 172.21.15.103:0/1332694704 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae89fc640 1 --2- 172.21.15.103:0/1332694704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ecaa0 0x559aa28fb370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae1ffb640 1 -- 172.21.15.103:0/1395750122 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ffad00cf620 con 0x7ffae4102250 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae3fff640 1 -- 172.21.15.103:0/1332694704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 msgr2=0x559aa28ec560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1332694704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28ec560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.104 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae91fd640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ffad40a2e90 0x7ffad40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae3fff640 1 -- 172.21.15.103:0/1332694704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ecaa0 msgr2=0x559aa28fb370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:31.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1332694704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ecaa0 0x559aa28fb370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.105 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae3fff640 1 -- 172.21.15.103:0/1332694704 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa25c3ba0 con 0x559aa28fb8b0 2024-08-02T18:50:31.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.102+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1332694704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28fb8b0 0x559aa28fdca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffad009b4e0 tx=0x7ffad006e5c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b3d56cdab2684df6 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:31.106 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.103+0000 7ffaceffd640 1 -- 172.21.15.103:0/1332694704 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad009b320 con 0x559aa28fb8b0 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.103+0000 7ffaceffd640 1 -- 172.21.15.103:0/1332694704 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad009bc50 con 0x559aa28fb8b0 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.103+0000 7ffaceffd640 1 -- 172.21.15.103:0/1332694704 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad000f3c0 con 0x559aa28fb8b0 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffaed05e740 1 -- 172.21.15.103:0/1332694704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28fb8b0 msgr2=0x559aa28fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1332694704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28fb8b0 0x559aa28fdca0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7ffad009b4e0 tx=0x7ffad006e5c0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffae91fd640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ffad40a2e90 0x7ffad40a5350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009fd0 tx=0x7ffadc00d040 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffaed05e740 1 -- 172.21.15.103:0/1332694704 shutdown_connections 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1332694704 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28fb8b0 0x559aa28fdca0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1332694704 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ecaa0 0x559aa28fb370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1332694704 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28ec560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffaed05e740 1 -- 172.21.15.103:0/1332694704 >> 172.21.15.103:0/1332694704 conn(0x559aa28e8850 msgr2=0x559aa28e8c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.104+0000 7ffaed05e740 1 -- 172.21.15.103:0/1332694704 shutdown_connections 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.105+0000 7ffaed05e740 1 -- 172.21.15.103:0/1332694704 wait complete. 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.105+0000 7ffaed05e740 1 -- start start 2024-08-02T18:50:31.107 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.105+0000 7ffaed05e740 1 Processor -- start 2024-08-02T18:50:31.109 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.106+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28f8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.106+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa28f8db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.106+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa28f92f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.106+0000 7ffaed05e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559aa28fe3c0 con 0x559aa28fb8b0 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.106+0000 7ffaed05e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559aa280c9a0 con 0x559aa28ec180 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.106+0000 7ffaed05e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559aa28fe540 con 0x559aa28ecaa0 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.106+0000 7ffae91fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa28f92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae91fd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa28f92f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46202/0 (socket says 172.21.15.103:46202) 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae91fd640 1 -- 172.21.15.103:0/1342305976 learned_addr learned my addr 172.21.15.103:0/1342305976 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa28f8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffaed05e740 10 client.0 _ll_register_callbacks cb 0x559aa27fac90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae89fc640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28f8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae3fff640 1 -- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 msgr2=0x559aa28f8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:31.110 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28f8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae3fff640 1 -- 172.21.15.103:0/1342305976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 msgr2=0x559aa28f92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa28f92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae3fff640 1 -- 172.21.15.103:0/1342305976 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa2818220 con 0x559aa28ecaa0 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae89fc640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28f8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae91fd640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa28f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffae3fff640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa28f8db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffad009fac0 tx=0x7ffad0097e70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=560d4567aa5ba6ee server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.107+0000 7ffac3fff640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.108+0000 7ffac3fff640 1 -- 172.21.15.103:0/1342305976 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad009aeb0 con 0x559aa28ecaa0 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.108+0000 7ffaed05e740 1 -- 172.21.15.103:0/1342305976 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad009bc50 con 0x559aa28ecaa0 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.108+0000 7ffac3fff640 1 -- 172.21.15.103:0/1342305976 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ffad00a3d30 con 0x559aa28ecaa0 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.108+0000 7ffac3fff640 1 -- 172.21.15.103:0/1342305976 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffad009b090 con 0x559aa28ecaa0 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.108+0000 7ffaed05e740 10 client.25192 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:31.111 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.108+0000 7ffaed05e740 1 -- 172.21.15.103:0/1342305976 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559aa28fe3c0 con 0x559aa28ecaa0 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.109+0000 7ffac3fff640 1 -- 172.21.15.103:0/1342305976 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad009bc50 con 0x559aa28ecaa0 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.109+0000 7ffac3fff640 1 -- 172.21.15.103:0/1342305976 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ffad0082b80 con 0x559aa28ecaa0 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.109+0000 7ffaed05e740 10 client.25192 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.109+0000 7ffaed05e740 10 client.25192 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.109+0000 7ffaed05e740 20 client.25192 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.109+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559aa28f01c0 0x559aa28f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.109+0000 7ffaed05e740 4 client.25192 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.109+0000 7ffaed05e740 1 -- 172.21.15.103:0/1342305976 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559aa285ef40 con 0x559aa28f01c0 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.110+0000 7ffae89fc640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559aa28f01c0 0x559aa28f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.110+0000 7ffac3fff640 10 client.25192 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:31.113 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.110+0000 7ffae89fc640 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559aa28f01c0 0x559aa28f25e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=128183c71fdf4128 server_cookie=434811f35405d4da in_seq=0 out_seq=0 2024-08-02T18:50:31.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.111+0000 7ffac3fff640 1 -- 172.21.15.103:0/1342305976 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559aa285ef40 con 0x559aa28f01c0 2024-08-02T18:50:31.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.111+0000 7ffac3fff640 10 client.25192 handle_command_reply: tid=0 2024-08-02T18:50:31.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.111+0000 7ffaed05e740 1 client.25192 shutdown 2024-08-02T18:50:31.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.111+0000 7ffaed05e740 1 -- 172.21.15.103:0/1342305976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 msgr2=0x559aa28f8db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.114 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa28f8db0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7ffad009fac0 tx=0x7ffad0097e70 comp rx=0 tx=0).stop 2024-08-02T18:50:31.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffaed05e740 1 -- 172.21.15.103:0/1342305976 shutdown_connections 2024-08-02T18:50:31.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559aa28f01c0 0x559aa28f25e0 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa28f92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa28f8db0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffaed05e740 1 --2- 172.21.15.103:0/1342305976 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ec180 0x559aa28f8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffaed05e740 1 -- 172.21.15.103:0/1342305976 >> 172.21.15.103:0/1342305976 conn(0x559aa28e8850 msgr2=0x559aa28e7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:31.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffac3fff640 0 client.25192 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:31.115 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.112+0000 7ffaed05e740 1 -- 172.21.15.103:0/1342305976 shutdown_connections 2024-08-02T18:50:31.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.113+0000 7ffaed05e740 1 -- 172.21.15.103:0/1342305976 wait complete. 2024-08-02T18:50:31.116 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.113+0000 7ffaed05e740 20 client.25192 trim_cache size 0 max 16384 2024-08-02T18:50:31.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffaed05e740 1 Processor -- start 2024-08-02T18:50:31.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffaed05e740 1 -- start start 2024-08-02T18:50:31.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ec180 0x559aa28f9140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ecaa0 0x559aa28e7a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa290f040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffaed05e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffae41af440 con 0x559aa28fb8b0 2024-08-02T18:50:31.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffaed05e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae41acd10 con 0x559aa28ecaa0 2024-08-02T18:50:31.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffaed05e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffae41aab60 con 0x559aa28ec180 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffae89fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ec180 0x559aa28f9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffae89fc640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ec180 0x559aa28f9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:48564/0 (socket says 172.21.15.103:48564) 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffae89fc640 1 -- 172.21.15.103:0/3003818728 learned_addr learned my addr 172.21.15.103:0/3003818728 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.132+0000 7ffae3fff640 1 --2- 172.21.15.103:0/3003818728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ecaa0 0x559aa28e7a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7ffae89fc640 1 -- 172.21.15.103:0/3003818728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ecaa0 msgr2=0x559aa28e7a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7ffae89fc640 1 --2- 172.21.15.103:0/3003818728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ecaa0 0x559aa28e7a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7ffae89fc640 1 -- 172.21.15.103:0/3003818728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 msgr2=0x559aa290f040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7ffae89fc640 1 --2- 172.21.15.103:0/3003818728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa290f040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7ffae89fc640 1 -- 172.21.15.103:0/3003818728 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559aa28ed060 con 0x559aa28ec180 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7ffae89fc640 1 --2- 172.21.15.103:0/3003818728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ec180 0x559aa28f9140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffad8004770 tx=0x7ffad80046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=109de014974d961f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7fface7fc640 1 -- 172.21.15.103:0/3003818728 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad804a030 con 0x559aa28ec180 2024-08-02T18:50:31.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7fface7fc640 1 -- 172.21.15.103:0/3003818728 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad8005020 con 0x559aa28ec180 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.133+0000 7fface7fc640 1 -- 172.21.15.103:0/3003818728 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad8035040 con 0x559aa28ec180 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 -- 172.21.15.103:0/3003818728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ec180 msgr2=0x559aa28f9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 --2- 172.21.15.103:0/3003818728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ec180 0x559aa28f9140 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7ffad8004770 tx=0x7ffad80046c0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 -- 172.21.15.103:0/3003818728 shutdown_connections 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 --2- 172.21.15.103:0/3003818728 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28fb8b0 0x559aa290f040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 --2- 172.21.15.103:0/3003818728 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28ecaa0 0x559aa28e7a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 --2- 172.21.15.103:0/3003818728 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ec180 0x559aa28f9140 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 -- 172.21.15.103:0/3003818728 >> 172.21.15.103:0/3003818728 conn(0x559aa28e8850 msgr2=0x559aa28e7310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 -- 172.21.15.103:0/3003818728 shutdown_connections 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 -- 172.21.15.103:0/3003818728 wait complete. 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.134+0000 7ffaed05e740 1 -- start start 2024-08-02T18:50:31.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffaed05e740 1 Processor -- start 2024-08-02T18:50:31.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ec180 0x559aa28f6290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa29037d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffaed05e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28fb8b0 0x559aa2903d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffaed05e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ffae41ab1d0 con 0x559aa28ec180 2024-08-02T18:50:31.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffaed05e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ffae41ac640 con 0x559aa28fb8b0 2024-08-02T18:50:31.139 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffaed05e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ffae41ab8a0 con 0x559aa28ecaa0 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffae89fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ec180 0x559aa28f6290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffae89fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ec180 0x559aa28f6290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46210/0 (socket says 172.21.15.103:46210) 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffae89fc640 1 -- 172.21.15.103:0/589922860 learned_addr learned my addr 172.21.15.103:0/589922860 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.135+0000 7ffaed05e740 10 client.0 _ll_register_callbacks cb 0x7ffad0005240 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffae3fff640 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa29037d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffae3fff640 1 -- 172.21.15.103:0/589922860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28fb8b0 msgr2=0x559aa2903d10 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffae3fff640 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28fb8b0 0x559aa2903d10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffae3fff640 1 -- 172.21.15.103:0/589922860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ec180 msgr2=0x559aa28f6290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffae3fff640 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ec180 0x559aa28f6290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffae3fff640 1 -- 172.21.15.103:0/589922860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559aa2904450 con 0x559aa28ecaa0 2024-08-02T18:50:31.140 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffae3fff640 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa29037d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009610 tx=0x7ffad00a4060 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6126f98d86f9374d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffac3fff640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.136+0000 7ffac3fff640 1 -- 172.21.15.103:0/589922860 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffad009aeb0 con 0x559aa28ecaa0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.137+0000 7ffac3fff640 1 -- 172.21.15.103:0/589922860 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ffad00cce00 con 0x559aa28ecaa0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.137+0000 7ffaed05e740 1 -- 172.21.15.103:0/589922860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffad8005020 con 0x559aa28ecaa0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.137+0000 7ffac3fff640 1 -- 172.21.15.103:0/589922860 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ffad00cc790 con 0x559aa28ecaa0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.137+0000 7ffaed05e740 10 client.25198 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.137+0000 7ffaed05e740 1 -- 172.21.15.103:0/589922860 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559aa29710f0 con 0x559aa28ecaa0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.137+0000 7ffac3fff640 1 -- 172.21.15.103:0/589922860 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ffad8005020 con 0x559aa28ecaa0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.138+0000 7ffac3fff640 1 -- 172.21.15.103:0/589922860 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ffad009a9a0 con 0x559aa28ecaa0 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.138+0000 7ffaed05e740 10 client.25198 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.138+0000 7ffaed05e740 10 client.25198 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.138+0000 7ffaed05e740 20 client.25198 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.138+0000 7ffaed05e740 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559aa29716c0 0x559aa2973ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:31.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.138+0000 7ffaed05e740 4 client.25198 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.95, "await_for": 45.0}] 2024-08-02T18:50:31.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.138+0000 7ffaed05e740 1 -- 172.21.15.103:0/589922860 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.95, "await_for": 45.0}) -- 0x559aa2859290 con 0x559aa29716c0 2024-08-02T18:50:31.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.138+0000 7ffae89fc640 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559aa29716c0 0x559aa2973ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:31.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.139+0000 7ffae89fc640 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559aa29716c0 0x559aa2973ae0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3c4a5f387c3a30f9 server_cookie=1d216e0906f8c922 in_seq=0 out_seq=0 2024-08-02T18:50:31.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.139+0000 7ffac3fff640 10 client.25198 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:31.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.149+0000 7ffac3fff640 1 -- 172.21.15.103:0/589922860 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x559aa2859290 con 0x559aa29716c0 2024-08-02T18:50:31.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.149+0000 7ffac3fff640 10 client.25198 handle_command_reply: tid=0 2024-08-02T18:50:31.151 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.149+0000 7ffaed05e740 1 client.25198 shutdown 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 -- 172.21.15.103:0/589922860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 msgr2=0x559aa29037d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa29037d0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7ffad0009610 tx=0x7ffad00a4060 comp rx=0 tx=0).stop 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 -- 172.21.15.103:0/589922860 shutdown_connections 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559aa29716c0 0x559aa2973ae0 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffac3fff640 0 client.25198 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559aa28fb8b0 0x559aa2903d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559aa28ecaa0 0x559aa29037d0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 --2- 172.21.15.103:0/589922860 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559aa28ec180 0x559aa28f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 -- 172.21.15.103:0/589922860 >> 172.21.15.103:0/589922860 conn(0x559aa28e8850 msgr2=0x559aa28e7b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:31.152 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 -- 172.21.15.103:0/589922860 shutdown_connections 2024-08-02T18:50:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 1 -- 172.21.15.103:0/589922860 wait complete. 2024-08-02T18:50:31.153 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.150+0000 7ffaed05e740 20 client.25198 trim_cache size 0 max 16384 2024-08-02T18:50:31.153 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:31.153 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 26, 2024-08-02T18:50:31.153 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24473, 2024-08-02T18:50:31.153 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 2, 2024-08-02T18:50:31.153 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "d5d6e209": { 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 2, 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 141.9, 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-08-02T18:50:31.154 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-08-02T18:50:31.155 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-08-02T18:50:31.155 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-08-02T18:50:31.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:31.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:31.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:31.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:31.155 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:31.155 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ffad40a2e90 msgr2=0x7ffad40a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ffad40a2e90 0x7ffad40a5350 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffadc009fd0 tx=0x7ffadc00d040 comp rx=0 tx=0).stop 2024-08-02T18:50:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae4102250 msgr2=0x7ffae4198900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae4102250 0x7ffae4198900 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7ffad000d720 tx=0x7ffad000dbe0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 shutdown_connections 2024-08-02T18:50:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ffad40a2e90 0x7ffad40a5350 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ffae41078b0 0x7ffae419cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.156 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ffae4102250 0x7ffae4198900 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 --2- 172.21.15.103:0/1395750122 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ffae41018b0 0x7ffae41983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 >> 172.21.15.103:0/1395750122 conn(0x7ffae40fd5b0 msgr2=0x7ffae40fddb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 shutdown_connections 2024-08-02T18:50:31.157 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:31.152+0000 7ffaeac60640 1 -- 172.21.15.103:0/1395750122 wait complete. 2024-08-02T18:50:31.905 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'd5d6e209', quiesce took 5.3 seconds. Will release after: 16.65 2024-08-02T18:50:31.911 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.485+0000 7f9fd653a640 1 -- 172.21.15.103:0/2633482577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0101130 msgr2=0x7f9fd010d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.485+0000 7f9fd653a640 1 --2- 172.21.15.103:0/2633482577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0101130 0x7f9fd010d660 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8009cd0 tx=0x7f9fc802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.485+0000 7f9fd653a640 1 -- 172.21.15.103:0/2633482577 shutdown_connections 2024-08-02T18:50:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.485+0000 7f9fd653a640 1 --2- 172.21.15.103:0/2633482577 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0101130 0x7f9fd010d660 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.485+0000 7f9fd653a640 1 --2- 172.21.15.103:0/2633482577 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0100790 0x7f9fd0100bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.485+0000 7f9fd653a640 1 --2- 172.21.15.103:0/2633482577 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fd0106790 0x7f9fd0106b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.485+0000 7f9fd653a640 1 -- 172.21.15.103:0/2633482577 >> 172.21.15.103:0/2633482577 conn(0x7f9fd00fc4b0 msgr2=0x7f9fd00fe8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.486+0000 7f9fd653a640 1 -- 172.21.15.103:0/2633482577 shutdown_connections 2024-08-02T18:50:32.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.486+0000 7f9fd653a640 1 -- 172.21.15.103:0/2633482577 wait complete. 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.486+0000 7f9fd653a640 1 Processor -- start 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.486+0000 7f9fd653a640 1 -- start start 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.487+0000 7f9fd653a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0100790 0x7f9fd0198240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.487+0000 7f9fd653a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fd0101130 0x7f9fd0198780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.487+0000 7f9fd653a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0106790 0x7f9fd019cb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.487+0000 7f9fd653a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110cb0 con 0x7f9fd0106790 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.487+0000 7f9fd653a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110b30 con 0x7f9fd0101130 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.487+0000 7f9fd4ad7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0106790 0x7f9fd019cb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd4ad7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0106790 0x7f9fd019cb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46226/0 (socket says 172.21.15.103:46226) 2024-08-02T18:50:32.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd4ad7640 1 -- 172.21.15.103:0/1240989478 learned_addr learned my addr 172.21.15.103:0/1240989478 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:32.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0100790 0x7f9fd0198240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd0110e30 con 0x7f9fd0100790 2024-08-02T18:50:32.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fd0101130 0x7f9fd0198780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd4ad7640 1 -- 172.21.15.103:0/1240989478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0100790 msgr2=0x7f9fd0198240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd4ad7640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0100790 0x7f9fd0198240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd4ad7640 1 -- 172.21.15.103:0/1240989478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fd0101130 msgr2=0x7f9fd0198780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd4ad7640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fd0101130 0x7f9fd0198780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd4ad7640 1 -- 172.21.15.103:0/1240989478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9fd019d1f0 con 0x7f9fd0106790 2024-08-02T18:50:32.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fd0101130 0x7f9fd0198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:32.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.488+0000 7f9fd4ad7640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0106790 0x7f9fd019cb10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8006010 tx=0x7f9fc8003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:32.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.489+0000 7f9fcd7fa640 1 -- 172.21.15.103:0/1240989478 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8031c80 con 0x7f9fd0106790 2024-08-02T18:50:32.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.489+0000 7f9fcd7fa640 1 -- 172.21.15.103:0/1240989478 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fc8031e20 con 0x7f9fd0106790 2024-08-02T18:50:32.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.489+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9fd019d480 con 0x7f9fd0106790 2024-08-02T18:50:32.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.489+0000 7f9fcd7fa640 1 -- 172.21.15.103:0/1240989478 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc8030cb0 con 0x7f9fd0106790 2024-08-02T18:50:32.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.489+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9fd01a4dc0 con 0x7f9fd0106790 2024-08-02T18:50:32.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.492+0000 7f9fd8938740 1 Processor -- start 2024-08-02T18:50:32.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.492+0000 7f9fcd7fa640 1 -- 172.21.15.103:0/1240989478 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f9fc8004040 con 0x7f9fd0106790 2024-08-02T18:50:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fd8938740 1 -- start start 2024-08-02T18:50:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 0x55c5989ec600 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e7660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fd8938740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c598942a40 con 0x55c5989ecb40 2024-08-02T18:50:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fd8938740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c5988da9d0 con 0x55c5989e71e0 2024-08-02T18:50:32.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fd8938740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c59893ea00 con 0x55c5989ec220 2024-08-02T18:50:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989e6b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46238/0 (socket says 172.21.15.103:46238) 2024-08-02T18:50:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fcffff640 1 -- 172.21.15.103:0/1079791590 learned_addr learned my addr 172.21.15.103:0/1079791590 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.493+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e7660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 0x55c5989ec600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcf7fe640 1 -- 172.21.15.103:0/1079791590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 msgr2=0x55c5989ec600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:32.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 0x55c5989ec600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcf7fe640 1 -- 172.21.15.103:0/1079791590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 msgr2=0x55c5989e6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:32.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989e6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcf7fe640 1 -- 172.21.15.103:0/1079791590 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5988e1650 con 0x55c5989e71e0 2024-08-02T18:50:32.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcd7fa640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9fb80a2e90 0x7f9fb80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e7660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00fe960 tx=0x7f9fc4005850 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6a57548eed8553a9 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:32.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:32.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.494+0000 7f9fcd7fa640 1 -- 172.21.15.103:0/1240989478 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f9fc802e030 con 0x7f9fd0106790 2024-08-02T18:50:32.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.495+0000 7f9fb67fc640 1 -- 172.21.15.103:0/1079791590 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc400f880 con 0x55c5989e71e0 2024-08-02T18:50:32.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.495+0000 7f9fb67fc640 1 -- 172.21.15.103:0/1079791590 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fc4005020 con 0x55c5989e71e0 2024-08-02T18:50:32.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.495+0000 7f9fb67fc640 1 -- 172.21.15.103:0/1079791590 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4004ce0 con 0x55c5989e71e0 2024-08-02T18:50:32.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.495+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9fb80a2e90 0x7f9fb80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 -- 172.21.15.103:0/1079791590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 msgr2=0x55c5989e7660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9fb80a2e90 0x7f9fb80a5350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55c5989da730 tx=0x7f9fc0005f90 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:32.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e7660 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f9fd00fe960 tx=0x7f9fc4005850 comp rx=0 tx=0).stop 2024-08-02T18:50:32.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 -- 172.21.15.103:0/1079791590 shutdown_connections 2024-08-02T18:50:32.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e7660 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1079791590 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 0x55c5989ec600 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 -- 172.21.15.103:0/1079791590 >> 172.21.15.103:0/1079791590 conn(0x55c5989d9020 msgr2=0x55c5989d9400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 -- 172.21.15.103:0/1079791590 shutdown_connections 2024-08-02T18:50:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 -- 172.21.15.103:0/1079791590 wait complete. 2024-08-02T18:50:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.496+0000 7f9fd8938740 1 -- start start 2024-08-02T18:50:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd8938740 1 Processor -- start 2024-08-02T18:50:32.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989f01b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 0x55c5989f06f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989f0c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd8938740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c5989f3560 con 0x55c5989ecb40 2024-08-02T18:50:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd8938740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c5988fdb20 con 0x55c5989e71e0 2024-08-02T18:50:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd8938740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c5989f36e0 con 0x55c5989ec220 2024-08-02T18:50:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd8938740 10 client.0 _ll_register_callbacks cb 0x55c5988fbbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fcf7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 0x55c5989f06f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989f01b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989f01b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:40304/0 (socket says 172.21.15.103:40304) 2024-08-02T18:50:32.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fcffff640 1 -- 172.21.15.103:0/1523390538 learned_addr learned my addr 172.21.15.103:0/1523390538 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:32.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.497+0000 7f9fd4ad7640 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989f0c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9fcffff640 1 -- 172.21.15.103:0/1523390538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 msgr2=0x55c5989f06f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:32.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 0x55c5989f06f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9fcffff640 1 -- 172.21.15.103:0/1523390538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 msgr2=0x55c5989f0c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:32.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989f0c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9fcffff640 1 -- 172.21.15.103:0/1523390538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c5986b43c0 con 0x55c5989e71e0 2024-08-02T18:50:32.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989f01b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0004620 tx=0x7f9fc0004730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dd8507d51b7dd0b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:32.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9faf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:50:32.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9faf7fe640 1 -- 172.21.15.103:0/1523390538 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0009990 con 0x55c5989e71e0 2024-08-02T18:50:32.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9fd8938740 1 -- 172.21.15.103:0/1523390538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc4005020 con 0x55c5989e71e0 2024-08-02T18:50:32.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.498+0000 7f9faf7fe640 1 -- 172.21.15.103:0/1523390538 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f9fc000f690 con 0x55c5989e71e0 2024-08-02T18:50:32.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9faf7fe640 1 -- 172.21.15.103:0/1523390538 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9fc000f890 con 0x55c5989e71e0 2024-08-02T18:50:32.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9fd8938740 10 client.25187 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:32.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9fd8938740 1 -- 172.21.15.103:0/1523390538 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c5989ff440 con 0x55c5989e71e0 2024-08-02T18:50:32.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9faf7fe640 1 -- 172.21.15.103:0/1523390538 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fc4005020 con 0x55c5989e71e0 2024-08-02T18:50:32.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9faf7fe640 1 -- 172.21.15.103:0/1523390538 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9fc0027070 con 0x55c5989e71e0 2024-08-02T18:50:32.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9fd8938740 10 client.25187 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:32.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9fd8938740 10 client.25187 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-02T18:50:32.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9fd8938740 20 client.25187 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:32.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55c598a00ab0 0x55c598a02f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9fd8938740 4 client.25187 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:32.507 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.499+0000 7f9fd8938740 1 -- 172.21.15.103:0/1523390538 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c59894ffb0 con 0x55c598a00ab0 2024-08-02T18:50:32.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.500+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55c598a00ab0 0x55c598a02f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.500+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55c598a00ab0 0x55c598a02f00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=ff7045c8ca2ddf41 server_cookie=c06ece295389e8ba in_seq=0 out_seq=0 2024-08-02T18:50:32.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.500+0000 7f9faf7fe640 10 client.25187 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:50:32.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9faf7fe640 1 -- 172.21.15.103:0/1523390538 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c59894ffb0 con 0x55c598a00ab0 2024-08-02T18:50:32.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9faf7fe640 10 client.25187 handle_command_reply: tid=0 2024-08-02T18:50:32.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 client.25187 shutdown 2024-08-02T18:50:32.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 -- 172.21.15.103:0/1523390538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 msgr2=0x55c5989f01b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989f01b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0004620 tx=0x7f9fc0004730 comp rx=0 tx=0).stop 2024-08-02T18:50:32.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 -- 172.21.15.103:0/1523390538 shutdown_connections 2024-08-02T18:50:32.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ecb40 0x55c5989f0c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ec220 0x55c5989f06f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55c598a00ab0 0x55c598a02f00 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9faf7fe640 0 client.25187 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:50:32.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1523390538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989f01b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 -- 172.21.15.103:0/1523390538 >> 172.21.15.103:0/1523390538 conn(0x55c5989d9020 msgr2=0x55c5989d86f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:32.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.501+0000 7f9fd8938740 1 -- 172.21.15.103:0/1523390538 shutdown_connections 2024-08-02T18:50:32.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.502+0000 7f9fd8938740 1 -- 172.21.15.103:0/1523390538 wait complete. 2024-08-02T18:50:32.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.502+0000 7f9fd8938740 20 client.25187 trim_cache size 0 max 16384 2024-08-02T18:50:32.516 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.515+0000 7f9fd8938740 1 Processor -- start 2024-08-02T18:50:32.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.515+0000 7f9fd8938740 1 -- start start 2024-08-02T18:50:32.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.515+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e6b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.515+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989eba50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.515+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ecb40 0x55c5989d4400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.515+0000 7f9fd8938740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01af320 con 0x55c5989ec220 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.515+0000 7f9fd8938740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01acbf0 con 0x55c5989e71e0 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.515+0000 7f9fd8938740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01aaa40 con 0x55c5989ecb40 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989eba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989eba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46266/0 (socket says 172.21.15.103:46266) 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 -- 172.21.15.103:0/1633640372 learned_addr learned my addr 172.21.15.103:0/1633640372 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fd4ad7640 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ecb40 0x55c5989d4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 -- 172.21.15.103:0/1633640372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ecb40 msgr2=0x55c5989d4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:32.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ecb40 0x55c5989d4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 -- 172.21.15.103:0/1633640372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 msgr2=0x55c5989e6b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:32.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e6b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 -- 172.21.15.103:0/1633640372 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c5989ee720 con 0x55c5989ec220 2024-08-02T18:50:32.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcffff640 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:32.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.516+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989eba50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40048b0 tx=0x7f9fc4013fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61fa8715858cb976 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:32.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.517+0000 7f9fb5ffb640 1 -- 172.21.15.103:0/1633640372 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc4005450 con 0x55c5989ec220 2024-08-02T18:50:32.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.517+0000 7f9fb5ffb640 1 -- 172.21.15.103:0/1633640372 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fc4004ef0 con 0x55c5989ec220 2024-08-02T18:50:32.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.517+0000 7f9fb5ffb640 1 -- 172.21.15.103:0/1633640372 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc40042a0 con 0x55c5989ec220 2024-08-02T18:50:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.517+0000 7f9fd8938740 1 -- 172.21.15.103:0/1633640372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 msgr2=0x55c5989eba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.517+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989eba50 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f9fc40048b0 tx=0x7f9fc4013fd0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 -- 172.21.15.103:0/1633640372 shutdown_connections 2024-08-02T18:50:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989ecb40 0x55c5989d4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989eba50 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 --2- 172.21.15.103:0/1633640372 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989e71e0 0x55c5989e6b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 -- 172.21.15.103:0/1633640372 >> 172.21.15.103:0/1633640372 conn(0x55c5989d9020 msgr2=0x55c5989eb340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 -- 172.21.15.103:0/1633640372 shutdown_connections 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 -- 172.21.15.103:0/1633640372 wait complete. 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 -- start start 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.518+0000 7f9fd8938740 1 Processor -- start 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989e71e0 0x55c5989f8b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989f9090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fd8938740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989ecb40 0x55c598a07b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fd8938740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01ab0b0 con 0x55c5989ec220 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fd8938740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01ac520 con 0x55c5989ecb40 2024-08-02T18:50:32.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fd8938740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9fd01ab780 con 0x55c5989e71e0 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fd8938740 10 client.0 _ll_register_callbacks cb 0x7f9fc00044b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989e71e0 0x55c5989f8b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fcffff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989e71e0 0x55c5989f8b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:48642/0 (socket says 172.21.15.103:48642) 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fcffff640 1 -- 172.21.15.103:0/2891880257 learned_addr learned my addr 172.21.15.103:0/2891880257 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989f9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.519+0000 7f9fd4ad7640 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989ecb40 0x55c598a07b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9fcffff640 1 -- 172.21.15.103:0/2891880257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989ecb40 msgr2=0x55c598a07b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9fcffff640 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989ecb40 0x55c598a07b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9fcffff640 1 -- 172.21.15.103:0/2891880257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 msgr2=0x55c5989f9090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9fcffff640 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989f9090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9fcffff640 1 -- 172.21.15.103:0/2891880257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c598a083b0 con 0x55c5989e71e0 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:32.523 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9fcffff640 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989e71e0 0x55c5989f8b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0004480 tx=0x7f9fc000fce0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e06d08662ad457d3 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:32.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9faf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:50:32.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9faf7fe640 1 -- 172.21.15.103:0/2891880257 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9fc0003e50 con 0x55c5989e71e0 2024-08-02T18:50:32.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9fd8938740 1 -- 172.21.15.103:0/2891880257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9fc4004ef0 con 0x55c5989e71e0 2024-08-02T18:50:32.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.520+0000 7f9faf7fe640 1 -- 172.21.15.103:0/2891880257 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f9fc001fac0 con 0x55c5989e71e0 2024-08-02T18:50:32.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9faf7fe640 1 -- 172.21.15.103:0/2891880257 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9fc0045050 con 0x55c5989e71e0 2024-08-02T18:50:32.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fd8938740 10 client.25216 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:32.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fd8938740 1 -- 172.21.15.103:0/2891880257 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c598a6b2c0 con 0x55c5989e71e0 2024-08-02T18:50:32.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9faf7fe640 1 -- 172.21.15.103:0/2891880257 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9fc003c070 con 0x55c5989e71e0 2024-08-02T18:50:32.526 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9faf7fe640 1 -- 172.21.15.103:0/2891880257 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9fc0027040 con 0x55c5989e71e0 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fd8938740 10 client.25216 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fd8938740 10 client.25216 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fd8938740 20 client.25216 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fd8938740 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55c598a00ab0 0x55c598a6d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fd8938740 4 client.25216 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fd8938740 1 -- 172.21.15.103:0/2891880257 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f9fc4004ef0 con 0x55c598a00ab0 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.521+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55c598a00ab0 0x55c598a6d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.522+0000 7f9faf7fe640 10 client.25216 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.522+0000 7f9fcf7fe640 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55c598a00ab0 0x55c598a6d9e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=b04d866b22345df6 server_cookie=44bce9e50a4d184d in_seq=0 out_seq=0 2024-08-02T18:50:32.527 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.522+0000 7f9faf7fe640 1 -- 172.21.15.103:0/2891880257 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f9fc4004ef0 con 0x55c598a00ab0 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.522+0000 7f9faf7fe640 10 client.25216 handle_command_reply: tid=0 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.522+0000 7f9fd8938740 1 client.25216 shutdown 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.522+0000 7f9fd8938740 1 -- 172.21.15.103:0/2891880257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989e71e0 msgr2=0x55c5989f8b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.522+0000 7f9fd8938740 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989e71e0 0x55c5989f8b50 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9fc0004480 tx=0x7f9fc000fce0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 1 -- 172.21.15.103:0/2891880257 shutdown_connections 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55c598a00ab0 0x55c598a6d9e0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c5989ecb40 0x55c598a07b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9faf7fe640 0 client.25216 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c5989ec220 0x55c5989f9090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 1 --2- 172.21.15.103:0/2891880257 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c5989e71e0 0x55c5989f8b50 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 1 -- 172.21.15.103:0/2891880257 >> 172.21.15.103:0/2891880257 conn(0x55c5989d9020 msgr2=0x55c5989d7ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 1 -- 172.21.15.103:0/2891880257 shutdown_connections 2024-08-02T18:50:32.528 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 1 -- 172.21.15.103:0/2891880257 wait complete. 2024-08-02T18:50:32.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.523+0000 7f9fd8938740 20 client.25216 trim_cache size 0 max 16384 2024-08-02T18:50:32.529 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:50:32.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9fb80a2e90 msgr2=0x7f9fb80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.529 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9fb80a2e90 0x7f9fb80a5350 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x55c5989da730 tx=0x7f9fc0005f90 comp rx=0 tx=0).stop 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0106790 msgr2=0x7f9fd019cb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0106790 0x7f9fd019cb10 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f9fc8006010 tx=0x7f9fc8003f10 comp rx=0 tx=0).stop 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 shutdown_connections 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9fb80a2e90 0x7f9fb80a5350 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9fd0106790 0x7f9fd019cb10 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9fd0101130 0x7f9fd0198780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 --2- 172.21.15.103:0/1240989478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9fd0100790 0x7f9fd0198240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 >> 172.21.15.103:0/1240989478 conn(0x7f9fd00fc4b0 msgr2=0x7f9fd00fd970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 shutdown_connections 2024-08-02T18:50:32.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:32.524+0000 7f9fd653a640 1 -- 172.21.15.103:0/1240989478 wait complete. 2024-08-02T18:50:32.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:32 smithi103 ceph-mon[32753]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-02T18:50:33.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:32 smithi121 ceph-mon[37236]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-02T18:50:33.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:32 smithi151 ceph-mon[37155]: pgmap v27: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 511 B/s wr, 7 op/s 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/669193294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 msgr2=0x7f6f2410e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/669193294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 0x7f6f2410e280 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c009ca0 tx=0x7f6f1c02a950 comp rx=0 tx=0).stop 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/669193294 shutdown_connections 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/669193294 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 0x7f6f2410e280 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/669193294 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f24103330 0x7f6f2410b810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/669193294 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f24102a10 0x7f6f24102df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/669193294 >> 172.21.15.103:0/669193294 conn(0x7f6f240776c0 msgr2=0x7f6f240fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/669193294 shutdown_connections 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.088+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/669193294 wait complete. 2024-08-02T18:50:33.092 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2b9f0640 1 Processor -- start 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2b9f0640 1 -- start start 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2b9f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f24102a10 0x7f6f24198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2b9f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f24103330 0x7f6f241986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2b9f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 0x7f6f2419ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2b9f0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24111d00 con 0x7f6f2410bde0 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2b9f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24111b80 con 0x7f6f24102a10 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2b9f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6f24111e80 con 0x7f6f24103330 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f29f8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 0x7f6f2419ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f29f8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 0x7f6f2419ca30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46286/0 (socket says 172.21.15.103:46286) 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f29f8d640 1 -- 172.21.15.103:0/1553012286 learned_addr learned my addr 172.21.15.103:0/1553012286 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f2978c640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f24102a10 0x7f6f24198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.089+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f24103330 0x7f6f241986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.093 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f29f8d640 1 -- 172.21.15.103:0/1553012286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f24103330 msgr2=0x7f6f241986b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f24103330 0x7f6f241986b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f29f8d640 1 -- 172.21.15.103:0/1553012286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f24102a10 msgr2=0x7f6f24198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f24102a10 0x7f6f24198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f29f8d640 1 -- 172.21.15.103:0/1553012286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f2419d160 con 0x7f6f2410bde0 2024-08-02T18:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f2978c640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f24102a10 0x7f6f24198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 0x7f6f2419ca30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c005cc0 tx=0x7f6f1c02f650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f1a7fc640 1 -- 172.21.15.103:0/1553012286 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c034040 con 0x7f6f2410bde0 2024-08-02T18:50:33.094 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f1a7fc640 1 -- 172.21.15.103:0/1553012286 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f1c030940 con 0x7f6f2410bde0 2024-08-02T18:50:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/1553012286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f2419d3f0 con 0x7f6f2410bde0 2024-08-02T18:50:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f1a7fc640 1 -- 172.21.15.103:0/1553012286 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c045480 con 0x7f6f2410bde0 2024-08-02T18:50:33.095 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.090+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/1553012286 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f241a4ce0 con 0x7f6f2410bde0 2024-08-02T18:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.092+0000 7f6f1a7fc640 1 -- 172.21.15.103:0/1553012286 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f6f1c037020 con 0x7f6f2410bde0 2024-08-02T18:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f2e821740 1 Processor -- start 2024-08-02T18:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f2e821740 1 -- start start 2024-08-02T18:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f1a7fc640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6f100a2fc0 0x7f6f100a5480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b818a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b827840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.098 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b827d80 0x55673b82a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f2e821740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55673b77c9b0 con 0x55673b818f70 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f2e821740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55673b724800 con 0x55673b827d80 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f2e821740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55673b778970 con 0x55673b818650 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.093+0000 7f6f1a7fc640 1 -- 172.21.15.103:0/1553012286 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f6f1c0f07d0 con 0x7f6f2410bde0 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6f100a2fc0 0x7f6f100a5480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f28f8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b827840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f29f8d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b827d80 0x55673b82a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f28f8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b827840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46302/0 (socket says 172.21.15.103:46302) 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f28f8b640 1 -- 172.21.15.103:0/207907438 learned_addr learned my addr 172.21.15.103:0/207907438 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:33.099 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f2978c640 1 --2- 172.21.15.103:0/207907438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b818a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f29f8d640 1 -- 172.21.15.103:0/207907438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 msgr2=0x55673b818a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/207907438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b818a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f29f8d640 1 -- 172.21.15.103:0/207907438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 msgr2=0x55673b827840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/207907438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b827840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f29f8d640 1 -- 172.21.15.103:0/207907438 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55673b490210 con 0x55673b827d80 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6f100a2fc0 0x7f6f100a5480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f140128e0 tx=0x7f6f14009a80 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.094+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/207907438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b827d80 0x55673b82a170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0edb10 tx=0x7f6f1c0bc170 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a1c91962ac21711d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.095+0000 7f6f0f7fe640 1 -- 172.21.15.103:0/207907438 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0d5070 con 0x55673b827d80 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.095+0000 7f6f0f7fe640 1 -- 172.21.15.103:0/207907438 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f1c030b10 con 0x55673b827d80 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.095+0000 7f6f0f7fe640 1 -- 172.21.15.103:0/207907438 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c004040 con 0x55673b827d80 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.095+0000 7f6f2e821740 1 -- 172.21.15.103:0/207907438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b827d80 msgr2=0x55673b82a170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.095+0000 7f6f2e821740 1 --2- 172.21.15.103:0/207907438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b827d80 0x55673b82a170 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0edb10 tx=0x7f6f1c0bc170 comp rx=0 tx=0).stop 2024-08-02T18:50:33.100 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 -- 172.21.15.103:0/207907438 shutdown_connections 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 --2- 172.21.15.103:0/207907438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b827d80 0x55673b82a170 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 --2- 172.21.15.103:0/207907438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b827840 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 --2- 172.21.15.103:0/207907438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b818a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 -- 172.21.15.103:0/207907438 >> 172.21.15.103:0/207907438 conn(0x55673b814d20 msgr2=0x55673b815100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 -- 172.21.15.103:0/207907438 shutdown_connections 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 -- 172.21.15.103:0/207907438 wait complete. 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 -- start start 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 Processor -- start 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818650 0x55673b824d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b8252a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 0x55673b8257e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55673b82a770 con 0x55673b818f70 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.096+0000 7f6f2e821740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55673b738500 con 0x55673b818650 2024-08-02T18:50:33.101 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f2e821740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55673b82a8f0 con 0x55673b827d80 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f2e821740 10 client.0 _ll_register_callbacks cb 0x55673b48fa00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b8252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f2978c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818650 0x55673b824d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b8252a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46316/0 (socket says 172.21.15.103:46316) 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 -- 172.21.15.103:0/1978108552 learned_addr learned my addr 172.21.15.103:0/1978108552 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 0x55673b8257e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 -- 172.21.15.103:0/1978108552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 msgr2=0x55673b8257e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 0x55673b8257e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.102 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 -- 172.21.15.103:0/1978108552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818650 msgr2=0x55673b824d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818650 0x55673b824d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 -- 172.21.15.103:0/1978108552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55673b55c620 con 0x55673b818f70 2024-08-02T18:50:33.103 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f2978c640 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818650 0x55673b824d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:33.106 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b8252a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f14010c50 tx=0x7f6f1401c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=213e1c64647d904 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f0cff9640 1 -- 172.21.15.103:0/1978108552 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f14024070 con 0x55673b818f70 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f0cff9640 1 -- 172.21.15.103:0/1978108552 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f6f140039f0 con 0x55673b818f70 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.097+0000 7f6f2e821740 1 -- 172.21.15.103:0/1978108552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f1c030b10 con 0x55673b818f70 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f0cff9640 1 -- 172.21.15.103:0/1978108552 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6f14032050 con 0x55673b818f70 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f2e821740 10 client.15675 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f2e821740 1 -- 172.21.15.103:0/1978108552 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55673b836430 con 0x55673b818f70 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f0cff9640 1 -- 172.21.15.103:0/1978108552 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f1c030b10 con 0x55673b818f70 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f0cff9640 1 -- 172.21.15.103:0/1978108552 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6f1401f050 con 0x55673b818f70 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f2e821740 10 client.15675 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f2e821740 10 client.15675 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f2e821740 20 client.15675 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:33.107 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f2e821740 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55673b8378f0 0x55673b839d20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f2e821740 4 client.15675 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.098+0000 7f6f2e821740 1 -- 172.21.15.103:0/1978108552 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55673b78a0e0 con 0x55673b8378f0 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.099+0000 7f6f2978c640 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55673b8378f0 0x55673b839d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.099+0000 7f6f0cff9640 10 client.15675 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.099+0000 7f6f2978c640 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55673b8378f0 0x55673b839d20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4ed05e08e85b210b server_cookie=761207b2db289419 in_seq=0 out_seq=0 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f0cff9640 1 -- 172.21.15.103:0/1978108552 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55673b78a0e0 con 0x55673b8378f0 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f0cff9640 10 client.15675 handle_command_reply: tid=0 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 client.15675 shutdown 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 -- 172.21.15.103:0/1978108552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 msgr2=0x55673b8252a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b8252a0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f6f14010c50 tx=0x7f6f1401c000 comp rx=0 tx=0).stop 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 -- 172.21.15.103:0/1978108552 shutdown_connections 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55673b8378f0 0x55673b839d20 crc :-1 s=READY pgs=52 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.108 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 0x55673b8257e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818f70 0x55673b8252a0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 --2- 172.21.15.103:0/1978108552 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818650 0x55673b824d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 -- 172.21.15.103:0/1978108552 >> 172.21.15.103:0/1978108552 conn(0x55673b814d20 msgr2=0x55673b81aa80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f0cff9640 0 client.15675 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 -- 172.21.15.103:0/1978108552 shutdown_connections 2024-08-02T18:50:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 1 -- 172.21.15.103:0/1978108552 wait complete. 2024-08-02T18:50:33.109 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.100+0000 7f6f2e821740 20 client.15675 trim_cache size 0 max 16384 2024-08-02T18:50:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2e821740 1 Processor -- start 2024-08-02T18:50:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2e821740 1 -- start start 2024-08-02T18:50:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818650 0x55673b83f630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b83fb70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.118 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 0x55673b813660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2e821740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241af1e0 con 0x55673b818650 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2e821740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241acab0 con 0x55673b818f70 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2e821740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241aa900 con 0x55673b827d80 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2978c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818650 0x55673b83f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2978c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818650 0x55673b83f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46332/0 (socket says 172.21.15.103:46332) 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f2978c640 1 -- 172.21.15.103:0/2656606301 learned_addr learned my addr 172.21.15.103:0/2656606301 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 0x55673b813660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.116+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b83fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f2978c640 1 -- 172.21.15.103:0/2656606301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 msgr2=0x55673b813660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f2978c640 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 0x55673b813660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f2978c640 1 -- 172.21.15.103:0/2656606301 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 msgr2=0x55673b83fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f2978c640 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b83fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f2978c640 1 -- 172.21.15.103:0/2656606301 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55673b8232b0 con 0x55673b818650 2024-08-02T18:50:33.119 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f2978c640 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818650 0x55673b83f630 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x55673b83a5d0 tx=0x7f6f200045d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd63b80265ffdb64 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f0effd640 1 -- 172.21.15.103:0/2656606301 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f200135e0 con 0x55673b818650 2024-08-02T18:50:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f0effd640 1 -- 172.21.15.103:0/2656606301 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f20013c80 con 0x55673b818650 2024-08-02T18:50:33.120 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.117+0000 7f6f0effd640 1 -- 172.21.15.103:0/2656606301 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f2001ed60 con 0x55673b818650 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 -- 172.21.15.103:0/2656606301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818650 msgr2=0x55673b83f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818650 0x55673b83f630 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x55673b83a5d0 tx=0x7f6f200045d0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 -- 172.21.15.103:0/2656606301 shutdown_connections 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b827d80 0x55673b813660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b83fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2656606301 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b818650 0x55673b83f630 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 -- 172.21.15.103:0/2656606301 >> 172.21.15.103:0/2656606301 conn(0x55673b814d20 msgr2=0x55673b820000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 -- 172.21.15.103:0/2656606301 shutdown_connections 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 -- 172.21.15.103:0/2656606301 wait complete. 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.118+0000 7f6f2e821740 1 -- start start 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2e821740 1 Processor -- start 2024-08-02T18:50:33.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b82feb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b821800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2e821740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b827d80 0x55673b821d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2e821740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241aaf70 con 0x55673b827d80 2024-08-02T18:50:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2e821740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241ac3e0 con 0x55673b818f70 2024-08-02T18:50:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2e821740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6f241ab640 con 0x55673b818650 2024-08-02T18:50:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2e821740 10 client.0 _ll_register_callbacks cb 0x7f6f14009530 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2978c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b82feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f29f8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b827d80 0x55673b821d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f29f8d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b827d80 0x55673b821d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46334/0 (socket says 172.21.15.103:46334) 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f2978c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b82feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:48700/0 (socket says 172.21.15.103:48700) 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f29f8d640 1 -- 172.21.15.103:0/2890598532 learned_addr learned my addr 172.21.15.103:0/2890598532 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.119+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b821800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f29f8d640 1 -- 172.21.15.103:0/2890598532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 msgr2=0x55673b82feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b82feb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f29f8d640 1 -- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 msgr2=0x55673b821800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b821800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f29f8d640 1 -- 172.21.15.103:0/2890598532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55673b822280 con 0x55673b827d80 2024-08-02T18:50:33.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f28f8b640 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b821800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f29f8d640 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b827d80 0x55673b821d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0b8c70 tx=0x7f6f1c02afd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28682d32fd3ed67d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f0cff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f0cff9640 1 -- 172.21.15.103:0/2890598532 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6f1c0d5040 con 0x55673b827d80 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f0cff9640 1 -- 172.21.15.103:0/2890598532 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f6f1c0f03d0 con 0x55673b827d80 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f2e821740 1 -- 172.21.15.103:0/2890598532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6f20013c80 con 0x55673b827d80 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f0cff9640 1 -- 172.21.15.103:0/2890598532 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f6f1c0f05d0 con 0x55673b827d80 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f2e821740 10 client.15681 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.120+0000 7f6f2e821740 1 -- 172.21.15.103:0/2890598532 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55673b8a22c0 con 0x55673b827d80 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f0cff9640 1 -- 172.21.15.103:0/2890598532 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6f20013c80 con 0x55673b827d80 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f0cff9640 1 -- 172.21.15.103:0/2890598532 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f6f1c04d030 con 0x55673b827d80 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f2e821740 10 client.15681 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f2e821740 10 client.15681 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:33.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f2e821740 20 client.15681 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55673b8a28b0 0x55673b8a4cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f2e821740 4 client.15681 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:50:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f2e821740 1 -- 172.21.15.103:0/2890598532 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55673b784430 con 0x55673b8a28b0 2024-08-02T18:50:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.121+0000 7f6f2978c640 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55673b8a28b0 0x55673b8a4cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.122+0000 7f6f2978c640 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55673b8a28b0 0x55673b8a4cd0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f98cdeff38d90678 server_cookie=5e6bedd705e92c99 in_seq=0 out_seq=0 2024-08-02T18:50:33.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.122+0000 7f6f0cff9640 10 client.15681 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.128+0000 7f6f0cff9640 1 -- 172.21.15.103:0/2890598532 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55673b784430 con 0x55673b8a28b0 2024-08-02T18:50:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.128+0000 7f6f0cff9640 10 client.15681 handle_command_reply: tid=0 2024-08-02T18:50:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 client.15681 shutdown 2024-08-02T18:50:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 -- 172.21.15.103:0/2890598532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b827d80 msgr2=0x55673b821d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b827d80 0x55673b821d40 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c0b8c70 tx=0x7f6f1c02afd0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 -- 172.21.15.103:0/2890598532 shutdown_connections 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55673b8a28b0 0x55673b8a4cd0 crc :-1 s=READY pgs=53 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55673b827d80 0x55673b821d40 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55673b818f70 0x55673b821800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 --2- 172.21.15.103:0/2890598532 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55673b818650 0x55673b82feb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f0cff9640 0 client.15681 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 -- 172.21.15.103:0/2890598532 >> 172.21.15.103:0/2890598532 conn(0x55673b814d20 msgr2=0x55673b813660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 -- 172.21.15.103:0/2890598532 shutdown_connections 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 1 -- 172.21.15.103:0/2890598532 wait complete. 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.129+0000 7f6f2e821740 20 client.15681 trim_cache size 0 max 16384 2024-08-02T18:50:33.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:50:33.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:50:33.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:50:33.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:50:33.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6f100a2fc0 msgr2=0x7f6f100a5480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6f100a2fc0 0x7f6f100a5480 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f6f140128e0 tx=0x7f6f14009a80 comp rx=0 tx=0).stop 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 msgr2=0x7f6f2419ca30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 0x7f6f2419ca30 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f6f1c005cc0 tx=0x7f6f1c02f650 comp rx=0 tx=0).stop 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/1553012286 shutdown_connections 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6f100a2fc0 0x7f6f100a5480 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6f2410bde0 0x7f6f2419ca30 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6f24103330 0x7f6f241986b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 --2- 172.21.15.103:0/1553012286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6f24102a10 0x7f6f24198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/1553012286 >> 172.21.15.103:0/1553012286 conn(0x7f6f240776c0 msgr2=0x7f6f240fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/1553012286 shutdown_connections 2024-08-02T18:50:33.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:33.130+0000 7f6f2b9f0640 1 -- 172.21.15.103:0/1553012286 wait complete. 2024-08-02T18:50:33.374 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-02T18:50:33.705 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:34.256 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 -- 172.21.15.103:0/2961070794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c103470 msgr2=0x7f509c1078b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2961070794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c103470 0x7f509c1078b0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f5090009930 tx=0x7f509002a420 comp rx=0 tx=0).stop 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 -- 172.21.15.103:0/2961070794 shutdown_connections 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2961070794 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f509c107fc0 0x7f509c10e960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2961070794 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c103470 0x7f509c1078b0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2961070794 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f509c102ac0 0x7f509c102ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 -- 172.21.15.103:0/2961070794 >> 172.21.15.103:0/2961070794 conn(0x7f509c0fc500 msgr2=0x7f509c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 -- 172.21.15.103:0/2961070794 shutdown_connections 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.236+0000 7f50a14d0640 1 -- 172.21.15.103:0/2961070794 wait complete. 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.237+0000 7f50a14d0640 1 Processor -- start 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.237+0000 7f50a14d0640 1 -- start start 2024-08-02T18:50:34.257 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f50a14d0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c102ac0 0x7f509c100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f50a14d0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f509c103470 0x7f509c100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f50a14d0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f509c107fc0 0x7f509c1011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f50a14d0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f509c111f30 con 0x7f509c102ac0 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f50a14d0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f509c111db0 con 0x7f509c107fc0 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f50a14d0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1120b0 con 0x7f509c103470 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c102ac0 0x7f509c100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c102ac0 0x7f509c100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46362/0 (socket says 172.21.15.103:46362) 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 -- 172.21.15.103:0/2368538553 learned_addr learned my addr 172.21.15.103:0/2368538553 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509a7fc640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f509c103470 0x7f509c100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509b7fe640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f509c107fc0 0x7f509c1011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 -- 172.21.15.103:0/2368538553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f509c103470 msgr2=0x7f509c100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.258 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f509c103470 0x7f509c100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 -- 172.21.15.103:0/2368538553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f509c107fc0 msgr2=0x7f509c1011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f509c107fc0 0x7f509c1011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 -- 172.21.15.103:0/2368538553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f509c1a6890 con 0x7f509c102ac0 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.238+0000 7f509affd640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c102ac0 0x7f509c100720 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d950 tx=0x7f508c00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.239+0000 7f5083fff640 1 -- 172.21.15.103:0/2368538553 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c017070 con 0x7f509c102ac0 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.239+0000 7f5083fff640 1 -- 172.21.15.103:0/2368538553 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f508c009c30 con 0x7f509c102ac0 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.239+0000 7f50a14d0640 1 -- 172.21.15.103:0/2368538553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f509c1a6b80 con 0x7f509c102ac0 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.239+0000 7f5083fff640 1 -- 172.21.15.103:0/2368538553 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f508c00f740 con 0x7f509c102ac0 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.239+0000 7f50a14d0640 1 -- 172.21.15.103:0/2368538553 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f509c1a7090 con 0x7f509c102ac0 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f50a38ce740 1 Processor -- start 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f50a38ce740 1 -- start start 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160e9a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160e9a910 0x55c160ea4c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.259 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160ea51d0 0x55c160ea75c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f50a38ce740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c160dffa40 con 0x55c160ea51d0 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f50a38ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c160d979d0 con 0x55c160e9a910 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f50a38ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c160dfba00 con 0x55c160e99ff0 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.242+0000 7f5083fff640 1 -- 172.21.15.103:0/2368538553 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f508c010a80 con 0x7f509c102ac0 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160ea51d0 0x55c160ea75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160ea51d0 0x55c160ea75c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46368/0 (socket says 172.21.15.103:46368) 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509a7fc640 1 -- 172.21.15.103:0/297832504 learned_addr learned my addr 172.21.15.103:0/297832504 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509b7fe640 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160e9a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509b7fe640 1 -- 172.21.15.103:0/297832504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160e9a910 msgr2=0x55c160ea4c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509affd640 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160e9a910 0x55c160ea4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509b7fe640 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160e9a910 0x55c160ea4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.260 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509b7fe640 1 -- 172.21.15.103:0/297832504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160ea51d0 msgr2=0x55c160ea75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509b7fe640 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160ea51d0 0x55c160ea75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509b7fe640 1 -- 172.21.15.103:0/297832504 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c160d9e650 con 0x55c160e99ff0 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509a7fc640 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160ea51d0 0x55c160ea75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.243+0000 7f509b7fe640 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160e9a3d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5094009eb0 tx=0x7f50940107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=899f9c3df5193ca2 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.244+0000 7f50817fa640 1 -- 172.21.15.103:0/297832504 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094003b70 con 0x55c160e99ff0 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.244+0000 7f50817fa640 1 -- 172.21.15.103:0/297832504 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5094015070 con 0x55c160e99ff0 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.244+0000 7f50817fa640 1 -- 172.21.15.103:0/297832504 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509401a930 con 0x55c160e99ff0 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.244+0000 7f5083fff640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50840a2f10 0x7f50840a53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.244+0000 7f5083fff640 1 -- 172.21.15.103:0/2368538553 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f508c0cf940 con 0x7f509c102ac0 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.244+0000 7f50a38ce740 1 -- 172.21.15.103:0/297832504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 msgr2=0x55c160e9a3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.244+0000 7f50a38ce740 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160e9a3d0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7f5094009eb0 tx=0x7f50940107a0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f509affd640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50840a2f10 0x7f50840a53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 -- 172.21.15.103:0/297832504 shutdown_connections 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160ea51d0 0x55c160ea75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160e9a910 0x55c160ea4c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 --2- 172.21.15.103:0/297832504 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160e9a3d0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 -- 172.21.15.103:0/297832504 >> 172.21.15.103:0/297832504 conn(0x55c160e96580 msgr2=0x55c160e96960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 -- 172.21.15.103:0/297832504 shutdown_connections 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 -- 172.21.15.103:0/297832504 wait complete. 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 -- start start 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.245+0000 7f50a38ce740 1 Processor -- start 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509affd640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50840a2f10 0x7f50840a53d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f508c0ccbd0 tx=0x7f508c010e20 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160ea2050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160ea2590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160ea2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f50a38ce740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c160ea7da0 con 0x55c160e9a910 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f50a38ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c160dbab20 con 0x55c160ea51d0 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160ea2590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f50a38ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c160ea7f20 con 0x55c160e99ff0 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509b7fe640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160ea2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160ea2590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46372/0 (socket says 172.21.15.103:46372) 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509a7fc640 1 -- 172.21.15.103:0/2839412200 learned_addr learned my addr 172.21.15.103:0/2839412200 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f50a38ce740 10 client.0 _ll_register_callbacks cb 0x55c160db8bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509b7fe640 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160ea2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509b7fe640 1 -- 172.21.15.103:0/2839412200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 msgr2=0x55c160ea2ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509b7fe640 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160ea2ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509b7fe640 1 -- 172.21.15.103:0/2839412200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 msgr2=0x55c160ea2590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509b7fe640 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160ea2590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509b7fe640 1 -- 172.21.15.103:0/2839412200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c160b713c0 con 0x55c160e99ff0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.246+0000 7f509a7fc640 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160ea2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f509b7fe640 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160ea2050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f509401a550 tx=0x7f50940092a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=616d230d827db695 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f507eff5640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f507eff5640 1 -- 172.21.15.103:0/2839412200 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5094004c40 con 0x55c160e99ff0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f507eff5640 1 -- 172.21.15.103:0/2839412200 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f5094004de0 con 0x55c160e99ff0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f50a38ce740 1 -- 172.21.15.103:0/2839412200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5094015070 con 0x55c160e99ff0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f507eff5640 1 -- 172.21.15.103:0/2839412200 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f5094032050 con 0x55c160e99ff0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f50a38ce740 10 client.25246 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f50a38ce740 1 -- 172.21.15.103:0/2839412200 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c160ebc160 con 0x55c160e99ff0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.247+0000 7f507eff5640 1 -- 172.21.15.103:0/2839412200 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5094020030 con 0x55c160e99ff0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f507eff5640 1 -- 172.21.15.103:0/2839412200 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5094029070 con 0x55c160e99ff0 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f50a38ce740 10 client.25246 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f50a38ce740 10 client.25246 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:34.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f50a38ce740 20 client.25246 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f50a38ce740 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c160ebd4b0 0x55c160ebf8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f50a38ce740 4 client.25246 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f50a38ce740 1 -- 172.21.15.103:0/2839412200 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f5094015070 con 0x55c160ebd4b0 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f509a7fc640 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c160ebd4b0 0x55c160ebf8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f509a7fc640 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c160ebd4b0 0x55c160ebf8a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f09bacc3b66bc3f3 server_cookie=3ac1d921ae25e966 in_seq=0 out_seq=0 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.248+0000 7f507eff5640 10 client.25246 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f507eff5640 1 -- 172.21.15.103:0/2839412200 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x7f5094015070 con 0x55c160ebd4b0 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f507eff5640 10 client.25246 handle_command_reply: tid=0 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 client.25246 shutdown 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 -- 172.21.15.103:0/2839412200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 msgr2=0x55c160ea2050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160ea2050 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f509401a550 tx=0x7f50940092a0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 -- 172.21.15.103:0/2839412200 shutdown_connections 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c160ebd4b0 0x55c160ebf8a0 crc :-1 s=READY pgs=54 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160ea2ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f507eff5640 0 client.25246 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160ea2590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 --2- 172.21.15.103:0/2839412200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160ea2050 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.249+0000 7f50a38ce740 1 -- 172.21.15.103:0/2839412200 >> 172.21.15.103:0/2839412200 conn(0x55c160e96580 msgr2=0x55c160e9c260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.250+0000 7f50a38ce740 1 -- 172.21.15.103:0/2839412200 shutdown_connections 2024-08-02T18:50:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.250+0000 7f50a38ce740 1 -- 172.21.15.103:0/2839412200 wait complete. 2024-08-02T18:50:34.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.250+0000 7f50a38ce740 20 client.25246 trim_cache size 0 max 16384 2024-08-02T18:50:34.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f50a38ce740 1 Processor -- start 2024-08-02T18:50:34.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f50a38ce740 1 -- start start 2024-08-02T18:50:34.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e99ff0 0x55c160ea12d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e9a910 0x55c160ea2920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160ec4f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f50a38ce740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1af460 con 0x55c160e99ff0 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f50a38ce740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1acd30 con 0x55c160ea51d0 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f50a38ce740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1aaba0 con 0x55c160e9a910 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f509b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e99ff0 0x55c160ea12d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f509b7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e99ff0 0x55c160ea12d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46388/0 (socket says 172.21.15.103:46388) 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f509b7fe640 1 -- 172.21.15.103:0/1914327686 learned_addr learned my addr 172.21.15.103:0/1914327686 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f509a7fc640 1 --2- 172.21.15.103:0/1914327686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e9a910 0x55c160ea2920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f509b7fe640 1 -- 172.21.15.103:0/1914327686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e9a910 msgr2=0x55c160ea2920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.263+0000 7f509b7fe640 1 --2- 172.21.15.103:0/1914327686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e9a910 0x55c160ea2920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.264+0000 7f509b7fe640 1 -- 172.21.15.103:0/1914327686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 msgr2=0x55c160ec4f30 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-02T18:50:34.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.264+0000 7f509b7fe640 1 --2- 172.21.15.103:0/1914327686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160ec4f30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.264+0000 7f509b7fe640 1 -- 172.21.15.103:0/1914327686 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c160e9a740 con 0x55c160e99ff0 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.264+0000 7f509b7fe640 1 --2- 172.21.15.103:0/1914327686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e99ff0 0x55c160ea12d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5094009bd0 tx=0x7f5094000f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4d41bc7cf8b2d15 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.264+0000 7f5080ff9640 1 -- 172.21.15.103:0/1914327686 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509402f030 con 0x55c160e99ff0 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.264+0000 7f5080ff9640 1 -- 172.21.15.103:0/1914327686 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5094015070 con 0x55c160e99ff0 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.264+0000 7f5080ff9640 1 -- 172.21.15.103:0/1914327686 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509401a800 con 0x55c160e99ff0 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 -- 172.21.15.103:0/1914327686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e99ff0 msgr2=0x55c160ea12d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1914327686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e99ff0 0x55c160ea12d0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f5094009bd0 tx=0x7f5094000f40 comp rx=0 tx=0).stop 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 -- 172.21.15.103:0/1914327686 shutdown_connections 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1914327686 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160ec4f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1914327686 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e9a910 0x55c160ea2920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1914327686 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e99ff0 0x55c160ea12d0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 -- 172.21.15.103:0/1914327686 >> 172.21.15.103:0/1914327686 conn(0x55c160e96580 msgr2=0x55c160ea3fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 -- 172.21.15.103:0/1914327686 shutdown_connections 2024-08-02T18:50:34.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 -- 172.21.15.103:0/1914327686 wait complete. 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.265+0000 7f50a38ce740 1 -- start start 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f50a38ce740 1 Processor -- start 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160e9ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160e9ef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f50a38ce740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160eb4a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f50a38ce740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1ab1f0 con 0x55c160e9a910 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f509a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160e9ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f509a7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160e9ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46404/0 (socket says 172.21.15.103:46404) 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f509a7fc640 1 -- 172.21.15.103:0/1455274819 learned_addr learned my addr 172.21.15.103:0/1455274819 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.266+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1ac660 con 0x55c160ea51d0 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f509c1ab8c0 con 0x55c160e99ff0 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f50a38ce740 10 client.0 _ll_register_callbacks cb 0x7f5090005b50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f509a7fc640 1 -- 172.21.15.103:0/1455274819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 msgr2=0x55c160e9ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:34.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f509a7fc640 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160e9ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f509a7fc640 1 -- 172.21.15.103:0/1455274819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 msgr2=0x55c160eb4a00 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f509a7fc640 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160eb4a00 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f509a7fc640 1 -- 172.21.15.103:0/1455274819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c160eb5010 con 0x55c160e9a910 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f509a7fc640 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160e9ef60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5090009930 tx=0x7f5090005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9b3d80cb58eed07 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f507eff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f507eff5640 1 -- 172.21.15.103:0/1455274819 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5090035040 con 0x55c160e9a910 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f507eff5640 1 -- 172.21.15.103:0/1455274819 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f50900046c0 con 0x55c160e9a910 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.267+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5094015070 con 0x55c160e9a910 2024-08-02T18:50:34.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.268+0000 7f507eff5640 1 -- 172.21.15.103:0/1455274819 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f50900048c0 con 0x55c160e9a910 2024-08-02T18:50:34.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.268+0000 7f50a38ce740 10 client.15699 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:34.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.268+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c160eb6340 con 0x55c160e9a910 2024-08-02T18:50:34.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.268+0000 7f507eff5640 1 -- 172.21.15.103:0/1455274819 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5090031640 con 0x55c160e9a910 2024-08-02T18:50:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.268+0000 7f507eff5640 1 -- 172.21.15.103:0/1455274819 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f5090003660 con 0x55c160e9a910 2024-08-02T18:50:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.269+0000 7f50a38ce740 10 client.15699 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.269+0000 7f50a38ce740 10 client.15699 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:34.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.269+0000 7f50a38ce740 20 client.15699 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.269+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c160ebd4b0 0x55c160f2a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.269+0000 7f50a38ce740 4 client.15699 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.269+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x7f5094015070 con 0x55c160ebd4b0 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.269+0000 7f509b7fe640 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c160ebd4b0 0x55c160f2a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f509b7fe640 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c160ebd4b0 0x55c160f2a170 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1e5b4bd2fe3144c8 server_cookie=23a91691d56da26f in_seq=0 out_seq=0 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f507eff5640 10 client.15699 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f507eff5640 1 -- 172.21.15.103:0/1455274819 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x7f5094015070 con 0x55c160ebd4b0 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f507eff5640 10 client.15699 handle_command_reply: tid=0 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 client.15699 shutdown 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 msgr2=0x55c160e9ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160e9ef60 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f5090009930 tx=0x7f5090005fd0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 shutdown_connections 2024-08-02T18:50:34.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c160ebd4b0 0x55c160f2a170 crc :-1 s=READY pgs=55 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c160ea51d0 0x55c160eb4a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c160e9a910 0x55c160e9ef60 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 --2- 172.21.15.103:0/1455274819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c160e99ff0 0x55c160e9ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 >> 172.21.15.103:0/1455274819 conn(0x55c160e96580 msgr2=0x55c160ea36c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f507eff5640 0 client.15699 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 shutdown_connections 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 1 -- 172.21.15.103:0/1455274819 wait complete. 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.270+0000 7f50a38ce740 20 client.15699 trim_cache size 0 max 16384 2024-08-02T18:50:34.277 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:50:34.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 -- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50840a2f10 msgr2=0x7f50840a53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50840a2f10 0x7f50840a53d0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f508c0ccbd0 tx=0x7f508c010e20 comp rx=0 tx=0).stop 2024-08-02T18:50:34.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 -- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c102ac0 msgr2=0x7f509c100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:34.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c102ac0 0x7f509c100720 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f508c00d950 tx=0x7f508c00de10 comp rx=0 tx=0).stop 2024-08-02T18:50:34.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 -- 172.21.15.103:0/2368538553 shutdown_connections 2024-08-02T18:50:34.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50840a2f10 0x7f50840a53d0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f509c107fc0 0x7f509c1011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f509c103470 0x7f509c100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 --2- 172.21.15.103:0/2368538553 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f509c102ac0 0x7f509c100720 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.271+0000 7f50a14d0640 1 -- 172.21.15.103:0/2368538553 >> 172.21.15.103:0/2368538553 conn(0x7f509c0fc500 msgr2=0x7f509c1060a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.272+0000 7f50a14d0640 1 -- 172.21.15.103:0/2368538553 shutdown_connections 2024-08-02T18:50:34.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:34.272+0000 7f50a14d0640 1 -- 172.21.15.103:0/2368538553 wait complete. 2024-08-02T18:50:35.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:34 smithi121 ceph-mon[37236]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-02T18:50:35.055 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:34 smithi103 ceph-mon[32753]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-02T18:50:35.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:34 smithi151 ceph-mon[37155]: pgmap v28: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 511 B/s wr, 5 op/s 2024-08-02T18:50:36.086 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-02T18:50:36.086 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-02T18:50:36.361 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:36.818 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:36 smithi103 ceph-mon[32753]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 -- 172.21.15.103:0/58136541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 msgr2=0x7f247410d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 --2- 172.21.15.103:0/58136541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 0x7f247410d770 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7f246c009ca0 tx=0x7f246c02ea40 comp rx=0 tx=0).stop 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 -- 172.21.15.103:0/58136541 shutdown_connections 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 --2- 172.21.15.103:0/58136541 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 0x7f247410d770 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 --2- 172.21.15.103:0/58136541 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f24741022a0 0x7f24741026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 --2- 172.21.15.103:0/58136541 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f2474100b50 0x7f2474100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 -- 172.21.15.103:0/58136541 >> 172.21.15.103:0/58136541 conn(0x7f24740fc500 msgr2=0x7f24740fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 -- 172.21.15.103:0/58136541 shutdown_connections 2024-08-02T18:50:36.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.949+0000 7f2478b4c640 1 -- 172.21.15.103:0/58136541 wait complete. 2024-08-02T18:50:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.950+0000 7f2478b4c640 1 Processor -- start 2024-08-02T18:50:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.950+0000 7f2478b4c640 1 -- start start 2024-08-02T18:50:36.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2478b4c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2474100b50 0x7f2474196030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2478b4c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24741022a0 0x7f2474196570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2478b4c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 0x7f247419a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 0x7f247419a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 0x7f247419a900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46424/0 (socket says 172.21.15.103:46424) 2024-08-02T18:50:36.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f247259c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2474100b50 0x7f2474196030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2472d9d640 1 -- 172.21.15.103:0/510148792 learned_addr learned my addr 172.21.15.103:0/510148792 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2471d9b640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24741022a0 0x7f2474196570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f247410fcd0 con 0x7f2474102c20 2024-08-02T18:50:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f247410fb50 con 0x7f24741022a0 2024-08-02T18:50:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.951+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f247410fe50 con 0x7f2474100b50 2024-08-02T18:50:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.952+0000 7f247259c640 1 -- 172.21.15.103:0/510148792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24741022a0 msgr2=0x7f2474196570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.952+0000 7f247259c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24741022a0 0x7f2474196570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.952+0000 7f247259c640 1 -- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 msgr2=0x7f247419a900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.952+0000 7f247259c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 0x7f247419a900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.952+0000 7f247259c640 1 -- 172.21.15.103:0/510148792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f247419afe0 con 0x7f2474100b50 2024-08-02T18:50:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.952+0000 7f247259c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2474100b50 0x7f2474196030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f246400d6d0 tx=0x7f246400db90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.952+0000 7f24637fe640 1 -- 172.21.15.103:0/510148792 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464017070 con 0x7f2474100b50 2024-08-02T18:50:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.953+0000 7f24637fe640 1 -- 172.21.15.103:0/510148792 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2464009820 con 0x7f2474100b50 2024-08-02T18:50:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.953+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f247419b2d0 con 0x7f2474100b50 2024-08-02T18:50:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.954+0000 7f24637fe640 1 -- 172.21.15.103:0/510148792 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2464004e00 con 0x7f2474100b50 2024-08-02T18:50:36.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.954+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f24741a2bb0 con 0x7f2474100b50 2024-08-02T18:50:36.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.956+0000 7f24637fe640 1 -- 172.21.15.103:0/510148792 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f2464005220 con 0x7f2474100b50 2024-08-02T18:50:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.957+0000 7f247af4a740 1 Processor -- start 2024-08-02T18:50:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.957+0000 7f24637fe640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f245c0a2e90 0x7f245c0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f247af4a740 1 -- start start 2024-08-02T18:50:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f2472d9d640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f245c0a2e90 0x7f245c0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f247af4a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0120 0x5586d74d0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f247af4a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d74e36b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f247af4a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f247af4a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5586d7493e40 con 0x5586d74d0120 2024-08-02T18:50:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f247af4a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5586d74357f0 con 0x5586d74e3bf0 2024-08-02T18:50:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f247af4a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5586d73dcfb0 con 0x5586d74d0a40 2024-08-02T18:50:36.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f247259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0120 0x5586d74d0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f2471d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d74e36b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f2471d9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d74e36b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:48796/0 (socket says 172.21.15.103:48796) 2024-08-02T18:50:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.958+0000 7f2471d9b640 1 -- 172.21.15.103:0/2531662233 learned_addr learned my addr 172.21.15.103:0/2531662233 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f2471d9b640 1 -- 172.21.15.103:0/2531662233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 msgr2=0x5586d74e5fe0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-08-02T18:50:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f2471d9b640 1 --2- 172.21.15.103:0/2531662233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e5fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f2471d9b640 1 -- 172.21.15.103:0/2531662233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0120 msgr2=0x5586d74d0500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f2471d9b640 1 --2- 172.21.15.103:0/2531662233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0120 0x5586d74d0500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f2471d9b640 1 -- 172.21.15.103:0/2531662233 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d71a76a0 con 0x5586d74d0a40 2024-08-02T18:50:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f247259c640 1 --2- 172.21.15.103:0/2531662233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0120 0x5586d74d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f2472d9d640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f245c0a2e90 0x7f245c0a5350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f246c004af0 tx=0x7f246c00f040 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f24637fe640 1 -- 172.21.15.103:0/510148792 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f24640cf460 con 0x7f2474100b50 2024-08-02T18:50:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f2471d9b640 1 --2- 172.21.15.103:0/2531662233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d74e36b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2468009c90 tx=0x7f2468011810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4bbb4879ba3a73e6 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:36.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.959+0000 7f2460ff9640 1 -- 172.21.15.103:0/2531662233 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246801e070 con 0x5586d74d0a40 2024-08-02T18:50:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.960+0000 7f2460ff9640 1 -- 172.21.15.103:0/2531662233 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2468019b30 con 0x5586d74d0a40 2024-08-02T18:50:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.960+0000 7f2460ff9640 1 -- 172.21.15.103:0/2531662233 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246800eac0 con 0x5586d74d0a40 2024-08-02T18:50:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.960+0000 7f247af4a740 1 -- 172.21.15.103:0/2531662233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 msgr2=0x5586d74e36b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.960+0000 7f247af4a740 1 --2- 172.21.15.103:0/2531662233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d74e36b0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f2468009c90 tx=0x7f2468011810 comp rx=0 tx=0).stop 2024-08-02T18:50:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 -- 172.21.15.103:0/2531662233 shutdown_connections 2024-08-02T18:50:36.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 --2- 172.21.15.103:0/2531662233 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e5fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 --2- 172.21.15.103:0/2531662233 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d74e36b0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 --2- 172.21.15.103:0/2531662233 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0120 0x5586d74d0500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 -- 172.21.15.103:0/2531662233 >> 172.21.15.103:0/2531662233 conn(0x5586d74cc790 msgr2=0x5586d74ccb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 -- 172.21.15.103:0/2531662233 shutdown_connections 2024-08-02T18:50:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 -- 172.21.15.103:0/2531662233 wait complete. 2024-08-02T18:50:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 -- start start 2024-08-02T18:50:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.961+0000 7f247af4a740 1 Processor -- start 2024-08-02T18:50:36.965 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f247af4a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74e0c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f247af4a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74e11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f247af4a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e16e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f247af4a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5586d73f0cb0 con 0x5586d74d0a40 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f247af4a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5586d74317b0 con 0x5586d74e3bf0 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f247af4a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5586d74e6760 con 0x5586d74d0120 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f247af4a740 10 client.0 _ll_register_callbacks cb 0x5586d7144ba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e16e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e16e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:40444/0 (socket says 172.21.15.103:40444) 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2472d9d640 1 -- 172.21.15.103:0/4176050200 learned_addr learned my addr 172.21.15.103:0/4176050200 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f247259c640 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74e0c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.966 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2471d9b640 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74e11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2472d9d640 1 -- 172.21.15.103:0/4176050200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 msgr2=0x5586d74e0c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2472d9d640 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74e0c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2472d9d640 1 -- 172.21.15.103:0/4176050200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 msgr2=0x5586d74e11a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2472d9d640 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74e11a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.962+0000 7f2472d9d640 1 -- 172.21.15.103:0/4176050200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d73efbc0 con 0x5586d74e3bf0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f2472d9d640 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e16e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f246c005f60 tx=0x7f246c0095c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=580490d3c76fba2a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f2459ffb640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f2459ffb640 1 -- 172.21.15.103:0/4176050200 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c032ad0 con 0x5586d74e3bf0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f247af4a740 1 -- 172.21.15.103:0/4176050200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2468019b30 con 0x5586d74e3bf0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f2459ffb640 1 -- 172.21.15.103:0/4176050200 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f246c032c70 con 0x5586d74e3bf0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f2459ffb640 1 -- 172.21.15.103:0/4176050200 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f246c032e70 con 0x5586d74e3bf0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f247af4a740 10 client.25226 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f247af4a740 1 -- 172.21.15.103:0/4176050200 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5586d74efbe0 con 0x5586d74e3bf0 2024-08-02T18:50:36.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.963+0000 7f2459ffb640 1 -- 172.21.15.103:0/4176050200 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2468019b30 con 0x5586d74e3bf0 2024-08-02T18:50:36.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.964+0000 7f2459ffb640 1 -- 172.21.15.103:0/4176050200 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f246c0475e0 con 0x5586d74e3bf0 2024-08-02T18:50:36.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.964+0000 7f247af4a740 10 client.25226 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:36.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.964+0000 7f247af4a740 10 client.25226 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:36.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.964+0000 7f247af4a740 20 client.25226 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:36.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.964+0000 7f247af4a740 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5586d74f1460 0x5586d74f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.964+0000 7f247af4a740 4 client.25226 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:36.968 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.964+0000 7f247af4a740 1 -- 172.21.15.103:0/4176050200 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5586d7442d60 con 0x5586d74f1460 2024-08-02T18:50:36.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.964+0000 7f247259c640 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5586d74f1460 0x5586d74f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.965+0000 7f2459ffb640 10 client.25226 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:36.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.965+0000 7f247259c640 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5586d74f1460 0x5586d74f38c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a470c51f3d7a8dd3 server_cookie=c32a0cfc6ed00d85 in_seq=0 out_seq=0 2024-08-02T18:50:36.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.965+0000 7f2459ffb640 1 -- 172.21.15.103:0/4176050200 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5586d7442d60 con 0x5586d74f1460 2024-08-02T18:50:36.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.965+0000 7f2459ffb640 10 client.25226 handle_command_reply: tid=0 2024-08-02T18:50:36.969 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.965+0000 7f247af4a740 1 client.25226 shutdown 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.965+0000 7f247af4a740 1 -- 172.21.15.103:0/4176050200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 msgr2=0x5586d74e16e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.965+0000 7f247af4a740 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e16e0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f246c005f60 tx=0x7f246c0095c0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 1 -- 172.21.15.103:0/4176050200 shutdown_connections 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5586d74f1460 0x5586d74f38c0 crc :-1 s=READY pgs=56 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74e16e0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74e11a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f2459ffb640 0 client.25226 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 1 --2- 172.21.15.103:0/4176050200 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74e0c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.970 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 1 -- 172.21.15.103:0/4176050200 >> 172.21.15.103:0/4176050200 conn(0x5586d74cc790 msgr2=0x5586d74cb8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:36.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 1 -- 172.21.15.103:0/4176050200 shutdown_connections 2024-08-02T18:50:36.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 1 -- 172.21.15.103:0/4176050200 wait complete. 2024-08-02T18:50:36.971 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.966+0000 7f247af4a740 20 client.25226 trim_cache size 0 max 16384 2024-08-02T18:50:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.983+0000 7f247af4a740 1 Processor -- start 2024-08-02T18:50:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.983+0000 7f247af4a740 1 -- start start 2024-08-02T18:50:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.983+0000 7f247af4a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74d0120 0x5586d74ffec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.983+0000 7f247af4a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d7500400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.983+0000 7f247af4a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74e3bf0 0x5586d74f91d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.983+0000 7f247af4a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f24741a6ae0 con 0x5586d74e3bf0 2024-08-02T18:50:36.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.983+0000 7f247af4a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f24741a43b0 con 0x5586d74d0120 2024-08-02T18:50:36.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.983+0000 7f247af4a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f2474197390 con 0x5586d74d0a40 2024-08-02T18:50:36.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74e3bf0 0x5586d74f91d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f247259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74d0120 0x5586d74ffec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74e3bf0 0x5586d74f91d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46432/0 (socket says 172.21.15.103:46432) 2024-08-02T18:50:36.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 -- 172.21.15.103:0/2333023789 learned_addr learned my addr 172.21.15.103:0/2333023789 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:36.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2471d9b640 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d7500400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 -- 172.21.15.103:0/2333023789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 msgr2=0x5586d7500400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d7500400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 -- 172.21.15.103:0/2333023789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74d0120 msgr2=0x5586d74ffec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74d0120 0x5586d74ffec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 -- 172.21.15.103:0/2333023789 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5586d74df1d0 con 0x5586d74e3bf0 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f247259c640 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74d0120 0x5586d74ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.984+0000 7f2472d9d640 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74e3bf0 0x5586d74f91d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f246c047a80 tx=0x7f246c005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eccdcaa74233ce4f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.985+0000 7f245bfff640 1 -- 172.21.15.103:0/2333023789 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c062070 con 0x5586d74e3bf0 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.985+0000 7f245bfff640 1 -- 172.21.15.103:0/2333023789 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f246c04c070 con 0x5586d74e3bf0 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.985+0000 7f245bfff640 1 -- 172.21.15.103:0/2333023789 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246c05d6e0 con 0x5586d74e3bf0 2024-08-02T18:50:36.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 -- 172.21.15.103:0/2333023789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74e3bf0 msgr2=0x5586d74f91d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74e3bf0 0x5586d74f91d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f246c047a80 tx=0x7f246c005fd0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 -- 172.21.15.103:0/2333023789 shutdown_connections 2024-08-02T18:50:36.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74e3bf0 0x5586d74f91d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0a40 0x5586d7500400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 --2- 172.21.15.103:0/2333023789 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74d0120 0x5586d74ffec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 -- 172.21.15.103:0/2333023789 >> 172.21.15.103:0/2333023789 conn(0x5586d74cc790 msgr2=0x5586d74df550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 -- 172.21.15.103:0/2333023789 shutdown_connections 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 -- 172.21.15.103:0/2333023789 wait complete. 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.986+0000 7f247af4a740 1 -- start start 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247af4a740 1 Processor -- start 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247af4a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74de610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247af4a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74eb9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247af4a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74ebf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247af4a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f2474073c70 con 0x5586d74d0a40 2024-08-02T18:50:36.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247af4a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f24741a3ce0 con 0x5586d74e3bf0 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247af4a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f24741a2f40 con 0x5586d74d0120 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f2471d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74eb9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247af4a740 10 client.0 _ll_register_callbacks cb 0x7f246c03e070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247259c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74de610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f2471d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74eb9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:46434/0 (socket says 172.21.15.103:46434) 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f247259c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74de610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:48814/0 (socket says 172.21.15.103:48814) 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f2471d9b640 1 -- 172.21.15.103:0/3338755581 learned_addr learned my addr 172.21.15.103:0/3338755581 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.987+0000 7f2472d9d640 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74ebf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2471d9b640 1 -- 172.21.15.103:0/3338755581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 msgr2=0x5586d74de610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2471d9b640 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74de610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2471d9b640 1 -- 172.21.15.103:0/3338755581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 msgr2=0x5586d74ebf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:36.991 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2471d9b640 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74ebf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2471d9b640 1 -- 172.21.15.103:0/3338755581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5586d74ec570 con 0x5586d74d0a40 2024-08-02T18:50:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2471d9b640 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74eb9f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f24680058c0 tx=0x7f2468009850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a454157c874fa13d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2459ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2459ffb640 1 -- 172.21.15.103:0/3338755581 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f246801e040 con 0x5586d74d0a40 2024-08-02T18:50:36.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f247af4a740 1 -- 172.21.15.103:0/3338755581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f246c04c070 con 0x5586d74d0a40 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.988+0000 7f2459ffb640 1 -- 172.21.15.103:0/3338755581 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f2468003a00 con 0x5586d74d0a40 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.989+0000 7f2459ffb640 1 -- 172.21.15.103:0/3338755581 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f24680098c0 con 0x5586d74d0a40 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.989+0000 7f247af4a740 10 client.15717 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.989+0000 7f247af4a740 1 -- 172.21.15.103:0/3338755581 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5586d755ea50 con 0x5586d74d0a40 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.989+0000 7f2459ffb640 1 -- 172.21.15.103:0/3338755581 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f246c04c070 con 0x5586d74d0a40 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.989+0000 7f2459ffb640 1 -- 172.21.15.103:0/3338755581 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f2468046430 con 0x5586d74d0a40 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.989+0000 7f247af4a740 10 client.15717 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.989+0000 7f247af4a740 10 client.15717 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.990+0000 7f247af4a740 20 client.15717 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:36.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.990+0000 7f247af4a740 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5586d755efc0 0x5586d75613e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.990+0000 7f247af4a740 4 client.15717 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-02T18:50:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.990+0000 7f247af4a740 1 -- 172.21.15.103:0/3338755581 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x5586d743d270 con 0x5586d755efc0 2024-08-02T18:50:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.990+0000 7f247259c640 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5586d755efc0 0x5586d75613e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.990+0000 7f2459ffb640 10 client.15717 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:36.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.990+0000 7f247259c640 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5586d755efc0 0x5586d75613e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bfe43a2341bbcac9 server_cookie=2e9049434b336b13 in_seq=0 out_seq=0 2024-08-02T18:50:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.991+0000 7f2459ffb640 1 -- 172.21.15.103:0/3338755581 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x5586d743d270 con 0x5586d755efc0 2024-08-02T18:50:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.991+0000 7f2459ffb640 10 client.15717 handle_command_reply: tid=0 2024-08-02T18:50:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.991+0000 7f247af4a740 1 client.15717 shutdown 2024-08-02T18:50:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f247af4a740 1 -- 172.21.15.103:0/3338755581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 msgr2=0x5586d74eb9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f247af4a740 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74eb9f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f24680058c0 tx=0x7f2468009850 comp rx=0 tx=0).stop 2024-08-02T18:50:36.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f247af4a740 1 -- 172.21.15.103:0/3338755581 shutdown_connections 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f247af4a740 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5586d755efc0 0x5586d75613e0 crc :-1 s=READY pgs=57 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f247af4a740 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5586d74e3bf0 0x5586d74ebf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f247af4a740 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5586d74d0a40 0x5586d74eb9f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f247af4a740 1 --2- 172.21.15.103:0/3338755581 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5586d74d0120 0x5586d74de610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f247af4a740 1 -- 172.21.15.103:0/3338755581 >> 172.21.15.103:0/3338755581 conn(0x5586d74cc790 msgr2=0x5586d74ffec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.992+0000 7f2459ffb640 0 client.15717 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.993+0000 7f247af4a740 1 -- 172.21.15.103:0/3338755581 shutdown_connections 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.993+0000 7f247af4a740 1 -- 172.21.15.103:0/3338755581 wait complete. 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-08-02T18:50:36.996 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "5daf6582-b1ad-4d5b-b4a1-87daf3b8ec11", 2024-08-02T18:50:36.997 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-08-02T18:50:36.997 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.993+0000 7f247af4a740 20 client.15717 trim_cache size 0 max 16384 2024-08-02T18:50:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f245c0a2e90 msgr2=0x7f245c0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f245c0a2e90 0x7f245c0a5350 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f246c004af0 tx=0x7f246c00f040 comp rx=0 tx=0).stop 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2474100b50 msgr2=0x7f2474196030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2474100b50 0x7f2474196030 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f246400d6d0 tx=0x7f246400db90 comp rx=0 tx=0).stop 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 shutdown_connections 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f245c0a2e90 0x7f245c0a5350 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f2474102c20 0x7f247419a900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f24741022a0 0x7f2474196570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 --2- 172.21.15.103:0/510148792 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f2474100b50 0x7f2474196030 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 >> 172.21.15.103:0/510148792 conn(0x7f24740fc500 msgr2=0x7f24740ff9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 shutdown_connections 2024-08-02T18:50:36.998 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:36.994+0000 7f2478b4c640 1 -- 172.21.15.103:0/510148792 wait complete. 2024-08-02T18:50:37.000 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:36 smithi121 ceph-mon[37236]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-02T18:50:37.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:36 smithi151 ceph-mon[37155]: pgmap v29: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 2.2 KiB/s wr, 10 op/s 2024-08-02T18:50:37.979 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:37 smithi103 ceph-mon[32753]: scrub queued for path: / 2024-08-02T18:50:37.979 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:37 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:50:37.979 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:37 smithi103 ceph-mon[32753]: scrub summary: active paths [/] 2024-08-02T18:50:37.979 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:37 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:50:37.980 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-02T18:50:38.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:37 smithi121 ceph-mon[37236]: scrub queued for path: / 2024-08-02T18:50:38.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:37 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:50:38.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:37 smithi121 ceph-mon[37236]: scrub summary: active paths [/] 2024-08-02T18:50:38.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:37 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:50:38.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:37 smithi151 ceph-mon[37155]: scrub queued for path: / 2024-08-02T18:50:38.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:37 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:50:38.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:37 smithi151 ceph-mon[37155]: scrub summary: active paths [/] 2024-08-02T18:50:38.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:37 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:50:38.360 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:38.723 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:38 smithi103 ceph-mon[32753]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-02T18:50:38.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.928+0000 7f16d4487640 1 -- 172.21.15.103:0/2865143819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 msgr2=0x7f16cc100c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.928+0000 7f16d4487640 1 --2- 172.21.15.103:0/2865143819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 0x7f16cc100c20 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f16bc009930 tx=0x7f16bc02a420 comp rx=0 tx=0).stop 2024-08-02T18:50:38.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.928+0000 7f16d4487640 1 -- 172.21.15.103:0/2865143819 shutdown_connections 2024-08-02T18:50:38.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.928+0000 7f16d4487640 1 --2- 172.21.15.103:0/2865143819 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc101160 0x7f16cc10d690 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.932 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.928+0000 7f16d4487640 1 --2- 172.21.15.103:0/2865143819 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 0x7f16cc100c20 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.928+0000 7f16d4487640 1 --2- 172.21.15.103:0/2865143819 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16cc1067c0 0x7f16cc106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.928+0000 7f16d4487640 1 -- 172.21.15.103:0/2865143819 >> 172.21.15.103:0/2865143819 conn(0x7f16cc0fc500 msgr2=0x7f16cc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:38.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.929+0000 7f16d4487640 1 -- 172.21.15.103:0/2865143819 shutdown_connections 2024-08-02T18:50:38.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.929+0000 7f16d4487640 1 -- 172.21.15.103:0/2865143819 wait complete. 2024-08-02T18:50:38.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.929+0000 7f16d4487640 1 Processor -- start 2024-08-02T18:50:38.933 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.929+0000 7f16d4487640 1 -- start start 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d4487640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 0x7f16cc19ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d4487640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc101160 0x7f16cc19f4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d4487640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16cc1067c0 0x7f16cc10b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d2223640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 0x7f16cc19ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d4487640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc111e00 con 0x7f16cc1007c0 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d4487640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc111c80 con 0x7f16cc101160 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d4487640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f16cc111f80 con 0x7f16cc1067c0 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d2223640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 0x7f16cc19ef60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57396/0 (socket says 172.21.15.103:57396) 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d2223640 1 -- 172.21.15.103:0/1530954841 learned_addr learned my addr 172.21.15.103:0/1530954841 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:38.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d2a24640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16cc1067c0 0x7f16cc10b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.930+0000 7f16d1a22640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc101160 0x7f16cc19f4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d2223640 1 -- 172.21.15.103:0/1530954841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16cc1067c0 msgr2=0x7f16cc10b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d2223640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16cc1067c0 0x7f16cc10b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d2223640 1 -- 172.21.15.103:0/1530954841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc101160 msgr2=0x7f16cc19f4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d2223640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc101160 0x7f16cc19f4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d2223640 1 -- 172.21.15.103:0/1530954841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16cc10bfd0 con 0x7f16cc1007c0 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d2a24640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16cc1067c0 0x7f16cc10b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d2223640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 0x7f16cc19ef60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16c800e9f0 tx=0x7f16c800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16c37fe640 1 -- 172.21.15.103:0/1530954841 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c800cd80 con 0x7f16cc1007c0 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16c37fe640 1 -- 172.21.15.103:0/1530954841 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16c8005520 con 0x7f16cc1007c0 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d4487640 1 -- 172.21.15.103:0/1530954841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16cc10c2c0 con 0x7f16cc1007c0 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.931+0000 7f16d4487640 1 -- 172.21.15.103:0/1530954841 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16cc19aac0 con 0x7f16cc1007c0 2024-08-02T18:50:38.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.932+0000 7f16c37fe640 1 -- 172.21.15.103:0/1530954841 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c8010690 con 0x7f16cc1007c0 2024-08-02T18:50:38.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.935+0000 7f16c37fe640 1 -- 172.21.15.103:0/1530954841 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f16c8010910 con 0x7f16cc1007c0 2024-08-02T18:50:38.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d6885740 1 Processor -- start 2024-08-02T18:50:38.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d6885740 1 -- start start 2024-08-02T18:50:38.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d6885740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502bf5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d6885740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c9eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d6885740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502cc7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d6885740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561a50224980 con 0x561a502bfb30 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d6885740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561a501bca70 con 0x561a502ca3f0 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d6885740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a50220940 con 0x561a502bf210 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16c37fe640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f16b80a2e90 0x7f16b80a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.936+0000 7f16d2223640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c9eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2223640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c9eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57402/0 (socket says 172.21.15.103:57402) 2024-08-02T18:50:38.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2223640 1 -- 172.21.15.103:0/2793387888 learned_addr learned my addr 172.21.15.103:0/2793387888 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d1a22640 1 --2- 172.21.15.103:0/2793387888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502cc7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16c37fe640 1 -- 172.21.15.103:0/1530954841 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f16c80cfce0 con 0x7f16cc1007c0 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2a24640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f16b80a2e90 0x7f16b80a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2223640 1 -- 172.21.15.103:0/2793387888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 msgr2=0x561a502bf5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2223640 1 --2- 172.21.15.103:0/2793387888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502bf5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2223640 1 -- 172.21.15.103:0/2793387888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 msgr2=0x561a502cc7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2223640 1 --2- 172.21.15.103:0/2793387888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502cc7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2223640 1 -- 172.21.15.103:0/2793387888 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a5021f6e0 con 0x561a502bfb30 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.937+0000 7f16d2223640 1 --2- 172.21.15.103:0/2793387888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c9eb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f16c80980d0 tx=0x7f16c80cfee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a41cf7fa434751cb server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.938+0000 7f16c0ff9640 1 -- 172.21.15.103:0/2793387888 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c809c370 con 0x561a502bfb30 2024-08-02T18:50:38.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.938+0000 7f16c0ff9640 1 -- 172.21.15.103:0/2793387888 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16c809bc70 con 0x561a502bfb30 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.938+0000 7f16c0ff9640 1 -- 172.21.15.103:0/2793387888 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c80cd4b0 con 0x561a502bfb30 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.938+0000 7f16d2a24640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f16b80a2e90 0x7f16b80a5350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f16c4005fd0 tx=0x7f16c4011440 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.938+0000 7f16d6885740 1 -- 172.21.15.103:0/2793387888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 msgr2=0x561a502c9eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.938+0000 7f16d6885740 1 --2- 172.21.15.103:0/2793387888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c9eb0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f16c80980d0 tx=0x7f16c80cfee0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 -- 172.21.15.103:0/2793387888 shutdown_connections 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 --2- 172.21.15.103:0/2793387888 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502cc7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 --2- 172.21.15.103:0/2793387888 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c9eb0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 --2- 172.21.15.103:0/2793387888 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502bf5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 -- 172.21.15.103:0/2793387888 >> 172.21.15.103:0/2793387888 conn(0x561a502bb7a0 msgr2=0x561a502bbb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 -- 172.21.15.103:0/2793387888 shutdown_connections 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 -- 172.21.15.103:0/2793387888 wait complete. 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 -- start start 2024-08-02T18:50:38.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.939+0000 7f16d6885740 1 Processor -- start 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d6885740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d6885740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d6885740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502c7d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d1a22640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d1a22640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c77f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57410/0 (socket says 172.21.15.103:57410) 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d1a22640 1 -- 172.21.15.103:0/1179975449 learned_addr learned my addr 172.21.15.103:0/1179975449 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x561a502ccfc0 con 0x561a502bfb30 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2223640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x561a501dfaa0 con 0x561a502ca3f0 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x561a502cd140 con 0x561a502bf210 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2a24640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502c7d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d6885740 10 client.0 _ll_register_callbacks cb 0x561a501cee60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2223640 1 -- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 msgr2=0x561a502c7d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2223640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502c7d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2223640 1 -- 172.21.15.103:0/1179975449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 msgr2=0x561a502c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2223640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2223640 1 -- 172.21.15.103:0/1179975449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a501c3650 con 0x561a502bf210 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2a24640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d1a22640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16c809bc70 con 0x561a502bf210 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16d2223640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502c72b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16c80a01e0 tx=0x7f16c8098020 comp rx=0 tx=0).ready entity=mon.1 client_cookie=5db32a8a4490923f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.940+0000 7f16b5ffb640 10 client.25276 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1179975449 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16c80b9060 con 0x561a502bf210 2024-08-02T18:50:38.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1179975449 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f16c80cd460 con 0x561a502bf210 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1179975449 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f16c809c370 con 0x561a502bf210 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16d6885740 10 client.25276 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({fsmap=26}) -- 0x561a4ff963c0 con 0x561a502bf210 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1179975449 <== mon.1 v2:172.21.15.151:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f16c809b0c0 con 0x561a502bf210 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16d6885740 10 client.25276 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16d6885740 10 client.25276 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16d6885740 20 client.25276 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16d6885740 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x561a502d9ba0 0x561a502dbf90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16d6885740 4 client.25276 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.941+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x561a50231ef0 con 0x561a502d9ba0 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.942+0000 7f16d1a22640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x561a502d9ba0 0x561a502dbf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.942+0000 7f16b5ffb640 10 client.25276 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.942+0000 7f16d1a22640 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x561a502d9ba0 0x561a502dbf90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3e48664e0d488161 server_cookie=5caea92aab0f4d19 in_seq=0 out_seq=0 2024-08-02T18:50:38.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1179975449 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x561a50231ef0 con 0x561a502d9ba0 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16b5ffb640 10 client.25276 handle_command_reply: tid=0 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 client.25276 shutdown 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 msgr2=0x561a502c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502c72b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f16c80a01e0 tx=0x7f16c8098020 comp rx=0 tx=0).stop 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 shutdown_connections 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x561a502d9ba0 0x561a502dbf90 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502ca3f0 0x561a502c7d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16b5ffb640 0 client.25276 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bfb30 0x561a502c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 --2- 172.21.15.103:0/1179975449 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502c72b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 >> 172.21.15.103:0/1179975449 conn(0x561a502bb7a0 msgr2=0x561a502ba900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:38.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 shutdown_connections 2024-08-02T18:50:38.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 1 -- 172.21.15.103:0/1179975449 wait complete. 2024-08-02T18:50:38.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.943+0000 7f16d6885740 20 client.25276 trim_cache size 0 max 16384 2024-08-02T18:50:38.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.975+0000 7f16d6885740 1 Processor -- start 2024-08-02T18:50:38.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d6885740 1 -- start start 2024-08-02T18:50:38.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d6885740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502e1590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d6885740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502bfb30 0x561a502e1ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.978 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d6885740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502ca3f0 0x561a502ba0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d2223640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502e1590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d2223640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502e1590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:37552/0 (socket says 172.21.15.103:37552) 2024-08-02T18:50:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d1a22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502bfb30 0x561a502e1ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d1a22640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502bfb30 0x561a502e1ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:48178/0 (socket says 172.21.15.103:48178) 2024-08-02T18:50:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.976+0000 7f16d2a24640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502ca3f0 0x561a502ba0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.980 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d2a24640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502ca3f0 0x561a502ba0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57416/0 (socket says 172.21.15.103:57416) 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d2223640 1 -- 172.21.15.103:0/2547786238 learned_addr learned my addr 172.21.15.103:0/2547786238 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d6885740 1 -- 172.21.15.103:0/2547786238 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16b0012550 con 0x561a502ca3f0 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d6885740 1 -- 172.21.15.103:0/2547786238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16b000fe20 con 0x561a502bfb30 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d6885740 1 -- 172.21.15.103:0/2547786238 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f16b000dc70 con 0x561a502bf210 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d1a22640 1 -- 172.21.15.103:0/2547786238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 msgr2=0x561a502e1590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d1a22640 1 --2- 172.21.15.103:0/2547786238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502e1590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d1a22640 1 -- 172.21.15.103:0/2547786238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502ca3f0 msgr2=0x561a502ba0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d1a22640 1 --2- 172.21.15.103:0/2547786238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502ca3f0 0x561a502ba0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.981 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d1a22640 1 -- 172.21.15.103:0/2547786238 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a502ccb50 con 0x561a502bfb30 2024-08-02T18:50:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.977+0000 7f16d2a24640 1 --2- 172.21.15.103:0/2547786238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502ca3f0 0x561a502ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.978+0000 7f16d1a22640 1 --2- 172.21.15.103:0/2547786238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502bfb30 0x561a502e1ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16bc006010 tx=0x7f16bc005780 comp rx=0 tx=0).ready entity=mon.2 client_cookie=7bd3e57eb9b21af9 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.978+0000 7f16b7fff640 1 -- 172.21.15.103:0/2547786238 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc04d020 con 0x561a502bfb30 2024-08-02T18:50:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.978+0000 7f16b7fff640 1 -- 172.21.15.103:0/2547786238 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16bc004240 con 0x561a502bfb30 2024-08-02T18:50:38.982 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.978+0000 7f16b7fff640 1 -- 172.21.15.103:0/2547786238 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc035040 con 0x561a502bfb30 2024-08-02T18:50:38.984 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 -- 172.21.15.103:0/2547786238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502bfb30 msgr2=0x561a502e1ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 --2- 172.21.15.103:0/2547786238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502bfb30 0x561a502e1ad0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f16bc006010 tx=0x7f16bc005780 comp rx=0 tx=0).stop 2024-08-02T18:50:38.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 -- 172.21.15.103:0/2547786238 shutdown_connections 2024-08-02T18:50:38.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 --2- 172.21.15.103:0/2547786238 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502ca3f0 0x561a502ba0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.985 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 --2- 172.21.15.103:0/2547786238 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502bfb30 0x561a502e1ad0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 --2- 172.21.15.103:0/2547786238 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502bf210 0x561a502e1590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 -- 172.21.15.103:0/2547786238 >> 172.21.15.103:0/2547786238 conn(0x561a502bb7a0 msgr2=0x561a502c63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 -- 172.21.15.103:0/2547786238 shutdown_connections 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 -- 172.21.15.103:0/2547786238 wait complete. 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 -- start start 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.979+0000 7f16d6885740 1 Processor -- start 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d6885740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bf210 0x561a502d2a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d6885740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502ca3f0 0x561a502c3f10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d6885740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502d9ba0 0x561a502c4450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d6885740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f16b000e2e0 con 0x561a502bf210 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d6885740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f16b000f750 con 0x561a502d9ba0 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d6885740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f16b000e9b0 con 0x561a502ca3f0 2024-08-02T18:50:38.986 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d6885740 10 client.0 _ll_register_callbacks cb 0x7f16c8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d2223640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bf210 0x561a502d2a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d2223640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bf210 0x561a502d2a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57422/0 (socket says 172.21.15.103:57422) 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d2223640 1 -- 172.21.15.103:0/1962760922 learned_addr learned my addr 172.21.15.103:0/1962760922 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d1a22640 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502ca3f0 0x561a502c3f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d2a24640 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502d9ba0 0x561a502c4450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d1a22640 1 -- 172.21.15.103:0/1962760922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502d9ba0 msgr2=0x561a502c4450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d1a22640 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502d9ba0 0x561a502c4450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d1a22640 1 -- 172.21.15.103:0/1962760922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bf210 msgr2=0x561a502d2a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d1a22640 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bf210 0x561a502d2a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d1a22640 1 -- 172.21.15.103:0/1962760922 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a502c4c50 con 0x561a502ca3f0 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.980+0000 7f16d2223640 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bf210 0x561a502d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:38.987 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16d1a22640 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502ca3f0 0x561a502c3f10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x561a502c5a70 tx=0x7f16bc005d50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d5218feec85e5332 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16b5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:50:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1962760922 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f16bc04d030 con 0x561a502ca3f0 2024-08-02T18:50:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1962760922 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f16bc004000 con 0x561a502ca3f0 2024-08-02T18:50:38.988 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16d6885740 1 -- 172.21.15.103:0/1962760922 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f16bc004240 con 0x561a502ca3f0 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1962760922 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f16bc035070 con 0x561a502ca3f0 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16d6885740 10 client.25282 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16d6885740 1 -- 172.21.15.103:0/1962760922 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x561a50344540 con 0x561a502ca3f0 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.981+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1962760922 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f16bc0043f0 con 0x561a502ca3f0 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1962760922 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f16bc048910 con 0x561a502ca3f0 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16d6885740 10 client.25282 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16d6885740 10 client.25282 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16d6885740 20 client.25282 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16d6885740 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x561a50344b90 0x561a50346fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16d6885740 4 client.25282 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16d6885740 1 -- 172.21.15.103:0/1962760922 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub status"}) -- 0x7f16bc004240 con 0x561a50344b90 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16d2223640 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x561a50344b90 0x561a50346fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:38.989 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16b5ffb640 10 client.25282 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.982+0000 7f16d2223640 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x561a50344b90 0x561a50346fb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7804189cc9c937bc server_cookie=beeaa0df4027b021 in_seq=0 out_seq=0 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16b5ffb640 1 -- 172.21.15.103:0/1962760922 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x7f16bc004240 con 0x561a50344b90 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16b5ffb640 10 client.25282 handle_command_reply: tid=0 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 client.25282 shutdown 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 -- 172.21.15.103:0/1962760922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502ca3f0 msgr2=0x561a502c3f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502ca3f0 0x561a502c3f10 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x561a502c5a70 tx=0x7f16bc005d50 comp rx=0 tx=0).stop 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 -- 172.21.15.103:0/1962760922 shutdown_connections 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x561a50344b90 0x561a50346fb0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16b5ffb640 0 client.25282 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x561a502d9ba0 0x561a502c4450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x561a502ca3f0 0x561a502c3f10 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 --2- 172.21.15.103:0/1962760922 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x561a502bf210 0x561a502d2a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.990 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 -- 172.21.15.103:0/1962760922 >> 172.21.15.103:0/1962760922 conn(0x561a502bb7a0 msgr2=0x561a502c0c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "5daf6582-b1ad-4d5b-b4a1-87daf3b8ec11": { 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/", 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "5daf6582-b1ad-4d5b-b4a1-87daf3b8ec11", 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:38.991 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.983+0000 7f16d6885740 1 -- 172.21.15.103:0/1962760922 shutdown_connections 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d6885740 1 -- 172.21.15.103:0/1962760922 wait complete. 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d6885740 20 client.25282 trim_cache size 0 max 16384 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 -- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f16b80a2e90 msgr2=0x7f16b80a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f16b80a2e90 0x7f16b80a5350 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f16c4005fd0 tx=0x7f16c4011440 comp rx=0 tx=0).stop 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 -- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 msgr2=0x7f16cc19ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 0x7f16cc19ef60 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f16c800e9f0 tx=0x7f16c800edf0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 -- 172.21.15.103:0/1530954841 shutdown_connections 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f16b80a2e90 0x7f16b80a5350 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f16cc1067c0 0x7f16cc10b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f16cc101160 0x7f16cc19f4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.992 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 --2- 172.21.15.103:0/1530954841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f16cc1007c0 0x7f16cc19ef60 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:38.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 -- 172.21.15.103:0/1530954841 >> 172.21.15.103:0/1530954841 conn(0x7f16cc0fc500 msgr2=0x7f16cc10e4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:38.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 -- 172.21.15.103:0/1530954841 shutdown_connections 2024-08-02T18:50:38.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:38.984+0000 7f16d4487640 1 -- 172.21.15.103:0/1530954841 wait complete. 2024-08-02T18:50:39.000 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:38 smithi121 ceph-mon[37236]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-02T18:50:39.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:38 smithi151 ceph-mon[37155]: pgmap v30: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 1.7 KiB/s wr, 6 op/s 2024-08-02T18:50:39.697 INFO:tasks.cephfs.filesystem:scrub status for tag:5daf6582-b1ad-4d5b-b4a1-87daf3b8ec11 - {'path': '/', 'tag': '5daf6582-b1ad-4d5b-b4a1-87daf3b8ec11', 'options': 'recursive,force'} 2024-08-02T18:50:41.004 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:40 smithi121 ceph-mon[37236]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-02T18:50:41.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:40 smithi151 ceph-mon[37155]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-02T18:50:41.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:40 smithi103 ceph-mon[32753]: pgmap v31: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.5 KiB/s rd, 1.7 KiB/s wr, 8 op/s 2024-08-02T18:50:42.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:41 smithi121 ceph-mon[37236]: scrub summary: idle 2024-08-02T18:50:42.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:41 smithi151 ceph-mon[37155]: scrub summary: idle 2024-08-02T18:50:42.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:41 smithi103 ceph-mon[32753]: scrub summary: idle 2024-08-02T18:50:43.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:42 smithi121 ceph-mon[37236]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-02T18:50:43.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:42 smithi151 ceph-mon[37155]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-02T18:50:43.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:42 smithi103 ceph-mon[32753]: pgmap v32: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.2 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-02T18:50:45.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:44 smithi121 ceph-mon[37236]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-08-02T18:50:45.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:44 smithi151 ceph-mon[37155]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-08-02T18:50:45.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:44 smithi103 ceph-mon[32753]: pgmap v33: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.7 KiB/s wr, 7 op/s 2024-08-02T18:50:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.221+0000 7face39ba640 1 -- 172.21.15.103:0/77512850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 msgr2=0x7facdc102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.221+0000 7face39ba640 1 --2- 172.21.15.103:0/77512850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 0x7facdc102d90 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7facd8009900 tx=0x7facd802a480 comp rx=0 tx=0).stop 2024-08-02T18:50:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 -- 172.21.15.103:0/77512850 shutdown_connections 2024-08-02T18:50:46.226 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 --2- 172.21.15.103:0/77512850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facdc10be00 0x7facdc10e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 --2- 172.21.15.103:0/77512850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facdc1032d0 0x7facdc10b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 --2- 172.21.15.103:0/77512850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 0x7facdc102d90 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 -- 172.21.15.103:0/77512850 >> 172.21.15.103:0/77512850 conn(0x7facdc0776c0 msgr2=0x7facdc0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 -- 172.21.15.103:0/77512850 shutdown_connections 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 -- 172.21.15.103:0/77512850 wait complete. 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 Processor -- start 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 -- start start 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 0x7facdc100600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.227 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.222+0000 7face39ba640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facdc1032d0 0x7facdc100b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face39ba640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facdc10be00 0x7facdc101080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face39ba640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7facdc111d00 con 0x7facdc1029b0 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face39ba640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7facdc111b80 con 0x7facdc10be00 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face39ba640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7facdc111e80 con 0x7facdc1032d0 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 0x7facdc100600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 0x7facdc100600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57442/0 (socket says 172.21.15.103:57442) 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 -- 172.21.15.103:0/2572808649 learned_addr learned my addr 172.21.15.103:0/2572808649 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face0f55640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facdc1032d0 0x7facdc100b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 -- 172.21.15.103:0/2572808649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facdc1032d0 msgr2=0x7facdc100b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facdc1032d0 0x7facdc100b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 -- 172.21.15.103:0/2572808649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facdc10be00 msgr2=0x7facdc101080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facdc10be00 0x7facdc101080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 -- 172.21.15.103:0/2572808649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7facdc1a6650 con 0x7facdc1029b0 2024-08-02T18:50:46.228 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face0f55640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facdc1032d0 0x7facdc100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face1756640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 0x7facdc100600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7facd8006010 tx=0x7facd80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7facd27fc640 1 -- 172.21.15.103:0/2572808649 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd803f030 con 0x7facdc1029b0 2024-08-02T18:50:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face39ba640 1 -- 172.21.15.103:0/2572808649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7facdc1a68e0 con 0x7facdc1029b0 2024-08-02T18:50:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7facd27fc640 1 -- 172.21.15.103:0/2572808649 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7facd8003d00 con 0x7facdc1029b0 2024-08-02T18:50:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7facd27fc640 1 -- 172.21.15.103:0/2572808649 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8035070 con 0x7facdc1029b0 2024-08-02T18:50:46.229 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.223+0000 7face39ba640 1 -- 172.21.15.103:0/2572808649 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7facdc1a6e20 con 0x7facdc1029b0 2024-08-02T18:50:46.234 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.226+0000 7facd27fc640 1 -- 172.21.15.103:0/2572808649 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7facd8042030 con 0x7facdc1029b0 2024-08-02T18:50:46.234 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.226+0000 7face67ea740 1 Processor -- start 2024-08-02T18:50:46.234 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.226+0000 7face67ea740 1 -- start start 2024-08-02T18:50:46.234 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face67ea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 0x557b746f9b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.234 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face67ea740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746fa0d0 0x557b74704430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.234 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face67ea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b74704970 0x557b74706d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.234 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face67ea740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557b7465d9b0 con 0x557b746fa0d0 2024-08-02T18:50:46.234 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face67ea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557b74605800 con 0x557b74704970 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face67ea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557b74659970 con 0x557b746f97b0 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face1756640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746fa0d0 0x557b74704430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face1756640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746fa0d0 0x557b74704430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57444/0 (socket says 172.21.15.103:57444) 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face1756640 1 -- 172.21.15.103:0/3318786994 learned_addr learned my addr 172.21.15.103:0/3318786994 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face0f55640 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b74704970 0x557b74706d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7facd27fc640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7facc80a2f40 0x7facc80a5400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face1f57640 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 0x557b746f9b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face1f57640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7facc80a2f40 0x7facc80a5400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7facd27fc640 1 -- 172.21.15.103:0/2572808649 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7facd80effe0 con 0x7facdc1029b0 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face0f55640 1 -- 172.21.15.103:0/3318786994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 msgr2=0x557b746f9b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:46.235 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face0f55640 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 0x557b746f9b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face0f55640 1 -- 172.21.15.103:0/3318786994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746fa0d0 msgr2=0x557b74704430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face0f55640 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746fa0d0 0x557b74704430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face0f55640 1 -- 172.21.15.103:0/3318786994 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b74371210 con 0x557b74704970 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.227+0000 7face1756640 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746fa0d0 0x557b74704430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.228+0000 7face0f55640 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b74704970 0x557b74706d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facdc102090 tx=0x7faccc00f730 comp rx=0 tx=0).ready entity=mon.2 client_cookie=89d1e900c0eaf48e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.228+0000 7face1f57640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7facc80a2f40 0x7facc80a5400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7facd4005c40 tx=0x7facd4005bd0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.228+0000 7facc77fe640 1 -- 172.21.15.103:0/3318786994 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc011440 con 0x557b74704970 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.228+0000 7facc77fe640 1 -- 172.21.15.103:0/3318786994 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faccc011ae0 con 0x557b74704970 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.228+0000 7facc77fe640 1 -- 172.21.15.103:0/3318786994 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faccc01bb80 con 0x557b74704970 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 -- 172.21.15.103:0/3318786994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b74704970 msgr2=0x557b74706d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b74704970 0x557b74706d60 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7facdc102090 tx=0x7faccc00f730 comp rx=0 tx=0).stop 2024-08-02T18:50:46.236 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 -- 172.21.15.103:0/3318786994 shutdown_connections 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b74704970 0x557b74706d60 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746fa0d0 0x557b74704430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 --2- 172.21.15.103:0/3318786994 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 0x557b746f9b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 -- 172.21.15.103:0/3318786994 >> 172.21.15.103:0/3318786994 conn(0x557b746f5d20 msgr2=0x557b746f6100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 -- 172.21.15.103:0/3318786994 shutdown_connections 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 -- 172.21.15.103:0/3318786994 wait complete. 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 -- start start 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.229+0000 7face67ea740 1 Processor -- start 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face67ea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b74704430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face67ea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b74701770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face67ea740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b74704970 0x557b74701f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face67ea740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557b74707590 con 0x557b74704970 2024-08-02T18:50:46.237 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face67ea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557b74619500 con 0x557b746f97b0 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face67ea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557b74707710 con 0x557b746fa0d0 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face67ea740 10 client.0 _ll_register_callbacks cb 0x557b74370a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face1f57640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b74704970 0x557b74701f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face1f57640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b74704970 0x557b74701f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57460/0 (socket says 172.21.15.103:57460) 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face1f57640 1 -- 172.21.15.103:0/3767793808 learned_addr learned my addr 172.21.15.103:0/3767793808 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face1756640 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b74704430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.230+0000 7face0f55640 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b74701770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face1f57640 1 -- 172.21.15.103:0/3767793808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 msgr2=0x557b74701770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face1f57640 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b74701770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face1f57640 1 -- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 msgr2=0x557b74704430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face1f57640 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b74704430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face1f57640 1 -- 172.21.15.103:0/3767793808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b7443d620 con 0x557b74704970 2024-08-02T18:50:46.238 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face1756640 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b74704430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face1f57640 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b74704970 0x557b74701f00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7facd4003dd0 tx=0x7facd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eff0117f345fa62 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7facc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7facc4ff9640 1 -- 172.21.15.103:0/3767793808 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd401c050 con 0x557b74704970 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7facc4ff9640 1 -- 172.21.15.103:0/3767793808 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7facd4012930 con 0x557b74704970 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face67ea740 1 -- 172.21.15.103:0/3767793808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7faccc011ae0 con 0x557b74704970 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7facc4ff9640 1 -- 172.21.15.103:0/3767793808 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7facd402f050 con 0x557b74704970 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face67ea740 10 client.15747 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7face67ea740 1 -- 172.21.15.103:0/3767793808 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557b74713180 con 0x557b74704970 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.231+0000 7facc4ff9640 1 -- 172.21.15.103:0/3767793808 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7faccc011ae0 con 0x557b74704970 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7facc4ff9640 1 -- 172.21.15.103:0/3767793808 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7facd400f420 con 0x557b74704970 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7face67ea740 10 client.15747 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7face67ea740 10 client.15747 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7face67ea740 20 client.15747 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:46.239 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7face67ea740 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x557b74714640 0x557b74716ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.240 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7face67ea740 4 client.15747 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:46.240 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7face67ea740 1 -- 172.21.15.103:0/3767793808 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557b7466b0e0 con 0x557b74714640 2024-08-02T18:50:46.240 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7face1756640 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x557b74714640 0x557b74716ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7facc4ff9640 10 client.15747 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.232+0000 7face1756640 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x557b74714640 0x557b74716ab0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4db7b35df7e4497d server_cookie=dbdda8bd7b6f314b in_seq=0 out_seq=0 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7facc4ff9640 1 -- 172.21.15.103:0/3767793808 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557b7466b0e0 con 0x557b74714640 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7facc4ff9640 10 client.15747 handle_command_reply: tid=0 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 client.15747 shutdown 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 -- 172.21.15.103:0/3767793808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b74704970 msgr2=0x557b74701f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b74704970 0x557b74701f00 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7facd4003dd0 tx=0x7facd4004a40 comp rx=0 tx=0).stop 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 -- 172.21.15.103:0/3767793808 shutdown_connections 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x557b74714640 0x557b74716ab0 crc :-1 s=READY pgs=60 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b74704970 0x557b74701f00 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.241 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b74701770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.242 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 --2- 172.21.15.103:0/3767793808 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b74704430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.242 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7facc4ff9640 0 client.15747 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:46.242 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.233+0000 7face67ea740 1 -- 172.21.15.103:0/3767793808 >> 172.21.15.103:0/3767793808 conn(0x557b746f5d20 msgr2=0x557b746fba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:46.242 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.234+0000 7face67ea740 1 -- 172.21.15.103:0/3767793808 shutdown_connections 2024-08-02T18:50:46.242 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.234+0000 7face67ea740 1 -- 172.21.15.103:0/3767793808 wait complete. 2024-08-02T18:50:46.242 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.234+0000 7face67ea740 20 client.15747 trim_cache size 0 max 16384 2024-08-02T18:50:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face67ea740 1 Processor -- start 2024-08-02T18:50:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face67ea740 1 -- start start 2024-08-02T18:50:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face67ea740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7471c410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face67ea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 0x557b7471c950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face67ea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746fa0d0 0x557b746fe9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.252 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face67ea740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7facdc1b3710 con 0x557b746f5d20 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face67ea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7facdc1b0fe0 con 0x557b746fa0d0 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face67ea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7facdc1aee30 con 0x557b746f97b0 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1756640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7471c410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1756640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7471c410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57466/0 (socket says 172.21.15.103:57466) 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1756640 1 -- 172.21.15.103:0/1141480722 learned_addr learned my addr 172.21.15.103:0/1141480722 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face0f55640 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 0x557b7471c950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1f57640 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746fa0d0 0x557b746fe9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1756640 1 -- 172.21.15.103:0/1141480722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 msgr2=0x557b7471c950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1756640 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 0x557b7471c950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1756640 1 -- 172.21.15.103:0/1141480722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746fa0d0 msgr2=0x557b746fe9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1756640 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746fa0d0 0x557b746fe9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.253 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.249+0000 7face1756640 1 -- 172.21.15.103:0/1141480722 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557b746f5b50 con 0x557b746f5d20 2024-08-02T18:50:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.250+0000 7face1756640 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7471c410 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7facd80dc010 tx=0x7facd80f2470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b883baecbec3be4 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.250+0000 7facc6ffd640 1 -- 172.21.15.103:0/1141480722 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8049040 con 0x557b746f5d20 2024-08-02T18:50:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.250+0000 7facc6ffd640 1 -- 172.21.15.103:0/1141480722 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7facd80bc800 con 0x557b746f5d20 2024-08-02T18:50:46.254 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.250+0000 7facc6ffd640 1 -- 172.21.15.103:0/1141480722 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd80ba400 con 0x557b746f5d20 2024-08-02T18:50:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.250+0000 7face67ea740 1 -- 172.21.15.103:0/1141480722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 msgr2=0x557b7471c410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.250+0000 7face67ea740 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7471c410 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7facd80dc010 tx=0x7facd80f2470 comp rx=0 tx=0).stop 2024-08-02T18:50:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 -- 172.21.15.103:0/1141480722 shutdown_connections 2024-08-02T18:50:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746fa0d0 0x557b746fe9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746f97b0 0x557b7471c950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 --2- 172.21.15.103:0/1141480722 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7471c410 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 -- 172.21.15.103:0/1141480722 >> 172.21.15.103:0/1141480722 conn(0x557b74704590 msgr2=0x557b74700040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:46.257 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 -- 172.21.15.103:0/1141480722 shutdown_connections 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 -- 172.21.15.103:0/1141480722 wait complete. 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 -- start start 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.251+0000 7face67ea740 1 Processor -- start 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face67ea740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7470d280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face67ea740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b746fe590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face67ea740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b746feb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7470d280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face67ea740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7facdc1af4a0 con 0x557b746f5d20 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face67ea740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7facdc1b0910 con 0x557b746f97b0 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face67ea740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7facdc1afb70 con 0x557b746fa0d0 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7470d280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:57478/0 (socket says 172.21.15.103:57478) 2024-08-02T18:50:46.258 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 -- 172.21.15.103:0/4087434402 learned_addr learned my addr 172.21.15.103:0/4087434402 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face0f55640 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b746fe590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face67ea740 10 client.0 _ll_register_callbacks cb 0x7facd4003a80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1f57640 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b746feb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 -- 172.21.15.103:0/4087434402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 msgr2=0x557b746feb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b746feb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 -- 172.21.15.103:0/4087434402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 msgr2=0x557b746fe590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b746fe590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 -- 172.21.15.103:0/4087434402 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557b746ff3b0 con 0x557b746f5d20 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1f57640 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b746feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7face1756640 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7470d280 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7facd80b8560 tx=0x7facd80bbb10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71cf50d87c4de511 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7facc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7facc4ff9640 1 -- 172.21.15.103:0/4087434402 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7facd8049070 con 0x557b746f5d20 2024-08-02T18:50:46.259 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.252+0000 7facc4ff9640 1 -- 172.21.15.103:0/4087434402 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7facd80c0160 con 0x557b746f5d20 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 1 -- 172.21.15.103:0/4087434402 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7facd80bc800 con 0x557b746f5d20 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7facc4ff9640 1 -- 172.21.15.103:0/4087434402 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7facd80dc040 con 0x557b746f5d20 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 10 client.15753 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 1 -- 172.21.15.103:0/4087434402 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x557b7477f4c0 con 0x557b746f5d20 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7facc4ff9640 1 -- 172.21.15.103:0/4087434402 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7facd80bc800 con 0x557b746f5d20 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7facc4ff9640 1 -- 172.21.15.103:0/4087434402 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7facd80f20b0 con 0x557b746f5d20 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 10 client.15753 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 10 client.15753 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 20 client.15753 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x557b74704970 0x557b747819f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 4 client.15753 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.253+0000 7face67ea740 1 -- 172.21.15.103:0/4087434402 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x557b74665430 con 0x557b74704970 2024-08-02T18:50:46.260 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.254+0000 7face0f55640 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x557b74704970 0x557b747819f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:46.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.254+0000 7facc4ff9640 10 client.15753 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:46.261 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.254+0000 7face0f55640 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x557b74704970 0x557b747819f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b62f69ef6cecf5cc server_cookie=571f93f657d9072 in_seq=0 out_seq=0 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7facc4ff9640 1 -- 172.21.15.103:0/4087434402 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x557b74665430 con 0x557b74704970 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7facc4ff9640 10 client.15753 handle_command_reply: tid=0 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 client.15753 shutdown 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 -- 172.21.15.103:0/4087434402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 msgr2=0x557b7470d280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7470d280 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7facd80b8560 tx=0x7facd80bbb10 comp rx=0 tx=0).stop 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 -- 172.21.15.103:0/4087434402 shutdown_connections 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x557b74704970 0x557b747819f0 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7facc4ff9640 0 client.15753 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x557b746fa0d0 0x557b746feb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x557b746f97b0 0x557b746fe590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.262 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 --2- 172.21.15.103:0/4087434402 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x557b746f5d20 0x557b7470d280 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 -- 172.21.15.103:0/4087434402 >> 172.21.15.103:0/4087434402 conn(0x557b74704590 msgr2=0x557b746f4660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 -- 172.21.15.103:0/4087434402 shutdown_connections 2024-08-02T18:50:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 1 -- 172.21.15.103:0/4087434402 wait complete. 2024-08-02T18:50:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face67ea740 20 client.15753 trim_cache size 0 max 16384 2024-08-02T18:50:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:50:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:50:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:50:46.263 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:50:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 -- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7facc80a2f40 msgr2=0x7facc80a5400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7facc80a2f40 0x7facc80a5400 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7facd4005c40 tx=0x7facd4005bd0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 -- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 msgr2=0x7facdc100600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 0x7facdc100600 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7facd8006010 tx=0x7facd80042f0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.264 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 -- 172.21.15.103:0/2572808649 shutdown_connections 2024-08-02T18:50:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7facc80a2f40 0x7facc80a5400 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7facdc10be00 0x7facdc101080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7facdc1032d0 0x7facdc100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 --2- 172.21.15.103:0/2572808649 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7facdc1029b0 0x7facdc100600 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 -- 172.21.15.103:0/2572808649 >> 172.21.15.103:0/2572808649 conn(0x7facdc0776c0 msgr2=0x7facdc0fe470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 -- 172.21.15.103:0/2572808649 shutdown_connections 2024-08-02T18:50:46.265 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:46.259+0000 7face39ba640 1 -- 172.21.15.103:0/2572808649 wait complete. 2024-08-02T18:50:47.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:46 smithi121 ceph-mon[37236]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-02T18:50:47.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:46 smithi151 ceph-mon[37155]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-02T18:50:47.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:46 smithi103 ceph-mon[32753]: pgmap v34: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 5.7 KiB/s rd, 1.7 KiB/s wr, 10 op/s 2024-08-02T18:50:48.556 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:50:48.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:48 smithi103 ceph-mon[32753]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:50:48.904 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:49.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:48 smithi121 ceph-mon[37236]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:50:49.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:48 smithi151 ceph-mon[37155]: pgmap v35: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:50:49.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.426+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4188148933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c1018e0 msgr2=0x7f5c0c101d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:49.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.426+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4188148933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c1018e0 0x7f5c0c101d40 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f5c00009930 tx=0x7f5c0002a420 comp rx=0 tx=0).stop 2024-08-02T18:50:49.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.427+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4188148933 shutdown_connections 2024-08-02T18:50:49.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.427+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4188148933 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c0c102280 0x7f5c0c10e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.427+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4188148933 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c1018e0 0x7f5c0c101d40 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.427+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4188148933 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c0c1078e0 0x7f5c0c107cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.427+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4188148933 >> 172.21.15.103:0/4188148933 conn(0x7f5c0c0fd600 msgr2=0x7f5c0c0ffa20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:49.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.427+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4188148933 shutdown_connections 2024-08-02T18:50:49.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.427+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4188148933 wait complete. 2024-08-02T18:50:49.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c11e4e640 1 Processor -- start 2024-08-02T18:50:49.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c11e4e640 1 -- start start 2024-08-02T18:50:49.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c11e4e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c0c1018e0 0x7f5c0c19a470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:49.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c11e4e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c102280 0x7f5c0c19a9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:49.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c11e4e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c0c1078e0 0x7f5c0c19ed40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:49.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c11e4e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c0757e0 con 0x7f5c0c102280 2024-08-02T18:50:49.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c11e4e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c075660 con 0x7f5c0c1078e0 2024-08-02T18:50:49.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c0affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c102280 0x7f5c0c19a9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:49.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c0affd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c102280 0x7f5c0c19a9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34688/0 (socket says 172.21.15.103:34688) 2024-08-02T18:50:49.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c0affd640 1 -- 172.21.15.103:0/4027405980 learned_addr learned my addr 172.21.15.103:0/4027405980 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:49.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.428+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5c0c075960 con 0x7f5c0c1018e0 2024-08-02T18:50:49.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c0bfff640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c0c1078e0 0x7f5c0c19ed40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:49.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c0b7fe640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c0c1018e0 0x7f5c0c19a470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:49.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c0affd640 1 -- 172.21.15.103:0/4027405980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c0c1018e0 msgr2=0x7f5c0c19a470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:49.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c0affd640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c0c1018e0 0x7f5c0c19a470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c0affd640 1 -- 172.21.15.103:0/4027405980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c0c1078e0 msgr2=0x7f5c0c19ed40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:49.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c0affd640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c0c1078e0 0x7f5c0c19ed40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c0affd640 1 -- 172.21.15.103:0/4027405980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c0c19f420 con 0x7f5c0c102280 2024-08-02T18:50:49.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c0affd640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c102280 0x7f5c0c19a9b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5c0002a940 tx=0x7f5c00032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:49.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c08ff9640 1 -- 172.21.15.103:0/4027405980 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c0003f030 con 0x7f5c0c102280 2024-08-02T18:50:49.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c0c19f6b0 con 0x7f5c0c102280 2024-08-02T18:50:49.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c08ff9640 1 -- 172.21.15.103:0/4027405980 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5c00032e10 con 0x7f5c0c102280 2024-08-02T18:50:49.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c08ff9640 1 -- 172.21.15.103:0/4027405980 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c00035070 con 0x7f5c0c102280 2024-08-02T18:50:49.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.429+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c0c1a6ff0 con 0x7f5c0c102280 2024-08-02T18:50:49.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.431+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c0c101d40 con 0x7f5c0c102280 2024-08-02T18:50:49.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.433+0000 7f5c08ff9640 1 -- 172.21.15.103:0/4027405980 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f5c00042030 con 0x7f5c0c102280 2024-08-02T18:50:49.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.433+0000 7f5c08ff9640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5bf40a2e90 0x7f5bf40a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:49.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.434+0000 7f5c0b7fe640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5bf40a2e90 0x7f5bf40a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:49.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.434+0000 7f5c08ff9640 1 -- 172.21.15.103:0/4027405980 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f5c000f01a0 con 0x7f5c0c102280 2024-08-02T18:50:49.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.434+0000 7f5c0b7fe640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5bf40a2e90 0x7f5bf40a5350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0099e0 tx=0x7f5bfc005ed0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:49.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.437+0000 7f5c08ff9640 1 -- 172.21.15.103:0/4027405980 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f5c000bc900 con 0x7f5c0c102280 2024-08-02T18:50:49.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.675+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c0c19b7d0 con 0x7f5c0c102280 2024-08-02T18:50:49.677 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.676+0000 7f5c08ff9640 1 -- 172.21.15.103:0/4027405980 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7f5c000bc200 con 0x7f5c0c102280 2024-08-02T18:50:49.678 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:50:49.678 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:50:49.678 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:50:49.679 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5bf40a2e90 msgr2=0x7f5bf40a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5bf40a2e90 0x7f5bf40a5350 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f5bfc0099e0 tx=0x7f5bfc005ed0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c102280 msgr2=0x7f5c0c19a9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c102280 0x7f5c0c19a9b0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f5c0002a940 tx=0x7f5c00032bf0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 shutdown_connections 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5bf40a2e90 0x7f5bf40a5350 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5c0c1078e0 0x7f5c0c19ed40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5c0c102280 0x7f5c0c19a9b0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 --2- 172.21.15.103:0/4027405980 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5c0c1018e0 0x7f5c0c19a470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:49.680 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 >> 172.21.15.103:0/4027405980 conn(0x7f5c0c0fd600 msgr2=0x7f5c0c0fd9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:49.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 shutdown_connections 2024-08-02T18:50:49.681 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:49.678+0000 7f5c11e4e640 1 -- 172.21.15.103:0/4027405980 wait complete. 2024-08-02T18:50:50.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:49 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4027405980' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:50.057 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:49 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4027405980' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:50.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:49 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4027405980' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:50.485 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id d5d6e209 --release --await' 2024-08-02T18:50:50.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id d5d6e209 --release --await 2024-08-02T18:50:50.747 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:50 smithi103 ceph-mon[32753]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:50:50.856 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:51.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:50 smithi121 ceph-mon[37236]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:50:51.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:50 smithi151 ceph-mon[37155]: pgmap v36: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.1 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.375+0000 7f51ca7f6640 1 -- 172.21.15.103:0/2782913754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 msgr2=0x7f51c4102e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.375+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/2782913754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 0x7f51c4102e40 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f51b4009900 tx=0x7f51b402a480 comp rx=0 tx=0).stop 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 -- 172.21.15.103:0/2782913754 shutdown_connections 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/2782913754 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51c410be90 0x7f51c410e330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/2782913754 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c4103380 0x7f51c410b870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/2782913754 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 0x7f51c4102e40 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 -- 172.21.15.103:0/2782913754 >> 172.21.15.103:0/2782913754 conn(0x7f51c40fc4c0 msgr2=0x7f51c40fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 -- 172.21.15.103:0/2782913754 shutdown_connections 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 -- 172.21.15.103:0/2782913754 wait complete. 2024-08-02T18:50:51.385 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 Processor -- start 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.376+0000 7f51ca7f6640 1 -- start start 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51ca7f6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 0x7f51c419a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51ca7f6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c4103380 0x7f51c419a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51ca7f6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51c410be90 0x7f51c419ed80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 0x7f51c419a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51ca7f6640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51c4111db0 con 0x7f51c4102a60 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 0x7f51c419a4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34704/0 (socket says 172.21.15.103:34704) 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51ca7f6640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51c4111c30 con 0x7f51c4103380 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51c4111f30 con 0x7f51c410be90 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51c3fff640 1 -- 172.21.15.103:0/3050502444 learned_addr learned my addr 172.21.15.103:0/3050502444 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51c37fe640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c4103380 0x7f51c419a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.386 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.377+0000 7f51c8d93640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51c410be90 0x7f51c419ed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c3fff640 1 -- 172.21.15.103:0/3050502444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51c410be90 msgr2=0x7f51c419ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c3fff640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51c410be90 0x7f51c419ed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c3fff640 1 -- 172.21.15.103:0/3050502444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c4103380 msgr2=0x7f51c419a9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c3fff640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c4103380 0x7f51c419a9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c3fff640 1 -- 172.21.15.103:0/3050502444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f51c419f460 con 0x7f51c4102a60 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c8d93640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51c410be90 0x7f51c419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c3fff640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 0x7f51c419a4b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f51b4006010 tx=0x7f51b40042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c17fa640 1 -- 172.21.15.103:0/3050502444 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b403f030 con 0x7f51c4102a60 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c17fa640 1 -- 172.21.15.103:0/3050502444 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51b4003d00 con 0x7f51c4102a60 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f51c419f6f0 con 0x7f51c4102a60 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51c17fa640 1 -- 172.21.15.103:0/3050502444 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4035070 con 0x7f51c4102a60 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.378+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f51c41a7030 con 0x7f51c4102a60 2024-08-02T18:50:51.387 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51c17fa640 1 -- 172.21.15.103:0/3050502444 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f51b4042030 con 0x7f51c4102a60 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51ccbf4740 1 Processor -- start 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51ccbf4740 1 -- start start 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec09c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1ce40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1f770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f58eb6fc60 con 0x55f58ec1d380 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f58eb07b90 con 0x55f58ec098b0 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.382+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f58eb6bc20 con 0x55f58ec0a1d0 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c17fa640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f51ac0a2e90 0x7f51ac0a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec09c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.388 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec09c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:36834/0 (socket says 172.21.15.103:36834) 2024-08-02T18:50:51.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 -- 172.21.15.103:0/1339524478 learned_addr learned my addr 172.21.15.103:0/1339524478 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:51.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c17fa640 1 -- 172.21.15.103:0/3050502444 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f51b40ef9a0 con 0x7f51c4102a60 2024-08-02T18:50:51.389 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f51ac0a2e90 0x7f51ac0a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 -- 172.21.15.103:0/1339524478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 msgr2=0x55f58ec1ce40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 --2- 172.21.15.103:0/1339524478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1ce40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 -- 172.21.15.103:0/1339524478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 msgr2=0x55f58ec1f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 --2- 172.21.15.103:0/1339524478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c8d93640 1 -- 172.21.15.103:0/1339524478 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58e87f580 con 0x55f58ec098b0 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.383+0000 7f51c3fff640 1 --2- 172.21.15.103:0/1339524478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.384+0000 7f51c8d93640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f51ac0a2e90 0x7f51ac0a5350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009fd0 tx=0x7f51bc01d000 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.384+0000 7f51c8d93640 1 --2- 172.21.15.103:0/1339524478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec09c90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51bc012df0 tx=0x7f51bc010740 comp rx=0 tx=0).ready entity=mon.2 client_cookie=13f68176e981a787 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.384+0000 7f51aa7fc640 1 -- 172.21.15.103:0/1339524478 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc022070 con 0x55f58ec098b0 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51aa7fc640 1 -- 172.21.15.103:0/1339524478 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51bc009db0 con 0x55f58ec098b0 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51aa7fc640 1 -- 172.21.15.103:0/1339524478 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51bc004280 con 0x55f58ec098b0 2024-08-02T18:50:51.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1339524478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 msgr2=0x55f58ec09c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1339524478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec09c90 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f51bc012df0 tx=0x7f51bc010740 comp rx=0 tx=0).stop 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1339524478 shutdown_connections 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1339524478 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1339524478 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1ce40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1339524478 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec09c90 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1339524478 >> 172.21.15.103:0/1339524478 conn(0x55f58ec05f20 msgr2=0x55f58ec06300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1339524478 shutdown_connections 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.385+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1339524478 wait complete. 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.386+0000 7f51ccbf4740 1 -- start start 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.386+0000 7f51ccbf4740 1 Processor -- start 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.386+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec1a330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1a870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1adb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f58ec1fe90 con 0x55f58ec1d380 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f58eb0d7c0 con 0x55f58ec098b0 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f58ec20010 con 0x55f58ec0a1d0 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51ccbf4740 10 client.0 _ll_register_callbacks cb 0x55f58eb16f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec1a330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec1a330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:36840/0 (socket says 172.21.15.103:36840) 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 -- 172.21.15.103:0/1848269136 learned_addr learned my addr 172.21.15.103:0/1848269136 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c37fe640 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c8d93640 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1adb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 -- 172.21.15.103:0/1848269136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 msgr2=0x55f58ec1a870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1a870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 -- 172.21.15.103:0/1848269136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 msgr2=0x55f58ec1adb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1adb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 -- 172.21.15.103:0/1848269136 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58e949960 con 0x55f58ec098b0 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c8d93640 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51c3fff640 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec1a330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51b40b83d0 tx=0x7f51b408a930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d651486f8b936b0e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51a37fe640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51a37fe640 1 -- 172.21.15.103:0/1848269136 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4049040 con 0x55f58ec098b0 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.387+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1848269136 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51bc009db0 con 0x55f58ec098b0 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51a37fe640 1 -- 172.21.15.103:0/1848269136 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f51b40bbc60 con 0x55f58ec098b0 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51a37fe640 1 -- 172.21.15.103:0/1848269136 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f51b40bb360 con 0x55f58ec098b0 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51ccbf4740 10 client.25283 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1848269136 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55f58ec2bf40 con 0x55f58ec098b0 2024-08-02T18:50:51.396 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51a37fe640 1 -- 172.21.15.103:0/1848269136 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51bc009db0 con 0x55f58ec098b0 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51a37fe640 1 -- 172.21.15.103:0/1848269136 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f51b404c060 con 0x55f58ec098b0 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51ccbf4740 10 client.25283 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51ccbf4740 10 client.25283 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51ccbf4740 20 client.25283 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f58ec2d350 0x55f58ec2f7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51ccbf4740 4 client.25283 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.388+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1848269136 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f58eb7d1d0 con 0x55f58ec2d350 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.389+0000 7f51c37fe640 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f58ec2d350 0x55f58ec2f7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.389+0000 7f51c37fe640 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f58ec2d350 0x55f58ec2f7b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=154f07511996e7ec server_cookie=3194bc0e713a7dd9 in_seq=0 out_seq=0 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.389+0000 7f51a37fe640 10 client.25283 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51a37fe640 1 -- 172.21.15.103:0/1848269136 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f58eb7d1d0 con 0x55f58ec2d350 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51a37fe640 10 client.25283 handle_command_reply: tid=0 2024-08-02T18:50:51.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 client.25283 shutdown 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1848269136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 msgr2=0x55f58ec1a330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec1a330 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f51b40b83d0 tx=0x7f51b408a930 comp rx=0 tx=0).stop 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1848269136 shutdown_connections 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f58ec2d350 0x55f58ec2f7b0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51a37fe640 0 client.25283 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec1d380 0x55f58ec1adb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec1a870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/1848269136 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec098b0 0x55f58ec1a330 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1848269136 >> 172.21.15.103:0/1848269136 conn(0x55f58ec05f20 msgr2=0x55f58ec05080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1848269136 shutdown_connections 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 1 -- 172.21.15.103:0/1848269136 wait complete. 2024-08-02T18:50:51.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.390+0000 7f51ccbf4740 20 client.25283 trim_cache size 0 max 16384 2024-08-02T18:50:51.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51ccbf4740 1 Processor -- start 2024-08-02T18:50:51.424 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51ccbf4740 1 -- start start 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec1c2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec35080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec355c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51c41af430 con 0x55f58ec098b0 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51c41acd00 con 0x55f58ec1d380 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51ccbf4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51c41aab90 con 0x55f58ec0a1d0 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec1c2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec1c2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34734/0 (socket says 172.21.15.103:34734) 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c3fff640 1 -- 172.21.15.103:0/4257590716 learned_addr learned my addr 172.21.15.103:0/4257590716 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c8d93640 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec355c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.425 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c37fe640 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec35080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c3fff640 1 -- 172.21.15.103:0/4257590716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 msgr2=0x55f58ec35080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:51.426 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c3fff640 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec35080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c3fff640 1 -- 172.21.15.103:0/4257590716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 msgr2=0x55f58ec355c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c3fff640 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec355c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.423+0000 7f51c3fff640 1 -- 172.21.15.103:0/4257590716 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f58ec05bf0 con 0x55f58ec098b0 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.424+0000 7f51c3fff640 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec1c2a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f51b4005940 tx=0x7f51b403b720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c6dc11f818d27628 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.424+0000 7f51a9ffb640 1 -- 172.21.15.103:0/4257590716 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4049070 con 0x55f58ec098b0 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.424+0000 7f51a9ffb640 1 -- 172.21.15.103:0/4257590716 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f51b40efe50 con 0x55f58ec098b0 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.424+0000 7f51a9ffb640 1 -- 172.21.15.103:0/4257590716 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4031470 con 0x55f58ec098b0 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 -- 172.21.15.103:0/4257590716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 msgr2=0x55f58ec1c2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.427 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec1c2a0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f51b4005940 tx=0x7f51b403b720 comp rx=0 tx=0).stop 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 -- 172.21.15.103:0/4257590716 shutdown_connections 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec355c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec35080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/4257590716 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec1c2a0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 -- 172.21.15.103:0/4257590716 >> 172.21.15.103:0/4257590716 conn(0x55f58ec05f20 msgr2=0x55f58ec1bb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 -- 172.21.15.103:0/4257590716 shutdown_connections 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 -- 172.21.15.103:0/4257590716 wait complete. 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.425+0000 7f51ccbf4740 1 -- start start 2024-08-02T18:50:51.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.426+0000 7f51ccbf4740 1 Processor -- start 2024-08-02T18:50:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.426+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec25530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.426+0000 7f51ccbf4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec25a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.426+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec25530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.426+0000 7f51c3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec25530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34742/0 (socket says 172.21.15.103:34742) 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.426+0000 7f51c3fff640 1 -- 172.21.15.103:0/862886187 learned_addr learned my addr 172.21.15.103:0/862886187 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.426+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec22270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f51c41ab1e0 con 0x55f58ec098b0 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f51c41ac630 con 0x55f58ec1d380 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51c37fe640 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec25a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f51c41ab890 con 0x55f58ec0a1d0 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51c8d93640 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec22270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51c3fff640 1 -- 172.21.15.103:0/862886187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 msgr2=0x55f58ec25a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51c3fff640 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec25a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51c3fff640 1 -- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 msgr2=0x55f58ec22270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51c3fff640 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec22270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51c3fff640 1 -- 172.21.15.103:0/862886187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f58ec22aa0 con 0x55f58ec098b0 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51c8d93640 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec22270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.427+0000 7f51ccbf4740 10 client.0 _ll_register_callbacks cb 0x7f51b4003eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.428+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f51b40efe50 con 0x55f58ec098b0 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.428+0000 7f51c3fff640 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec25530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f51b40b7e60 tx=0x7f51b40bb7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86b849c9bf09c67a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.428+0000 7f51a37fe640 10 client.15777 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.428+0000 7f51a37fe640 1 -- 172.21.15.103:0/862886187 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f51b4049070 con 0x55f58ec098b0 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.428+0000 7f51a37fe640 1 -- 172.21.15.103:0/862886187 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f51b40bb060 con 0x55f58ec098b0 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.428+0000 7f51a37fe640 1 -- 172.21.15.103:0/862886187 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f51b4031470 con 0x55f58ec098b0 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.428+0000 7f51ccbf4740 10 client.15777 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:51.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.428+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({fsmap=26}) -- 0x55f58ec989f0 con 0x55f58ec098b0 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.429+0000 7f51a37fe640 1 -- 172.21.15.103:0/862886187 <== mon.0 v2:172.21.15.103:3300/0 4 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f51b408d070 con 0x55f58ec098b0 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.429+0000 7f51ccbf4740 10 client.15777 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.429+0000 7f51ccbf4740 10 client.15777 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.429+0000 7f51ccbf4740 20 client.15777 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.429+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f58ec98d80 0x55f58ec9b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.429+0000 7f51ccbf4740 4 client.15777 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "d5d6e209", "release": true, "await": true}] 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.429+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "quiesce db", "set_id": "d5d6e209", "release": true, "await": true}) -- 0x7f51b40efe50 con 0x55f58ec98d80 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.429+0000 7f51c37fe640 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f58ec98d80 0x55f58ec9b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.430+0000 7f51a37fe640 10 client.15777 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:51.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.430+0000 7f51c37fe640 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f58ec98d80 0x55f58ec9b170 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=cc8c8c5f8c78d469 server_cookie=59f905c56ff11e7a in_seq=0 out_seq=0 2024-08-02T18:50:51.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.431+0000 7f51a37fe640 1 -- 172.21.15.103:0/862886187 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x7f51b40efe50 con 0x55f58ec98d80 2024-08-02T18:50:51.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.431+0000 7f51a37fe640 10 client.15777 handle_command_reply: tid=0 2024-08-02T18:50:51.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.431+0000 7f51ccbf4740 1 client.15777 shutdown 2024-08-02T18:50:51.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.431+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 msgr2=0x55f58ec25530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.431+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec25530 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f51b40b7e60 tx=0x7f51b40bb7d0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.431+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 shutdown_connections 2024-08-02T18:50:51.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.431+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f58ec98d80 0x55f58ec9b170 crc :-1 s=READY pgs=63 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.436 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.432+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f58ec1d380 0x55f58ec22270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.432+0000 7f51a37fe640 0 client.15777 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.432+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f58ec0a1d0 0x55f58ec25a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.432+0000 7f51ccbf4740 1 --2- 172.21.15.103:0/862886187 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f58ec098b0 0x55f58ec25530 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.432+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 >> 172.21.15.103:0/862886187 conn(0x55f58ec05f20 msgr2=0x55f58ec1c3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.432+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 shutdown_connections 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.432+0000 7f51ccbf4740 1 -- 172.21.15.103:0/862886187 wait complete. 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.432+0000 7f51ccbf4740 20 client.15777 trim_cache size 0 max 16384 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:51.437 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 26, 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24473, 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 4, 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "d5d6e209": { 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 4, 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 141.9, 2024-08-02T18:50:51.438 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:51.439 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.433+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f51ac0a2e90 msgr2=0x7f51ac0a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.433+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f51ac0a2e90 0x7f51ac0a5350 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f51bc009fd0 tx=0x7f51bc01d000 comp rx=0 tx=0).stop 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.433+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 msgr2=0x7f51c419a4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.433+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 0x7f51c419a4b0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f51b4006010 tx=0x7f51b40042f0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.433+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 shutdown_connections 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.433+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f51ac0a2e90 0x7f51ac0a5350 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.433+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f51c410be90 0x7f51c419ed80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.433+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f51c4103380 0x7f51c419a9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.434+0000 7f51ca7f6640 1 --2- 172.21.15.103:0/3050502444 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f51c4102a60 0x7f51c419a4b0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.434+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 >> 172.21.15.103:0/3050502444 conn(0x7f51c40fc4c0 msgr2=0x7f51c410d1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:51.441 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.434+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 shutdown_connections 2024-08-02T18:50:51.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:51.434+0000 7f51ca7f6640 1 -- 172.21.15.103:0/3050502444 wait complete. 2024-08-02T18:50:52.261 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'd5d6e209', total seconds elapsed: 25.7 2024-08-02T18:50:52.261 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.95 2024-08-02T18:50:52.261 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:50:52.536 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:52.937 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:52 smithi103 ceph-mon[32753]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-02T18:50:52.937 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:50:52.937 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:50:52.937 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:50:52.937 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:50:53.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:52 smithi121 ceph-mon[37236]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-02T18:50:53.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:50:53.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:50:53.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:50:53.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:50:53.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:52 smithi151 ceph-mon[37155]: pgmap v37: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 341 B/s wr, 7 op/s 2024-08-02T18:50:53.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:50:53.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:50:53.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:50:53.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 -- 172.21.15.103:0/2593699291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 msgr2=0x7f50a8100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 --2- 172.21.15.103:0/2593699291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 0x7f50a8100f30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f5098009900 tx=0x7f509802a480 comp rx=0 tx=0).stop 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 -- 172.21.15.103:0/2593699291 shutdown_connections 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 --2- 172.21.15.103:0/2593699291 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a8102c20 0x7f50a810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 --2- 172.21.15.103:0/2593699291 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50a81022a0 0x7f50a81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 --2- 172.21.15.103:0/2593699291 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 0x7f50a8100f30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 -- 172.21.15.103:0/2593699291 >> 172.21.15.103:0/2593699291 conn(0x7f50a80fc500 msgr2=0x7f50a80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 -- 172.21.15.103:0/2593699291 shutdown_connections 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.016+0000 7f50aeff9640 1 -- 172.21.15.103:0/2593699291 wait complete. 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50aeff9640 1 Processor -- start 2024-08-02T18:50:53.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50aeff9640 1 -- start start 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50aeff9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 0x7f50a8196f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50aeff9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81022a0 0x7f50a8197480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50aeff9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50a8102c20 0x7f50a81979c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50aeff9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8110e10 con 0x7f50a8100b50 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50aeff9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8110c90 con 0x7f50a8102c20 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50aeff9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f50a8110f90 con 0x7f50a81022a0 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50acd95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 0x7f50a8196f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50acd95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 0x7f50a8196f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34760/0 (socket says 172.21.15.103:34760) 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50acd95640 1 -- 172.21.15.103:0/4192883284 learned_addr learned my addr 172.21.15.103:0/4192883284 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50a7fff640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81022a0 0x7f50a8197480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:53.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.017+0000 7f50ad596640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50a8102c20 0x7f50a81979c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:53.399 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:50:53.399 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:50:53.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50acd95640 1 -- 172.21.15.103:0/4192883284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81022a0 msgr2=0x7f50a8197480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:53.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50acd95640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81022a0 0x7f50a8197480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50acd95640 1 -- 172.21.15.103:0/4192883284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50a8102c20 msgr2=0x7f50a81979c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:53.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50acd95640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50a8102c20 0x7f50a81979c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50acd95640 1 -- 172.21.15.103:0/4192883284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50a81a67b0 con 0x7f50a8100b50 2024-08-02T18:50:53.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50acd95640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 0x7f50a8196f40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5098006010 tx=0x7f5098004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50a5ffb640 1 -- 172.21.15.103:0/4192883284 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f509803f030 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50a5ffb640 1 -- 172.21.15.103:0/4192883284 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5098005500 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50a81a6a40 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50a5ffb640 1 -- 172.21.15.103:0/4192883284 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5098035070 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.018+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50a81a6f20 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.019+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50a8100f30 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.020+0000 7f50a5ffb640 1 -- 172.21.15.103:0/4192883284 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f5098042030 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.021+0000 7f50a5ffb640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50880a2e10 0x7f50880a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.021+0000 7f50a7fff640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50880a2e10 0x7f50880a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.021+0000 7f50a5ffb640 1 -- 172.21.15.103:0/4192883284 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f50980efe20 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.021+0000 7f50a7fff640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50880a2e10 0x7f50880a52d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50a81990a0 tx=0x7f509000b390 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.025+0000 7f50a5ffb640 1 -- 172.21.15.103:0/4192883284 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f50980bbf30 con 0x7f50a8100b50 2024-08-02T18:50:53.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.226+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f50a81a7180 con 0x7f50a8100b50 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.227+0000 7f50a5ffb640 1 -- 172.21.15.103:0/4192883284 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7f50980c0230 con 0x7f50a8100b50 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50880a2e10 msgr2=0x7f50880a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50880a2e10 0x7f50880a52d0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f50a81990a0 tx=0x7f509000b390 comp rx=0 tx=0).stop 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 msgr2=0x7f50a8196f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 0x7f50a8196f40 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f5098006010 tx=0x7f5098004c00 comp rx=0 tx=0).stop 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 shutdown_connections 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f50880a2e10 0x7f50880a52d0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f50a8102c20 0x7f50a81979c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f50a81022a0 0x7f50a8197480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 --2- 172.21.15.103:0/4192883284 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f50a8100b50 0x7f50a8196f40 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 >> 172.21.15.103:0/4192883284 conn(0x7f50a80fc500 msgr2=0x7f50a80fdce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 shutdown_connections 2024-08-02T18:50:53.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:53.230+0000 7f50aeff9640 1 -- 172.21.15.103:0/4192883284 wait complete. 2024-08-02T18:50:53.810 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:53 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4192883284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:54.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:53 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4192883284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:54.233 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db / --timeout 90 --expiration 141.95 --await-for 45.0' 2024-08-02T18:50:54.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db / --timeout 90 --expiration 141.95 --await-for 45.0 2024-08-02T18:50:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:53 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4192883284' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:50:54.518 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:50:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:54 smithi103 ceph-mon[32753]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-02T18:50:55.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:54 smithi151 ceph-mon[37155]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-02T18:50:55.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 -- 172.21.15.103:0/3321043831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8102c20 msgr2=0x7ff5a810d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/3321043831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8102c20 0x7ff5a810d770 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0009900 tx=0x7ff5a002a480 comp rx=0 tx=0).stop 2024-08-02T18:50:55.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 -- 172.21.15.103:0/3321043831 shutdown_connections 2024-08-02T18:50:55.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/3321043831 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8102c20 0x7ff5a810d770 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.117 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/3321043831 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5a81022a0 0x7ff5a81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/3321043831 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a8100b50 0x7ff5a8100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 -- 172.21.15.103:0/3321043831 >> 172.21.15.103:0/3321043831 conn(0x7ff5a80fc500 msgr2=0x7ff5a80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 -- 172.21.15.103:0/3321043831 shutdown_connections 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.091+0000 7ff5b06a2640 1 -- 172.21.15.103:0/3321043831 wait complete. 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5b06a2640 1 Processor -- start 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5b06a2640 1 -- start start 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5b06a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8100b50 0x7ff5a8199100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5b06a2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5a81022a0 0x7ff5a8199640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5b06a2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a8102c20 0x7ff5a81a4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5b06a2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a8110dd0 con 0x7ff5a8100b50 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5b06a2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a8110c50 con 0x7ff5a81022a0 2024-08-02T18:50:55.118 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5b06a2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a8110f50 con 0x7ff5a8102c20 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5ae43e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8100b50 0x7ff5a8199100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5ae43e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8100b50 0x7ff5a8199100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34784/0 (socket says 172.21.15.103:34784) 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5ae43e640 1 -- 172.21.15.103:0/1888322349 learned_addr learned my addr 172.21.15.103:0/1888322349 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a8102c20 0x7ff5a81a4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5ae43e640 1 -- 172.21.15.103:0/1888322349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a8102c20 msgr2=0x7ff5a81a4180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a8102c20 0x7ff5a81a4180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5ae43e640 1 -- 172.21.15.103:0/1888322349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5a81022a0 msgr2=0x7ff5a8199640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5a81022a0 0x7ff5a8199640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.092+0000 7ff5ae43e640 1 -- 172.21.15.103:0/1888322349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5a81a46c0 con 0x7ff5a8100b50 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.093+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a8102c20 0x7ff5a81a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.093+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8100b50 0x7ff5a8199100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff59800e9f0 tx=0x7ff59800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.093+0000 7ff59f7fe640 1 -- 172.21.15.103:0/1888322349 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59800cd80 con 0x7ff5a8100b50 2024-08-02T18:50:55.119 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.093+0000 7ff59f7fe640 1 -- 172.21.15.103:0/1888322349 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff598005520 con 0x7ff5a8100b50 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.093+0000 7ff5b06a2640 1 -- 172.21.15.103:0/1888322349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5a81a4890 con 0x7ff5a8100b50 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.093+0000 7ff59f7fe640 1 -- 172.21.15.103:0/1888322349 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff598010690 con 0x7ff5a8100b50 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.093+0000 7ff5b06a2640 1 -- 172.21.15.103:0/1888322349 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5a81a4da0 con 0x7ff5a8100b50 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.095+0000 7ff59f7fe640 1 -- 172.21.15.103:0/1888322349 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7ff598010850 con 0x7ff5a8100b50 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.095+0000 7ff5b2aa0740 1 Processor -- start 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5b2aa0740 1 -- start start 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9227b6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c92285f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c92288890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563c921e0810 con 0x563c9227b2c0 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563c92187c70 con 0x563c9227bbe0 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563c921dc7d0 con 0x563c922864a0 2024-08-02T18:50:55.120 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5aec3f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9227b6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5aec3f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9227b6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34796/0 (socket says 172.21.15.103:34796) 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5aec3f640 1 -- 172.21.15.103:0/2836372639 learned_addr learned my addr 172.21.15.103:0/2836372639 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c92285f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff59f7fe640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5940a2e90 0x7ff5940a5350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.096+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c92288890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff5aec3f640 1 -- 172.21.15.103:0/2836372639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 msgr2=0x563c92288890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c92288890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff5aec3f640 1 -- 172.21.15.103:0/2836372639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 msgr2=0x563c92285f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c92285f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff5aec3f640 1 -- 172.21.15.103:0/2836372639 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c91f52ba0 con 0x563c9227b2c0 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff59f7fe640 1 -- 172.21.15.103:0/1888322349 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff5980cff70 con 0x7ff5a8100b50 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5940a2e90 0x7ff5940a5350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.121 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9227b6a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0031580 tx=0x7ff5a0032ca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42625ab984dc70d0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff59cff9640 1 -- 172.21.15.103:0/2836372639 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0035070 con 0x563c9227b2c0 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff59cff9640 1 -- 172.21.15.103:0/2836372639 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a00046c0 con 0x563c9227b2c0 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.097+0000 7ff59cff9640 1 -- 172.21.15.103:0/2836372639 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a0003850 con 0x563c9227b2c0 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5940a2e90 0x7ff5940a5350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0048000 tx=0x7ff5a0045000 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2836372639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 msgr2=0x563c9227b6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9227b6a0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0031580 tx=0x7ff5a0032ca0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2836372639 shutdown_connections 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c92288890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c92285f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/2836372639 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9227b6a0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2836372639 >> 172.21.15.103:0/2836372639 conn(0x563c92277850 msgr2=0x563c92277c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2836372639 shutdown_connections 2024-08-02T18:50:55.122 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2836372639 wait complete. 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 -- start start 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.098+0000 7ff5b2aa0740 1 Processor -- start 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227b2c0 0x563c92283480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227bbe0 0x563c922839c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c92283f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563c92288fb0 con 0x563c9227bbe0 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563c9219b9a0 con 0x563c9227b2c0 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563c92289130 con 0x563c922864a0 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5b2aa0740 10 client.0 _ll_register_callbacks cb 0x563c92189c90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227bbe0 0x563c922839c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227bbe0 0x563c922839c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34810/0 (socket says 172.21.15.103:34810) 2024-08-02T18:50:55.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 -- 172.21.15.103:0/3103356806 learned_addr learned my addr 172.21.15.103:0/3103356806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227b2c0 0x563c92283480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c92283f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 -- 172.21.15.103:0/3103356806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 msgr2=0x563c92283f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c92283f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 -- 172.21.15.103:0/3103356806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227b2c0 msgr2=0x563c92283480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227b2c0 0x563c92283480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 -- 172.21.15.103:0/3103356806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c921a7220 con 0x563c9227bbe0 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227bbe0 0x563c922839c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400f9e0 tx=0x7ff5a400fea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4aebff42ebd865d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.099+0000 7ff591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff591ffb640 1 -- 172.21.15.103:0/3103356806 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a400dd00 con 0x563c9227bbe0 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff591ffb640 1 -- 172.21.15.103:0/3103356806 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff5a4018430 con 0x563c9227bbe0 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3103356806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5a00046c0 con 0x563c9227bbe0 2024-08-02T18:50:55.124 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff591ffb640 1 -- 172.21.15.103:0/3103356806 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff5a400dea0 con 0x563c9227bbe0 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 10 client.15795 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3103356806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563c92294da0 con 0x563c9227bbe0 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff591ffb640 1 -- 172.21.15.103:0/3103356806 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a00046c0 con 0x563c9227bbe0 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff591ffb640 1 -- 172.21.15.103:0/3103356806 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff5a4005140 con 0x563c9227bbe0 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 10 client.15795 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 10 client.15795 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 20 client.15795 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563c92296260 0x563c922986b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 4 client.15795 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.100+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3103356806 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563c921edf40 con 0x563c92296260 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.101+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563c92296260 0x563c922986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.101+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563c92296260 0x563c922986b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4d3414c977b27489 server_cookie=bcb5492d50dc3e69 in_seq=0 out_seq=0 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.101+0000 7ff591ffb640 10 client.15795 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff591ffb640 1 -- 172.21.15.103:0/3103356806 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563c921edf40 con 0x563c92296260 2024-08-02T18:50:55.125 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff591ffb640 10 client.15795 handle_command_reply: tid=0 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 client.15795 shutdown 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3103356806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227bbe0 msgr2=0x563c922839c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227bbe0 0x563c922839c0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff5a400f9e0 tx=0x7ff5a400fea0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3103356806 shutdown_connections 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563c92296260 0x563c922986b0 crc :-1 s=READY pgs=64 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c92283f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227bbe0 0x563c922839c0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff591ffb640 0 client.15795 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3103356806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227b2c0 0x563c92283480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3103356806 >> 172.21.15.103:0/3103356806 conn(0x563c92277850 msgr2=0x563c92276b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3103356806 shutdown_connections 2024-08-02T18:50:55.126 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3103356806 wait complete. 2024-08-02T18:50:55.127 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.102+0000 7ff5b2aa0740 20 client.15795 trim_cache size 0 max 16384 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.120+0000 7ff5b2aa0740 1 Processor -- start 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.120+0000 7ff5b2aa0740 1 -- start start 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c9227b2c0 0x563c9229dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9229e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c922864a0 0x563c9228e370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a81b15b0 con 0x563c922864a0 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a81aee80 con 0x563c9227bbe0 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a81accd0 con 0x563c9227b2c0 2024-08-02T18:50:55.131 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5aec3f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c922864a0 0x563c9228e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5ae43e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c9227b2c0 0x563c9229dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5ae43e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c9227b2c0 0x563c9229dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:51334/0 (socket says 172.21.15.103:51334) 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5aec3f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c922864a0 0x563c9228e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34816/0 (socket says 172.21.15.103:34816) 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5ae43e640 1 -- 172.21.15.103:0/2233962286 learned_addr learned my addr 172.21.15.103:0/2233962286 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9229e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5adc3d640 1 -- 172.21.15.103:0/2233962286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c9227b2c0 msgr2=0x563c9229dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c9227b2c0 0x563c9229dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5adc3d640 1 -- 172.21.15.103:0/2233962286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c922864a0 msgr2=0x563c9228e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c922864a0 0x563c9228e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5adc3d640 1 -- 172.21.15.103:0/2233962286 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563c9227ba10 con 0x563c9227bbe0 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.121+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c9227b2c0 0x563c9229dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.122+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9229e500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4005600 tx=0x7ff5a4005db0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9a3443f251e32551 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.122+0000 7ff593fff640 1 -- 172.21.15.103:0/2233962286 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a402c070 con 0x563c9227bbe0 2024-08-02T18:50:55.132 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.122+0000 7ff593fff640 1 -- 172.21.15.103:0/2233962286 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a4005140 con 0x563c9227bbe0 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.122+0000 7ff593fff640 1 -- 172.21.15.103:0/2233962286 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff5a4018690 con 0x563c9227bbe0 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2233962286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 msgr2=0x563c9229e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9229e500 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7ff5a4005600 tx=0x7ff5a4005db0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2233962286 shutdown_connections 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c922864a0 0x563c9228e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9229e500 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/2233962286 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c9227b2c0 0x563c9229dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2233962286 >> 172.21.15.103:0/2233962286 conn(0x563c92277850 msgr2=0x563c92277c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2233962286 shutdown_connections 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/2233962286 wait complete. 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 -- start start 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.123+0000 7ff5b2aa0740 1 Processor -- start 2024-08-02T18:50:55.133 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9228d380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9228d8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5b2aa0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c9228df40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a81ad340 con 0x563c9227b2c0 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a81ae7b0 con 0x563c9227bbe0 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5b2aa0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff5a81ada10 con 0x563c922864a0 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9228d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9228d380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34818/0 (socket says 172.21.15.103:34818) 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5b2aa0740 10 client.0 _ll_register_callbacks cb 0x7ff5a400a810 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 -- 172.21.15.103:0/3284919420 learned_addr learned my addr 172.21.15.103:0/3284919420 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9228d8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5aec3f640 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c9228df40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.134 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 -- 172.21.15.103:0/3284919420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 msgr2=0x563c9228df40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c9228df40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 -- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 msgr2=0x563c9228d8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9228d8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 -- 172.21.15.103:0/3284919420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563c9228e710 con 0x563c9227b2c0 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9228d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff5ae43e640 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9228d380 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff59800cfd0 tx=0x7ff59809be00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930ef9182bcdab53 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.124+0000 7ff591ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.125+0000 7ff591ffb640 1 -- 172.21.15.103:0/3284919420 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff59809c600 con 0x563c9227b2c0 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.125+0000 7ff591ffb640 1 -- 172.21.15.103:0/3284919420 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff598098570 con 0x563c9227b2c0 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.125+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3284919420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff5a4005140 con 0x563c9227b2c0 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.125+0000 7ff591ffb640 1 -- 172.21.15.103:0/3284919420 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff5980152d0 con 0x563c9227b2c0 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.125+0000 7ff5b2aa0740 10 client.15801 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:55.135 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.125+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3284919420 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563c922fcf70 con 0x563c9227b2c0 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.125+0000 7ff591ffb640 1 -- 172.21.15.103:0/3284919420 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff5a4005140 con 0x563c9227b2c0 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.125+0000 7ff591ffb640 1 -- 172.21.15.103:0/3284919420 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff59809c160 con 0x563c9227b2c0 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff5b2aa0740 10 client.15801 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff5b2aa0740 10 client.15801 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff5b2aa0740 20 client.15801 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563c922fd6b0 0x563c922ffad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff5b2aa0740 4 client.15801 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.95, "await_for": 45.0}] 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3284919420 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 90.0, "expiration": 141.95, "await_for": 45.0}) -- 0x563c921e8290 con 0x563c922fd6b0 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563c922fd6b0 0x563c922ffad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff591ffb640 10 client.15801 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:55.136 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.126+0000 7ff5adc3d640 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563c922fd6b0 0x563c922ffad0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c3c451080c4cd7a server_cookie=73d18dda362b8fb5 in_seq=0 out_seq=0 2024-08-02T18:50:55.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.135+0000 7ff591ffb640 1 -- 172.21.15.103:0/3284919420 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x563c921e8290 con 0x563c922fd6b0 2024-08-02T18:50:55.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.135+0000 7ff591ffb640 10 client.15801 handle_command_reply: tid=0 2024-08-02T18:50:55.137 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.135+0000 7ff5b2aa0740 1 client.15801 shutdown 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3284919420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 msgr2=0x563c9228d380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9228d380 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff59800cfd0 tx=0x7ff59809be00 comp rx=0 tx=0).stop 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3284919420 shutdown_connections 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563c922fd6b0 0x563c922ffad0 crc :-1 s=READY pgs=65 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563c922864a0 0x563c9228df40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563c9227bbe0 0x563c9228d8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 --2- 172.21.15.103:0/3284919420 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563c9227b2c0 0x563c9228d380 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3284919420 >> 172.21.15.103:0/3284919420 conn(0x563c92277850 msgr2=0x563c92276310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff591ffb640 0 client.15801 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3284919420 shutdown_connections 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 1 -- 172.21.15.103:0/3284919420 wait complete. 2024-08-02T18:50:55.138 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.136+0000 7ff5b2aa0740 20 client.15801 trim_cache size 0 max 16384 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 26, 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24473, 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 6, 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "9814e3a3": { 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 6, 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-08-02T18:50:55.139 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 141.9, 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "QUIESCED", 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:55.140 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:55.141 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:50:55.141 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:50:55.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 -- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5940a2e90 msgr2=0x7ff5940a5350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5940a2e90 0x7ff5940a5350 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7ff5a0048000 tx=0x7ff5a0045000 comp rx=0 tx=0).stop 2024-08-02T18:50:55.141 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 -- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8100b50 msgr2=0x7ff5a8199100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8100b50 0x7ff5a8199100 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff59800e9f0 tx=0x7ff59800edf0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 -- 172.21.15.103:0/1888322349 shutdown_connections 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5940a2e90 0x7ff5940a5350 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff5a8102c20 0x7ff5a81a4180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff5a81022a0 0x7ff5a8199640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 --2- 172.21.15.103:0/1888322349 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff5a8100b50 0x7ff5a8199100 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 -- 172.21.15.103:0/1888322349 >> 172.21.15.103:0/1888322349 conn(0x7ff5a80fc500 msgr2=0x7ff5a8106500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 -- 172.21.15.103:0/1888322349 shutdown_connections 2024-08-02T18:50:55.142 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:50:55.137+0000 7ff5b06a2640 1 -- 172.21.15.103:0/1888322349 wait complete. 2024-08-02T18:50:55.246 INFO:tasks.workunit.client.0.smithi103.stderr:Updating files: 94% (11460/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-08-02T18:50:55.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:54 smithi121 ceph-mon[37236]: pgmap v38: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 341 B/s wr, 5 op/s 2024-08-02T18:50:55.891 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '9814e3a3', quiesce took 3.6 seconds. Will release after: 18.349999999999998 2024-08-02T18:50:55.940 INFO:tasks.workunit.client.0.smithi103.stderr:Note: switching to '26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea'. 2024-08-02T18:50:55.940 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-08-02T18:50:55.940 INFO:tasks.workunit.client.0.smithi103.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-08-02T18:50:55.940 INFO:tasks.workunit.client.0.smithi103.stderr:changes and commit them, and you can discard any commits you make in this 2024-08-02T18:50:55.940 INFO:tasks.workunit.client.0.smithi103.stderr:state without impacting any branches by switching back to a branch. 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr:If you want to create a new branch to retain commits you create, you may 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr:do so (now or later) by using -c with the switch command. Example: 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr: git switch -c 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr:Or undo this operation with: 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr: git switch - 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-08-02T18:50:55.941 INFO:tasks.workunit.client.0.smithi103.stderr: 2024-08-02T18:50:55.942 INFO:tasks.workunit.client.0.smithi103.stderr:HEAD is now at 26c3fb8e197 Merge pull request #58932 from cbodley/wip-67267-squid 2024-08-02T18:50:55.946 DEBUG:teuthology.orchestra.run.smithi103:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-08-02T18:50:55.974 INFO:tasks.workunit.client.0.smithi103.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-08-02T18:50:55.976 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-02T18:50:55.977 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-08-02T18:50:56.711 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-08-02T18:50:56.770 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-08-02T18:50:56.811 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-08-02T18:50:56.813 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-02T18:50:56.813 INFO:tasks.workunit.client.0.smithi103.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-08-02T18:50:56.852 INFO:tasks.workunit.client.0.smithi103.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-08-02T18:50:56.855 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T18:50:56.855 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-08-02T18:50:56.911 INFO:tasks.workunit:Running workunits matching fs/norstats on client.0... 2024-08-02T18:50:56.913 INFO:tasks.workunit:Running workunit fs/norstats/kernel_untar_tar.sh... 2024-08-02T18:50:56.913 DEBUG:teuthology.orchestra.run.smithi103:workunit test fs/norstats/kernel_untar_tar.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/fs/norstats/kernel_untar_tar.sh 2024-08-02T18:50:57.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:56 smithi151 ceph-mon[37155]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-02T18:50:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:56 smithi103 ceph-mon[32753]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-02T18:50:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:56 smithi121 ceph-mon[37236]: pgmap v39: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.8 KiB/s rd, 341 B/s wr, 8 op/s 2024-08-02T18:50:59.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:50:58 smithi151 ceph-mon[37155]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-02T18:50:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:50:58 smithi103 ceph-mon[32753]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-02T18:50:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:50:58 smithi121 ceph-mon[37236]: pgmap v40: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 255 B/s wr, 5 op/s 2024-08-02T18:50:59.360 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 -- 172.21.15.103:0/1067635718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 msgr2=0x7f00a8104af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 --2- 172.21.15.103:0/1067635718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 0x7f00a8104af0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7f0098009900 tx=0x7f009802a410 comp rx=0 tx=0).stop 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 -- 172.21.15.103:0/1067635718 shutdown_connections 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 --2- 172.21.15.103:0/1067635718 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a8105250 0x7f00a810cda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 --2- 172.21.15.103:0/1067635718 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 0x7f00a8104af0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 --2- 172.21.15.103:0/1067635718 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a8100560 0x7f00a8100940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 -- 172.21.15.103:0/1067635718 >> 172.21.15.103:0/1067635718 conn(0x7f00a8075c50 msgr2=0x7f00a8076060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 -- 172.21.15.103:0/1067635718 shutdown_connections 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 -- 172.21.15.103:0/1067635718 wait complete. 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.357+0000 7f00b0474640 1 Processor -- start 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00b0474640 1 -- start start 2024-08-02T18:50:59.361 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00b0474640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a8100560 0x7f00a8198170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00b0474640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 0x7f00a81986b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00b0474640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a8105250 0x7f00a819ca30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00b0474640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00a810fb40 con 0x7f00a8100f10 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00b0474640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00a810f9c0 con 0x7f00a8105250 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00b0474640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f00a810fcc0 con 0x7f00a8100560 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 0x7f00a81986b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 0x7f00a81986b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56258/0 (socket says 172.21.15.103:56258) 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 -- 172.21.15.103:0/2523518766 learned_addr learned my addr 172.21.15.103:0/2523518766 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ae210640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a8100560 0x7f00a8198170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00aea11640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a8105250 0x7f00a819ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 -- 172.21.15.103:0/2523518766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a8100560 msgr2=0x7f00a8198170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.362 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a8100560 0x7f00a8198170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 -- 172.21.15.103:0/2523518766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a8105250 msgr2=0x7f00a819ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a8105250 0x7f00a819ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 -- 172.21.15.103:0/2523518766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00a819d160 con 0x7f00a8100f10 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.358+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 0x7f00a81986b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0098005940 tx=0x7f00980040c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.359+0000 7f009f7fe640 1 -- 172.21.15.103:0/2523518766 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f009803f030 con 0x7f00a8100f10 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.359+0000 7f00b0474640 1 -- 172.21.15.103:0/2523518766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00a819d3f0 con 0x7f00a8100f10 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.359+0000 7f009f7fe640 1 -- 172.21.15.103:0/2523518766 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00980044c0 con 0x7f00a8100f10 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.359+0000 7f009f7fe640 1 -- 172.21.15.103:0/2523518766 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098035070 con 0x7f00a8100f10 2024-08-02T18:50:59.363 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.359+0000 7f00b0474640 1 -- 172.21.15.103:0/2523518766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00a81a4ce0 con 0x7f00a8100f10 2024-08-02T18:50:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.361+0000 7f009f7fe640 1 -- 172.21.15.103:0/2523518766 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f0098042030 con 0x7f00a8100f10 2024-08-02T18:50:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.361+0000 7f00b31ca740 1 Processor -- start 2024-08-02T18:50:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00b31ca740 1 -- start start 2024-08-02T18:50:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d8aa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d99840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d9c170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00b31ca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563fe6cee9b0 con 0x563fe6d8afb0 2024-08-02T18:50:59.370 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00b31ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563fe6c96800 con 0x563fe6d99d80 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00b31ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563fe6cea970 con 0x563fe6d8a690 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00ae210640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d99840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00ae210640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d99840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56266/0 (socket says 172.21.15.103:56266) 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00ae210640 1 -- 172.21.15.103:0/2440044528 learned_addr learned my addr 172.21.15.103:0/2440044528 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f009f7fe640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f00940a2ec0 0x7f00940a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00aea11640 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d8aa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.362+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d9c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00aea11640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f00940a2ec0 0x7f00940a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00ae210640 1 -- 172.21.15.103:0/2440044528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 msgr2=0x563fe6d8aa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00ae210640 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d8aa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.371 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00ae210640 1 -- 172.21.15.103:0/2440044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 msgr2=0x563fe6d9c170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00ae210640 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d9c170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00ae210640 1 -- 172.21.15.103:0/2440044528 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe6a02210 con 0x563fe6d8afb0 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d9c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f009f7fe640 1 -- 172.21.15.103:0/2523518766 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f00980efe10 con 0x7f00a8100f10 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00ae210640 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d99840 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f00a400ad90 tx=0x7f00a4005f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b040871b77cce26e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f00aea11640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f00940a2ec0 0x7f00940a5380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005fd0 tx=0x7f00a0004ab0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f009cbfe640 1 -- 172.21.15.103:0/2440044528 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a401c070 con 0x563fe6d8afb0 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f009cbfe640 1 -- 172.21.15.103:0/2440044528 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00a4004230 con 0x563fe6d8afb0 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.363+0000 7f009cbfe640 1 -- 172.21.15.103:0/2440044528 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a4017840 con 0x563fe6d8afb0 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 -- 172.21.15.103:0/2440044528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 msgr2=0x563fe6d99840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d99840 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f00a400ad90 tx=0x7f00a4005f90 comp rx=0 tx=0).stop 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 -- 172.21.15.103:0/2440044528 shutdown_connections 2024-08-02T18:50:59.372 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d9c170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d99840 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2440044528 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d8aa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 -- 172.21.15.103:0/2440044528 >> 172.21.15.103:0/2440044528 conn(0x563fe6d86d20 msgr2=0x563fe6d87100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 -- 172.21.15.103:0/2440044528 shutdown_connections 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 -- 172.21.15.103:0/2440044528 wait complete. 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 -- start start 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.364+0000 7f00b31ca740 1 Processor -- start 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d96cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d97200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d97740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00b31ca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563fe6d9c9b0 con 0x563fe6d8afb0 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00b31ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563fe6caa500 con 0x563fe6d99d80 2024-08-02T18:50:59.373 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00b31ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563fe6d9cb30 con 0x563fe6d8a690 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00b31ca740 10 client.0 _ll_register_callbacks cb 0x563fe6a01a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d97200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ae210640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d96cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d97200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56276/0 (socket says 172.21.15.103:56276) 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ae210640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d96cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:52678/0 (socket says 172.21.15.103:52678) 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 -- 172.21.15.103:0/2563267740 learned_addr learned my addr 172.21.15.103:0/2563267740 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00aea11640 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d97740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 -- 172.21.15.103:0/2563267740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 msgr2=0x563fe6d96cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d96cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 -- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 msgr2=0x563fe6d97740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d97740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.374 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 -- 172.21.15.103:0/2563267740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe6ace620 con 0x563fe6d8afb0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00aea11640 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d97740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ae210640 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d96cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d97200 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0098005ec0 tx=0x7f009808ad40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afbd9a20d2b031ff server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f0091ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f0091ffb640 1 -- 172.21.15.103:0/2563267740 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098049070 con 0x563fe6d8afb0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.365+0000 7f0091ffb640 1 -- 172.21.15.103:0/2563267740 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f009803bc10 con 0x563fe6d8afb0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 1 -- 172.21.15.103:0/2563267740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00a4004230 con 0x563fe6d8afb0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f0091ffb640 1 -- 172.21.15.103:0/2563267740 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f00980bbe10 con 0x563fe6d8afb0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 10 client.15813 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 1 -- 172.21.15.103:0/2563267740 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563fe6da8650 con 0x563fe6d8afb0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f0091ffb640 1 -- 172.21.15.103:0/2563267740 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00a4004230 con 0x563fe6d8afb0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f0091ffb640 1 -- 172.21.15.103:0/2563267740 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f009808bce0 con 0x563fe6d8afb0 2024-08-02T18:50:59.375 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 10 client.15813 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 10 client.15813 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 20 client.15813 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563fe6da9ab0 0x563fe6dabf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 4 client.15813 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00b31ca740 1 -- 172.21.15.103:0/2563267740 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563fe6cfc0e0 con 0x563fe6da9ab0 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.366+0000 7f00ae210640 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563fe6da9ab0 0x563fe6dabf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.367+0000 7f00ae210640 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563fe6da9ab0 0x563fe6dabf40 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d09a68b8503c154c server_cookie=f5d454d3b6cccf94 in_seq=0 out_seq=0 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.367+0000 7f0091ffb640 10 client.15813 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.367+0000 7f0091ffb640 1 -- 172.21.15.103:0/2563267740 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563fe6cfc0e0 con 0x563fe6da9ab0 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.367+0000 7f0091ffb640 10 client.15813 handle_command_reply: tid=0 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.367+0000 7f00b31ca740 1 client.15813 shutdown 2024-08-02T18:50:59.376 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 -- 172.21.15.103:0/2563267740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 msgr2=0x563fe6d97200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d97200 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f0098005ec0 tx=0x7f009808ad40 comp rx=0 tx=0).stop 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 -- 172.21.15.103:0/2563267740 shutdown_connections 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563fe6da9ab0 0x563fe6dabf40 crc :-1 s=READY pgs=66 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6d97740 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6d97200 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f0091ffb640 0 client.15813 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2563267740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d96cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 -- 172.21.15.103:0/2563267740 >> 172.21.15.103:0/2563267740 conn(0x563fe6d86d20 msgr2=0x563fe6d8ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 -- 172.21.15.103:0/2563267740 shutdown_connections 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 1 -- 172.21.15.103:0/2563267740 wait complete. 2024-08-02T18:50:59.377 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.368+0000 7f00b31ca740 20 client.15813 trim_cache size 0 max 16384 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00b31ca740 1 Processor -- start 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00b31ca740 1 -- start start 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d85d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6db1820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6db1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00b31ca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81af310 con 0x563fe6d8afb0 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00b31ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81acbe0 con 0x563fe6d99d80 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00b31ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81aaa30 con 0x563fe6d8a690 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00ada0f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6db1820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.389 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00ada0f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6db1820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56284/0 (socket says 172.21.15.103:56284) 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00ada0f640 1 -- 172.21.15.103:0/2717849739 learned_addr learned my addr 172.21.15.103:0/2717849739 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00ada0f640 1 -- 172.21.15.103:0/2717849739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 msgr2=0x563fe6d85d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2717849739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d85d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00ada0f640 1 -- 172.21.15.103:0/2717849739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 msgr2=0x563fe6db1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2717849739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6db1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.383+0000 7f00ada0f640 1 -- 172.21.15.103:0/2717849739 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563fe6d8ade0 con 0x563fe6d8afb0 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00ada0f640 1 --2- 172.21.15.103:0/2717849739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6db1820 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0098006010 tx=0x7f0098005be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f11830c5147162 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f0093fff640 1 -- 172.21.15.103:0/2717849739 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0098049050 con 0x563fe6d8afb0 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f0093fff640 1 -- 172.21.15.103:0/2717849739 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00980c4a80 con 0x563fe6d8afb0 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f0093fff640 1 -- 172.21.15.103:0/2717849739 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00980ed320 con 0x563fe6d8afb0 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 -- 172.21.15.103:0/2717849739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 msgr2=0x563fe6db1820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.390 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2717849739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6db1820 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f0098006010 tx=0x7f0098005be0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 -- 172.21.15.103:0/2717849739 shutdown_connections 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2717849739 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d99d80 0x563fe6db1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2717849739 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d8afb0 0x563fe6db1820 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 --2- 172.21.15.103:0/2717849739 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d85d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 -- 172.21.15.103:0/2717849739 >> 172.21.15.103:0/2717849739 conn(0x563fe6d86d20 msgr2=0x563fe6d85660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 -- 172.21.15.103:0/2717849739 shutdown_connections 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.384+0000 7f00b31ca740 1 -- 172.21.15.103:0/2717849739 wait complete. 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 1 -- start start 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 1 Processor -- start 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d9e120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d8afb0 0x563fe6d9e660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d99d80 0x563fe6e137f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.391 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81ab0a0 con 0x563fe6d99d80 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81ac510 con 0x563fe6d8afb0 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f00a81ab770 con 0x563fe6d8a690 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00b31ca740 10 client.0 _ll_register_callbacks cb 0x7f00980b8170 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00aea11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d99d80 0x563fe6e137f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00aea11640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d99d80 0x563fe6e137f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56290/0 (socket says 172.21.15.103:56290) 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00aea11640 1 -- 172.21.15.103:0/340867379 learned_addr learned my addr 172.21.15.103:0/340867379 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00ada0f640 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d8afb0 0x563fe6d9e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00ae210640 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d9e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00aea11640 1 -- 172.21.15.103:0/340867379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 msgr2=0x563fe6d9e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00aea11640 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d9e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00aea11640 1 -- 172.21.15.103:0/340867379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d8afb0 msgr2=0x563fe6d9e660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:50:59.392 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00aea11640 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d8afb0 0x563fe6d9e660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.385+0000 7f00aea11640 1 -- 172.21.15.103:0/340867379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563fe6e13d30 con 0x563fe6d99d80 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00aea11640 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d99d80 0x563fe6e137f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f00a0014300 tx=0x7f00a0009cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e499d06e4a22466b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f0091ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f0091ffb640 1 -- 172.21.15.103:0/340867379 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00a0026070 con 0x563fe6d99d80 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f0091ffb640 1 -- 172.21.15.103:0/340867379 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f00a0004b20 con 0x563fe6d99d80 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 1 -- 172.21.15.103:0/340867379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f00980c4a80 con 0x563fe6d99d80 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f0091ffb640 1 -- 172.21.15.103:0/340867379 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f00a0031050 con 0x563fe6d99d80 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 10 client.15819 fetch_fsmap learned FSMap version 26 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 1 -- 172.21.15.103:0/340867379 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x563fe6e14fa0 con 0x563fe6d99d80 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f0091ffb640 1 -- 172.21.15.103:0/340867379 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f00980c4a80 con 0x563fe6d99d80 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f0091ffb640 1 -- 172.21.15.103:0/340867379 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f00a0020040 con 0x563fe6d99d80 2024-08-02T18:50:59.393 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 10 client.15819 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:50:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 10 client.15819 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:50:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 20 client.15819 populate_metadata read hostname 'smithi103' 2024-08-02T18:50:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563fe6e15720 0x563fe6e17b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:50:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 4 client.15819 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:50:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.386+0000 7f00b31ca740 1 -- 172.21.15.103:0/340867379 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x563fe6cf6430 con 0x563fe6e15720 2024-08-02T18:50:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.387+0000 7f00ae210640 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563fe6e15720 0x563fe6e17b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:50:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.387+0000 7f0091ffb640 10 client.15819 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:59.394 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.387+0000 7f00ae210640 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563fe6e15720 0x563fe6e17b40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9e57bf9eac6e2eed server_cookie=fb388f820fccd567 in_seq=0 out_seq=0 2024-08-02T18:50:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f0091ffb640 1 -- 172.21.15.103:0/340867379 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x563fe6cf6430 con 0x563fe6e15720 2024-08-02T18:50:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f0091ffb640 10 client.15819 handle_command_reply: tid=0 2024-08-02T18:50:59.395 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 client.15819 shutdown 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 -- 172.21.15.103:0/340867379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d99d80 msgr2=0x563fe6e137f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d99d80 0x563fe6e137f0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f00a0014300 tx=0x7f00a0009cd0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 -- 172.21.15.103:0/340867379 shutdown_connections 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563fe6e15720 0x563fe6e17b40 crc :-1 s=READY pgs=67 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563fe6d99d80 0x563fe6e137f0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f0091ffb640 0 client.15819 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563fe6d8afb0 0x563fe6d9e660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 --2- 172.21.15.103:0/340867379 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563fe6d8a690 0x563fe6d9e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.392+0000 7f00b31ca740 1 -- 172.21.15.103:0/340867379 >> 172.21.15.103:0/340867379 conn(0x563fe6d86d20 msgr2=0x563fe6d974a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b31ca740 1 -- 172.21.15.103:0/340867379 shutdown_connections 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b31ca740 1 -- 172.21.15.103:0/340867379 wait complete. 2024-08-02T18:50:59.396 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b31ca740 20 client.15819 trim_cache size 0 max 16384 2024-08-02T18:50:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:50:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:50:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:50:59.397 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:50:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 -- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f00940a2ec0 msgr2=0x7f00940a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f00940a2ec0 0x7f00940a5380 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f00a0005fd0 tx=0x7f00a0004ab0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 -- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 msgr2=0x7f00a81986b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:50:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 0x7f00a81986b0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f0098005940 tx=0x7f00980040c0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 -- 172.21.15.103:0/2523518766 shutdown_connections 2024-08-02T18:50:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f00940a2ec0 0x7f00940a5380 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f00a8105250 0x7f00a819ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.398 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f00a8100f10 0x7f00a81986b0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 --2- 172.21.15.103:0/2523518766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f00a8100560 0x7f00a8198170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:50:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 -- 172.21.15.103:0/2523518766 >> 172.21.15.103:0/2523518766 conn(0x7f00a8075c50 msgr2=0x7f00a8103f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:50:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 -- 172.21.15.103:0/2523518766 shutdown_connections 2024-08-02T18:50:59.399 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:50:59.393+0000 7f00b0474640 1 -- 172.21.15.103:0/2523518766 wait complete. 2024-08-02T18:51:01.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:00 smithi151 ceph-mon[37155]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-02T18:51:01.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:00 smithi103 ceph-mon[32753]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-02T18:51:01.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:00 smithi121 ceph-mon[37236]: pgmap v41: 129 pgs: 129 active+clean; 1.3 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 426 B/s wr, 6 op/s 2024-08-02T18:51:03.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:02 smithi151 ceph-mon[37155]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-02T18:51:03.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:02 smithi103 ceph-mon[32753]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-02T18:51:03.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:02 smithi121 ceph-mon[37236]: pgmap v42: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1.2 KiB/s wr, 7 op/s 2024-08-02T18:51:05.053 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:04 smithi121 ceph-mon[37236]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-08-02T18:51:05.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:04 smithi151 ceph-mon[37155]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-08-02T18:51:05.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:04 smithi103 ceph-mon[32753]: pgmap v43: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 1023 B/s wr, 5 op/s 2024-08-02T18:51:07.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:06 smithi151 ceph-mon[37155]: pgmap v44: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-02T18:51:07.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:06 smithi103 ceph-mon[32753]: pgmap v44: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-02T18:51:07.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:06 smithi121 ceph-mon[37236]: pgmap v44: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-02T18:51:09.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:08 smithi151 ceph-mon[37155]: pgmap v45: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-02T18:51:09.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:08 smithi103 ceph-mon[32753]: pgmap v45: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-02T18:51:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:08 smithi121 ceph-mon[37236]: pgmap v45: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 23 KiB/s wr, 20 op/s 2024-08-02T18:51:09.698 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-02T18:51:09.967 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:10.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 -- 172.21.15.103:0/1848224734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f0101150 msgr2=0x7ff2f010d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 --2- 172.21.15.103:0/1848224734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f0101150 0x7ff2f010d680 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009cd0 tx=0x7ff2e802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 -- 172.21.15.103:0/1848224734 shutdown_connections 2024-08-02T18:51:10.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 --2- 172.21.15.103:0/1848224734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f0101150 0x7ff2f010d680 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 --2- 172.21.15.103:0/1848224734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f01007b0 0x7ff2f0100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 --2- 172.21.15.103:0/1848224734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f01067b0 0x7ff2f0106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 -- 172.21.15.103:0/1848224734 >> 172.21.15.103:0/1848224734 conn(0x7ff2f00fc4d0 msgr2=0x7ff2f00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 -- 172.21.15.103:0/1848224734 shutdown_connections 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.392+0000 7ff2f7011640 1 -- 172.21.15.103:0/1848224734 wait complete. 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f7011640 1 Processor -- start 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f7011640 1 -- start start 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f7011640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f01007b0 0x7ff2f0196ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f7011640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0101150 0x7ff2f01973e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f7011640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f01067b0 0x7ff2f0197920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f7011640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0110d10 con 0x7ff2f01007b0 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f7011640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0110b90 con 0x7ff2f0101150 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f7011640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f0110e90 con 0x7ff2f01067b0 2024-08-02T18:51:10.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f4dad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f01007b0 0x7ff2f0196ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f4dad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f01007b0 0x7ff2f0196ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59668/0 (socket says 172.21.15.103:59668) 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2f4dad640 1 -- 172.21.15.103:0/317863797 learned_addr learned my addr 172.21.15.103:0/317863797 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.393+0000 7ff2effff640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0101150 0x7ff2f01973e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f55ae640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f01067b0 0x7ff2f0197920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f4dad640 1 -- 172.21.15.103:0/317863797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f01067b0 msgr2=0x7ff2f0197920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f01067b0 0x7ff2f0197920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f4dad640 1 -- 172.21.15.103:0/317863797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0101150 msgr2=0x7ff2f01973e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0101150 0x7ff2f01973e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f4dad640 1 -- 172.21.15.103:0/317863797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff2f01a6710 con 0x7ff2f01007b0 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2effff640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0101150 0x7ff2f01973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f01007b0 0x7ff2f0196ea0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b4a0 tx=0x7ff2e400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2edffb640 1 -- 172.21.15.103:0/317863797 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4014070 con 0x7ff2f01007b0 2024-08-02T18:51:10.416 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2edffb640 1 -- 172.21.15.103:0/317863797 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2e4010b10 con 0x7ff2f01007b0 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f7011640 1 -- 172.21.15.103:0/317863797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff2f01a6a00 con 0x7ff2f01007b0 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2edffb640 1 -- 172.21.15.103:0/317863797 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e4017d60 con 0x7ff2f01007b0 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.394+0000 7ff2f7011640 1 -- 172.21.15.103:0/317863797 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff2f01a6ef0 con 0x7ff2f01007b0 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.396+0000 7ff2edffb640 1 -- 172.21.15.103:0/317863797 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7ff2e4017070 con 0x7ff2f01007b0 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f940f740 1 Processor -- start 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f940f740 1 -- start start 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 0x559bcc5b95f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9b30 0x559bcc5c3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c67e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f940f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559bcc51e980 con 0x559bcc5c43f0 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f940f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559bcc4b6a70 con 0x559bcc5b9b30 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f940f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559bcc51a940 con 0x559bcc5b9210 2024-08-02T18:51:10.417 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2edffb640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2e00a2e10 0x7ff2e00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2effff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c67e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f55ae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 0x559bcc5b95f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2effff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c67e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59676/0 (socket says 172.21.15.103:59676) 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2effff640 1 -- 172.21.15.103:0/4153084873 learned_addr learned my addr 172.21.15.103:0/4153084873 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f55ae640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2e00a2e10 0x7ff2e00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2edffb640 1 -- 172.21.15.103:0/317863797 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff2e40cee00 con 0x7ff2f01007b0 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/4153084873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9b30 0x559bcc5c3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2effff640 1 -- 172.21.15.103:0/4153084873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 msgr2=0x559bcc5b95f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2effff640 1 --2- 172.21.15.103:0/4153084873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 0x559bcc5b95f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2effff640 1 -- 172.21.15.103:0/4153084873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9b30 msgr2=0x559bcc5c3eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2effff640 1 --2- 172.21.15.103:0/4153084873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9b30 0x559bcc5c3eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.397+0000 7ff2effff640 1 -- 172.21.15.103:0/4153084873 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bcc5196e0 con 0x559bcc5c43f0 2024-08-02T18:51:10.418 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2effff640 1 --2- 172.21.15.103:0/4153084873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c67e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00bd30 tx=0x7ff2dc00f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab97ac3c37349ea server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2f55ae640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2e00a2e10 0x7ff2e00a52d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009a60 tx=0x7ff2e8031000 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2daffd640 1 -- 172.21.15.103:0/4153084873 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc015070 con 0x559bcc5c43f0 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2daffd640 1 -- 172.21.15.103:0/4153084873 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2dc00be20 con 0x559bcc5c43f0 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2daffd640 1 -- 172.21.15.103:0/4153084873 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc011af0 con 0x559bcc5c43f0 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2f940f740 1 -- 172.21.15.103:0/4153084873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 msgr2=0x559bcc5c67e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2f940f740 1 --2- 172.21.15.103:0/4153084873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c67e0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00bd30 tx=0x7ff2dc00f730 comp rx=0 tx=0).stop 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2f940f740 1 -- 172.21.15.103:0/4153084873 shutdown_connections 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2f940f740 1 --2- 172.21.15.103:0/4153084873 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c67e0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2f940f740 1 --2- 172.21.15.103:0/4153084873 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9b30 0x559bcc5c3eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2f940f740 1 --2- 172.21.15.103:0/4153084873 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 0x559bcc5b95f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.398+0000 7ff2f940f740 1 -- 172.21.15.103:0/4153084873 >> 172.21.15.103:0/4153084873 conn(0x559bcc5b57a0 msgr2=0x559bcc5b5b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.399+0000 7ff2f940f740 1 -- 172.21.15.103:0/4153084873 shutdown_connections 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.399+0000 7ff2f940f740 1 -- 172.21.15.103:0/4153084873 wait complete. 2024-08-02T18:51:10.419 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.399+0000 7ff2f940f740 1 -- start start 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.399+0000 7ff2f940f740 1 Processor -- start 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.399+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9210 0x559bcc5c1250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 0x559bcc5c1790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 0x559bcc5c1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f940f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559bcc5c6fc0 con 0x559bcc5b9210 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f940f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559bcc4d9aa0 con 0x559bcc5c43f0 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f940f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559bcc5c7140 con 0x559bcc5b9b30 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f940f740 10 client.0 _ll_register_callbacks cb 0x559bcc4c8e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9210 0x559bcc5c1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9210 0x559bcc5c1250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59692/0 (socket says 172.21.15.103:59692) 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 -- 172.21.15.103:0/3171400631 learned_addr learned my addr 172.21.15.103:0/3171400631 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f55ae640 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 0x559bcc5c1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.420 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2effff640 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 0x559bcc5c1790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 -- 172.21.15.103:0/3171400631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 msgr2=0x559bcc5c1790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 0x559bcc5c1790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 -- 172.21.15.103:0/3171400631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 msgr2=0x559bcc5c1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 0x559bcc5c1cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 -- 172.21.15.103:0/3171400631 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bcc4bd650 con 0x559bcc5b9210 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9210 0x559bcc5c1250 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4097870 tx=0x7ff2e40177c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a437db160d444bff server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2cffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2cffff640 1 -- 172.21.15.103:0/3171400631 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e401e040 con 0x559bcc5b9210 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2cffff640 1 -- 172.21.15.103:0/3171400631 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff2e4010cc0 con 0x559bcc5b9210 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.400+0000 7ff2f940f740 1 -- 172.21.15.103:0/3171400631 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2dc00be20 con 0x559bcc5b9210 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2cffff640 1 -- 172.21.15.103:0/3171400631 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff2e409aea0 con 0x559bcc5b9210 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2f940f740 10 client.15831 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2f940f740 1 -- 172.21.15.103:0/3171400631 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559bcc2903c0 con 0x559bcc5b9210 2024-08-02T18:51:10.421 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2cffff640 1 -- 172.21.15.103:0/3171400631 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2e40b7070 con 0x559bcc5b9210 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2cffff640 1 -- 172.21.15.103:0/3171400631 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff2e409a2f0 con 0x559bcc5b9210 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2f940f740 10 client.15831 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2f940f740 10 client.15831 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2f940f740 20 client.15831 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559bcc5d3ea0 0x559bcc5d62b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2f940f740 4 client.15831 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2f940f740 1 -- 172.21.15.103:0/3171400631 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559bcc52bef0 con 0x559bcc5d3ea0 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.401+0000 7ff2effff640 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559bcc5d3ea0 0x559bcc5d62b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.402+0000 7ff2effff640 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559bcc5d3ea0 0x559bcc5d62b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6cc30e9ac0dcfff7 server_cookie=9b101d9911d043d3 in_seq=0 out_seq=0 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.402+0000 7ff2cffff640 10 client.15831 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.402+0000 7ff2cffff640 1 -- 172.21.15.103:0/3171400631 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559bcc52bef0 con 0x559bcc5d3ea0 2024-08-02T18:51:10.422 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.402+0000 7ff2cffff640 10 client.15831 handle_command_reply: tid=0 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.402+0000 7ff2f940f740 1 client.15831 shutdown 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 -- 172.21.15.103:0/3171400631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9210 msgr2=0x559bcc5c1250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9210 0x559bcc5c1250 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7ff2e4097870 tx=0x7ff2e40177c0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 -- 172.21.15.103:0/3171400631 shutdown_connections 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559bcc5d3ea0 0x559bcc5d62b0 crc :-1 s=READY pgs=68 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 0x559bcc5c1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 0x559bcc5c1790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2cffff640 0 client.15831 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3171400631 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9210 0x559bcc5c1250 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 -- 172.21.15.103:0/3171400631 >> 172.21.15.103:0/3171400631 conn(0x559bcc5b57a0 msgr2=0x559bcc5bb480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 -- 172.21.15.103:0/3171400631 shutdown_connections 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 1 -- 172.21.15.103:0/3171400631 wait complete. 2024-08-02T18:51:10.423 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.403+0000 7ff2f940f740 20 client.15831 trim_cache size 0 max 16384 2024-08-02T18:51:10.428 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.420+0000 7ff2f940f740 1 Processor -- start 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.420+0000 7ff2f940f740 1 -- start start 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.420+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9210 0x559bcc5bbc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.420+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 0x559bcc5c0b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.420+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c29a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.420+0000 7ff2f940f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f01b3770 con 0x559bcc5c43f0 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.420+0000 7ff2f940f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f01b1040 con 0x559bcc5b9210 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.420+0000 7ff2f940f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f01aee90 con 0x559bcc5b9b30 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c29a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59696/0 (socket says 172.21.15.103:59696) 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 -- 172.21.15.103:0/86400703 learned_addr learned my addr 172.21.15.103:0/86400703 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2effff640 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 0x559bcc5c0b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.429 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9210 0x559bcc5bbc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 -- 172.21.15.103:0/86400703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 msgr2=0x559bcc5c0b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 0x559bcc5c0b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 -- 172.21.15.103:0/86400703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9210 msgr2=0x559bcc5bbc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9210 0x559bcc5bbc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 -- 172.21.15.103:0/86400703 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559bcc5b9960 con 0x559bcc5c43f0 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9210 0x559bcc5bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2f55ae640 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c29a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8035000 tx=0x7ff2e8041070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b06678deed7bcf98 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2da7fc640 1 -- 172.21.15.103:0/86400703 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8052070 con 0x559bcc5c43f0 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2da7fc640 1 -- 172.21.15.103:0/86400703 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2e8036040 con 0x559bcc5c43f0 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.421+0000 7ff2da7fc640 1 -- 172.21.15.103:0/86400703 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2e8030b60 con 0x559bcc5c43f0 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 -- 172.21.15.103:0/86400703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 msgr2=0x559bcc5c29a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c29a0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8035000 tx=0x7ff2e8041070 comp rx=0 tx=0).stop 2024-08-02T18:51:10.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 -- 172.21.15.103:0/86400703 shutdown_connections 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5c43f0 0x559bcc5c29a0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9b30 0x559bcc5c0b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 --2- 172.21.15.103:0/86400703 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5b9210 0x559bcc5bbc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 -- 172.21.15.103:0/86400703 >> 172.21.15.103:0/86400703 conn(0x559bcc5b57a0 msgr2=0x559bcc5b4900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 -- 172.21.15.103:0/86400703 shutdown_connections 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 -- 172.21.15.103:0/86400703 wait complete. 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 -- start start 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.422+0000 7ff2f940f740 1 Processor -- start 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 0x559bcc5cc8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9b30 0x559bcc5bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f940f740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 0x559bcc5be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f940f740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f01af500 con 0x559bcc5b9b30 2024-08-02T18:51:10.431 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f940f740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f01b0970 con 0x559bcc5c43f0 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f940f740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff2f01afbd0 con 0x559bcc5b9210 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f940f740 10 client.0 _ll_register_callbacks cb 0x7ff2e4096a60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9b30 0x559bcc5bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9b30 0x559bcc5bdd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59702/0 (socket says 172.21.15.103:59702) 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 -- 172.21.15.103:0/3209544112 learned_addr learned my addr 172.21.15.103:0/3209544112 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 0x559bcc5cc8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2f55ae640 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 0x559bcc5be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 -- 172.21.15.103:0/3209544112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 msgr2=0x559bcc5cc8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 0x559bcc5cc8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 -- 172.21.15.103:0/3209544112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 msgr2=0x559bcc5be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 0x559bcc5be2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 -- 172.21.15.103:0/3209544112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559bcc5be8c0 con 0x559bcc5b9b30 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2effff640 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9b30 0x559bcc5bdd90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c010 tx=0x7ff2dc00bc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae539ae02c6e24c1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.423+0000 7ff2cffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2cffff640 1 -- 172.21.15.103:0/3209544112 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc02c060 con 0x559bcc5b9b30 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2cffff640 1 -- 172.21.15.103:0/3209544112 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff2dc004440 con 0x559bcc5b9b30 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 1 -- 172.21.15.103:0/3209544112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff2e8036040 con 0x559bcc5b9b30 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2cffff640 1 -- 172.21.15.103:0/3209544112 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7ff2dc033050 con 0x559bcc5b9b30 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 10 client.15837 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 1 -- 172.21.15.103:0/3209544112 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559bcc63e930 con 0x559bcc5b9b30 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2cffff640 1 -- 172.21.15.103:0/3209544112 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2e8036040 con 0x559bcc5b9b30 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2cffff640 1 -- 172.21.15.103:0/3209544112 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7ff2dc004680 con 0x559bcc5b9b30 2024-08-02T18:51:10.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 10 client.15837 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 10 client.15837 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 20 client.15837 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559bcc63edd0 0x559bcc6411c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 4 client.15837 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f940f740 1 -- 172.21.15.103:0/3209544112 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub status"}) -- 0x559bcc526400 con 0x559bcc63edd0 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.424+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559bcc63edd0 0x559bcc6411c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2cffff640 10 client.15837 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f4dad640 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559bcc63edd0 0x559bcc6411c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ac8538a80a8c521 server_cookie=92eb3329d32daa63 in_seq=0 out_seq=0 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2cffff640 1 -- 172.21.15.103:0/3209544112 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x559bcc526400 con 0x559bcc63edd0 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2cffff640 10 client.15837 handle_command_reply: tid=0 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 client.15837 shutdown 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 -- 172.21.15.103:0/3209544112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9b30 msgr2=0x559bcc5bdd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.434 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9b30 0x559bcc5bdd90 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc00c010 tx=0x7ff2dc00bc30 comp rx=0 tx=0).stop 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 -- 172.21.15.103:0/3209544112 shutdown_connections 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559bcc63edd0 0x559bcc6411c0 crc :-1 s=READY pgs=69 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559bcc5c43f0 0x559bcc5be2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559bcc5b9b30 0x559bcc5bdd90 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2cffff640 0 client.15837 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 --2- 172.21.15.103:0/3209544112 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559bcc5b9210 0x559bcc5cc8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 -- 172.21.15.103:0/3209544112 >> 172.21.15.103:0/3209544112 conn(0x559bcc5b57a0 msgr2=0x559bcc5cf210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 -- 172.21.15.103:0/3209544112 shutdown_connections 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.425+0000 7ff2f940f740 1 -- 172.21.15.103:0/3209544112 wait complete. 2024-08-02T18:51:10.435 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f940f740 20 client.15837 trim_cache size 0 max 16384 2024-08-02T18:51:10.436 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:51:10.436 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-08-02T18:51:10.436 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-08-02T18:51:10.436 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 -- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2e00a2e10 msgr2=0x7ff2e00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2e00a2e10 0x7ff2e00a52d0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7ff2e8009a60 tx=0x7ff2e8031000 comp rx=0 tx=0).stop 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 -- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f01007b0 msgr2=0x7ff2f0196ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f01007b0 0x7ff2f0196ea0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7ff2e400b4a0 tx=0x7ff2e400b960 comp rx=0 tx=0).stop 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 -- 172.21.15.103:0/317863797 shutdown_connections 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2e00a2e10 0x7ff2e00a52d0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff2f01067b0 0x7ff2f0197920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff2f0101150 0x7ff2f01973e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 --2- 172.21.15.103:0/317863797 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff2f01007b0 0x7ff2f0196ea0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 -- 172.21.15.103:0/317863797 >> 172.21.15.103:0/317863797 conn(0x7ff2f00fc4d0 msgr2=0x7ff2f00fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 -- 172.21.15.103:0/317863797 shutdown_connections 2024-08-02T18:51:10.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:10.426+0000 7ff2f7011640 1 -- 172.21.15.103:0/317863797 wait complete. 2024-08-02T18:51:11.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:10 smithi151 ceph-mon[37155]: pgmap v46: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-02T18:51:11.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:10 smithi103 ceph-mon[32753]: pgmap v46: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-02T18:51:11.138 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-02T18:51:11.138 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:51:11.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:10 smithi121 ceph-mon[37236]: pgmap v46: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 23 op/s 2024-08-02T18:51:11.401 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 -- 172.21.15.103:0/137858017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 msgr2=0x7fad70100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 --2- 172.21.15.103:0/137858017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 0x7fad70100f30 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fad60009900 tx=0x7fad6002a480 comp rx=0 tx=0).stop 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 -- 172.21.15.103:0/137858017 shutdown_connections 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 --2- 172.21.15.103:0/137858017 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad70102c20 0x7fad7010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 --2- 172.21.15.103:0/137858017 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad701022a0 0x7fad701026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 --2- 172.21.15.103:0/137858017 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 0x7fad70100f30 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 -- 172.21.15.103:0/137858017 >> 172.21.15.103:0/137858017 conn(0x7fad700fc500 msgr2=0x7fad700fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 -- 172.21.15.103:0/137858017 shutdown_connections 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.883+0000 7fad74e9b640 1 -- 172.21.15.103:0/137858017 wait complete. 2024-08-02T18:51:11.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.884+0000 7fad74e9b640 1 Processor -- start 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.884+0000 7fad74e9b640 1 -- start start 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.884+0000 7fad74e9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 0x7fad700fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.884+0000 7fad74e9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad701022a0 0x7fad700fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.884+0000 7fad74e9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad70102c20 0x7fad700fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.884+0000 7fad74e9b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fad70110dd0 con 0x7fad70100b50 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.884+0000 7fad74e9b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fad70110c50 con 0x7fad70102c20 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.884+0000 7fad74e9b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fad70110f50 con 0x7fad701022a0 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 0x7fad700fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 0x7fad700fc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59732/0 (socket says 172.21.15.103:59732) 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 -- 172.21.15.103:0/4179509513 learned_addr learned my addr 172.21.15.103:0/4179509513 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6ed9d640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad70102c20 0x7fad700fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:11.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 -- 172.21.15.103:0/4179509513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad701022a0 msgr2=0x7fad700fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad701022a0 0x7fad700fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 -- 172.21.15.103:0/4179509513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad70102c20 msgr2=0x7fad700fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad70102c20 0x7fad700fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 -- 172.21.15.103:0/4179509513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad701a6800 con 0x7fad70100b50 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad6e59c640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 0x7fad700fc9b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fad60006010 tx=0x7fad60004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad5f7fe640 1 -- 172.21.15.103:0/4179509513 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad6003f030 con 0x7fad70100b50 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad5f7fe640 1 -- 172.21.15.103:0/4179509513 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fad60005500 con 0x7fad70100b50 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad701a6a90 con 0x7fad70100b50 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad5f7fe640 1 -- 172.21.15.103:0/4179509513 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fad60035070 con 0x7fad70100b50 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.885+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad701a6f70 con 0x7fad70100b50 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.886+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad70100f30 con 0x7fad70100b50 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.888+0000 7fad5f7fe640 1 -- 172.21.15.103:0/4179509513 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7fad60042030 con 0x7fad70100b50 2024-08-02T18:51:11.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.888+0000 7fad5f7fe640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fad580a2e10 0x7fad580a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:11.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.888+0000 7fad6dd9b640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fad580a2e10 0x7fad580a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:11.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.888+0000 7fad5f7fe640 1 -- 172.21.15.103:0/4179509513 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fad600f05e0 con 0x7fad70100b50 2024-08-02T18:51:11.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.889+0000 7fad6dd9b640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fad580a2e10 0x7fad580a52d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad700fe440 tx=0x7fad64005bf0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:11.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:11.891+0000 7fad5f7fe640 1 -- 172.21.15.103:0/4179509513 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fad600bcd40 con 0x7fad70100b50 2024-08-02T18:51:12.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.096+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fad70109dd0 con 0x7fad70100b50 2024-08-02T18:51:12.098 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.097+0000 7fad5f7fe640 1 -- 172.21.15.103:0/4179509513 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7fad600b8030 con 0x7fad70100b50 2024-08-02T18:51:12.098 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:51:12.099 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:51:12.099 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:51:12.100 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fad580a2e10 msgr2=0x7fad580a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fad580a2e10 0x7fad580a52d0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fad700fe440 tx=0x7fad64005bf0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 msgr2=0x7fad700fc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 0x7fad700fc9b0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fad60006010 tx=0x7fad60004c00 comp rx=0 tx=0).stop 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 shutdown_connections 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fad580a2e10 0x7fad580a52d0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fad70102c20 0x7fad700fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fad701022a0 0x7fad700fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 --2- 172.21.15.103:0/4179509513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fad70100b50 0x7fad700fc9b0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.101 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 >> 172.21.15.103:0/4179509513 conn(0x7fad700fc500 msgr2=0x7fad70069f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:12.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 shutdown_connections 2024-08-02T18:51:12.102 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:12.099+0000 7fad74e9b640 1 -- 172.21.15.103:0/4179509513 wait complete. 2024-08-02T18:51:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 -- 172.21.15.103:0/3422470087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 msgr2=0x7f9f5c102d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 --2- 172.21.15.103:0/3422470087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 0x7f9f5c102d90 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c009ca0 tx=0x7f9f4c02a950 comp rx=0 tx=0).stop 2024-08-02T18:51:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 -- 172.21.15.103:0/3422470087 shutdown_connections 2024-08-02T18:51:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 --2- 172.21.15.103:0/3422470087 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f5c10be00 0x7f9f5c10e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 --2- 172.21.15.103:0/3422470087 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f5c1032d0 0x7f9f5c10b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 --2- 172.21.15.103:0/3422470087 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 0x7f9f5c102d90 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.486 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 -- 172.21.15.103:0/3422470087 >> 172.21.15.103:0/3422470087 conn(0x7f9f5c0776c0 msgr2=0x7f9f5c0fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 -- 172.21.15.103:0/3422470087 shutdown_connections 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 -- 172.21.15.103:0/3422470087 wait complete. 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 Processor -- start 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.483+0000 7f9f62f92640 1 -- start start 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f62f92640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 0x7f9f5c198110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f62f92640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f5c1032d0 0x7f9f5c198650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f62f92640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f5c10be00 0x7f9f5c19c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f62f92640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c111d00 con 0x7f9f5c1029b0 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f62f92640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c111b80 con 0x7f9f5c10be00 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f62f92640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c111e80 con 0x7f9f5c1032d0 2024-08-02T18:51:12.487 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 0x7f9f5c198110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 0x7f9f5c198110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59756/0 (socket says 172.21.15.103:59756) 2024-08-02T18:51:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 -- 172.21.15.103:0/1504984985 learned_addr learned my addr 172.21.15.103:0/1504984985 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f6152f640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f5c10be00 0x7f9f5c19c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f5c1032d0 0x7f9f5c198650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 -- 172.21.15.103:0/1504984985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f5c1032d0 msgr2=0x7f9f5c198650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f5c1032d0 0x7f9f5c198650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 -- 172.21.15.103:0/1504984985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f5c10be00 msgr2=0x7f9f5c19c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.488 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f5c10be00 0x7f9f5c19c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 -- 172.21.15.103:0/1504984985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9f5c19d100 con 0x7f9f5c1029b0 2024-08-02T18:51:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 0x7f9f5c198110 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c005cc0 tx=0x7f9f4c02f790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f59ffb640 1 -- 172.21.15.103:0/1504984985 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c034040 con 0x7f9f5c1029b0 2024-08-02T18:51:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f59ffb640 1 -- 172.21.15.103:0/1504984985 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f4c003e40 con 0x7f9f5c1029b0 2024-08-02T18:51:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f62f92640 1 -- 172.21.15.103:0/1504984985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9f5c19d390 con 0x7f9f5c1029b0 2024-08-02T18:51:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.484+0000 7f9f59ffb640 1 -- 172.21.15.103:0/1504984985 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c039430 con 0x7f9f5c1029b0 2024-08-02T18:51:12.489 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.485+0000 7f9f62f92640 1 -- 172.21.15.103:0/1504984985 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9f5c1a4c80 con 0x7f9f5c1029b0 2024-08-02T18:51:12.495 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f59ffb640 1 -- 172.21.15.103:0/1504984985 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f9f4c037020 con 0x7f9f5c1029b0 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f65dc0740 1 Processor -- start 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f65dc0740 1 -- start start 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d97f1a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9800840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 0x5615d9803170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5615d97559b0 con 0x5615d97f1f90 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5615d96fd800 con 0x5615d9800d80 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5615d9751970 con 0x5615d97f1670 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f60d2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9800840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.496 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f60d2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9800840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59772/0 (socket says 172.21.15.103:59772) 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f60d2e640 1 -- 172.21.15.103:0/2434280671 learned_addr learned my addr 172.21.15.103:0/2434280671 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.487+0000 7f9f59ffb640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9f480a2ec0 0x7f9f480a5380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f6152f640 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d97f1a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f6152f640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9f480a2ec0 0x7f9f480a5380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 0x5615d9803170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f59ffb640 1 -- 172.21.15.103:0/1504984985 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f9f4c0f0a10 con 0x7f9f5c1029b0 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f60d2e640 1 -- 172.21.15.103:0/2434280671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 msgr2=0x5615d97f1a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d97f1a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f60d2e640 1 -- 172.21.15.103:0/2434280671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 msgr2=0x5615d9803170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 0x5615d9803170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f60d2e640 1 -- 172.21.15.103:0/2434280671 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615d9469210 con 0x5615d97f1f90 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9800840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0ede40 tx=0x7f9f4c02a950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afd5d3e83f41ba9d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:12.497 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f6152f640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9f480a2ec0 0x7f9f480a5380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f54005d80 tx=0x7f9f5400b2e0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f52ffd640 1 -- 172.21.15.103:0/2434280671 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c02c040 con 0x5615d97f1f90 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f52ffd640 1 -- 172.21.15.103:0/2434280671 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f4c0bd1b0 con 0x5615d97f1f90 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.488+0000 7f9f52ffd640 1 -- 172.21.15.103:0/2434280671 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4c0b9120 con 0x5615d97f1f90 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2434280671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 msgr2=0x5615d9800840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9800840 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c0ede40 tx=0x7f9f4c02a950 comp rx=0 tx=0).stop 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2434280671 shutdown_connections 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 0x5615d9803170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9800840 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2434280671 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d97f1a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2434280671 >> 172.21.15.103:0/2434280671 conn(0x5615d97edd20 msgr2=0x5615d97ee100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2434280671 shutdown_connections 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.489+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2434280671 wait complete. 2024-08-02T18:51:12.498 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 1 -- start start 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 1 Processor -- start 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1670 0x5615d97fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d97fe240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d9800d80 0x5615d97fe780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5615d97559b0 con 0x5615d97f1f90 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5615d9711500 con 0x5615d97f1670 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5615d9803710 con 0x5615d9800d80 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f65dc0740 10 client.0 _ll_register_callbacks cb 0x5615d9468a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f5bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d97fe240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f60d2e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1670 0x5615d97fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f5bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d97fe240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59784/0 (socket says 172.21.15.103:59784) 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f5bfff640 1 -- 172.21.15.103:0/2604652923 learned_addr learned my addr 172.21.15.103:0/2604652923 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:12.499 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.490+0000 7f9f6152f640 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d9800d80 0x5615d97fe780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f5bfff640 1 -- 172.21.15.103:0/2604652923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d9800d80 msgr2=0x5615d97fe780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d9800d80 0x5615d97fe780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f5bfff640 1 -- 172.21.15.103:0/2604652923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1670 msgr2=0x5615d97fdd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1670 0x5615d97fdd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f5bfff640 1 -- 172.21.15.103:0/2604652923 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615d9535620 con 0x5615d97f1f90 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1670 0x5615d97fdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d97fe240 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9f44003be0 tx=0x7f9f44012450 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7efeaaa886f39a5d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f3bfff640 1 -- 172.21.15.103:0/2604652923 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4401b640 con 0x5615d97f1f90 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f3bfff640 1 -- 172.21.15.103:0/2604652923 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f9f4401a3e0 con 0x5615d97f1f90 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2604652923 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f4c0bd1b0 con 0x5615d97f1f90 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f3bfff640 1 -- 172.21.15.103:0/2604652923 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9f4401b7e0 con 0x5615d97f1f90 2024-08-02T18:51:12.500 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f65dc0740 10 client.15855 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2604652923 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5615d980f2d0 con 0x5615d97f1f90 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.491+0000 7f9f3bfff640 1 -- 172.21.15.103:0/2604652923 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f4c0bd1b0 con 0x5615d97f1f90 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f3bfff640 1 -- 172.21.15.103:0/2604652923 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9f44019070 con 0x5615d97f1f90 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f65dc0740 10 client.15855 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f65dc0740 10 client.15855 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f65dc0740 20 client.15855 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5615d98107e0 0x5615d9812c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f65dc0740 4 client.15855 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2604652923 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5615d97630e0 con 0x5615d98107e0 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5615d98107e0 0x5615d9812c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f3bfff640 10 client.15855 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.492+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5615d98107e0 0x5615d9812c80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d62a88dbac578fc4 server_cookie=244aac9bb3ea1ff9 in_seq=0 out_seq=0 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f3bfff640 1 -- 172.21.15.103:0/2604652923 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5615d97630e0 con 0x5615d98107e0 2024-08-02T18:51:12.501 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f3bfff640 10 client.15855 handle_command_reply: tid=0 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 client.15855 shutdown 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2604652923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 msgr2=0x5615d97fe240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d97fe240 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f9f44003be0 tx=0x7f9f44012450 comp rx=0 tx=0).stop 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2604652923 shutdown_connections 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5615d98107e0 0x5615d9812c80 crc :-1 s=READY pgs=70 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d9800d80 0x5615d97fe780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f3bfff640 0 client.15855 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d97fe240 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/2604652923 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1670 0x5615d97fdd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2604652923 >> 172.21.15.103:0/2604652923 conn(0x5615d97edd20 msgr2=0x5615d97ece80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2604652923 shutdown_connections 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 1 -- 172.21.15.103:0/2604652923 wait complete. 2024-08-02T18:51:12.502 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.493+0000 7f9f65dc0740 20 client.15855 trim_cache size 0 max 16384 2024-08-02T18:51:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.508+0000 7f9f65dc0740 1 Processor -- start 2024-08-02T18:51:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.508+0000 7f9f65dc0740 1 -- start start 2024-08-02T18:51:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.508+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d980d240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.508+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9818550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.508+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 0x5615d9818a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.511 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.508+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1af280 con 0x5615d97f1f90 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.508+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1acb50 con 0x5615d9800d80 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.508+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1aa9a0 con 0x5615d97f1670 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9818550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9818550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59790/0 (socket says 172.21.15.103:59790) 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 -- 172.21.15.103:0/1242189224 learned_addr learned my addr 172.21.15.103:0/1242189224 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 -- 172.21.15.103:0/1242189224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 msgr2=0x5615d980d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/1242189224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d980d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 -- 172.21.15.103:0/1242189224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 msgr2=0x5615d9818a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/1242189224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 0x5615d9818a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 -- 172.21.15.103:0/1242189224 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5615d9800760 con 0x5615d97f1f90 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/1242189224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9818550 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9f44004280 tx=0x7f9f440042b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=134d35db96e13966 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f527fc640 1 -- 172.21.15.103:0/1242189224 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4402e070 con 0x5615d97f1f90 2024-08-02T18:51:12.512 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f527fc640 1 -- 172.21.15.103:0/1242189224 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f44005040 con 0x5615d97f1f90 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.509+0000 7f9f527fc640 1 -- 172.21.15.103:0/1242189224 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f4401b640 con 0x5615d97f1f90 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- 172.21.15.103:0/1242189224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 msgr2=0x5615d9818550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/1242189224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9818550 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f9f44004280 tx=0x7f9f440042b0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- 172.21.15.103:0/1242189224 shutdown_connections 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/1242189224 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d9800d80 0x5615d9818a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/1242189224 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d97f1f90 0x5615d9818550 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/1242189224 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d980d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- 172.21.15.103:0/1242189224 >> 172.21.15.103:0/1242189224 conn(0x5615d97edd20 msgr2=0x5615d980cb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- 172.21.15.103:0/1242189224 shutdown_connections 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- 172.21.15.103:0/1242189224 wait complete. 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- start start 2024-08-02T18:51:12.513 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 Processor -- start 2024-08-02T18:51:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d9804110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1f90 0x5615d9804650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d9800d80 0x5615d9873550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1ab010 con 0x5615d9800d80 2024-08-02T18:51:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1ac480 con 0x5615d97f1f90 2024-08-02T18:51:12.516 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9f5c1ab6e0 con 0x5615d97f1670 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.510+0000 7f9f65dc0740 10 client.0 _ll_register_callbacks cb 0x7f9f44004550 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d9800d80 0x5615d9873550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d9800d80 0x5615d9873550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59804/0 (socket says 172.21.15.103:59804) 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 -- 172.21.15.103:0/535246965 learned_addr learned my addr 172.21.15.103:0/535246965 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d9804110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 -- 172.21.15.103:0/535246965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 msgr2=0x5615d9804110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d9804110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 -- 172.21.15.103:0/535246965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1f90 msgr2=0x5615d9804650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f5bfff640 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1f90 0x5615d9804650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1f90 0x5615d9804650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 -- 172.21.15.103:0/535246965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5615d9873bf0 con 0x5615d9800d80 2024-08-02T18:51:12.517 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f6152f640 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d9800d80 0x5615d9873550 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9f5401f7a0 tx=0x7f9f54005cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d6843b21b025e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f3bfff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f3bfff640 1 -- 172.21.15.103:0/535246965 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9f5401ec10 con 0x5615d9800d80 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f3bfff640 1 -- 172.21.15.103:0/535246965 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f9f5401edb0 con 0x5615d9800d80 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f65dc0740 1 -- 172.21.15.103:0/535246965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f9f44005040 con 0x5615d9800d80 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f3bfff640 1 -- 172.21.15.103:0/535246965 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f9f54035050 con 0x5615d9800d80 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f65dc0740 10 client.15861 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.511+0000 7f9f65dc0740 1 -- 172.21.15.103:0/535246965 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x5615d987b010 con 0x5615d9800d80 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f3bfff640 1 -- 172.21.15.103:0/535246965 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9f44005040 con 0x5615d9800d80 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f3bfff640 1 -- 172.21.15.103:0/535246965 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f9f54030030 con 0x5615d9800d80 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f65dc0740 10 client.15861 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f65dc0740 10 client.15861 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f65dc0740 20 client.15861 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:12.518 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5615d987b810 0x5615d987dc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f65dc0740 4 client.15861 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:51:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f65dc0740 1 -- 172.21.15.103:0/535246965 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5615d975d430 con 0x5615d987b810 2024-08-02T18:51:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5615d987b810 0x5615d987dc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f3bfff640 10 client.15861 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:12.519 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.512+0000 7f9f60d2e640 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5615d987b810 0x5615d987dc30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=78af6b6326aab94d server_cookie=de910bdb8f027662 in_seq=0 out_seq=0 2024-08-02T18:51:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f3bfff640 1 -- 172.21.15.103:0/535246965 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5615d975d430 con 0x5615d987b810 2024-08-02T18:51:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f3bfff640 10 client.15861 handle_command_reply: tid=0 2024-08-02T18:51:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 client.15861 shutdown 2024-08-02T18:51:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 -- 172.21.15.103:0/535246965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d9800d80 msgr2=0x5615d9873550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d9800d80 0x5615d9873550 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f9f5401f7a0 tx=0x7f9f54005cf0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 -- 172.21.15.103:0/535246965 shutdown_connections 2024-08-02T18:51:12.520 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5615d987b810 0x5615d987dc30 crc :-1 s=READY pgs=71 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5615d9800d80 0x5615d9873550 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f3bfff640 0 client.15861 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5615d97f1f90 0x5615d9804650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 --2- 172.21.15.103:0/535246965 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5615d97f1670 0x5615d9804110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 -- 172.21.15.103:0/535246965 >> 172.21.15.103:0/535246965 conn(0x5615d97edd20 msgr2=0x5615d97fdca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 -- 172.21.15.103:0/535246965 shutdown_connections 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 1 -- 172.21.15.103:0/535246965 wait complete. 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.518+0000 7f9f65dc0740 20 client.15861 trim_cache size 0 max 16384 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:51:12.521 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:51:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:51:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:51:12.522 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 -- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9f480a2ec0 msgr2=0x7f9f480a5380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9f480a2ec0 0x7f9f480a5380 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f9f54005d80 tx=0x7f9f5400b2e0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 -- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 msgr2=0x7f9f5c198110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 0x7f9f5c198110 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f9f4c005cc0 tx=0x7f9f4c02f790 comp rx=0 tx=0).stop 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 -- 172.21.15.103:0/1504984985 shutdown_connections 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9f480a2ec0 0x7f9f480a5380 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9f5c10be00 0x7f9f5c19c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9f5c1032d0 0x7f9f5c198650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 --2- 172.21.15.103:0/1504984985 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9f5c1029b0 0x7f9f5c198110 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 -- 172.21.15.103:0/1504984985 >> 172.21.15.103:0/1504984985 conn(0x7f9f5c0776c0 msgr2=0x7f9f5c0fe410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 -- 172.21.15.103:0/1504984985 shutdown_connections 2024-08-02T18:51:12.523 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:12.519+0000 7f9f62f92640 1 -- 172.21.15.103:0/1504984985 wait complete. 2024-08-02T18:51:12.720 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-02T18:51:12.977 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:13.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:12 smithi151 ceph-mon[37155]: pgmap v47: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-02T18:51:13.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:12 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4179509513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:13.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:12 smithi103 ceph-mon[32753]: pgmap v47: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-02T18:51:13.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:12 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4179509513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:13.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:12 smithi121 ceph-mon[37236]: pgmap v47: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 23 KiB/s wr, 21 op/s 2024-08-02T18:51:13.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:12 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4179509513' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:13.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 -- 172.21.15.103:0/1362566685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 msgr2=0x7f47b0100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 --2- 172.21.15.103:0/1362566685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 0x7f47b0100c10 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4798009930 tx=0x7f479802a420 comp rx=0 tx=0).stop 2024-08-02T18:51:13.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 -- 172.21.15.103:0/1362566685 shutdown_connections 2024-08-02T18:51:13.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 --2- 172.21.15.103:0/1362566685 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b0101150 0x7f47b010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 --2- 172.21.15.103:0/1362566685 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 0x7f47b0100c10 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 --2- 172.21.15.103:0/1362566685 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b01067b0 0x7f47b0106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.456 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 -- 172.21.15.103:0/1362566685 >> 172.21.15.103:0/1362566685 conn(0x7f47b00fc4d0 msgr2=0x7f47b00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 -- 172.21.15.103:0/1362566685 shutdown_connections 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.443+0000 7f47b71b8640 1 -- 172.21.15.103:0/1362566685 wait complete. 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b71b8640 1 Processor -- start 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b71b8640 1 -- start start 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b71b8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 0x7f47b01990e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b71b8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b0101150 0x7f47b0199620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b71b8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b01067b0 0x7f47b01a4160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b71b8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0110cd0 con 0x7f47b01007b0 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b71b8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0110b50 con 0x7f47b0101150 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b71b8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f47b0110e50 con 0x7f47b01067b0 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b4f54640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 0x7f47b01990e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.457 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b4f54640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 0x7f47b01990e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59812/0 (socket says 172.21.15.103:59812) 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b4f54640 1 -- 172.21.15.103:0/2359152673 learned_addr learned my addr 172.21.15.103:0/2359152673 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b4f54640 1 -- 172.21.15.103:0/2359152673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b01067b0 msgr2=0x7f47b01a4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47affff640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b0101150 0x7f47b0199620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b5755640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b01067b0 0x7f47b01a4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b4f54640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b01067b0 0x7f47b01a4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b4f54640 1 -- 172.21.15.103:0/2359152673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b0101150 msgr2=0x7f47b0199620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b4f54640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b0101150 0x7f47b0199620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.444+0000 7f47b4f54640 1 -- 172.21.15.103:0/2359152673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f47b01a46a0 con 0x7f47b01007b0 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.445+0000 7f47b4f54640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 0x7f47b01990e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f47a000d950 tx=0x7f47a000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.445+0000 7f47adffb640 1 -- 172.21.15.103:0/2359152673 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a0017070 con 0x7f47b01007b0 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.445+0000 7f47b71b8640 1 -- 172.21.15.103:0/2359152673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f47b01a4870 con 0x7f47b01007b0 2024-08-02T18:51:13.458 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.445+0000 7f47adffb640 1 -- 172.21.15.103:0/2359152673 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47a0009c30 con 0x7f47b01007b0 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.445+0000 7f47adffb640 1 -- 172.21.15.103:0/2359152673 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a000f740 con 0x7f47b01007b0 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.445+0000 7f47b71b8640 1 -- 172.21.15.103:0/2359152673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f47b01a4d80 con 0x7f47b01007b0 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.447+0000 7f47adffb640 1 -- 172.21.15.103:0/2359152673 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7f47a0010a80 con 0x7f47b01007b0 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.447+0000 7f47b95b6740 1 Processor -- start 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b95b6740 1 -- start start 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab233d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab23910 0x556feab2dc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab2e1d0 0x556feab305c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b95b6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556feaa88a40 con 0x556feab2e1d0 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b95b6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556feaa209d0 con 0x556feab22ff0 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b95b6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556feaa84a00 con 0x556feab23910 2024-08-02T18:51:13.459 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47adffb640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f479c0a2e10 0x7f479c0a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab2e1d0 0x556feab305c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab2e1d0 0x556feab305c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59820/0 (socket says 172.21.15.103:59820) 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 -- 172.21.15.103:0/2232177941 learned_addr learned my addr 172.21.15.103:0/2232177941 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b4f54640 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab23910 0x556feab2dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b5755640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f479c0a2e10 0x7f479c0a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b5755640 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab233d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47adffb640 1 -- 172.21.15.103:0/2359152673 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f47a00cf6e0 con 0x7f47b01007b0 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 -- 172.21.15.103:0/2232177941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab23910 msgr2=0x556feab2dc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab23910 0x556feab2dc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 -- 172.21.15.103:0/2232177941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 msgr2=0x556feab233d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab233d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 -- 172.21.15.103:0/2232177941 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556feaa27650 con 0x556feab2e1d0 2024-08-02T18:51:13.460 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47b4f54640 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab23910 0x556feab2dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.448+0000 7f47affff640 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab2e1d0 0x556feab305c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4798006010 tx=0x7f4798031530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed2b7ff751126975 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b5755640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f479c0a2e10 0x7f479c0a52d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009270 tx=0x7f47a8009c90 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47a6ffd640 1 -- 172.21.15.103:0/2232177941 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798035070 con 0x556feab2e1d0 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47a6ffd640 1 -- 172.21.15.103:0/2232177941 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4798004030 con 0x556feab2e1d0 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47a6ffd640 1 -- 172.21.15.103:0/2232177941 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47980055a0 con 0x556feab2e1d0 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b95b6740 1 -- 172.21.15.103:0/2232177941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab2e1d0 msgr2=0x556feab305c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b95b6740 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab2e1d0 0x556feab305c0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4798006010 tx=0x7f4798031530 comp rx=0 tx=0).stop 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b95b6740 1 -- 172.21.15.103:0/2232177941 shutdown_connections 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b95b6740 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab2e1d0 0x556feab305c0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b95b6740 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab23910 0x556feab2dc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b95b6740 1 --2- 172.21.15.103:0/2232177941 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab233d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b95b6740 1 -- 172.21.15.103:0/2232177941 >> 172.21.15.103:0/2232177941 conn(0x556feab1f580 msgr2=0x556feab1f960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:13.461 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.449+0000 7f47b95b6740 1 -- 172.21.15.103:0/2232177941 shutdown_connections 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 -- 172.21.15.103:0/2232177941 wait complete. 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 -- start start 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 Processor -- start 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab2aff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab2b530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab2ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x556feab30da0 con 0x556feab23910 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x556feaa43b20 con 0x556feab22ff0 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x556feab30f20 con 0x556feab2e1d0 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b95b6740 10 client.0 _ll_register_callbacks cb 0x556feaa41bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab2b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab2b530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59828/0 (socket says 172.21.15.103:59828) 2024-08-02T18:51:13.462 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47affff640 1 -- 172.21.15.103:0/1527465802 learned_addr learned my addr 172.21.15.103:0/1527465802 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.450+0000 7f47b5755640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab2ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47b4f54640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab2aff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47affff640 1 -- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 msgr2=0x556feab2ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47affff640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab2ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47affff640 1 -- 172.21.15.103:0/1527465802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 msgr2=0x556feab2aff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47affff640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab2aff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47affff640 1 -- 172.21.15.103:0/1527465802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556fea7fa3c0 con 0x556feab23910 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47b5755640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab2ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47b4f54640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab2aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47affff640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab2b530 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4798005280 tx=0x7f4798032e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad7cbc46faa47bd server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f478ffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f478ffff640 1 -- 172.21.15.103:0/1527465802 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798035050 con 0x556feab23910 2024-08-02T18:51:13.463 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47b95b6740 1 -- 172.21.15.103:0/1527465802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4798004030 con 0x556feab23910 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f478ffff640 1 -- 172.21.15.103:0/1527465802 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f4798005320 con 0x556feab23910 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f478ffff640 1 -- 172.21.15.103:0/1527465802 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4798005520 con 0x556feab23910 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47b95b6740 10 client.15873 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f47b95b6740 1 -- 172.21.15.103:0/1527465802 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556feab3c8f0 con 0x556feab23910 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f478ffff640 1 -- 172.21.15.103:0/1527465802 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4798004030 con 0x556feab23910 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.451+0000 7f478ffff640 1 -- 172.21.15.103:0/1527465802 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f47980046c0 con 0x556feab23910 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f47b95b6740 10 client.15873 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f47b95b6740 10 client.15873 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f47b95b6740 20 client.15873 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556feab3dc40 0x556feab40030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f47b95b6740 4 client.15873 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f47b95b6740 1 -- 172.21.15.103:0/1527465802 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556feaa95fb0 con 0x556feab3dc40 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f47b4f54640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556feab3dc40 0x556feab40030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.464 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f478ffff640 10 client.15873 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.452+0000 7f47b4f54640 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556feab3dc40 0x556feab40030 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=81bf3ecb5e6c584f server_cookie=1cb550e794d07a2a in_seq=0 out_seq=0 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f478ffff640 1 -- 172.21.15.103:0/1527465802 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x556feaa95fb0 con 0x556feab3dc40 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f478ffff640 10 client.15873 handle_command_reply: tid=0 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 client.15873 shutdown 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 -- 172.21.15.103:0/1527465802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 msgr2=0x556feab2b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab2b530 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4798005280 tx=0x7f4798032e90 comp rx=0 tx=0).stop 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 -- 172.21.15.103:0/1527465802 shutdown_connections 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab2ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556feab3dc40 0x556feab40030 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab2b530 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1527465802 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab22ff0 0x556feab2aff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f478ffff640 0 client.15873 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:51:13.465 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 -- 172.21.15.103:0/1527465802 >> 172.21.15.103:0/1527465802 conn(0x556feab1f580 msgr2=0x556feab25260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:13.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 -- 172.21.15.103:0/1527465802 shutdown_connections 2024-08-02T18:51:13.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 1 -- 172.21.15.103:0/1527465802 wait complete. 2024-08-02T18:51:13.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.453+0000 7f47b95b6740 20 client.15873 trim_cache size 0 max 16384 2024-08-02T18:51:13.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.466+0000 7f47b95b6740 1 Processor -- start 2024-08-02T18:51:13.468 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.466+0000 7f47b95b6740 1 -- start start 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.466+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab22ff0 0x556feab25a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.466+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab455d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.466+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab2e1d0 0x556feab45b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.466+0000 7f47b95b6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01af3f0 con 0x556feab23910 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.466+0000 7f47b95b6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01accc0 con 0x556feab2e1d0 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.466+0000 7f47b95b6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01aab10 con 0x556feab22ff0 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab455d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab455d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59842/0 (socket says 172.21.15.103:59842) 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 -- 172.21.15.103:0/274931598 learned_addr learned my addr 172.21.15.103:0/274931598 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47b4f54640 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab22ff0 0x556feab25a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47b5755640 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab2e1d0 0x556feab45b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 -- 172.21.15.103:0/274931598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab22ff0 msgr2=0x556feab25a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab22ff0 0x556feab25a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 -- 172.21.15.103:0/274931598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab2e1d0 msgr2=0x556feab45b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab2e1d0 0x556feab45b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 -- 172.21.15.103:0/274931598 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556feab23740 con 0x556feab23910 2024-08-02T18:51:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47affff640 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab455d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4798001eb0 tx=0x7f4798005fd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51c9dd3ef0928bb4 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47a67fc640 1 -- 172.21.15.103:0/274931598 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798035040 con 0x556feab23910 2024-08-02T18:51:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47a67fc640 1 -- 172.21.15.103:0/274931598 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47980052b0 con 0x556feab23910 2024-08-02T18:51:13.470 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.467+0000 7f47a67fc640 1 -- 172.21.15.103:0/274931598 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4798031640 con 0x556feab23910 2024-08-02T18:51:13.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 -- 172.21.15.103:0/274931598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 msgr2=0x556feab455d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab455d0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4798001eb0 tx=0x7f4798005fd0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 -- 172.21.15.103:0/274931598 shutdown_connections 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab2e1d0 0x556feab45b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab23910 0x556feab455d0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 --2- 172.21.15.103:0/274931598 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab22ff0 0x556feab25a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 -- 172.21.15.103:0/274931598 >> 172.21.15.103:0/274931598 conn(0x556feab1f580 msgr2=0x556feab1e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 -- 172.21.15.103:0/274931598 shutdown_connections 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 -- 172.21.15.103:0/274931598 wait complete. 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 -- start start 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.468+0000 7f47b95b6740 1 Processor -- start 2024-08-02T18:51:13.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab22ff0 0x556feab36170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab23910 0x556feab366b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b95b6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab27620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b95b6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01ab180 con 0x556feab22ff0 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b95b6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01ac5f0 con 0x556feab23910 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b95b6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f47b01ab850 con 0x556feab2e1d0 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b95b6740 10 client.0 _ll_register_callbacks cb 0x7f4798031400 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab22ff0 0x556feab36170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab22ff0 0x556feab36170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59852/0 (socket says 172.21.15.103:59852) 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 -- 172.21.15.103:0/1858681815 learned_addr learned my addr 172.21.15.103:0/1858681815 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47affff640 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab23910 0x556feab366b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b5755640 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab27620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 -- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 msgr2=0x556feab27620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:13.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab27620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 -- 172.21.15.103:0/1858681815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab23910 msgr2=0x556feab366b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab23910 0x556feab366b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 -- 172.21.15.103:0/1858681815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556feab27b60 con 0x556feab22ff0 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b5755640 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab27620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b4f54640 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab22ff0 0x556feab36170 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f47a00cd0f0 tx=0x7f47a006b4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ac2bbd8e26cc204 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f478ffff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f478ffff640 1 -- 172.21.15.103:0/1858681815 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47a0020040 con 0x556feab22ff0 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f478ffff640 1 -- 172.21.15.103:0/1858681815 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f47a0097ce0 con 0x556feab22ff0 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f47b95b6740 1 -- 172.21.15.103:0/1858681815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f47980052b0 con 0x556feab22ff0 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.469+0000 7f478ffff640 1 -- 172.21.15.103:0/1858681815 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f47a009bd70 con 0x556feab22ff0 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47b95b6740 10 client.15879 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47b95b6740 1 -- 172.21.15.103:0/1858681815 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x556feaba7da0 con 0x556feab22ff0 2024-08-02T18:51:13.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f478ffff640 1 -- 172.21.15.103:0/1858681815 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f47980052b0 con 0x556feab22ff0 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f478ffff640 1 -- 172.21.15.103:0/1858681815 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f47a0084bb0 con 0x556feab22ff0 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47b95b6740 10 client.15879 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47b95b6740 10 client.15879 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47b95b6740 20 client.15879 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556feaba8420 0x556feabaa840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47b95b6740 4 client.15879 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47b95b6740 1 -- 172.21.15.103:0/1858681815 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "damage ls"}) -- 0x556feaa904c0 con 0x556feaba8420 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.470+0000 7f47affff640 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556feaba8420 0x556feabaa840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47affff640 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556feaba8420 0x556feabaa840 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=a98cbe6b08228709 server_cookie=3f279c0b864f8d8 in_seq=0 out_seq=0 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f478ffff640 10 client.15879 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f478ffff640 1 -- 172.21.15.103:0/1858681815 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x556feaa904c0 con 0x556feaba8420 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f478ffff640 10 client.15879 handle_command_reply: tid=0 2024-08-02T18:51:13.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 client.15879 shutdown 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 -- 172.21.15.103:0/1858681815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab22ff0 msgr2=0x556feab36170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab22ff0 0x556feab36170 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f47a00cd0f0 tx=0x7f47a006b4d0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 -- 172.21.15.103:0/1858681815 shutdown_connections 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x556feab2e1d0 0x556feab27620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x556feab23910 0x556feab366b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x556feaba8420 0x556feabaa840 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 --2- 172.21.15.103:0/1858681815 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x556feab22ff0 0x556feab36170 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f478ffff640 0 client.15879 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 -- 172.21.15.103:0/1858681815 >> 172.21.15.103:0/1858681815 conn(0x556feab1f580 msgr2=0x556feab2c560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 -- 172.21.15.103:0/1858681815 shutdown_connections 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 1 -- 172.21.15.103:0/1858681815 wait complete. 2024-08-02T18:51:13.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.471+0000 7f47b95b6740 20 client.15879 trim_cache size 0 max 16384 2024-08-02T18:51:13.479 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 -- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f479c0a2e10 msgr2=0x7f479c0a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f479c0a2e10 0x7f479c0a52d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f47a8009270 tx=0x7f47a8009c90 comp rx=0 tx=0).stop 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 -- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 msgr2=0x7f47b01990e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 0x7f47b01990e0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f47a000d950 tx=0x7f47a000de10 comp rx=0 tx=0).stop 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 -- 172.21.15.103:0/2359152673 shutdown_connections 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f479c0a2e10 0x7f479c0a52d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f47b01067b0 0x7f47b01a4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f47b0101150 0x7f47b0199620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 --2- 172.21.15.103:0/2359152673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f47b01007b0 0x7f47b01990e0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:13.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 -- 172.21.15.103:0/2359152673 >> 172.21.15.103:0/2359152673 conn(0x7f47b00fc4d0 msgr2=0x7f47b00fcbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:13.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 -- 172.21.15.103:0/2359152673 shutdown_connections 2024-08-02T18:51:13.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:13.472+0000 7f47b71b8640 1 -- 172.21.15.103:0/2359152673 wait complete. 2024-08-02T18:51:14.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-02T18:51:14.242 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:51:14.512 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:14.515 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:14.892 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:14 smithi103 ceph-mon[32753]: pgmap v48: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-02T18:51:15.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:14 smithi151 ceph-mon[37155]: pgmap v48: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-02T18:51:15.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:14 smithi121 ceph-mon[37236]: pgmap v48: 129 pgs: 129 active+clean; 1.4 MiB data, 370 MiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 20 op/s 2024-08-02T18:51:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 -- 172.21.15.103:0/3306080646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab4101150 msgr2=0x7fdab410d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3306080646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab4101150 0x7fdab410d680 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7fdaac009cd0 tx=0x7fdaac02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 -- 172.21.15.103:0/3306080646 shutdown_connections 2024-08-02T18:51:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3306080646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab4101150 0x7fdab410d680 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.275 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3306080646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab41007b0 0x7fdab4100c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3306080646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab41067b0 0x7fdab4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 -- 172.21.15.103:0/3306080646 >> 172.21.15.103:0/3306080646 conn(0x7fdab40fc4d0 msgr2=0x7fdab40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 -- 172.21.15.103:0/3306080646 shutdown_connections 2024-08-02T18:51:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.243+0000 7fdab8dae640 1 -- 172.21.15.103:0/3306080646 wait complete. 2024-08-02T18:51:15.276 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab8dae640 1 Processor -- start 2024-08-02T18:51:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab8dae640 1 -- start start 2024-08-02T18:51:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab8dae640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab41007b0 0x7fdab4198230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab8dae640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab4101150 0x7fdab4198770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab8dae640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab41067b0 0x7fdab419cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab8dae640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdab4110cd0 con 0x7fdab41067b0 2024-08-02T18:51:15.277 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab8dae640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdab4110b50 con 0x7fdab41007b0 2024-08-02T18:51:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab8dae640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdab4110e50 con 0x7fdab4101150 2024-08-02T18:51:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab41067b0 0x7fdab419cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab41067b0 0x7fdab419cb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59880/0 (socket says 172.21.15.103:59880) 2024-08-02T18:51:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 -- 172.21.15.103:0/3032107428 learned_addr learned my addr 172.21.15.103:0/3032107428 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:15.278 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab4101150 0x7fdab4198770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab259c640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab41007b0 0x7fdab4198230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 -- 172.21.15.103:0/3032107428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab4101150 msgr2=0x7fdab4198770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab4101150 0x7fdab4198770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 -- 172.21.15.103:0/3032107428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab41007b0 msgr2=0x7fdab4198230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.279 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab41007b0 0x7fdab4198230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 -- 172.21.15.103:0/3032107428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdab419d1e0 con 0x7fdab41067b0 2024-08-02T18:51:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab4101150 0x7fdab4198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.244+0000 7fdab2d9d640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab41067b0 0x7fdab419cb00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdaac006010 tx=0x7fdaac003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.245+0000 7fdaab7fe640 1 -- 172.21.15.103:0/3032107428 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac004040 con 0x7fdab41067b0 2024-08-02T18:51:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.245+0000 7fdab8dae640 1 -- 172.21.15.103:0/3032107428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdab419d470 con 0x7fdab41067b0 2024-08-02T18:51:15.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.245+0000 7fdaab7fe640 1 -- 172.21.15.103:0/3032107428 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdaac0046e0 con 0x7fdab41067b0 2024-08-02T18:51:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.245+0000 7fdaab7fe640 1 -- 172.21.15.103:0/3032107428 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaac046480 con 0x7fdab41067b0 2024-08-02T18:51:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.245+0000 7fdab8dae640 1 -- 172.21.15.103:0/3032107428 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdab41a4db0 con 0x7fdab41067b0 2024-08-02T18:51:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.247+0000 7fdaab7fe640 1 -- 172.21.15.103:0/3032107428 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7fdaac030630 con 0x7fdab41067b0 2024-08-02T18:51:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.247+0000 7fdabb1ac740 1 Processor -- start 2024-08-02T18:51:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.247+0000 7fdabb1ac740 1 -- start start 2024-08-02T18:51:15.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbecff0 0x55800cbed3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbed910 0x55800cbf7c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 0x55800cbfa5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55800cb52a40 con 0x55800cbed910 2024-08-02T18:51:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55800caea9d0 con 0x55800cbf81d0 2024-08-02T18:51:15.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55800cb4ea00 con 0x55800cbecff0 2024-08-02T18:51:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbed910 0x55800cbf7c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbed910 0x55800cbf7c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59896/0 (socket says 172.21.15.103:59896) 2024-08-02T18:51:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 -- 172.21.15.103:0/2693997203 learned_addr learned my addr 172.21.15.103:0/2693997203 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbecff0 0x55800cbed3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdaab7fe640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa00a2e10 0x7fdaa00a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 0x55800cbfa5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 -- 172.21.15.103:0/2693997203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbecff0 msgr2=0x55800cbed3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbecff0 0x55800cbed3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 -- 172.21.15.103:0/2693997203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 msgr2=0x55800cbfa5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 0x55800cbfa5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 -- 172.21.15.103:0/2693997203 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55800caf1650 con 0x55800cbed910 2024-08-02T18:51:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab2d9d640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa00a2e10 0x7fdaa00a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdaab7fe640 1 -- 172.21.15.103:0/3032107428 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fdaac02e030 con 0x7fdab41067b0 2024-08-02T18:51:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.248+0000 7fdab259c640 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbed910 0x55800cbf7c90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400bc60 tx=0x7fdaa400f730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e98cccae91085e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.249+0000 7fdaa8ff9640 1 -- 172.21.15.103:0/2693997203 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4015070 con 0x55800cbed910 2024-08-02T18:51:15.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.249+0000 7fdab2d9d640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa00a2e10 0x7fdaa00a52d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0ee5d0 tx=0x7fdaac041c00 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.249+0000 7fdaa8ff9640 1 -- 172.21.15.103:0/2693997203 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdaa4011940 con 0x55800cbed910 2024-08-02T18:51:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.249+0000 7fdaa8ff9640 1 -- 172.21.15.103:0/2693997203 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdaa4010930 con 0x55800cbed910 2024-08-02T18:51:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.249+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2693997203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbed910 msgr2=0x55800cbf7c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.249+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbed910 0x55800cbf7c90 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fdaa400bc60 tx=0x7fdaa400f730 comp rx=0 tx=0).stop 2024-08-02T18:51:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.249+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2693997203 shutdown_connections 2024-08-02T18:51:15.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 0x55800cbfa5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbed910 0x55800cbf7c90 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2693997203 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbecff0 0x55800cbed3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2693997203 >> 172.21.15.103:0/2693997203 conn(0x55800cbe9580 msgr2=0x55800cbe9960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:15.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2693997203 shutdown_connections 2024-08-02T18:51:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2693997203 wait complete. 2024-08-02T18:51:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 -- start start 2024-08-02T18:51:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 Processor -- start 2024-08-02T18:51:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbf50a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf55e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 0x55800cbf5b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55800cbfada0 con 0x55800cbecff0 2024-08-02T18:51:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55800cb0db20 con 0x55800cbf81d0 2024-08-02T18:51:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55800cbfaf20 con 0x55800cbed910 2024-08-02T18:51:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdabb1ac740 10 client.0 _ll_register_callbacks cb 0x55800cb0bbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:15.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.250+0000 7fdab1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbf50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbf50a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59908/0 (socket says 172.21.15.103:59908) 2024-08-02T18:51:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 -- 172.21.15.103:0/2692246113 learned_addr learned my addr 172.21.15.103:0/2692246113 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab259c640 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf55e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 0x55800cbf5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 -- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 msgr2=0x55800cbf55e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf55e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 -- 172.21.15.103:0/2692246113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 msgr2=0x55800cbf5b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 0x55800cbf5b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 -- 172.21.15.103:0/2692246113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55800c8c43c0 con 0x55800cbecff0 2024-08-02T18:51:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab259c640 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:15.291 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbf50a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fda9c013fd0 tx=0x7fda9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d82c06af044cd0a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fda99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fda99ffb640 1 -- 172.21.15.103:0/2692246113 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c0130d0 con 0x55800cbecff0 2024-08-02T18:51:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fda99ffb640 1 -- 172.21.15.103:0/2692246113 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fda9c005020 con 0x55800cbecff0 2024-08-02T18:51:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2692246113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdaa4011940 con 0x55800cbecff0 2024-08-02T18:51:15.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fda99ffb640 1 -- 172.21.15.103:0/2692246113 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda9c026050 con 0x55800cbecff0 2024-08-02T18:51:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdabb1ac740 10 client.15891 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2692246113 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55800cc06a50 con 0x55800cbecff0 2024-08-02T18:51:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.251+0000 7fda99ffb640 1 -- 172.21.15.103:0/2692246113 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdaa4011940 con 0x55800cbecff0 2024-08-02T18:51:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fda99ffb640 1 -- 172.21.15.103:0/2692246113 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fda9c00e660 con 0x55800cbecff0 2024-08-02T18:51:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fdabb1ac740 10 client.15891 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:15.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fdabb1ac740 10 client.15891 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-02T18:51:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fdabb1ac740 20 client.15891 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55800cc07e60 0x55800cc0a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fdabb1ac740 4 client.15891 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2692246113 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55800cb5ffb0 con 0x55800cc07e60 2024-08-02T18:51:15.294 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fdab259c640 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55800cc07e60 0x55800cc0a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fda99ffb640 10 client.15891 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:51:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.252+0000 7fdab259c640 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55800cc07e60 0x55800cc0a270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=88cc673aa3eb1e46 server_cookie=395acb240a32e289 in_seq=0 out_seq=0 2024-08-02T18:51:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fda99ffb640 1 -- 172.21.15.103:0/2692246113 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55800cb5ffb0 con 0x55800cc07e60 2024-08-02T18:51:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fda99ffb640 10 client.15891 handle_command_reply: tid=0 2024-08-02T18:51:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 client.15891 shutdown 2024-08-02T18:51:15.295 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2692246113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 msgr2=0x55800cbf50a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbf50a0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fda9c013fd0 tx=0x7fda9c0046c0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2692246113 shutdown_connections 2024-08-02T18:51:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55800cc07e60 0x55800cc0a270 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbf81d0 0x55800cbf5b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf55e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.296 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/2692246113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbf50a0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2692246113 >> 172.21.15.103:0/2692246113 conn(0x55800cbe9580 msgr2=0x55800cbef260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fda99ffb640 0 client.15891 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:51:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2692246113 shutdown_connections 2024-08-02T18:51:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.253+0000 7fdabb1ac740 1 -- 172.21.15.103:0/2692246113 wait complete. 2024-08-02T18:51:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.254+0000 7fdabb1ac740 20 client.15891 trim_cache size 0 max 16384 2024-08-02T18:51:15.297 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.266+0000 7fdabb1ac740 1 Processor -- start 2024-08-02T18:51:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.266+0000 7fdabb1ac740 1 -- start start 2024-08-02T18:51:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.266+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbecff0 0x55800cbefa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.266+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf6f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.266+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbf81d0 0x55800cc0fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.266+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdab41b1540 con 0x55800cbf81d0 2024-08-02T18:51:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.266+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdab41aee10 con 0x55800cbecff0 2024-08-02T18:51:15.298 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.266+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdab41acc60 con 0x55800cbed910 2024-08-02T18:51:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbf81d0 0x55800cc0fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbf81d0 0x55800cc0fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59924/0 (socket says 172.21.15.103:59924) 2024-08-02T18:51:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 -- 172.21.15.103:0/4275911158 learned_addr learned my addr 172.21.15.103:0/4275911158 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbecff0 0x55800cbefa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.299 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab259c640 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf6f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 -- 172.21.15.103:0/4275911158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 msgr2=0x55800cbf6f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf6f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 -- 172.21.15.103:0/4275911158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbecff0 msgr2=0x55800cbefa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbecff0 0x55800cbefa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.300 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 -- 172.21.15.103:0/4275911158 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55800cbed740 con 0x55800cbf81d0 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbf81d0 0x55800cc0fb40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fda9c005fd0 tx=0x7fda9c000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d4501a3a5ca799e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fda9bfff640 1 -- 172.21.15.103:0/4275911158 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c013110 con 0x55800cbf81d0 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fda9bfff640 1 -- 172.21.15.103:0/4275911158 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda9c0132b0 con 0x55800cbf81d0 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.267+0000 7fda9bfff640 1 -- 172.21.15.103:0/4275911158 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c004fa0 con 0x55800cbf81d0 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4275911158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbf81d0 msgr2=0x55800cc0fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbf81d0 0x55800cc0fb40 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fda9c005fd0 tx=0x7fda9c000bc0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4275911158 shutdown_connections 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbf81d0 0x55800cc0fb40 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.301 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbed910 0x55800cbf6f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4275911158 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbecff0 0x55800cbefa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4275911158 >> 172.21.15.103:0/4275911158 conn(0x55800cbe9580 msgr2=0x55800cbf67f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4275911158 shutdown_connections 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4275911158 wait complete. 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- start start 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 Processor -- start 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbfb680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbed910 0x55800cbfbbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbf81d0 0x55800cc70b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdab41ad2d0 con 0x55800cbecff0 2024-08-02T18:51:15.302 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdab41ae740 con 0x55800cbed910 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdab41ad9a0 con 0x55800cbf81d0 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.268+0000 7fdabb1ac740 10 client.0 _ll_register_callbacks cb 0x7fda9c013b90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbfb680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbfb680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59934/0 (socket says 172.21.15.103:59934) 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 -- 172.21.15.103:0/4045532337 learned_addr learned my addr 172.21.15.103:0/4045532337 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab259c640 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbed910 0x55800cbfbbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbf81d0 0x55800cc70b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 -- 172.21.15.103:0/4045532337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbf81d0 msgr2=0x55800cc70b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbf81d0 0x55800cc70b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 -- 172.21.15.103:0/4045532337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbed910 msgr2=0x55800cbfbbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbed910 0x55800cbfbbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 -- 172.21.15.103:0/4045532337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55800cc71040 con 0x55800cbecff0 2024-08-02T18:51:15.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab259c640 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbed910 0x55800cbfbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdab1d9b640 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbfb680 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00ec90 tx=0x7fda9c00bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161c73f5f390bf71 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fda99ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fda99ffb640 1 -- 172.21.15.103:0/4045532337 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fda9c03c060 con 0x55800cbecff0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fda99ffb640 1 -- 172.21.15.103:0/4045532337 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fda9c004860 con 0x55800cbecff0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4045532337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fda9c0132b0 con 0x55800cbecff0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fda99ffb640 1 -- 172.21.15.103:0/4045532337 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fda9c043050 con 0x55800cbecff0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.269+0000 7fdabb1ac740 10 client.15897 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4045532337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55800cc72270 con 0x55800cbecff0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fda99ffb640 1 -- 172.21.15.103:0/4045532337 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fda9c0132b0 con 0x55800cbecff0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fda99ffb640 1 -- 172.21.15.103:0/4045532337 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fda9c037b60 con 0x55800cbecff0 2024-08-02T18:51:15.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fdabb1ac740 10 client.15897 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fdabb1ac740 10 client.15897 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fdabb1ac740 20 client.15897 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55800cc728d0 0x55800cc74cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fdabb1ac740 4 client.15897 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4045532337 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55800cb5a4c0 con 0x55800cc728d0 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.270+0000 7fdab259c640 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55800cc728d0 0x55800cc74cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdab259c640 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55800cc728d0 0x55800cc74cf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=7f50c5efa2a4d237 server_cookie=1bf61eb106d9d07f in_seq=0 out_seq=0 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fda99ffb640 10 client.15897 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fda99ffb640 1 -- 172.21.15.103:0/4045532337 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55800cb5a4c0 con 0x55800cc728d0 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fda99ffb640 10 client.15897 handle_command_reply: tid=0 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 client.15897 shutdown 2024-08-02T18:51:15.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4045532337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 msgr2=0x55800cbfb680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbfb680 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fda9c00ec90 tx=0x7fda9c00bb50 comp rx=0 tx=0).stop 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4045532337 shutdown_connections 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55800cbf81d0 0x55800cc70b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55800cc728d0 0x55800cc74cf0 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55800cbed910 0x55800cbfbbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 --2- 172.21.15.103:0/4045532337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55800cbecff0 0x55800cbfb680 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fda99ffb640 0 client.15897 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4045532337 >> 172.21.15.103:0/4045532337 conn(0x55800cbe9580 msgr2=0x55800cc03810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4045532337 shutdown_connections 2024-08-02T18:51:15.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 1 -- 172.21.15.103:0/4045532337 wait complete. 2024-08-02T18:51:15.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.271+0000 7fdabb1ac740 20 client.15897 trim_cache size 0 max 16384 2024-08-02T18:51:15.307 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:51:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 -- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa00a2e10 msgr2=0x7fdaa00a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa00a2e10 0x7fdaa00a52d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fdaac0ee5d0 tx=0x7fdaac041c00 comp rx=0 tx=0).stop 2024-08-02T18:51:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 -- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab41067b0 msgr2=0x7fdab419cb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab41067b0 0x7fdab419cb00 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7fdaac006010 tx=0x7fdaac003f10 comp rx=0 tx=0).stop 2024-08-02T18:51:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 -- 172.21.15.103:0/3032107428 shutdown_connections 2024-08-02T18:51:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdaa00a2e10 0x7fdaa00a52d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdab41067b0 0x7fdab419cb00 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdab4101150 0x7fdab4198770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 --2- 172.21.15.103:0/3032107428 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdab41007b0 0x7fdab4198230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 -- 172.21.15.103:0/3032107428 >> 172.21.15.103:0/3032107428 conn(0x7fdab40fc4d0 msgr2=0x7fdab406a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 -- 172.21.15.103:0/3032107428 shutdown_connections 2024-08-02T18:51:15.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.272+0000 7fdab8dae640 1 -- 172.21.15.103:0/3032107428 wait complete. 2024-08-02T18:51:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 -- 172.21.15.103:0/3896043746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4681007b0 msgr2=0x7fb468100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 --2- 172.21.15.103:0/3896043746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4681007b0 0x7fb468100c10 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009930 tx=0x7fb45c02a420 comp rx=0 tx=0).stop 2024-08-02T18:51:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 -- 172.21.15.103:0/3896043746 shutdown_connections 2024-08-02T18:51:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 --2- 172.21.15.103:0/3896043746 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb468101150 0x7fb46810d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 --2- 172.21.15.103:0/3896043746 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb4681007b0 0x7fb468100c10 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 --2- 172.21.15.103:0/3896043746 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4681067b0 0x7fb468106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 -- 172.21.15.103:0/3896043746 >> 172.21.15.103:0/3896043746 conn(0x7fb4680fc4d0 msgr2=0x7fb4680fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:15.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 -- 172.21.15.103:0/3896043746 shutdown_connections 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.459+0000 7fb46d30b640 1 -- 172.21.15.103:0/3896043746 wait complete. 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.460+0000 7fb46d30b640 1 Processor -- start 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.460+0000 7fb46d30b640 1 -- start start 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.460+0000 7fb46d30b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4681007b0 0x7fb46819a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.460+0000 7fb46d30b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb468101150 0x7fb46819aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.460+0000 7fb46d30b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4681067b0 0x7fb46819ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.460+0000 7fb46d30b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fb468110cd0 con 0x7fb468101150 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.460+0000 7fb46d30b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fb468110b50 con 0x7fb4681007b0 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.460+0000 7fb46d30b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fb468110e50 con 0x7fb4681067b0 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb468101150 0x7fb46819aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb468101150 0x7fb46819aa50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59946/0 (socket says 172.21.15.103:59946) 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 -- 172.21.15.103:0/1440136150 learned_addr learned my addr 172.21.15.103:0/1440136150 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4677fe640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4681067b0 0x7fb46819ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb466ffd640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4681007b0 0x7fb46819a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 -- 172.21.15.103:0/1440136150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4681067b0 msgr2=0x7fb46819ede0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4681067b0 0x7fb46819ede0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 -- 172.21.15.103:0/1440136150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4681007b0 msgr2=0x7fb46819a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4681007b0 0x7fb46819a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 -- 172.21.15.103:0/1440136150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb46819f4c0 con 0x7fb468101150 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb466ffd640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4681007b0 0x7fb46819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb4667fc640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb468101150 0x7fb46819aa50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009230 tx=0x7fb45c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:15.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb44ffff640 1 -- 172.21.15.103:0/1440136150 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c03f030 con 0x7fb468101150 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb46819f750 con 0x7fb468101150 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb44ffff640 1 -- 172.21.15.103:0/1440136150 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fb45c003af0 con 0x7fb468101150 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb44ffff640 1 -- 172.21.15.103:0/1440136150 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb45c035070 con 0x7fb468101150 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.461+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb4681a7090 con 0x7fb468101150 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.462+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb468100c10 con 0x7fb468101150 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.464+0000 7fb44ffff640 1 -- 172.21.15.103:0/1440136150 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 25) ==== 138067+0+0 (secure 0 0 0) 0x7fb45c042030 con 0x7fb468101150 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.464+0000 7fb44ffff640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb4500a2e10 0x7fb4500a52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.464+0000 7fb466ffd640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb4500a2e10 0x7fb4500a52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.464+0000 7fb44ffff640 1 -- 172.21.15.103:0/1440136150 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fb45c0f0560 con 0x7fb468101150 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.465+0000 7fb466ffd640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb4500a2e10 0x7fb4500a52d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb4580092f0 tx=0x7fb458009280 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:15.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.467+0000 7fb44ffff640 1 -- 172.21.15.103:0/1440136150 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fb45c0bcd80 con 0x7fb468101150 2024-08-02T18:51:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.670+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb4681a7260 con 0x7fb468101150 2024-08-02T18:51:15.672 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.671+0000 7fb44ffff640 1 -- 172.21.15.103:0/1440136150 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7fb45c0bc680 con 0x7fb468101150 2024-08-02T18:51:15.672 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:51:15.673 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:51:15.673 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:51:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb4500a2e10 msgr2=0x7fb4500a52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.674 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb4500a2e10 0x7fb4500a52d0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fb4580092f0 tx=0x7fb458009280 comp rx=0 tx=0).stop 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb468101150 msgr2=0x7fb46819aa50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb468101150 0x7fb46819aa50 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fb45c009230 tx=0x7fb45c004270 comp rx=0 tx=0).stop 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 shutdown_connections 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fb4500a2e10 0x7fb4500a52d0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fb4681067b0 0x7fb46819ede0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fb468101150 0x7fb46819aa50 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 --2- 172.21.15.103:0/1440136150 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fb4681007b0 0x7fb46819a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 >> 172.21.15.103:0/1440136150 conn(0x7fb4680fc4d0 msgr2=0x7fb46806a500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 shutdown_connections 2024-08-02T18:51:15.675 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:15.673+0000 7fb46d30b640 1 -- 172.21.15.103:0/1440136150 wait complete. 2024-08-02T18:51:16.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:15 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1440136150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:16.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:15 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1440136150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:16.182 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-02T18:51:16.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:15 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1440136150' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:16.904 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --set-id 9814e3a3 --release --await' 2024-08-02T18:51:16.904 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --set-id 9814e3a3 --release --await 2024-08-02T18:51:16.973 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:16 smithi151 ceph-mon[37155]: pgmap v49: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-02T18:51:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:16 smithi151 ceph-mon[37155]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-08-02T18:51:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:16 smithi103 ceph-mon[32753]: pgmap v49: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-02T18:51:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:16 smithi103 ceph-mon[32753]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-08-02T18:51:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:16 smithi121 ceph-mon[37236]: pgmap v49: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 23 KiB/s wr, 24 op/s 2024-08-02T18:51:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:16 smithi121 ceph-mon[37236]: mgrmap e26: x(active, since 92s), standbys: z, y 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 -- 172.21.15.103:0/240094855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd228101160 msgr2=0x7fd22810d690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/240094855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd228101160 0x7fd22810d690 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fd220009cd0 tx=0x7fd22002a8e0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 -- 172.21.15.103:0/240094855 shutdown_connections 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/240094855 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd228101160 0x7fd22810d690 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/240094855 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd2281007c0 0x7fd228100c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/240094855 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2281067c0 0x7fd228106ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 -- 172.21.15.103:0/240094855 >> 172.21.15.103:0/240094855 conn(0x7fd2280fc500 msgr2=0x7fd2280fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 -- 172.21.15.103:0/240094855 shutdown_connections 2024-08-02T18:51:17.473 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.461+0000 7fd22e4d5640 1 -- 172.21.15.103:0/240094855 wait complete. 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22e4d5640 1 Processor -- start 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22e4d5640 1 -- start start 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22e4d5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2281007c0 0x7fd228197100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22e4d5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd228101160 0x7fd228197640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22e4d5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2281067c0 0x7fd22819b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22e4d5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd228110ce0 con 0x7fd2281067c0 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22e4d5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd228110b60 con 0x7fd228101160 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22e4d5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd228110e60 con 0x7fd2281007c0 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22ca72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2281067c0 0x7fd22819b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22ca72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2281067c0 0x7fd22819b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59964/0 (socket says 172.21.15.103:59964) 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd22ca72640 1 -- 172.21.15.103:0/177077438 learned_addr learned my addr 172.21.15.103:0/177077438 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:17.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd227fff640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2281007c0 0x7fd228197100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.462+0000 7fd21ffff640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd228101160 0x7fd228197640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd22ca72640 1 -- 172.21.15.103:0/177077438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2281007c0 msgr2=0x7fd228197100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd22ca72640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2281007c0 0x7fd228197100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd22ca72640 1 -- 172.21.15.103:0/177077438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd228101160 msgr2=0x7fd228197640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd22ca72640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd228101160 0x7fd228197640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd22ca72640 1 -- 172.21.15.103:0/177077438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd22819c0b0 con 0x7fd2281067c0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd22ca72640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2281067c0 0x7fd22819b9d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd220009ca0 tx=0x7fd220003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd225ffb640 1 -- 172.21.15.103:0/177077438 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220004040 con 0x7fd2281067c0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd22e4d5640 1 -- 172.21.15.103:0/177077438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd22819c340 con 0x7fd2281067c0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd225ffb640 1 -- 172.21.15.103:0/177077438 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd2200046e0 con 0x7fd2281067c0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd225ffb640 1 -- 172.21.15.103:0/177077438 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd220046480 con 0x7fd2281067c0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.463+0000 7fd22e4d5640 1 -- 172.21.15.103:0/177077438 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2281a3c80 con 0x7fd2281067c0 2024-08-02T18:51:17.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.465+0000 7fd225ffb640 1 -- 172.21.15.103:0/177077438 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fd2200305a0 con 0x7fd2281067c0 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd2308d3740 1 Processor -- start 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd2308d3740 1 -- start start 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f8ff0 0x559d214f93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d21503c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d215041d0 0x559d215065c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd2308d3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559d2145ea40 con 0x559d215041d0 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd2308d3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559d213f69d0 con 0x559d214f9910 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd2308d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559d2145aa00 con 0x559d214f8ff0 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd225ffb640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd2140a4f00 0x7fd2140a73c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d215041d0 0x559d215065c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd22ca72640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd2140a4f00 0x7fd2140a73c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d215041d0 0x559d215065c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59970/0 (socket says 172.21.15.103:59970) 2024-08-02T18:51:17.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd21ffff640 1 -- 172.21.15.103:0/2384804196 learned_addr learned my addr 172.21.15.103:0/2384804196 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd21ffff640 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f8ff0 0x559d214f93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd225ffb640 1 -- 172.21.15.103:0/177077438 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fd22002e030 con 0x7fd2281067c0 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd227fff640 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d21503c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd21ffff640 1 -- 172.21.15.103:0/2384804196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f8ff0 msgr2=0x559d214f93d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd21ffff640 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f8ff0 0x559d214f93d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd21ffff640 1 -- 172.21.15.103:0/2384804196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 msgr2=0x559d21503c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.466+0000 7fd21ffff640 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d21503c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd21ffff640 1 -- 172.21.15.103:0/2384804196 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d213fd650 con 0x559d215041d0 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd227fff640 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d21503c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd22ca72640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd2140a4f00 0x7fd2140a73c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2200ee900 tx=0x7fd2200dd040 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd21ffff640 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d215041d0 0x559d215065c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd2100149c0 tx=0x7fd21000c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=459517cfe8495e73 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd21e7fc640 1 -- 172.21.15.103:0/2384804196 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2100142d0 con 0x559d215041d0 2024-08-02T18:51:17.477 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd21e7fc640 1 -- 172.21.15.103:0/2384804196 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd21000fc60 con 0x559d215041d0 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd21e7fc640 1 -- 172.21.15.103:0/2384804196 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210012c00 con 0x559d215041d0 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd2308d3740 1 -- 172.21.15.103:0/2384804196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d215041d0 msgr2=0x559d215065c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.467+0000 7fd2308d3740 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d215041d0 0x559d215065c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fd2100149c0 tx=0x7fd21000c4d0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 -- 172.21.15.103:0/2384804196 shutdown_connections 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d215041d0 0x559d215065c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d21503c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 --2- 172.21.15.103:0/2384804196 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f8ff0 0x559d214f93d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 -- 172.21.15.103:0/2384804196 >> 172.21.15.103:0/2384804196 conn(0x559d214f5580 msgr2=0x559d214f5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 -- 172.21.15.103:0/2384804196 shutdown_connections 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 -- 172.21.15.103:0/2384804196 wait complete. 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 -- start start 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 Processor -- start 2024-08-02T18:51:17.478 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f8ff0 0x559d21501070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f9910 0x559d215015b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d21501af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x559d21506da0 con 0x559d214f9910 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x559d21419b20 con 0x559d214f8ff0 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x559d21506f20 con 0x559d215041d0 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd2308d3740 10 client.0 _ll_register_callbacks cb 0x559d21417bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.468+0000 7fd227fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f9910 0x559d215015b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd227fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f9910 0x559d215015b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59978/0 (socket says 172.21.15.103:59978) 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd227fff640 1 -- 172.21.15.103:0/3893662766 learned_addr learned my addr 172.21.15.103:0/3893662766 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f8ff0 0x559d21501070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d21501af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd227fff640 1 -- 172.21.15.103:0/3893662766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 msgr2=0x559d21501af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd227fff640 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d21501af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd227fff640 1 -- 172.21.15.103:0/3893662766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f8ff0 msgr2=0x559d21501070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd227fff640 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f8ff0 0x559d21501070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd227fff640 1 -- 172.21.15.103:0/3893662766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d211d03c0 con 0x559d214f9910 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d21501af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd227fff640 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f9910 0x559d215015b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd218010840 tx=0x7fd218010d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=daa37794d97540d4 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd2077fe640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd2077fe640 1 -- 172.21.15.103:0/3893662766 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd21800ed40 con 0x559d214f9910 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd2308d3740 1 -- 172.21.15.103:0/3893662766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd21000fc60 con 0x559d214f9910 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd2077fe640 1 -- 172.21.15.103:0/3893662766 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fd21801c480 con 0x559d214f9910 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd2077fe640 1 -- 172.21.15.103:0/3893662766 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd218025050 con 0x559d214f9910 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd2308d3740 10 client.15915 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd2308d3740 1 -- 172.21.15.103:0/3893662766 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559d21512a20 con 0x559d214f9910 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.469+0000 7fd2077fe640 1 -- 172.21.15.103:0/3893662766 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd21000fc60 con 0x559d214f9910 2024-08-02T18:51:17.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd2077fe640 1 -- 172.21.15.103:0/3893662766 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd218011840 con 0x559d214f9910 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd2308d3740 10 client.15915 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd2308d3740 10 client.15915 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd2308d3740 20 client.15915 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559d21513ee0 0x559d21516330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd2308d3740 4 client.15915 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd2308d3740 1 -- 172.21.15.103:0/3893662766 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x559d2146bfb0 con 0x559d21513ee0 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559d21513ee0 0x559d21516330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd2077fe640 10 client.15915 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.470+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559d21513ee0 0x559d21516330 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=72b81d8de059f2f7 server_cookie=75ca602b1bb78e7f in_seq=0 out_seq=0 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2077fe640 1 -- 172.21.15.103:0/3893662766 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x559d2146bfb0 con 0x559d21513ee0 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2077fe640 10 client.15915 handle_command_reply: tid=0 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 client.15915 shutdown 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 -- 172.21.15.103:0/3893662766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f9910 msgr2=0x559d215015b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f9910 0x559d215015b0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fd218010840 tx=0x7fd218010d00 comp rx=0 tx=0).stop 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 -- 172.21.15.103:0/3893662766 shutdown_connections 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559d21513ee0 0x559d21516330 crc :-1 s=READY pgs=72 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d21501af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2077fe640 0 client.15915 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f9910 0x559d215015b0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3893662766 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f8ff0 0x559d21501070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.471+0000 7fd2308d3740 1 -- 172.21.15.103:0/3893662766 >> 172.21.15.103:0/3893662766 conn(0x559d214f5580 msgr2=0x559d214fb260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.472+0000 7fd2308d3740 1 -- 172.21.15.103:0/3893662766 shutdown_connections 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.472+0000 7fd2308d3740 1 -- 172.21.15.103:0/3893662766 wait complete. 2024-08-02T18:51:17.482 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.472+0000 7fd2308d3740 20 client.15915 trim_cache size 0 max 16384 2024-08-02T18:51:17.487 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd2308d3740 1 Processor -- start 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd2308d3740 1 -- start start 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d2151bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f9910 0x559d2151c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d215041d0 0x559d21501030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd2308d3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281af270 con 0x559d214f8ff0 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd2308d3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281acb40 con 0x559d215041d0 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd2308d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281aa990 con 0x559d214f9910 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d2151bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d2151bc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59982/0 (socket says 172.21.15.103:59982) 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd21ffff640 1 -- 172.21.15.103:0/2416727719 learned_addr learned my addr 172.21.15.103:0/2416727719 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd227fff640 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f9910 0x559d2151c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.488 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.485+0000 7fd21ffff640 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d215041d0 0x559d21501030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21ffff640 1 -- 172.21.15.103:0/2416727719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f9910 msgr2=0x559d2151c180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21ffff640 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f9910 0x559d2151c180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21ffff640 1 -- 172.21.15.103:0/2416727719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d215041d0 msgr2=0x559d21501030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21ffff640 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d215041d0 0x559d21501030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21ffff640 1 -- 172.21.15.103:0/2416727719 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d215169b0 con 0x559d214f8ff0 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21ffff640 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d2151bc40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd210012890 tx=0x7fd2100128c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c185910bc9d826d1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21dffb640 1 -- 172.21.15.103:0/2416727719 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210014600 con 0x559d214f8ff0 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21dffb640 1 -- 172.21.15.103:0/2416727719 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd210027070 con 0x559d214f8ff0 2024-08-02T18:51:17.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.486+0000 7fd21dffb640 1 -- 172.21.15.103:0/2416727719 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2100053b0 con 0x559d214f8ff0 2024-08-02T18:51:17.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 -- 172.21.15.103:0/2416727719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 msgr2=0x559d2151bc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d2151bc40 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fd210012890 tx=0x7fd2100128c0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 -- 172.21.15.103:0/2416727719 shutdown_connections 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d215041d0 0x559d21501030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d214f9910 0x559d2151c180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 --2- 172.21.15.103:0/2416727719 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d2151bc40 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 -- 172.21.15.103:0/2416727719 >> 172.21.15.103:0/2416727719 conn(0x559d214f5580 msgr2=0x559d214ff940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 -- 172.21.15.103:0/2416727719 shutdown_connections 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 -- 172.21.15.103:0/2416727719 wait complete. 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.487+0000 7fd2308d3740 1 -- start start 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd2308d3740 1 Processor -- start 2024-08-02T18:51:17.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d21576f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d215774d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd2308d3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d2150b160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd2308d3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281ab000 con 0x559d214f8ff0 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd2308d3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281ac470 con 0x559d214f9910 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd2308d3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd2281ab6d0 con 0x559d215041d0 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d21576f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd2308d3740 10 client.0 _ll_register_callbacks cb 0x7fd21800c410 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd21ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d21576f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:59990/0 (socket says 172.21.15.103:59990) 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd21ffff640 1 -- 172.21.15.103:0/3931487383 learned_addr learned my addr 172.21.15.103:0/3931487383 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d2150b160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.488+0000 7fd227fff640 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d215774d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd21ffff640 1 -- 172.21.15.103:0/3931487383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 msgr2=0x559d2150b160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:17.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d2150b160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd21ffff640 1 -- 172.21.15.103:0/3931487383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 msgr2=0x559d215774d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d215774d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd21ffff640 1 -- 172.21.15.103:0/3931487383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d214f53b0 con 0x559d214f8ff0 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd21ffff640 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d21576f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd210012860 tx=0x7fd21000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2cb5e74e01f277b5 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd2077fe640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd2077fe640 1 -- 172.21.15.103:0/3931487383 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd210034070 con 0x559d214f8ff0 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd2077fe640 1 -- 172.21.15.103:0/3931487383 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fd210005350 con 0x559d214f8ff0 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd2308d3740 1 -- 172.21.15.103:0/3931487383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd210027070 con 0x559d214f8ff0 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd2077fe640 1 -- 172.21.15.103:0/3931487383 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd210005550 con 0x559d214f8ff0 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd2308d3740 10 client.15921 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd2308d3740 1 -- 172.21.15.103:0/3931487383 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x559d2150c590 con 0x559d214f8ff0 2024-08-02T18:51:17.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.489+0000 7fd2077fe640 1 -- 172.21.15.103:0/3931487383 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd210027070 con 0x559d214f8ff0 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd2077fe640 1 -- 172.21.15.103:0/3931487383 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fd21000fb70 con 0x559d214f8ff0 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd2308d3740 10 client.15921 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd2308d3740 10 client.15921 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd2308d3740 20 client.15921 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559d2150cab0 0x559d21585030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd2308d3740 4 client.15921 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd2308d3740 1 -- 172.21.15.103:0/3931487383 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x559d214664c0 con 0x559d2150cab0 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd227fff640 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559d2150cab0 0x559d21585030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd2077fe640 10 client.15921 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.490+0000 7fd227fff640 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559d2150cab0 0x559d21585030 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=990a0bd2e0f6cc84 server_cookie=3ab16717bf09d471 in_seq=0 out_seq=0 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2077fe640 1 -- 172.21.15.103:0/3931487383 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x559d214664c0 con 0x559d2150cab0 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2077fe640 10 client.15921 handle_command_reply: tid=0 2024-08-02T18:51:17.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 client.15921 shutdown 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 -- 172.21.15.103:0/3931487383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 msgr2=0x559d21576f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d21576f90 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fd210012860 tx=0x7fd21000cca0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 -- 172.21.15.103:0/3931487383 shutdown_connections 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x559d2150cab0 0x559d21585030 crc :-1 s=READY pgs=73 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x559d215041d0 0x559d2150b160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x559d214f9910 0x559d215774d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 --2- 172.21.15.103:0/3931487383 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x559d214f8ff0 0x559d21576f90 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2077fe640 0 client.15921 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 -- 172.21.15.103:0/3931487383 >> 172.21.15.103:0/3931487383 conn(0x559d214f5580 msgr2=0x559d215026e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 -- 172.21.15.103:0/3931487383 shutdown_connections 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 1 -- 172.21.15.103:0/3931487383 wait complete. 2024-08-02T18:51:17.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.491+0000 7fd2308d3740 20 client.15921 trim_cache size 0 max 16384 2024-08-02T18:51:17.498 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:51:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 -- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd2140a4f00 msgr2=0x7fd2140a73c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd2140a4f00 0x7fd2140a73c0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fd2200ee900 tx=0x7fd2200dd040 comp rx=0 tx=0).stop 2024-08-02T18:51:17.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 -- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2281067c0 msgr2=0x7fd22819b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2281067c0 0x7fd22819b9d0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7fd220009ca0 tx=0x7fd220003f80 comp rx=0 tx=0).stop 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 -- 172.21.15.103:0/177077438 shutdown_connections 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd2140a4f00 0x7fd2140a73c0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd2281067c0 0x7fd22819b9d0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd228101160 0x7fd228197640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 --2- 172.21.15.103:0/177077438 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd2281007c0 0x7fd228197100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 -- 172.21.15.103:0/177077438 >> 172.21.15.103:0/177077438 conn(0x7fd2280fc500 msgr2=0x7fd2280fcb90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 -- 172.21.15.103:0/177077438 shutdown_connections 2024-08-02T18:51:17.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:17.492+0000 7fd22e4d5640 1 -- 172.21.15.103:0/177077438 wait complete. 2024-08-02T18:51:17.689 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 -- 172.21.15.103:0/1557634279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 msgr2=0x7fa2e01078c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 --2- 172.21.15.103:0/1557634279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 0x7fa2e01078c0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8009930 tx=0x7fa2c802a420 comp rx=0 tx=0).stop 2024-08-02T18:51:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 -- 172.21.15.103:0/1557634279 shutdown_connections 2024-08-02T18:51:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 --2- 172.21.15.103:0/1557634279 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2e0107fd0 0x7fa2e010e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 --2- 172.21.15.103:0/1557634279 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 0x7fa2e01078c0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 --2- 172.21.15.103:0/1557634279 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2e0102a60 0x7fa2e0102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 -- 172.21.15.103:0/1557634279 >> 172.21.15.103:0/1557634279 conn(0x7fa2e00fc500 msgr2=0x7fa2e00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 -- 172.21.15.103:0/1557634279 shutdown_connections 2024-08-02T18:51:18.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 -- 172.21.15.103:0/1557634279 wait complete. 2024-08-02T18:51:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.583+0000 7fa2e51de640 1 Processor -- start 2024-08-02T18:51:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2e51de640 1 -- start start 2024-08-02T18:51:18.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2e51de640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2e0102a60 0x7fa2e019a5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2e51de640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 0x7fa2e019ab20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2e51de640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2e0107fd0 0x7fa2e019eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2e51de640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0111ef0 con 0x7fa2e0103410 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2e51de640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0111d70 con 0x7fa2e0102a60 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2e51de640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e0112070 con 0x7fa2e0107fd0 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 0x7fa2e019ab20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 0x7fa2e019ab20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60020/0 (socket says 172.21.15.103:60020) 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2d659c640 1 -- 172.21.15.103:0/3152069343 learned_addr learned my addr 172.21.15.103:0/3152069343 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2e0102a60 0x7fa2e019a5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2df59e640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2e0107fd0 0x7fa2e019eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2d659c640 1 -- 172.21.15.103:0/3152069343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2e0107fd0 msgr2=0x7fa2e019eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2d659c640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2e0107fd0 0x7fa2e019eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2d659c640 1 -- 172.21.15.103:0/3152069343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2e0102a60 msgr2=0x7fa2e019a5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2d659c640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2e0102a60 0x7fa2e019a5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.584+0000 7fa2d659c640 1 -- 172.21.15.103:0/3152069343 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2e019f590 con 0x7fa2e0103410 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.585+0000 7fa2d659c640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 0x7fa2e019ab20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8004770 tx=0x7fa2c80042f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.585+0000 7fa2dcd99640 1 -- 172.21.15.103:0/3152069343 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c803f030 con 0x7fa2e0103410 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.585+0000 7fa2e51de640 1 -- 172.21.15.103:0/3152069343 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2e019f820 con 0x7fa2e0103410 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.585+0000 7fa2dcd99640 1 -- 172.21.15.103:0/3152069343 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2c8003d00 con 0x7fa2e0103410 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.585+0000 7fa2dcd99640 1 -- 172.21.15.103:0/3152069343 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8035070 con 0x7fa2e0103410 2024-08-02T18:51:18.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.585+0000 7fa2e51de640 1 -- 172.21.15.103:0/3152069343 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2e01a7160 con 0x7fa2e0103410 2024-08-02T18:51:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.587+0000 7fa2dcd99640 1 -- 172.21.15.103:0/3152069343 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fa2c8042030 con 0x7fa2e0103410 2024-08-02T18:51:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.587+0000 7fa2e75dc740 1 Processor -- start 2024-08-02T18:51:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.587+0000 7fa2e75dc740 1 -- start start 2024-08-02T18:51:18.590 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d233990 0x55c71d233d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23e630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d23eb70 0x55c71d240f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c71d199c60 con 0x55c71d2342b0 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c71d131b90 con 0x55c71d233990 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c71d195c20 con 0x55c71d23eb70 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60026/0 (socket says 172.21.15.103:60026) 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 -- 172.21.15.103:0/1822977431 learned_addr learned my addr 172.21.15.103:0/1822977431 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2dcd99640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2cc0a2cf0 0x7fa2cc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2d659c640 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d23eb70 0x55c71d240f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2df59e640 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d233990 0x55c71d233d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2df59e640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2cc0a2cf0 0x7fa2cc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.591 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 -- 172.21.15.103:0/1822977431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d23eb70 msgr2=0x55c71d240f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d23eb70 0x55c71d240f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 -- 172.21.15.103:0/1822977431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d233990 msgr2=0x55c71d233d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d233990 0x55c71d233d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 -- 172.21.15.103:0/1822977431 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c71cea9580 con 0x55c71d2342b0 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2df59e640 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d233990 0x55c71d233d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2d659c640 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d23eb70 0x55c71d240f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2dcd99640 1 -- 172.21.15.103:0/3152069343 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa2c80ef8a0 con 0x7fa2e0103410 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.588+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23e630 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000bd10 tx=0x7fa2d00107a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85bfa1e1b93d846b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.589+0000 7fa2d559a640 1 -- 172.21.15.103:0/1822977431 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0004030 con 0x55c71d2342b0 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.589+0000 7fa2d559a640 1 -- 172.21.15.103:0/1822977431 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2d00041d0 con 0x55c71d2342b0 2024-08-02T18:51:18.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.589+0000 7fa2d559a640 1 -- 172.21.15.103:0/1822977431 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d00118c0 con 0x55c71d2342b0 2024-08-02T18:51:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.589+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1822977431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 msgr2=0x55c71d23e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.589+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23e630 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000bd10 tx=0x7fa2d00107a0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.589+0000 7fa2df59e640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2cc0a2cf0 0x7fa2cc0a51b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8005fd0 tx=0x7fa2d8009600 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:18.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1822977431 shutdown_connections 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d23eb70 0x55c71d240f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23e630 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1822977431 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d233990 0x55c71d233d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1822977431 >> 172.21.15.103:0/1822977431 conn(0x55c71d22ff20 msgr2=0x55c71d230300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1822977431 shutdown_connections 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1822977431 wait complete. 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 -- start start 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 Processor -- start 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d23ba10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23bf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d23c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55c71d241740 con 0x55c71d2342b0 2024-08-02T18:51:18.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55c71d1377c0 con 0x55c71d23eb70 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55c71d2418c0 con 0x55c71d233990 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2e75dc740 10 client.0 _ll_register_callbacks cb 0x55c71d140f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.590+0000 7fa2d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23bf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23bf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60036/0 (socket says 172.21.15.103:60036) 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2d659c640 1 -- 172.21.15.103:0/1275215114 learned_addr learned my addr 172.21.15.103:0/1275215114 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2df59e640 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d23c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d23ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2d659c640 1 -- 172.21.15.103:0/1275215114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 msgr2=0x55c71d23ba10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2d659c640 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d23ba10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2d659c640 1 -- 172.21.15.103:0/1275215114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 msgr2=0x55c71d23c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2d659c640 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d23c490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2d659c640 1 -- 172.21.15.103:0/1275215114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c71cf73960 con 0x55c71d2342b0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d23ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2d659c640 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23bf50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8005ec0 tx=0x7fa2c808b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92032053ce74b599 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2c67fc640 1 -- 172.21.15.103:0/1275215114 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8049040 con 0x55c71d2342b0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2c67fc640 1 -- 172.21.15.103:0/1275215114 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa2c80ecf30 con 0x55c71d2342b0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1275215114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d00041d0 con 0x55c71d2342b0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2c67fc640 1 -- 172.21.15.103:0/1275215114 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa2c80bb490 con 0x55c71d2342b0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2e75dc740 10 client.15933 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.591+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1275215114 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c71d24d730 con 0x55c71d2342b0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2c67fc640 1 -- 172.21.15.103:0/1275215114 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2d00041d0 con 0x55c71d2342b0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2c67fc640 1 -- 172.21.15.103:0/1275215114 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa2c804c060 con 0x55c71d2342b0 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2e75dc740 10 client.15933 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:18.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2e75dc740 10 client.15933 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2e75dc740 20 client.15933 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c71d24ea80 0x55c71d250f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2e75dc740 4 client.15933 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1275215114 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55c71d1a71d0 con 0x55c71d24ea80 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c71d24ea80 0x55c71d250f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c71d24ea80 0x55c71d250f20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1ff8bd1e06ada8c4 server_cookie=9dd74481484a7f62 in_seq=0 out_seq=0 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.592+0000 7fa2c67fc640 10 client.15933 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2c67fc640 1 -- 172.21.15.103:0/1275215114 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55c71d1a71d0 con 0x55c71d24ea80 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2c67fc640 10 client.15933 handle_command_reply: tid=0 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 client.15933 shutdown 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1275215114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 msgr2=0x55c71d23bf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23bf50 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8005ec0 tx=0x7fa2c808b990 comp rx=0 tx=0).stop 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1275215114 shutdown_connections 2024-08-02T18:51:18.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c71d24ea80 0x55c71d250f20 crc :-1 s=READY pgs=74 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d23c490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d23bf50 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1275215114 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d23ba10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2c67fc640 0 client.15933 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1275215114 >> 172.21.15.103:0/1275215114 conn(0x55c71d22ff20 msgr2=0x55c71d235c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.593+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1275215114 shutdown_connections 2024-08-02T18:51:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.594+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1275215114 wait complete. 2024-08-02T18:51:18.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.594+0000 7fa2e75dc740 20 client.15933 trim_cache size 0 max 16384 2024-08-02T18:51:18.612 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.610+0000 7fa2e75dc740 1 Processor -- start 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.610+0000 7fa2e75dc740 1 -- start start 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.610+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d233990 0x55c71d23a2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.610+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d2342b0 0x55c71d256880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.610+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d256dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.610+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b37e0 con 0x55c71d233990 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.610+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b10b0 con 0x55c71d23eb70 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.610+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01aef00 con 0x55c71d2342b0 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d233990 0x55c71d23a2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d233990 0x55c71d23a2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60052/0 (socket says 172.21.15.103:60052) 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 -- 172.21.15.103:0/1177495564 learned_addr learned my addr 172.21.15.103:0/1177495564 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2d659c640 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d2342b0 0x55c71d256880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 -- 172.21.15.103:0/1177495564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d2342b0 msgr2=0x55c71d256880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:18.613 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d2342b0 0x55c71d256880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2df59e640 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d256dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 -- 172.21.15.103:0/1177495564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 msgr2=0x55c71d256dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d256dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 -- 172.21.15.103:0/1177495564 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c71d22fd50 con 0x55c71d233990 2024-08-02T18:51:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d233990 0x55c71d23a2e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000bc30 tx=0x7fa2d000b390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251a45e42b5c8943 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2d4d99640 1 -- 172.21.15.103:0/1177495564 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0005240 con 0x55c71d233990 2024-08-02T18:51:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2d4d99640 1 -- 172.21.15.103:0/1177495564 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2d0003af0 con 0x55c71d233990 2024-08-02T18:51:18.614 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.611+0000 7fa2d4d99640 1 -- 172.21.15.103:0/1177495564 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2d0011970 con 0x55c71d233990 2024-08-02T18:51:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1177495564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d233990 msgr2=0x55c71d23a2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d233990 0x55c71d23a2e0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000bc30 tx=0x7fa2d000b390 comp rx=0 tx=0).stop 2024-08-02T18:51:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1177495564 shutdown_connections 2024-08-02T18:51:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d256dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d2342b0 0x55c71d256880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/1177495564 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d233990 0x55c71d23a2e0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1177495564 >> 172.21.15.103:0/1177495564 conn(0x55c71d22ff20 msgr2=0x55c71d23da90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:18.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1177495564 shutdown_connections 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 -- 172.21.15.103:0/1177495564 wait complete. 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 -- start start 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.612+0000 7fa2e75dc740 1 Processor -- start 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d242f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d2434b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2e75dc740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d2b8850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01af570 con 0x55c71d2342b0 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01b09e0 con 0x55c71d23eb70 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2e75dc740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa2e01afc40 con 0x55c71d233990 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2e75dc740 10 client.0 _ll_register_callbacks cb 0x7fa2c80044e0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d2434b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d2434b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:60062/0 (socket says 172.21.15.103:60062) 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 -- 172.21.15.103:0/2659922157 learned_addr learned my addr 172.21.15.103:0/2659922157 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d242f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2df59e640 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d2b8850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 -- 172.21.15.103:0/2659922157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 msgr2=0x55c71d242f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d242f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 -- 172.21.15.103:0/2659922157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 msgr2=0x55c71d2b8850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d2b8850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 -- 172.21.15.103:0/2659922157 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c71d2b8d90 con 0x55c71d2342b0 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2d659c640 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d2434b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80b7f90 tx=0x7fa2c80ed140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1a20904c376edd8 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2c67fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.613+0000 7fa2c67fc640 1 -- 172.21.15.103:0/2659922157 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8049070 con 0x55c71d2342b0 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2c67fc640 1 -- 172.21.15.103:0/2659922157 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa2c803bcc0 con 0x55c71d2342b0 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 1 -- 172.21.15.103:0/2659922157 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2d0003af0 con 0x55c71d2342b0 2024-08-02T18:51:18.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2c67fc640 1 -- 172.21.15.103:0/2659922157 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa2c804b2f0 con 0x55c71d2342b0 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 10 client.15939 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 1 -- 172.21.15.103:0/2659922157 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55c71d2b8d90 con 0x55c71d2342b0 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2c67fc640 1 -- 172.21.15.103:0/2659922157 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2d0003af0 con 0x55c71d2342b0 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2c67fc640 1 -- 172.21.15.103:0/2659922157 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fa2c80baf80 con 0x55c71d2342b0 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 10 client.15939 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 10 client.15939 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 20 client.15939 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c71d2ba4a0 0x55c71d2bc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 4 client.15939 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "9814e3a3", "release": true, "await": true}] 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2e75dc740 1 -- 172.21.15.103:0/2659922157 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "quiesce db", "set_id": "9814e3a3", "release": true, "await": true}) -- 0x55c71d22b1d0 con 0x55c71d2ba4a0 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.614+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c71d2ba4a0 0x55c71d2bc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.615+0000 7fa2ded9d640 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c71d2ba4a0 0x55c71d2bc8c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d38958d16e2a4a88 server_cookie=3fd96308b2850065 in_seq=0 out_seq=0 2024-08-02T18:51:18.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.615+0000 7fa2c67fc640 10 client.15939 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:18.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.617+0000 7fa2c67fc640 1 -- 172.21.15.103:0/2659922157 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55c71d22b1d0 con 0x55c71d2ba4a0 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2c67fc640 10 client.15939 handle_command_reply: tid=0 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 client.15939 shutdown 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 -- 172.21.15.103:0/2659922157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 msgr2=0x55c71d2434b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d2434b0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80b7f90 tx=0x7fa2c80ed140 comp rx=0 tx=0).stop 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 -- 172.21.15.103:0/2659922157 shutdown_connections 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55c71d2ba4a0 0x55c71d2bc8c0 crc :-1 s=READY pgs=75 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55c71d23eb70 0x55c71d2b8850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55c71d2342b0 0x55c71d2434b0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2c67fc640 0 client.15939 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 --2- 172.21.15.103:0/2659922157 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55c71d233990 0x55c71d242f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 -- 172.21.15.103:0/2659922157 >> 172.21.15.103:0/2659922157 conn(0x55c71d22ff20 msgr2=0x55c71d235c50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 -- 172.21.15.103:0/2659922157 shutdown_connections 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 1 -- 172.21.15.103:0/2659922157 wait complete. 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e75dc740 20 client.15939 trim_cache size 0 max 16384 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 26, 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24473, 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 8, 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": { 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stdout: "9814e3a3": { 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stdout: "version": 8, 2024-08-02T18:51:18.623 INFO:teuthology.orchestra.run.smithi103.stdout: "age_ref": 0.0, 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "timeout": 90.0, 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "expiration": 141.9, 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "members": { 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "file:/": { 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "excluded": false, 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "state": { 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RELEASED", 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: "age": 0.0 2024-08-02T18:51:18.624 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:51:18.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:51:18.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:51:18.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:51:18.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:51:18.625 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:51:18.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e51de640 1 -- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2cc0a2cf0 msgr2=0x7fa2cc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e51de640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2cc0a2cf0 0x7fa2cc0a51b0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fa2d8005fd0 tx=0x7fa2d8009600 comp rx=0 tx=0).stop 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e51de640 1 -- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 msgr2=0x7fa2e019ab20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.618+0000 7fa2e51de640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 0x7fa2e019ab20 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8004770 tx=0x7fa2c80042f0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.619+0000 7fa2e51de640 1 -- 172.21.15.103:0/3152069343 shutdown_connections 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.619+0000 7fa2e51de640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2cc0a2cf0 0x7fa2cc0a51b0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.619+0000 7fa2e51de640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2e0107fd0 0x7fa2e019eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.619+0000 7fa2e51de640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2e0103410 0x7fa2e019ab20 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.619+0000 7fa2e51de640 1 --2- 172.21.15.103:0/3152069343 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2e0102a60 0x7fa2e019a5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.619+0000 7fa2e51de640 1 -- 172.21.15.103:0/3152069343 >> 172.21.15.103:0/3152069343 conn(0x7fa2e00fc500 msgr2=0x7fa2e01010f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.619+0000 7fa2e51de640 1 -- 172.21.15.103:0/3152069343 shutdown_connections 2024-08-02T18:51:18.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:18.619+0000 7fa2e51de640 1 -- 172.21.15.103:0/3152069343 wait complete. 2024-08-02T18:51:18.627 INFO:tasks.workunit.client.0.smithi103.stderr:+ KERNEL=linux-4.0.5 2024-08-02T18:51:18.627 INFO:tasks.workunit.client.0.smithi103.stderr:+ wget -q http://download.ceph.com/qa/linux-4.0.5.tar.xz 2024-08-02T18:51:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:18 smithi151 ceph-mon[37155]: pgmap v50: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-08-02T18:51:19.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:18 smithi103 ceph-mon[32753]: pgmap v50: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-08-02T18:51:19.165 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-02T18:51:19.166 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-02T18:51:19.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:18 smithi121 ceph-mon[37236]: pgmap v50: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 KiB/s rd, 1.3 KiB/s wr, 6 op/s 2024-08-02T18:51:19.683 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '9814e3a3', total seconds elapsed: 27.4 2024-08-02T18:51:19.762 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:20.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2693688031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd41007b0 msgr2=0x7f8cd4100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2693688031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd41007b0 0x7f8cd4100c10 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009930 tx=0x7f8cc402a420 comp rx=0 tx=0).stop 2024-08-02T18:51:20.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2693688031 shutdown_connections 2024-08-02T18:51:20.261 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2693688031 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cd4101150 0x7f8cd410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2693688031 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd41007b0 0x7f8cd4100c10 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2693688031 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd41067b0 0x7f8cd4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2693688031 >> 172.21.15.103:0/2693688031 conn(0x7f8cd40fc4d0 msgr2=0x7f8cd40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2693688031 shutdown_connections 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.243+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2693688031 wait complete. 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdc7fa640 1 Processor -- start 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdc7fa640 1 -- start start 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdc7fa640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd41007b0 0x7f8cd4198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdc7fa640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd4101150 0x7f8cd41987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.262 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdc7fa640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cd41067b0 0x7f8cd419cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdc7fa640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd4110ce0 con 0x7f8cd4101150 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdc7fa640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd4110b60 con 0x7f8cd41067b0 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdc7fa640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd4110e60 con 0x7f8cd41007b0 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cd9d95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd4101150 0x7f8cd41987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cd9d95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd4101150 0x7f8cd41987b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40200/0 (socket says 172.21.15.103:40200) 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cd9d95640 1 -- 172.21.15.103:0/2769918228 learned_addr learned my addr 172.21.15.103:0/2769918228 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cdad97640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cd41067b0 0x7f8cd419cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.244+0000 7f8cda596640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd41007b0 0x7f8cd4198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8cd9d95640 1 -- 172.21.15.103:0/2769918228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd41007b0 msgr2=0x7f8cd4198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd41007b0 0x7f8cd4198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.263 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8cd9d95640 1 -- 172.21.15.103:0/2769918228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cd41067b0 msgr2=0x7f8cd419cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cd41067b0 0x7f8cd419cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8cd9d95640 1 -- 172.21.15.103:0/2769918228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8cd419d220 con 0x7f8cd4101150 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd4101150 0x7f8cd41987b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8cc402a940 tx=0x7f8cc4032bf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8ccb7fe640 1 -- 172.21.15.103:0/2769918228 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc403f030 con 0x7f8cd4101150 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8ccb7fe640 1 -- 172.21.15.103:0/2769918228 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cc4032e10 con 0x7f8cd4101150 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2769918228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8cd419d4b0 con 0x7f8cd4101150 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8ccb7fe640 1 -- 172.21.15.103:0/2769918228 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc4035070 con 0x7f8cd4101150 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.245+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2769918228 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8cd41a4df0 con 0x7f8cd4101150 2024-08-02T18:51:20.264 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8ccb7fe640 1 -- 172.21.15.103:0/2769918228 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f8cc4042030 con 0x7f8cd4101150 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8cdebf8740 1 Processor -- start 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8cdebf8740 1 -- start start 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfca4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd92b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdbbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fb3df8de40 con 0x55fb3dfca9e0 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb3df2f7f0 con 0x55fb3dfca0c0 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.248+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fb3ded6fb0 con 0x55fb3dfd97f0 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd92b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd92b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40212/0 (socket says 172.21.15.103:40212) 2024-08-02T18:51:20.265 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 -- 172.21.15.103:0/2867226882 learned_addr learned my addr 172.21.15.103:0/2867226882 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cdad97640 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfca4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdbbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8ccb7fe640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f8cc00a2cf0 0x7f8cc00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 -- 172.21.15.103:0/2867226882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfd97f0 msgr2=0x55fb3dfdbbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdbbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 -- 172.21.15.103:0/2867226882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca0c0 msgr2=0x55fb3dfca4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfca4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 -- 172.21.15.103:0/2867226882 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb3dca16a0 con 0x55fb3dfca9e0 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:20.266 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cdad97640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f8cc00a2cf0 0x7f8cc00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8ccb7fe640 1 -- 172.21.15.103:0/2769918228 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f8cc40efbc0 con 0x7f8cd4101150 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cda596640 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd92b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000cbe0 tx=0x7f8cd000e720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e8678b842a5c035 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cc8ff9640 1 -- 172.21.15.103:0/2867226882 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0005220 con 0x55fb3dfca9e0 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cc8ff9640 1 -- 172.21.15.103:0/2867226882 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cd0004ca0 con 0x55fb3dfca9e0 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.249+0000 7f8cc8ff9640 1 -- 172.21.15.103:0/2867226882 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cd0010960 con 0x55fb3dfca9e0 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 -- 172.21.15.103:0/2867226882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 msgr2=0x55fb3dfd92b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdad97640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f8cc00a2cf0 0x7f8cc00a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0098b0 tx=0x7f8ccc004a40 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd92b0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f8cd000cbe0 tx=0x7f8cd000e720 comp rx=0 tx=0).stop 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 -- 172.21.15.103:0/2867226882 shutdown_connections 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdbbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.267 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd92b0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/2867226882 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfca4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 -- 172.21.15.103:0/2867226882 >> 172.21.15.103:0/2867226882 conn(0x55fb3dfc6790 msgr2=0x55fb3dfc6b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:20.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 -- 172.21.15.103:0/2867226882 shutdown_connections 2024-08-02T18:51:20.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 -- 172.21.15.103:0/2867226882 wait complete. 2024-08-02T18:51:20.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.250+0000 7f8cdebf8740 1 -- start start 2024-08-02T18:51:20.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdebf8740 1 Processor -- start 2024-08-02T18:51:20.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfd66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.268 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfd7170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fb3deeacb0 con 0x55fb3dfca9e0 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fb3df2b7b0 con 0x55fb3dfd97f0 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fb3dfdc3c0 con 0x55fb3dfca0c0 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdebf8740 10 client.0 _ll_register_callbacks cb 0x55fb3dc3eba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40222/0 (socket says 172.21.15.103:40222) 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 -- 172.21.15.103:0/1006439413 learned_addr learned my addr 172.21.15.103:0/1006439413 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cda596640 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfd66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.269 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cdad97640 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfd7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 -- 172.21.15.103:0/1006439413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 msgr2=0x55fb3dfd66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:20.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfd66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 -- 172.21.15.103:0/1006439413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 msgr2=0x55fb3dfd7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:20.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfd7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 -- 172.21.15.103:0/1006439413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb3dee9bc0 con 0x55fb3dfca9e0 2024-08-02T18:51:20.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cda596640 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfd66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:20.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd6c30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40ed5d0 tx=0x7f8cc40bbb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=48319bbbc1094759 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:20.270 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.251+0000 7f8cbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cbdffb640 1 -- 172.21.15.103:0/1006439413 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40bf020 con 0x55fb3dfca9e0 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cbdffb640 1 -- 172.21.15.103:0/1006439413 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f8cc40ed250 con 0x55fb3dfca9e0 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 1 -- 172.21.15.103:0/1006439413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8cd0004ca0 con 0x55fb3dfca9e0 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cbdffb640 1 -- 172.21.15.103:0/1006439413 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8cc4049070 con 0x55fb3dfca9e0 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 10 client.15951 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 1 -- 172.21.15.103:0/1006439413 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fb3dfe8240 con 0x55fb3dfca9e0 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cbdffb640 1 -- 172.21.15.103:0/1006439413 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cd0004ca0 con 0x55fb3dfca9e0 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cbdffb640 1 -- 172.21.15.103:0/1006439413 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8cc40b8410 con 0x55fb3dfca9e0 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 10 client.15951 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 10 client.15951 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:20.271 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 20 client.15951 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fb3dfe9650 0x55fb3dfebae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 4 client.15951 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cdebf8740 1 -- 172.21.15.103:0/1006439413 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fb3df3cd60 con 0x55fb3dfe9650 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.252+0000 7f8cda596640 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fb3dfe9650 0x55fb3dfebae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.253+0000 7f8cbdffb640 10 client.15951 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.253+0000 7f8cda596640 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fb3dfe9650 0x55fb3dfebae0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=187f3e6f31bb7583 server_cookie=6a3454c27a81bce8 in_seq=0 out_seq=0 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.253+0000 7f8cbdffb640 1 -- 172.21.15.103:0/1006439413 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fb3df3cd60 con 0x55fb3dfe9650 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.253+0000 7f8cbdffb640 10 client.15951 handle_command_reply: tid=0 2024-08-02T18:51:20.272 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.253+0000 7f8cdebf8740 1 client.15951 shutdown 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 -- 172.21.15.103:0/1006439413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 msgr2=0x55fb3dfd6c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd6c30 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f8cc40ed5d0 tx=0x7f8cc40bbb70 comp rx=0 tx=0).stop 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 -- 172.21.15.103:0/1006439413 shutdown_connections 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fb3dfe9650 0x55fb3dfebae0 crc :-1 s=READY pgs=76 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfd7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfd6c30 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cbdffb640 0 client.15951 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/1006439413 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfd66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 -- 172.21.15.103:0/1006439413 >> 172.21.15.103:0/1006439413 conn(0x55fb3dfc6790 msgr2=0x55fb3dfcc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:20.273 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 -- 172.21.15.103:0/1006439413 shutdown_connections 2024-08-02T18:51:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 1 -- 172.21.15.103:0/1006439413 wait complete. 2024-08-02T18:51:20.274 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.254+0000 7f8cdebf8740 20 client.15951 trim_cache size 0 max 16384 2024-08-02T18:51:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdebf8740 1 Processor -- start 2024-08-02T18:51:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdebf8740 1 -- start start 2024-08-02T18:51:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dff13b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dff18f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfc50d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd41af2a0 con 0x55fb3dfca9e0 2024-08-02T18:51:20.280 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd41acb70 con 0x55fb3dfd97f0 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd41aa9c0 con 0x55fb3dfca0c0 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cd9d95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dff18f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cd9d95640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dff18f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40226/0 (socket says 172.21.15.103:40226) 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cd9d95640 1 -- 172.21.15.103:0/3570898414 learned_addr learned my addr 172.21.15.103:0/3570898414 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cda596640 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dff13b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cdad97640 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfc50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cd9d95640 1 -- 172.21.15.103:0/3570898414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 msgr2=0x55fb3dff13b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dff13b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cd9d95640 1 -- 172.21.15.103:0/3570898414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 msgr2=0x55fb3dfc50d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:20.281 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfc50d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.271+0000 7f8cd9d95640 1 -- 172.21.15.103:0/3570898414 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fb3dfccc00 con 0x55fb3dfca9e0 2024-08-02T18:51:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.272+0000 7f8cdad97640 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfc50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.272+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dff18f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009900 tx=0x7f8cc402a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5a0c2cf842bea19 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.272+0000 7f8cbffff640 1 -- 172.21.15.103:0/3570898414 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40bf050 con 0x55fb3dfca9e0 2024-08-02T18:51:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.272+0000 7f8cbffff640 1 -- 172.21.15.103:0/3570898414 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8cc40bc000 con 0x55fb3dfca9e0 2024-08-02T18:51:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.272+0000 7f8cbffff640 1 -- 172.21.15.103:0/3570898414 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8cc40b8410 con 0x55fb3dfca9e0 2024-08-02T18:51:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.272+0000 7f8cdebf8740 1 -- 172.21.15.103:0/3570898414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 msgr2=0x55fb3dff18f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.282 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.272+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dff18f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f8cc4009900 tx=0x7f8cc402a420 comp rx=0 tx=0).stop 2024-08-02T18:51:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 -- 172.21.15.103:0/3570898414 shutdown_connections 2024-08-02T18:51:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfc50d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfca9e0 0x55fb3dff18f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/3570898414 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dff13b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.283 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 -- 172.21.15.103:0/3570898414 >> 172.21.15.103:0/3570898414 conn(0x55fb3dfc6790 msgr2=0x55fb3dfd57e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:20.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 -- 172.21.15.103:0/3570898414 shutdown_connections 2024-08-02T18:51:20.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 -- 172.21.15.103:0/3570898414 wait complete. 2024-08-02T18:51:20.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 -- start start 2024-08-02T18:51:20.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 Processor -- start 2024-08-02T18:51:20.284 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfe17a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfe1ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdcbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd41ab030 con 0x55fb3dfd97f0 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd41ac4a0 con 0x55fb3dfca9e0 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f8cd41ab700 con 0x55fb3dfca0c0 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdebf8740 10 client.0 _ll_register_callbacks cb 0x7f8cc4003f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdad97640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdcbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdad97640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdcbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40236/0 (socket says 172.21.15.103:40236) 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cdad97640 1 -- 172.21.15.103:0/648804891 learned_addr learned my addr 172.21.15.103:0/648804891 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:20.285 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cda596640 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfe17a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.273+0000 7f8cd9d95640 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfe1ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdad97640 1 -- 172.21.15.103:0/648804891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 msgr2=0x55fb3dfe17a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdad97640 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfe17a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdad97640 1 -- 172.21.15.103:0/648804891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca9e0 msgr2=0x55fb3dfe1ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdad97640 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfe1ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdad97640 1 -- 172.21.15.103:0/648804891 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fb3dfdd3e0 con 0x55fb3dfd97f0 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdad97640 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdcbb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0139a0 tx=0x7f8ccc004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e126603bb859fcc8 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cbdffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:20.286 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cbdffb640 1 -- 172.21.15.103:0/648804891 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc01fb00 con 0x55fb3dfd97f0 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cbdffb640 1 -- 172.21.15.103:0/648804891 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f8ccc01fca0 con 0x55fb3dfd97f0 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdebf8740 1 -- 172.21.15.103:0/648804891 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fb3df37270 con 0x55fb3dfd97f0 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cbdffb640 1 -- 172.21.15.103:0/648804891 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f8ccc01c430 con 0x55fb3dfd97f0 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdebf8740 10 client.15957 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cdebf8740 1 -- 172.21.15.103:0/648804891 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55fb3e053e50 con 0x55fb3dfd97f0 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.274+0000 7f8cbdffb640 1 -- 172.21.15.103:0/648804891 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55fb3df37270 con 0x55fb3dfd97f0 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cbdffb640 1 -- 172.21.15.103:0/648804891 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f8ccc00f040 con 0x55fb3dfd97f0 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cdebf8740 10 client.15957 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:20.287 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cdebf8740 10 client.15957 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cdebf8740 20 client.15957 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fb3e0545c0 0x55fb3e0569b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cdebf8740 4 client.15957 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-02T18:51:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cdebf8740 1 -- 172.21.15.103:0/648804891 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55fb3deb4110 con 0x55fb3e0545c0 2024-08-02T18:51:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cda596640 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fb3e0545c0 0x55fb3e0569b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cbdffb640 10 client.15957 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.275+0000 7f8cda596640 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fb3e0545c0 0x55fb3e0569b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ab7efdb98eaafb8 server_cookie=7862dcc96390b27a in_seq=0 out_seq=0 2024-08-02T18:51:20.288 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.276+0000 7f8cbdffb640 1 -- 172.21.15.103:0/648804891 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55fb3deb4110 con 0x55fb3e0545c0 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.276+0000 7f8cbdffb640 10 client.15957 handle_command_reply: tid=0 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.276+0000 7f8cdebf8740 1 client.15957 shutdown 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.276+0000 7f8cdebf8740 1 -- 172.21.15.103:0/648804891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfd97f0 msgr2=0x55fb3dfdcbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.276+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdcbb0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0139a0 tx=0x7f8ccc004ab0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 1 -- 172.21.15.103:0/648804891 shutdown_connections 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fb3e0545c0 0x55fb3e0569b0 crc :-1 s=READY pgs=77 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fb3dfd97f0 0x55fb3dfdcbb0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cbdffb640 0 client.15957 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fb3dfca9e0 0x55fb3dfe1ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.289 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 1 --2- 172.21.15.103:0/648804891 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fb3dfca0c0 0x55fb3dfe17a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 1 -- 172.21.15.103:0/648804891 >> 172.21.15.103:0/648804891 conn(0x55fb3dfc6790 msgr2=0x55fb3dfc50d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:20.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 1 -- 172.21.15.103:0/648804891 shutdown_connections 2024-08-02T18:51:20.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 1 -- 172.21.15.103:0/648804891 wait complete. 2024-08-02T18:51:20.290 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdebf8740 20 client.15957 trim_cache size 0 max 16384 2024-08-02T18:51:20.290 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:51:20.290 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-08-02T18:51:20.290 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "458f248b-bc3c-48d9-be80-8fc4404a2e08", 2024-08-02T18:51:20.290 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-08-02T18:51:20.291 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f8cc00a2cf0 msgr2=0x7f8cc00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f8cc00a2cf0 0x7f8cc00a51b0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc0098b0 tx=0x7f8ccc004a40 comp rx=0 tx=0).stop 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd4101150 msgr2=0x7f8cd41987b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.277+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd4101150 0x7f8cd41987b0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f8cc402a940 tx=0x7f8cc4032bf0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.278+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2769918228 shutdown_connections 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.278+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f8cc00a2cf0 0x7f8cc00a51b0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.278+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8cd41067b0 0x7f8cd419cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.278+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8cd4101150 0x7f8cd41987b0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.278+0000 7f8cdc7fa640 1 --2- 172.21.15.103:0/2769918228 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8cd41007b0 0x7f8cd4198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.278+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2769918228 >> 172.21.15.103:0/2769918228 conn(0x7f8cd40fc4d0 msgr2=0x7f8cd406a6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:20.292 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.278+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2769918228 shutdown_connections 2024-08-02T18:51:20.293 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:20.278+0000 7f8cdc7fa640 1 -- 172.21.15.103:0/2769918228 wait complete. 2024-08-02T18:51:21.019 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:20 smithi103 ceph-mon[32753]: pgmap v51: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-08-02T18:51:21.019 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:20 smithi103 ceph-mon[32753]: scrub queued for path: / 2024-08-02T18:51:21.019 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:20 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:21.019 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:20 smithi103 ceph-mon[32753]: scrub summary: active paths [/] 2024-08-02T18:51:21.019 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:20 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:21.046 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-02T18:51:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:20 smithi151 ceph-mon[37155]: pgmap v51: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-08-02T18:51:21.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:20 smithi151 ceph-mon[37155]: scrub queued for path: / 2024-08-02T18:51:21.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:20 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:21.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:20 smithi151 ceph-mon[37155]: scrub summary: active paths [/] 2024-08-02T18:51:21.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:20 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:20 smithi121 ceph-mon[37236]: pgmap v51: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 3.5 KiB/s wr, 9 op/s 2024-08-02T18:51:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:20 smithi121 ceph-mon[37236]: scrub queued for path: / 2024-08-02T18:51:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:20 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:20 smithi121 ceph-mon[37236]: scrub summary: active paths [/] 2024-08-02T18:51:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:20 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:21.313 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:21.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 -- 172.21.15.103:0/1728551040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 msgr2=0x7f3390102ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 --2- 172.21.15.103:0/1728551040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 0x7f3390102ea0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f338c009900 tx=0x7f338c02a480 comp rx=0 tx=0).stop 2024-08-02T18:51:21.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 -- 172.21.15.103:0/1728551040 shutdown_connections 2024-08-02T18:51:21.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 --2- 172.21.15.103:0/1728551040 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f339010bea0 0x7f339010e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.802 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 --2- 172.21.15.103:0/1728551040 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33901033e0 0x7f339010b8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 --2- 172.21.15.103:0/1728551040 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 0x7f3390102ea0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 -- 172.21.15.103:0/1728551040 >> 172.21.15.103:0/1728551040 conn(0x7f33900fc4c0 msgr2=0x7f33900fe8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:21.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 -- 172.21.15.103:0/1728551040 shutdown_connections 2024-08-02T18:51:21.803 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.801+0000 7f33975f5640 1 -- 172.21.15.103:0/1728551040 wait complete. 2024-08-02T18:51:21.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f33975f5640 1 Processor -- start 2024-08-02T18:51:21.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f33975f5640 1 -- start start 2024-08-02T18:51:21.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f33975f5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 0x7f3390100720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f33975f5640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33901033e0 0x7f3390100c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.805 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f33975f5640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f339010bea0 0x7f33901011a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f33975f5640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f3390111df0 con 0x7f3390102ac0 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f33975f5640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f3390111c70 con 0x7f33901033e0 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f33975f5640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f3390111f70 con 0x7f339010bea0 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3395391640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 0x7f3390100720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3395391640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 0x7f3390100720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40258/0 (socket says 172.21.15.103:40258) 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3395391640 1 -- 172.21.15.103:0/4291851571 learned_addr learned my addr 172.21.15.103:0/4291851571 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3394b90640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33901033e0 0x7f3390100c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3395b92640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f339010bea0 0x7f33901011a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3395391640 1 -- 172.21.15.103:0/4291851571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f339010bea0 msgr2=0x7f33901011a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3395391640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f339010bea0 0x7f33901011a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3395391640 1 -- 172.21.15.103:0/4291851571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33901033e0 msgr2=0x7f3390100c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.806 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.802+0000 7f3395391640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33901033e0 0x7f3390100c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.803+0000 7f3395391640 1 -- 172.21.15.103:0/4291851571 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33901a6780 con 0x7f3390102ac0 2024-08-02T18:51:21.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.803+0000 7f3395b92640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f339010bea0 0x7f33901011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:21.807 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.803+0000 7f3395391640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 0x7f3390100720 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f338c004770 tx=0x7f338c032c90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:21.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.804+0000 7f33867fc640 1 -- 172.21.15.103:0/4291851571 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c03f030 con 0x7f3390102ac0 2024-08-02T18:51:21.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.804+0000 7f33867fc640 1 -- 172.21.15.103:0/4291851571 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f338c003d00 con 0x7f3390102ac0 2024-08-02T18:51:21.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.804+0000 7f33975f5640 1 -- 172.21.15.103:0/4291851571 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33901a6a10 con 0x7f3390102ac0 2024-08-02T18:51:21.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.804+0000 7f33867fc640 1 -- 172.21.15.103:0/4291851571 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c035070 con 0x7f3390102ac0 2024-08-02T18:51:21.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.804+0000 7f33975f5640 1 -- 172.21.15.103:0/4291851571 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33901a6f40 con 0x7f3390102ac0 2024-08-02T18:51:21.808 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.806+0000 7f33867fc640 1 -- 172.21.15.103:0/4291851571 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f338c042030 con 0x7f3390102ac0 2024-08-02T18:51:21.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33867fc640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f337c0a2d70 0x7f337c0a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33999f3740 1 Processor -- start 2024-08-02T18:51:21.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33999f3740 1 -- start start 2024-08-02T18:51:21.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33867fc640 1 -- 172.21.15.103:0/4291851571 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f338c0efbf0 con 0x7f3390102ac0 2024-08-02T18:51:21.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f3394b90640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f337c0a2d70 0x7f337c0a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33999f3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7210 0x56386d0a75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.810 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33999f3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7b30 0x56386d0b1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33999f3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0b23f0 0x56386d0b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33999f3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56386d00c980 con 0x56386d0b23f0 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33999f3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56386cfa4a70 con 0x56386d0a7210 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.807+0000 7f33999f3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56386d008940 con 0x56386d0a7b30 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7210 0x56386d0a75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3394b90640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7b30 0x56386d0b1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7210 0x56386d0a75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:57024/0 (socket says 172.21.15.103:57024) 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395b92640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0b23f0 0x56386d0b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 -- 172.21.15.103:0/3085294146 learned_addr learned my addr 172.21.15.103:0/3085294146 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3394b90640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f337c0a2d70 0x7f337c0a5230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33900feab0 tx=0x7f33800103d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 -- 172.21.15.103:0/3085294146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7b30 msgr2=0x56386d0b1eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:21.811 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 --2- 172.21.15.103:0/3085294146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7b30 0x56386d0b1eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 -- 172.21.15.103:0/3085294146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0b23f0 msgr2=0x56386d0b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:21.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 --2- 172.21.15.103:0/3085294146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0b23f0 0x56386d0b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 -- 172.21.15.103:0/3085294146 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56386d0076e0 con 0x56386d0a7210 2024-08-02T18:51:21.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f3395391640 1 --2- 172.21.15.103:0/3085294146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7210 0x56386d0a75f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f338c0c4510 tx=0x7f338c0bb910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a10e92808330cd0a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:21.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f337b7fe640 1 -- 172.21.15.103:0/3085294146 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c049040 con 0x56386d0a7210 2024-08-02T18:51:21.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f337b7fe640 1 -- 172.21.15.103:0/3085294146 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f338c0bbdd0 con 0x56386d0a7210 2024-08-02T18:51:21.812 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.808+0000 7f337b7fe640 1 -- 172.21.15.103:0/3085294146 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c03b5b0 con 0x56386d0a7210 2024-08-02T18:51:21.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 -- 172.21.15.103:0/3085294146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7210 msgr2=0x56386d0a75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 --2- 172.21.15.103:0/3085294146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7210 0x56386d0a75f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f338c0c4510 tx=0x7f338c0bb910 comp rx=0 tx=0).stop 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 -- 172.21.15.103:0/3085294146 shutdown_connections 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 --2- 172.21.15.103:0/3085294146 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0b23f0 0x56386d0b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 --2- 172.21.15.103:0/3085294146 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7b30 0x56386d0b1eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 --2- 172.21.15.103:0/3085294146 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7210 0x56386d0a75f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 -- 172.21.15.103:0/3085294146 >> 172.21.15.103:0/3085294146 conn(0x56386d0a37a0 msgr2=0x56386d0a3b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 -- 172.21.15.103:0/3085294146 shutdown_connections 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.809+0000 7f33999f3740 1 -- 172.21.15.103:0/3085294146 wait complete. 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 1 -- start start 2024-08-02T18:51:21.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 1 Processor -- start 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0af270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x56386d0b4d80 con 0x56386d0a7210 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x56386cfc7aa0 con 0x56386d0a7b30 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x56386d0b4f00 con 0x56386d0b23f0 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f33999f3740 10 client.0 _ll_register_callbacks cb 0x56386cfb6e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3395391640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0af270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.819 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3395391640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0af270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40280/0 (socket says 172.21.15.103:40280) 2024-08-02T18:51:21.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3395391640 1 -- 172.21.15.103:0/1548653450 learned_addr learned my addr 172.21.15.103:0/1548653450 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:21.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3395b92640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3394b90640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3395391640 1 -- 172.21.15.103:0/1548653450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 msgr2=0x56386d0afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:21.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3395391640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3395391640 1 -- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 msgr2=0x56386d0af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:21.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.810+0000 7f3395391640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.820 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3395391640 1 -- 172.21.15.103:0/1548653450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56386cfab650 con 0x56386d0a7210 2024-08-02T18:51:21.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3394b90640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:21.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3395b92640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:21.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3395391640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0af270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f338c005ec0 tx=0x7f338c03bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c861c883f5e25cf server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:21.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:21.821 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3378ff9640 1 -- 172.21.15.103:0/1548653450 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c0d8030 con 0x56386d0a7210 2024-08-02T18:51:21.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 1 -- 172.21.15.103:0/1548653450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f338c0bbdd0 con 0x56386d0a7210 2024-08-02T18:51:21.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3378ff9640 1 -- 172.21.15.103:0/1548653450 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f338c0ba0d0 con 0x56386d0a7210 2024-08-02T18:51:21.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3378ff9640 1 -- 172.21.15.103:0/1548653450 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f338c049070 con 0x56386d0a7210 2024-08-02T18:51:21.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 10 client.15969 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:21.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 1 -- 172.21.15.103:0/1548653450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56386cd7e3c0 con 0x56386d0a7210 2024-08-02T18:51:21.822 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3378ff9640 1 -- 172.21.15.103:0/1548653450 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f338c0bbdd0 con 0x56386d0a7210 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f3378ff9640 1 -- 172.21.15.103:0/1548653450 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f338c0d1020 con 0x56386d0a7210 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 10 client.15969 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 10 client.15969 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 20 client.15969 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56386d0c1a20 0x56386d0c3e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 4 client.15969 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.811+0000 7f33999f3740 1 -- 172.21.15.103:0/1548653450 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56386d019ef0 con 0x56386d0c1a20 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.812+0000 7f3394b90640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56386d0c1a20 0x56386d0c3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.812+0000 7f3378ff9640 10 client.15969 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.812+0000 7f3394b90640 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56386d0c1a20 0x56386d0c3e10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=eeb20528181cbc8a server_cookie=a8f11e6938453fd5 in_seq=0 out_seq=0 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f3378ff9640 1 -- 172.21.15.103:0/1548653450 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x56386d019ef0 con 0x56386d0c1a20 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f3378ff9640 10 client.15969 handle_command_reply: tid=0 2024-08-02T18:51:21.823 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 client.15969 shutdown 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 -- 172.21.15.103:0/1548653450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 msgr2=0x56386d0af270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0af270 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f338c005ec0 tx=0x7f338c03bf80 comp rx=0 tx=0).stop 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 -- 172.21.15.103:0/1548653450 shutdown_connections 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56386d0c1a20 0x56386d0c3e10 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 --2- 172.21.15.103:0/1548653450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0af270 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 -- 172.21.15.103:0/1548653450 >> 172.21.15.103:0/1548653450 conn(0x56386d0a37a0 msgr2=0x56386d0a9480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f3378ff9640 0 client.15969 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 -- 172.21.15.103:0/1548653450 shutdown_connections 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 1 -- 172.21.15.103:0/1548653450 wait complete. 2024-08-02T18:51:21.824 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.813+0000 7f33999f3740 20 client.15969 trim_cache size 0 max 16384 2024-08-02T18:51:21.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.830+0000 7f33999f3740 1 Processor -- start 2024-08-02T18:51:21.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.830+0000 7f33999f3740 1 -- start start 2024-08-02T18:51:21.833 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.830+0000 7f33999f3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0b1490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.830+0000 7f33999f3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.830+0000 7f33999f3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0c9b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.830+0000 7f33999f3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f33901b37b0 con 0x56386d0a7210 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.830+0000 7f33999f3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33901b1080 con 0x56386d0a7b30 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.830+0000 7f33999f3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f33901aeed0 con 0x56386d0b23f0 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0b1490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0b1490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40292/0 (socket says 172.21.15.103:40292) 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 -- 172.21.15.103:0/3172317125 learned_addr learned my addr 172.21.15.103:0/3172317125 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395b92640 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0c9b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 -- 172.21.15.103:0/3172317125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 msgr2=0x56386d0c9b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0c9b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.834 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3394b90640 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 -- 172.21.15.103:0/3172317125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 msgr2=0x56386d0c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 -- 172.21.15.103:0/3172317125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56386d0a7960 con 0x56386d0a7210 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3394b90640 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f3395391640 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0b1490 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f338c0ba080 tx=0x7f338c0bb910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36f71d0c5774c9a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f337affd640 1 -- 172.21.15.103:0/3172317125 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c0d8070 con 0x56386d0a7210 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f337affd640 1 -- 172.21.15.103:0/3172317125 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f338c0b8440 con 0x56386d0a7210 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.831+0000 7f337affd640 1 -- 172.21.15.103:0/3172317125 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f338c03b460 con 0x56386d0a7210 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 -- 172.21.15.103:0/3172317125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 msgr2=0x56386d0b1490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0b1490 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7f338c0ba080 tx=0x7f338c0bb910 comp rx=0 tx=0).stop 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 -- 172.21.15.103:0/3172317125 shutdown_connections 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0b23f0 0x56386d0c9b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0a7b30 0x56386d0c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.835 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 --2- 172.21.15.103:0/3172317125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7210 0x56386d0b1490 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 -- 172.21.15.103:0/3172317125 >> 172.21.15.103:0/3172317125 conn(0x56386d0a37a0 msgr2=0x56386d0ae230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:21.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 -- 172.21.15.103:0/3172317125 shutdown_connections 2024-08-02T18:51:21.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 -- 172.21.15.103:0/3172317125 wait complete. 2024-08-02T18:51:21.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 -- start start 2024-08-02T18:51:21.836 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.832+0000 7f33999f3740 1 Processor -- start 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f33999f3740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7210 0x56386d0abc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f33999f3740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7b30 0x56386d0ac180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f33999f3740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0b23f0 0x56386d0b90c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f33999f3740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f33901af540 con 0x56386d0a7b30 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f33999f3740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f33901b09b0 con 0x56386d0b23f0 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f33999f3740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f33901afc10 con 0x56386d0a7210 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f33999f3740 10 client.0 _ll_register_callbacks cb 0x7f3388009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7b30 0x56386d0ac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.839 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3395391640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7210 0x56386d0abc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7b30 0x56386d0ac180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40298/0 (socket says 172.21.15.103:40298) 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3395391640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7210 0x56386d0abc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:51748/0 (socket says 172.21.15.103:51748) 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 -- 172.21.15.103:0/2685989538 learned_addr learned my addr 172.21.15.103:0/2685989538 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3395b92640 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0b23f0 0x56386d0b90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 -- 172.21.15.103:0/2685989538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7210 msgr2=0x56386d0abc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7210 0x56386d0abc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 -- 172.21.15.103:0/2685989538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0b23f0 msgr2=0x56386d0b90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0b23f0 0x56386d0b90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 -- 172.21.15.103:0/2685989538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56386d0b9680 con 0x56386d0a7b30 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3394b90640 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7b30 0x56386d0ac180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3380010970 tx=0x7f3380015070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20d18401b31d91e5 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.833+0000 7f3378ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f3378ff9640 1 -- 172.21.15.103:0/2685989538 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3380005220 con 0x56386d0a7b30 2024-08-02T18:51:21.840 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 1 -- 172.21.15.103:0/2685989538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f338c0b8440 con 0x56386d0a7b30 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f3378ff9640 1 -- 172.21.15.103:0/2685989538 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f33800053c0 con 0x56386d0a7b30 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f3378ff9640 1 -- 172.21.15.103:0/2685989538 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f3380037050 con 0x56386d0a7b30 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 10 client.15975 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 1 -- 172.21.15.103:0/2685989538 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x56386d0ba960 con 0x56386d0a7b30 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f3378ff9640 1 -- 172.21.15.103:0/2685989538 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f338c0b8440 con 0x56386d0a7b30 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f3378ff9640 1 -- 172.21.15.103:0/2685989538 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f338002a9e0 con 0x56386d0a7b30 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 10 client.15975 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 10 client.15975 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 20 client.15975 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56386d12c7a0 0x56386d12ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 4 client.15975 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f33999f3740 1 -- 172.21.15.103:0/2685989538 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub status"}) -- 0x56386d014400 con 0x56386d12c7a0 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.834+0000 7f3395391640 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56386d12c7a0 0x56386d12ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:21.841 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f3378ff9640 10 client.15975 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f3395391640 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56386d12c7a0 0x56386d12ebc0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f89d3beed322713d server_cookie=14664a12bd797912 in_seq=0 out_seq=0 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f3378ff9640 1 -- 172.21.15.103:0/2685989538 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x56386d014400 con 0x56386d12c7a0 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f3378ff9640 10 client.15975 handle_command_reply: tid=0 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 client.15975 shutdown 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 -- 172.21.15.103:0/2685989538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7b30 msgr2=0x56386d0ac180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7b30 0x56386d0ac180 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f3380010970 tx=0x7f3380015070 comp rx=0 tx=0).stop 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 -- 172.21.15.103:0/2685989538 shutdown_connections 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x56386d12c7a0 0x56386d12ebc0 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x56386d0b23f0 0x56386d0b90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f3378ff9640 0 client.15975 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x56386d0a7b30 0x56386d0ac180 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 --2- 172.21.15.103:0/2685989538 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x56386d0a7210 0x56386d0abc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.842 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 -- 172.21.15.103:0/2685989538 >> 172.21.15.103:0/2685989538 conn(0x56386d0a37a0 msgr2=0x56386d0ada10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:21.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 -- 172.21.15.103:0/2685989538 shutdown_connections 2024-08-02T18:51:21.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 1 -- 172.21.15.103:0/2685989538 wait complete. 2024-08-02T18:51:21.843 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.835+0000 7f33999f3740 20 client.15975 trim_cache size 0 max 16384 2024-08-02T18:51:21.843 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:51:21.843 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-08-02T18:51:21.843 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-08-02T18:51:21.844 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:51:21.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 -- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f337c0a2d70 msgr2=0x7f337c0a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f337c0a2d70 0x7f337c0a5230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f33900feab0 tx=0x7f33800103d0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.844 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 -- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 msgr2=0x7f3390100720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 0x7f3390100720 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7f338c004770 tx=0x7f338c032c90 comp rx=0 tx=0).stop 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 -- 172.21.15.103:0/4291851571 shutdown_connections 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f337c0a2d70 0x7f337c0a5230 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f339010bea0 0x7f33901011a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f33901033e0 0x7f3390100c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 --2- 172.21.15.103:0/4291851571 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f3390102ac0 0x7f3390100720 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 -- 172.21.15.103:0/4291851571 >> 172.21.15.103:0/4291851571 conn(0x7f33900fc4c0 msgr2=0x7f33900fdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 -- 172.21.15.103:0/4291851571 shutdown_connections 2024-08-02T18:51:21.845 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:21.836+0000 7f33975f5640 1 -- 172.21.15.103:0/4291851571 wait complete. 2024-08-02T18:51:22.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:21 smithi151 ceph-mon[37155]: scrub summary: idle 2024-08-02T18:51:22.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:21 smithi103 ceph-mon[32753]: scrub summary: idle 2024-08-02T18:51:22.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:21 smithi121 ceph-mon[37236]: scrub summary: idle 2024-08-02T18:51:22.489 INFO:tasks.workunit.client.0.smithi103.stderr:+ mkdir untar_tar 2024-08-02T18:51:22.492 INFO:tasks.workunit.client.0.smithi103.stderr:+ cd untar_tar 2024-08-02T18:51:22.492 INFO:tasks.workunit.client.0.smithi103.stderr:+ tar Jxvf ../linux-4.0.5.tar.xz linux-4.0.5/Documentation/ 2024-08-02T18:51:22.583 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ 2024-08-02T18:51:22.585 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/00-INDEX 2024-08-02T18:51:22.586 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/ 2024-08-02T18:51:22.587 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/README 2024-08-02T18:51:22.588 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/obsolete/ 2024-08-02T18:51:22.589 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/obsolete/proc-sys-vm-nr_pdflush_threads 2024-08-02T18:51:22.589 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-bus-usb 2024-08-02T18:51:22.590 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-class-rfkill 2024-08-02T18:51:22.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-koneplus 2024-08-02T18:51:22.592 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-kovaplus 2024-08-02T18:51:22.593 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/obsolete/sysfs-driver-hid-roccat-pyra 2024-08-02T18:51:22.594 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/removed/ 2024-08-02T18:51:22.595 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/removed/devfs 2024-08-02T18:51:22.596 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/removed/dv1394 2024-08-02T18:51:22.597 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/removed/ip_queue 2024-08-02T18:51:22.598 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/removed/net_dma 2024-08-02T18:51:22.599 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/removed/o2cb 2024-08-02T18:51:22.600 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/removed/raw1394 2024-08-02T18:51:22.601 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/removed/video1394 2024-08-02T18:51:22.602 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/ 2024-08-02T18:51:22.603 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/firewire-cdev 2024-08-02T18:51:22.603 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/o2cb 2024-08-02T18:51:22.604 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/syscalls 2024-08-02T18:51:22.605 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile 2024-08-02T18:51:22.606 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire 2024-08-02T18:51:22.607 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb 2024-08-02T18:51:22.608 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend 2024-08-02T18:51:22.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight 2024-08-02T18:51:22.610 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-02T18:51:22.610 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:51:22.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill 2024-08-02T18:51:22.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm 2024-08-02T18:51:22.613 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi 2024-08-02T18:51:22.613 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc 2024-08-02T18:51:22.614 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node 2024-08-02T18:51:22.615 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu 2024-08-02T18:51:22.616 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory 2024-08-02T18:51:22.617 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp 2024-08-02T18:51:22.617 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx 2024-08-02T18:51:22.618 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc 2024-08-02T18:51:22.619 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 2024-08-02T18:51:22.620 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars 2024-08-02T18:51:22.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump 2024-08-02T18:51:22.622 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog 2024-08-02T18:51:22.622 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-module 2024-08-02T18:51:22.623 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp 2024-08-02T18:51:22.624 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/thermal-notification 2024-08-02T18:51:22.625 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/stable/vdso 2024-08-02T18:51:22.626 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/ 2024-08-02T18:51:22.627 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget 2024-08-02T18:51:22.628 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget 2024-08-02T18:51:22.628 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm 2024-08-02T18:51:22.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm 2024-08-02T18:51:22.630 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-eem 2024-08-02T18:51:22.631 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ffs 2024-08-02T18:51:22.632 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-hid 2024-08-02T18:51:22.633 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback 2024-08-02T18:51:22.634 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage 2024-08-02T18:51:22.635 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi 2024-08-02T18:51:22.636 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ncm 2024-08-02T18:51:22.637 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-obex 2024-08-02T18:51:22.638 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-phonet 2024-08-02T18:51:22.639 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-rndis 2024-08-02T18:51:22.639 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial 2024-08-02T18:51:22.640 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-sourcesink 2024-08-02T18:51:22.641 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-subset 2024-08-02T18:51:22.642 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac1 2024-08-02T18:51:22.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 2024-08-02T18:51:22.644 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc 2024-08-02T18:51:22.645 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe 2024-08-02T18:51:22.645 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ec 2024-08-02T18:51:22.646 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad 2024-08-02T18:51:22.647 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-olpc 2024-08-02T18:51:22.648 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto 2024-08-02T18:51:22.649 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd 2024-08-02T18:51:22.650 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/dev-kmsg 2024-08-02T18:51:22.650 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/evm 2024-08-02T18:51:22.651 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/ima_policy 2024-08-02T18:51:22.652 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/procfs-diskstats 2024-08-02T18:51:22.653 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/pstore 2024-08-02T18:51:22.654 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ata 2024-08-02T18:51:22.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block 2024-08-02T18:51:22.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-bcache 2024-08-02T18:51:22.656 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-dm 2024-08-02T18:51:22.657 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-rssd 2024-08-02T18:51:22.658 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram 2024-08-02T18:51:22.659 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-acpi 2024-08-02T18:51:22.660 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-amba 2024-08-02T18:51:22.660 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma 2024-08-02T18:51:22.661 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 2024-08-02T18:51:22.662 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x 2024-08-02T18:51:22.663 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-funnel 2024-08-02T18:51:22.664 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-tmc 2024-08-02T18:51:22.665 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-css 2024-08-02T18:51:22.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-events 2024-08-02T18:51:22.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format 2024-08-02T18:51:22.667 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 2024-08-02T18:51:22.668 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci 2024-08-02T18:51:22.669 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe 2024-08-02T18:51:22.670 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-hsi 2024-08-02T18:51:22.670 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-fsa9480 2024-08-02T18:51:22.671 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-hm6352 2024-08-02T18:51:22.672 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 2024-08-02T18:51:22.673 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio 2024-08-02T18:51:22.674 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-accel-bmc150 2024-08-02T18:51:22.674 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-ad9523 2024-08-02T18:51:22.675 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-frequency-adf4350 2024-08-02T18:51:22.676 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 2024-08-02T18:51:22.677 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als 2024-08-02T18:51:22.678 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-mpu6050 2024-08-02T18:51:22.679 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-proximity-as3935 2024-08-02T18:51:22.680 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs 2024-08-02T18:51:22.680 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio 2024-08-02T18:51:22.681 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media 2024-08-02T18:51:22.682 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei 2024-08-02T18:51:22.683 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci 2024-08-02T18:51:22.684 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-devices-cciss 2024-08-02T18:51:22.685 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-pci-drivers-ehci_hcd 2024-08-02T18:51:22.685 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform 2024-08-02T18:51:22.686 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rbd 2024-08-02T18:51:22.687 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg 2024-08-02T18:51:22.688 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-umc 2024-08-02T18:51:22.689 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb 2024-08-02T18:51:22.690 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-devices-usbsevseg 2024-08-02T18:51:22.690 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-bus-usb-lvstest 2024-08-02T18:51:22.691 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-c2port 2024-08-02T18:51:22.692 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency 2024-08-02T18:51:22.693 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class 2024-08-02T18:51:22.694 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 2024-08-02T18:51:22.694 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-lm3533 2024-08-02T18:51:22.695 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi 2024-08-02T18:51:22.696 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-cxl 2024-08-02T18:51:22.697 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-devfreq 2024-08-02T18:51:22.698 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-extcon 2024-08-02T18:51:22.699 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu 2024-08-02T18:51:22.699 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-amd-iommu 2024-08-02T18:51:22.700 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu 2024-08-02T18:51:22.701 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd 2024-08-02T18:51:22.702 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led 2024-08-02T18:51:22.703 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 2024-08-02T18:51:22.703 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-leds-gt683r 2024-08-02T18:51:22.704 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mei 2024-08-02T18:51:22.705 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt 2024-08-02T18:51:22.706 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd 2024-08-02T18:51:22.707 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net 2024-08-02T18:51:22.707 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-batman-adv 2024-08-02T18:51:22.708 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-cdc_ncm 2024-08-02T18:51:22.709 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan 2024-08-02T18:51:22.710 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-mesh 2024-08-02T18:51:22.711 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-queues 2024-08-02T18:51:22.712 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics 2024-08-02T18:51:22.713 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd 2024-08-02T18:51:22.714 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-power 2024-08-02T18:51:22.714 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap 2024-08-02T18:51:22.715 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-pwm 2024-08-02T18:51:22.716 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rc 2024-08-02T18:51:22.717 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-regulator 2024-08-02T18:51:22.717 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration 2024-08-02T18:51:22.718 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-scsi_host 2024-08-02T18:51:22.719 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc 2024-08-02T18:51:22.720 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc-wusbhc 2024-08-02T18:51:22.721 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-dev 2024-08-02T18:51:22.721 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices 2024-08-02T18:51:22.722 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac 2024-08-02T18:51:22.723 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-firmware_node 2024-08-02T18:51:22.724 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-lpss_ltr 2024-08-02T18:51:22.724 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory 2024-08-02T18:51:22.725 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc 2024-08-02T18:51:22.726 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online 2024-08-02T18:51:22.727 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget 2024-08-02T18:51:22.728 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-docg3 2024-08-02T18:51:22.728 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb 2024-08-02T18:51:22.729 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power 2024-08-02T18:51:22.730 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D0 2024-08-02T18:51:22.731 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D1 2024-08-02T18:51:22.732 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 2024-08-02T18:51:22.733 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D3hot 2024-08-02T18:51:22.734 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup 2024-08-02T18:51:22.734 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_state 2024-08-02T18:51:22.735 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state 2024-08-02T18:51:22.735 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-resource_in_use 2024-08-02T18:51:22.736 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc 2024-08-02T18:51:22.737 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun 2024-08-02T18:51:22.738 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu 2024-08-02T18:51:22.739 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-ibm-rtl 2024-08-02T18:51:22.739 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu 2024-08-02T18:51:22.740 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe 2024-08-02T18:51:22.741 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid 2024-08-02T18:51:22.742 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo 2024-08-02T18:51:22.742 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-logitech-lg4ff 2024-08-02T18:51:22.743 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch 2024-08-02T18:51:22.744 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-picolcd 2024-08-02T18:51:22.745 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys 2024-08-02T18:51:22.746 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-arvo 2024-08-02T18:51:22.747 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku 2024-08-02T18:51:22.747 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone 2024-08-02T18:51:22.748 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus 2024-08-02T18:51:22.749 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure 2024-08-02T18:51:22.750 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus 2024-08-02T18:51:22.751 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-lua 2024-08-02T18:51:22.751 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-pyra 2024-08-02T18:51:22.869 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:22 smithi151 ceph-mon[37155]: pgmap v52: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-08-02T18:51:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:22 smithi103 ceph-mon[32753]: pgmap v52: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-08-02T18:51:23.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:22 smithi121 ceph-mon[37236]: pgmap v52: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-08-02T18:51:23.350 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 -- 172.21.15.103:0/805404841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 msgr2=0x7f1a40100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/805404841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 0x7f1a40100c10 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c009930 tx=0x7f1a2c02a420 comp rx=0 tx=0).stop 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 -- 172.21.15.103:0/805404841 shutdown_connections 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/805404841 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a40101150 0x7f1a4010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/805404841 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 0x7f1a40100c10 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/805404841 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a401067b0 0x7f1a40106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 -- 172.21.15.103:0/805404841 >> 172.21.15.103:0/805404841 conn(0x7f1a400fc4d0 msgr2=0x7f1a400fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 -- 172.21.15.103:0/805404841 shutdown_connections 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.328+0000 7f1a46d5a640 1 -- 172.21.15.103:0/805404841 wait complete. 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a46d5a640 1 Processor -- start 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a46d5a640 1 -- start start 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a46d5a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 0x7f1a40198290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a46d5a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a40101150 0x7f1a401987d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:23.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a46d5a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a401067b0 0x7f1a4019cb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a46d5a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a40111db0 con 0x7f1a401007b0 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a46d5a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a40111c30 con 0x7f1a40101150 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a46d5a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1a40111f30 con 0x7f1a401067b0 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a44af6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 0x7f1a40198290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a44af6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 0x7f1a40198290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40306/0 (socket says 172.21.15.103:40306) 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a44af6640 1 -- 172.21.15.103:0/1458605424 learned_addr learned my addr 172.21.15.103:0/1458605424 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a452f7640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a401067b0 0x7f1a4019cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a44af6640 1 -- 172.21.15.103:0/1458605424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a401067b0 msgr2=0x7f1a4019cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a44af6640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a401067b0 0x7f1a4019cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a3ffff640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a40101150 0x7f1a401987d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a44af6640 1 -- 172.21.15.103:0/1458605424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a40101150 msgr2=0x7f1a401987d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a44af6640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a40101150 0x7f1a401987d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.329+0000 7f1a44af6640 1 -- 172.21.15.103:0/1458605424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a4019d240 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.330+0000 7f1a44af6640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 0x7f1a40198290 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400d950 tx=0x7f1a3400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.330+0000 7f1a3dffb640 1 -- 172.21.15.103:0/1458605424 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34017030 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.330+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a4019d530 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.330+0000 7f1a3dffb640 1 -- 172.21.15.103:0/1458605424 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1a34004020 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.330+0000 7f1a3dffb640 1 -- 172.21.15.103:0/1458605424 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a34004a00 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.330+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a401a4e10 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.331+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a40100c10 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.332+0000 7f1a3dffb640 1 -- 172.21.15.103:0/1458605424 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f1a340041d0 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.333+0000 7f1a3dffb640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a300a2cf0 0x7f1a300a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.333+0000 7f1a3ffff640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a300a2cf0 0x7f1a300a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.333+0000 7f1a3dffb640 1 -- 172.21.15.103:0/1458605424 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f1a340cf1e0 con 0x7f1a401007b0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.334+0000 7f1a3ffff640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a300a2cf0 0x7f1a300a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c006010 tx=0x7f1a2c000bc0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:23.353 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.337+0000 7f1a3dffb640 1 -- 172.21.15.103:0/1458605424 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1a3400e350 con 0x7f1a401007b0 2024-08-02T18:51:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.539+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1a401995f0 con 0x7f1a401007b0 2024-08-02T18:51:23.541 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.540+0000 7f1a3dffb640 1 -- 172.21.15.103:0/1458605424 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) ==== 94+0+11933 (secure 0 0 0) 0x7f1a3409bac0 con 0x7f1a401007b0 2024-08-02T18:51:23.542 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:51:23.542 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":26,"btime":"2024-08-02T18:49:42:223973+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":26,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:49:42.173778+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":18,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":16,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24473,24469,24454]},"id":1}]} 2024-08-02T18:51:23.542 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 26 2024-08-02T18:51:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a300a2cf0 msgr2=0x7f1a300a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a300a2cf0 0x7f1a300a51b0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f1a2c006010 tx=0x7f1a2c000bc0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 msgr2=0x7f1a40198290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 0x7f1a40198290 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f1a3400d950 tx=0x7f1a3400de10 comp rx=0 tx=0).stop 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 shutdown_connections 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a300a2cf0 0x7f1a300a51b0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a401067b0 0x7f1a4019cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a40101150 0x7f1a401987d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 --2- 172.21.15.103:0/1458605424 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a401007b0 0x7f1a40198290 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 >> 172.21.15.103:0/1458605424 conn(0x7f1a400fc4d0 msgr2=0x7f1a400fcc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 shutdown_connections 2024-08-02T18:51:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:23.543+0000 7f1a46d5a640 1 -- 172.21.15.103:0/1458605424 wait complete. 2024-08-02T18:51:24.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:23 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1458605424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:24.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:23 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1458605424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:24.246 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-02T18:51:24.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:23 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1458605424' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:51:24.515 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos 2024-08-02T18:51:24.517 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-savu 2024-08-02T18:51:24.517 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 2024-08-02T18:51:24.518 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-wiimote 2024-08-02T18:51:24.519 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek 2024-08-02T18:51:24.520 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start 2024-08-02T18:51:24.520 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-pciback 2024-08-02T18:51:24.521 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-ppi 2024-08-02T18:51:24.522 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop 2024-08-02T18:51:24.523 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-sunxi-sid 2024-08-02T18:51:24.524 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse 2024-08-02T18:51:24.524 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-toshiba_acpi 2024-08-02T18:51:24.525 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-wacom 2024-08-02T18:51:24.526 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback 2024-08-02T18:51:24.527 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront 2024-08-02T18:51:24.528 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi 2024-08-02T18:51:24.529 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi 2024-08-02T18:51:24.529 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi 2024-08-02T18:51:24.530 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map 2024-08-02T18:51:24.531 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-gsmi 2024-08-02T18:51:24.532 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log 2024-08-02T18:51:24.533 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap 2024-08-02T18:51:24.534 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw 2024-08-02T18:51:24.534 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi 2024-08-02T18:51:24.535 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv 2024-08-02T18:51:24.536 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 2024-08-02T18:51:24.537 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs 2024-08-02T18:51:24.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-nilfs2 2024-08-02T18:51:24.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-fs-xfs 2024-08-02T18:51:24.539 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-gpio 2024-08-02T18:51:24.540 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 2024-08-02T18:51:24.541 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ibft 2024-08-02T18:51:24.542 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params 2024-08-02T18:51:24.543 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps 2024-08-02T18:51:24.543 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-iommu_groups 2024-08-02T18:51:24.544 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-livepatch 2024-08-02T18:51:24.545 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm 2024-08-02T18:51:24.546 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-hugepages 2024-08-02T18:51:24.547 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm 2024-08-02T18:51:24.547 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab 2024-08-02T18:51:24.548 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-uids 2024-08-02T18:51:24.549 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-vmcoreinfo 2024-08-02T18:51:24.550 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline 2024-08-02T18:51:24.551 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-module 2024-08-02T18:51:24.552 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 2024-08-02T18:51:24.552 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-laptop 2024-08-02T18:51:24.553 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi 2024-08-02T18:51:24.554 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 2024-08-02T18:51:24.555 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-brcmstb-gisb-arb 2024-08-02T18:51:24.556 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg 2024-08-02T18:51:24.556 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop 2024-08-02T18:51:24.557 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop 2024-08-02T18:51:24.558 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim 2024-08-02T18:51:24.559 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-msi-laptop 2024-08-02T18:51:24.560 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb 2024-08-02T18:51:24.560 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ts5500 2024-08-02T18:51:24.561 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-power 2024-08-02T18:51:24.562 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-pps 2024-08-02T18:51:24.563 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-profiling 2024-08-02T18:51:24.564 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-ptp 2024-08-02T18:51:24.565 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-tty 2024-08-02T18:51:24.565 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf 2024-08-02T18:51:24.566 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/BUG-HUNTING 2024-08-02T18:51:24.567 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/Changes 2024-08-02T18:51:24.568 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/CodeOfConflict 2024-08-02T18:51:24.569 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/CodingStyle 2024-08-02T18:51:24.569 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DMA-API-HOWTO.txt 2024-08-02T18:51:24.570 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DMA-API.txt 2024-08-02T18:51:24.571 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DMA-ISA-LPC.txt 2024-08-02T18:51:24.572 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DMA-attributes.txt 2024-08-02T18:51:24.573 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/ 2024-08-02T18:51:24.573 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/.gitignore 2024-08-02T18:51:24.574 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/80211.tmpl 2024-08-02T18:51:24.575 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/Makefile 2024-08-02T18:51:24.576 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl 2024-08-02T18:51:24.576 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/crypto-API.tmpl 2024-08-02T18:51:24.577 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/debugobjects.tmpl 2024-08-02T18:51:24.578 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/device-drivers.tmpl 2024-08-02T18:51:24.579 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl 2024-08-02T18:51:24.580 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/drm.tmpl 2024-08-02T18:51:24.582 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/filesystems.tmpl 2024-08-02T18:51:24.583 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/gadget.tmpl 2024-08-02T18:51:24.584 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/genericirq.tmpl 2024-08-02T18:51:24.584 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/kernel-api.tmpl 2024-08-02T18:51:24.585 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl 2024-08-02T18:51:24.586 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl 2024-08-02T18:51:24.587 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/kgdb.tmpl 2024-08-02T18:51:24.587 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/libata.tmpl 2024-08-02T18:51:24.588 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/librs.tmpl 2024-08-02T18:51:24.589 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:24.589 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/lsm.tmpl 2024-08-02T18:51:24.590 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/ 2024-08-02T18:51:24.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/Makefile 2024-08-02T18:51:24.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 2024-08-02T18:51:24.592 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 2024-08-02T18:51:24.593 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 2024-08-02T18:51:24.593 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ 2024-08-02T18:51:24.594 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore 2024-08-02T18:51:24.595 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml 2024-08-02T18:51:24.596 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml 2024-08-02T18:51:24.596 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml 2024-08-02T18:51:24.597 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml 2024-08-02T18:51:24.598 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml 2024-08-02T18:51:24.599 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf 2024-08-02T18:51:24.600 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml 2024-08-02T18:51:24.601 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml 2024-08-02T18:51:24.601 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml 2024-08-02T18:51:24.602 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml 2024-08-02T18:51:24.603 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/net.xml 2024-08-02T18:51:24.604 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvb/video.xml 2024-08-02T18:51:24.605 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 2024-08-02T18:51:24.606 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 2024-08-02T18:51:24.608 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 2024-08-02T18:51:24.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 2024-08-02T18:51:24.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 2024-08-02T18:51:24.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 2024-08-02T18:51:24.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/selection.png.b64 2024-08-02T18:51:24.612 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/ 2024-08-02T18:51:24.613 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore 2024-08-02T18:51:24.614 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml 2024-08-02T18:51:24.615 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml 2024-08-02T18:51:24.615 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/common.xml 2024-08-02T18:51:24.616 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml 2024-08-02T18:51:24.617 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml 2024-08-02T18:51:24.620 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf 2024-08-02T18:51:24.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml 2024-08-02T18:51:24.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml 2024-08-02T18:51:24.622 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml 2024-08-02T18:51:24.623 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml 2024-08-02T18:51:24.624 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml 2024-08-02T18:51:24.625 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml 2024-08-02T18:51:24.626 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml 2024-08-02T18:51:24.626 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml 2024-08-02T18:51:24.627 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml 2024-08-02T18:51:24.628 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml 2024-08-02T18:51:24.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml 2024-08-02T18:51:24.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml 2024-08-02T18:51:24.630 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml 2024-08-02T18:51:24.631 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml 2024-08-02T18:51:24.632 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml 2024-08-02T18:51:24.633 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml 2024-08-02T18:51:24.633 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf 2024-08-02T18:51:24.634 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf 2024-08-02T18:51:24.635 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml 2024-08-02T18:51:24.636 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml 2024-08-02T18:51:24.637 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml 2024-08-02T18:51:24.637 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml 2024-08-02T18:51:24.638 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml 2024-08-02T18:51:24.639 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml 2024-08-02T18:51:24.640 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml 2024-08-02T18:51:24.641 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml 2024-08-02T18:51:24.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml 2024-08-02T18:51:24.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml 2024-08-02T18:51:24.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/io.xml 2024-08-02T18:51:24.644 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml 2024-08-02T18:51:24.645 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml 2024-08-02T18:51:24.646 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml 2024-08-02T18:51:24.646 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml 2024-08-02T18:51:24.647 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml 2024-08-02T18:51:24.648 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml 2024-08-02T18:51:24.649 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml 2024-08-02T18:51:24.650 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml 2024-08-02T18:51:24.651 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml 2024-08-02T18:51:24.651 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml 2024-08-02T18:51:24.653 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml 2024-08-02T18:51:24.653 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf 2024-08-02T18:51:24.654 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml 2024-08-02T18:51:24.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml 2024-08-02T18:51:24.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml 2024-08-02T18:51:24.656 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml 2024-08-02T18:51:24.657 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml 2024-08-02T18:51:24.658 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml 2024-08-02T18:51:24.659 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml 2024-08-02T18:51:24.660 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml 2024-08-02T18:51:24.660 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml 2024-08-02T18:51:24.661 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml 2024-08-02T18:51:24.662 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml 2024-08-02T18:51:24.663 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml 2024-08-02T18:51:24.664 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml 2024-08-02T18:51:24.665 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml 2024-08-02T18:51:24.665 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml 2024-08-02T18:51:24.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml 2024-08-02T18:51:24.667 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml 2024-08-02T18:51:24.668 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml 2024-08-02T18:51:24.668 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml 2024-08-02T18:51:24.669 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml 2024-08-02T18:51:24.670 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml 2024-08-02T18:51:24.671 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml 2024-08-02T18:51:24.672 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml 2024-08-02T18:51:24.672 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml 2024-08-02T18:51:24.673 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml 2024-08-02T18:51:24.674 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml 2024-08-02T18:51:24.675 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml 2024-08-02T18:51:24.676 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml 2024-08-02T18:51:24.677 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml 2024-08-02T18:51:24.677 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml 2024-08-02T18:51:24.679 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml 2024-08-02T18:51:24.679 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml 2024-08-02T18:51:24.680 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml 2024-08-02T18:51:24.681 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml 2024-08-02T18:51:24.682 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml 2024-08-02T18:51:24.683 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml 2024-08-02T18:51:24.683 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml 2024-08-02T18:51:24.684 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml 2024-08-02T18:51:24.685 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml 2024-08-02T18:51:24.686 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml 2024-08-02T18:51:24.687 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml 2024-08-02T18:51:24.688 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml 2024-08-02T18:51:24.688 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml 2024-08-02T18:51:24.689 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml 2024-08-02T18:51:24.690 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml 2024-08-02T18:51:24.691 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml 2024-08-02T18:51:24.692 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml 2024-08-02T18:51:24.693 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia 2024-08-02T18:51:24.693 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg 2024-08-02T18:51:24.694 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia 2024-08-02T18:51:24.695 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg 2024-08-02T18:51:24.696 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia 2024-08-02T18:51:24.697 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg 2024-08-02T18:51:24.697 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml 2024-08-02T18:51:24.698 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml 2024-08-02T18:51:24.699 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf 2024-08-02T18:51:24.700 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf 2024-08-02T18:51:24.701 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf 2024-08-02T18:51:24.702 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml 2024-08-02T18:51:24.703 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml 2024-08-02T18:51:24.704 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml 2024-08-02T18:51:24.704 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml 2024-08-02T18:51:24.705 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml 2024-08-02T18:51:24.706 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml 2024-08-02T18:51:24.707 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml 2024-08-02T18:51:24.708 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml 2024-08-02T18:51:24.709 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml 2024-08-02T18:51:24.709 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml 2024-08-02T18:51:24.710 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml 2024-08-02T18:51:24.711 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml 2024-08-02T18:51:24.712 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml 2024-08-02T18:51:24.713 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml 2024-08-02T18:51:24.713 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml 2024-08-02T18:51:24.714 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml 2024-08-02T18:51:24.715 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml 2024-08-02T18:51:24.715 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml 2024-08-02T18:51:24.716 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml 2024-08-02T18:51:24.717 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml 2024-08-02T18:51:24.718 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml 2024-08-02T18:51:24.719 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml 2024-08-02T18:51:24.720 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml 2024-08-02T18:51:24.721 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml 2024-08-02T18:51:24.722 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml 2024-08-02T18:51:24.723 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml 2024-08-02T18:51:24.723 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml 2024-08-02T18:51:24.724 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml 2024-08-02T18:51:24.725 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml 2024-08-02T18:51:24.726 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml 2024-08-02T18:51:24.727 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml 2024-08-02T18:51:24.728 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml 2024-08-02T18:51:24.729 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml 2024-08-02T18:51:24.729 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml 2024-08-02T18:51:24.730 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml 2024-08-02T18:51:24.731 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml 2024-08-02T18:51:24.732 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml 2024-08-02T18:51:24.733 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml 2024-08-02T18:51:24.736 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml 2024-08-02T18:51:24.737 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml 2024-08-02T18:51:24.738 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml 2024-08-02T18:51:24.739 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml 2024-08-02T18:51:24.740 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml 2024-08-02T18:51:24.741 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml 2024-08-02T18:51:24.741 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml 2024-08-02T18:51:24.742 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querybuf.xml 2024-08-02T18:51:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:24 smithi151 ceph-mon[37155]: pgmap v53: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-08-02T18:51:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:24 smithi103 ceph-mon[32753]: pgmap v53: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-08-02T18:51:25.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:24 smithi121 ceph-mon[37236]: pgmap v53: 129 pgs: 129 active+clean; 1.4 MiB data, 369 MiB used, 1.0 TiB / 1.0 TiB avail; 2.8 KiB/s rd, 3.4 KiB/s wr, 7 op/s 2024-08-02T18:51:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- 172.21.15.103:0/3534311113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e201010b0 msgr2=0x7f0e2010d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 --2- 172.21.15.103:0/3534311113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e201010b0 0x7f0e2010d5e0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009cd0 tx=0x7f0e1802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- 172.21.15.103:0/3534311113 shutdown_connections 2024-08-02T18:51:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 --2- 172.21.15.103:0/3534311113 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e201010b0 0x7f0e2010d5e0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 --2- 172.21.15.103:0/3534311113 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e20100710 0x7f0e20100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 --2- 172.21.15.103:0/3534311113 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e20106720 0x7f0e20106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- 172.21.15.103:0/3534311113 >> 172.21.15.103:0/3534311113 conn(0x7f0e200fc3d0 msgr2=0x7f0e200fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:25.611 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- 172.21.15.103:0/3534311113 shutdown_connections 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- 172.21.15.103:0/3534311113 wait complete. 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 Processor -- start 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- start start 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e20100710 0x7f0e200fc8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e201010b0 0x7f0e200fce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e20106720 0x7f0e200fd370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e20110d00 con 0x7f0e20100710 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0e20110b80 con 0x7f0e20106720 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.608+0000 7f0e273a4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e20110e80 con 0x7f0e201010b0 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e20100710 0x7f0e200fc8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e20100710 0x7f0e200fc8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40328/0 (socket says 172.21.15.103:40328) 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 -- 172.21.15.103:0/19403641 learned_addr learned my addr 172.21.15.103:0/19403641 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:25.612 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e2493f640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e201010b0 0x7f0e200fce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25941640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e20106720 0x7f0e200fd370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 -- 172.21.15.103:0/19403641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e201010b0 msgr2=0x7f0e200fce30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e201010b0 0x7f0e200fce30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 -- 172.21.15.103:0/19403641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e20106720 msgr2=0x7f0e200fd370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e20106720 0x7f0e200fd370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 -- 172.21.15.103:0/19403641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e201a67a0 con 0x7f0e20100710 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25941640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e20106720 0x7f0e200fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e25140640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e20100710 0x7f0e200fc8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000b4a0 tx=0x7f0e1000b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e167fc640 1 -- 172.21.15.103:0/19403641 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e10015020 con 0x7f0e20100710 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e167fc640 1 -- 172.21.15.103:0/19403641 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e10011d30 con 0x7f0e20100710 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e273a4640 1 -- 172.21.15.103:0/19403641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0e201a6a90 con 0x7f0e20100710 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e167fc640 1 -- 172.21.15.103:0/19403641 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1000f2e0 con 0x7f0e20100710 2024-08-02T18:51:25.613 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.609+0000 7f0e273a4640 1 -- 172.21.15.103:0/19403641 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0e201a6f90 con 0x7f0e20100710 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.612+0000 7f0e167fc640 1 -- 172.21.15.103:0/19403641 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f0e10018020 con 0x7f0e20100710 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.612+0000 7f0e2a1d2740 1 Processor -- start 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e2a1d2740 1 -- start start 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809ccbb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809cd8d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b809c2f9b0 con 0x55b809ccb7b0 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b809bd7800 con 0x55b809cd6970 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b809c2b970 con 0x55b809ccc0d0 2024-08-02T18:51:25.619 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809ccbb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809ccbb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40332/0 (socket says 172.21.15.103:40332) 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 -- 172.21.15.103:0/3034010095 learned_addr learned my addr 172.21.15.103:0/3034010095 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25140640 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e167fc640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0e0c0a2da0 0x7f0e0c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e2493f640 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809cd8d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 -- 172.21.15.103:0/3034010095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 msgr2=0x55b809cd6430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd6430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 -- 172.21.15.103:0/3034010095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 msgr2=0x55b809cd8d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809cd8d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 -- 172.21.15.103:0/3034010095 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b809943210 con 0x55b809ccb7b0 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e167fc640 1 -- 172.21.15.103:0/19403641 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f0e100cef80 con 0x7f0e20100710 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.613+0000 7f0e25941640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0e0c0a2da0 0x7f0e0c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.620 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e25941640 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809ccbb90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0e180315c0 tx=0x7f0e180315f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1a3253e953b2717 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e0b7fe640 1 -- 172.21.15.103:0/3034010095 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1804d070 con 0x55b809ccb7b0 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e0b7fe640 1 -- 172.21.15.103:0/3034010095 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e18043070 con 0x55b809ccb7b0 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e0b7fe640 1 -- 172.21.15.103:0/3034010095 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e18047430 con 0x55b809ccb7b0 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e25941640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0e0c0a2da0 0x7f0e0c0a5260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e1804a000 tx=0x7f0e1804b000 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3034010095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 msgr2=0x55b809ccbb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809ccbb90 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f0e180315c0 tx=0x7f0e180315f0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3034010095 shutdown_connections 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809cd8d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd6430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3034010095 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809ccbb90 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.614+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3034010095 >> 172.21.15.103:0/3034010095 conn(0x55b809cc7d20 msgr2=0x55b809cc8100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3034010095 shutdown_connections 2024-08-02T18:51:25.621 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3034010095 wait complete. 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 -- start start 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 Processor -- start 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809ccb7b0 0x55b809cd3850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd3d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809cd6970 0x55b809cd42d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b809cd9540 con 0x55b809cd6970 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b809beb500 con 0x55b809ccb7b0 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b809cd96c0 con 0x55b809ccc0d0 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e2a1d2740 10 client.0 _ll_register_callbacks cb 0x55b809942a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e25941640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809cd6970 0x55b809cd42d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e25941640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809cd6970 0x55b809cd42d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40340/0 (socket says 172.21.15.103:40340) 2024-08-02T18:51:25.622 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.615+0000 7f0e25941640 1 -- 172.21.15.103:0/3281888915 learned_addr learned my addr 172.21.15.103:0/3281888915 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e2493f640 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e25941640 1 -- 172.21.15.103:0/3281888915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 msgr2=0x55b809cd3d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e25941640 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd3d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e25941640 1 -- 172.21.15.103:0/3281888915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809ccb7b0 msgr2=0x55b809cd3850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e25941640 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809ccb7b0 0x55b809cd3850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e25941640 1 -- 172.21.15.103:0/3281888915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b809a0f620 con 0x55b809cd6970 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e2493f640 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e25941640 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809cd6970 0x55b809cd42d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009590 tx=0x7f0e180095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64ac81d760503ca8 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e08ff9640 1 -- 172.21.15.103:0/3281888915 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1804d070 con 0x55b809cd6970 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e08ff9640 1 -- 172.21.15.103:0/3281888915 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f0e18047750 con 0x55b809cd6970 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3281888915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e18043070 con 0x55b809cd6970 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e08ff9640 1 -- 172.21.15.103:0/3281888915 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e18061050 con 0x55b809cd6970 2024-08-02T18:51:25.623 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e2a1d2740 10 client.15993 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3281888915 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b809ce5190 con 0x55b809cd6970 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.616+0000 7f0e08ff9640 1 -- 172.21.15.103:0/3281888915 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e18043070 con 0x55b809cd6970 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e08ff9640 1 -- 172.21.15.103:0/3281888915 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0e18030070 con 0x55b809cd6970 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e2a1d2740 10 client.15993 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e2a1d2740 10 client.15993 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e2a1d2740 20 client.15993 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b809ce64e0 0x55b809ce88d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e2a1d2740 4 client.15993 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3281888915 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b809c3d0e0 con 0x55b809ce64e0 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e25140640 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b809ce64e0 0x55b809ce88d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e08ff9640 10 client.15993 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:25.624 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.617+0000 7f0e25140640 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b809ce64e0 0x55b809ce88d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42063062408d6ca6 server_cookie=17d461df917a0333 in_seq=0 out_seq=0 2024-08-02T18:51:25.625 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e08ff9640 1 -- 172.21.15.103:0/3281888915 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b809c3d0e0 con 0x55b809ce64e0 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e08ff9640 10 client.15993 handle_command_reply: tid=0 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 client.15993 shutdown 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3281888915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809cd6970 msgr2=0x55b809cd42d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809cd6970 0x55b809cd42d0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f0e18009590 tx=0x7f0e180095c0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3281888915 shutdown_connections 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b809ce64e0 0x55b809ce88d0 crc :-1 s=READY pgs=80 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809cd6970 0x55b809cd42d0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cd3d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e08ff9640 0 client.15993 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3281888915 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809ccb7b0 0x55b809cd3850 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3281888915 >> 172.21.15.103:0/3281888915 conn(0x55b809cc7d20 msgr2=0x55b809ccda30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:25.626 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3281888915 shutdown_connections 2024-08-02T18:51:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.618+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3281888915 wait complete. 2024-08-02T18:51:25.627 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.619+0000 7f0e2a1d2740 20 client.15993 trim_cache size 0 max 16384 2024-08-02T18:51:25.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.633+0000 7f0e2a1d2740 1 Processor -- start 2024-08-02T18:51:25.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.633+0000 7f0e2a1d2740 1 -- start start 2024-08-02T18:51:25.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cd56b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cedfc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.636 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809cee500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201b3860 con 0x55b809ccb7b0 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201b1130 con 0x55b809cd6970 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201aef80 con 0x55b809ccc0d0 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cd56b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cd56b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40356/0 (socket says 172.21.15.103:40356) 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 -- 172.21.15.103:0/3779715215 learned_addr learned my addr 172.21.15.103:0/3779715215 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 -- 172.21.15.103:0/3779715215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 msgr2=0x55b809cedfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 --2- 172.21.15.103:0/3779715215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cedfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 -- 172.21.15.103:0/3779715215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 msgr2=0x55b809cee500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 --2- 172.21.15.103:0/3779715215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809cee500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.637 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 -- 172.21.15.103:0/3779715215 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b809cc8dd0 con 0x55b809ccb7b0 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e25140640 1 --2- 172.21.15.103:0/3779715215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cd56b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000bda0 tx=0x7f0e100047d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad7d9d276df81c9 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e0affd640 1 -- 172.21.15.103:0/3779715215 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e1009f620 con 0x55b809ccb7b0 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e0affd640 1 -- 172.21.15.103:0/3779715215 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e100a3ee0 con 0x55b809ccb7b0 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.634+0000 7f0e0affd640 1 -- 172.21.15.103:0/3779715215 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100978e0 con 0x55b809ccb7b0 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3779715215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 msgr2=0x55b809cd56b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3779715215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cd56b0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000bda0 tx=0x7f0e100047d0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3779715215 shutdown_connections 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3779715215 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809cee500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3779715215 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cedfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/3779715215 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cd56b0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3779715215 >> 172.21.15.103:0/3779715215 conn(0x55b809cc7d20 msgr2=0x55b809cd4fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3779715215 shutdown_connections 2024-08-02T18:51:25.638 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/3779715215 wait complete. 2024-08-02T18:51:25.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 -- start start 2024-08-02T18:51:25.639 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.635+0000 7f0e2a1d2740 1 Processor -- start 2024-08-02T18:51:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cdaa00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cdaf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2a1d2740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809d4ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201af5f0 con 0x55b809ccb7b0 2024-08-02T18:51:25.641 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201b0a60 con 0x55b809cd6970 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2a1d2740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0e201afcc0 con 0x55b809ccc0d0 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2a1d2740 10 client.0 _ll_register_callbacks cb 0x7f0e1804b070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cdaa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cdaa00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40362/0 (socket says 172.21.15.103:40362) 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 -- 172.21.15.103:0/1698018999 learned_addr learned my addr 172.21.15.103:0/1698018999 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25941640 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809d4ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2493f640 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cdaf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 -- 172.21.15.103:0/1698018999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 msgr2=0x55b809cdaf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cdaf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 -- 172.21.15.103:0/1698018999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 msgr2=0x55b809d4ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809d4ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 -- 172.21.15.103:0/1698018999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b809cdb800 con 0x55b809ccb7b0 2024-08-02T18:51:25.642 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2493f640 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cdaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e25140640 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cdaa00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0e100a39b0 tx=0x7f0e1009b330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a20c74413722494 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e08ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e08ff9640 1 -- 172.21.15.103:0/1698018999 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0e100cc680 con 0x55b809ccb7b0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e08ff9640 1 -- 172.21.15.103:0/1698018999 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f0e100105a0 con 0x55b809ccb7b0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.636+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/1698018999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f0e100a3ee0 con 0x55b809ccb7b0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e08ff9640 1 -- 172.21.15.103:0/1698018999 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f0e100978e0 con 0x55b809ccb7b0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2a1d2740 10 client.15999 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/1698018999 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b809d515e0 con 0x55b809ccb7b0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e08ff9640 1 -- 172.21.15.103:0/1698018999 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0e100a3ee0 con 0x55b809ccb7b0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e08ff9640 1 -- 172.21.15.103:0/1698018999 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f0e100bb0b0 con 0x55b809ccb7b0 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2a1d2740 10 client.15999 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2a1d2740 10 client.15999 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:25.643 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2a1d2740 20 client.15999 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b809d51cf0 0x55b809d540e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2a1d2740 4 client.15999 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:51:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/1698018999 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55b809c37430 con 0x55b809d51cf0 2024-08-02T18:51:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2493f640 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b809d51cf0 0x55b809d540e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e08ff9640 10 client.15999 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:25.644 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:25.637+0000 7f0e2493f640 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b809d51cf0 0x55b809d540e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b8f8b5213c974b1c server_cookie=adeaf2147fcd3703 in_seq=0 out_seq=0 2024-08-02T18:51:25.859 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querycap.xml 2024-08-02T18:51:25.860 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-queryctrl.xml 2024-08-02T18:51:25.861 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-querystd.xml 2024-08-02T18:51:25.862 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-reqbufs.xml 2024-08-02T18:51:25.863 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-s-hw-freq-seek.xml 2024-08-02T18:51:25.864 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-streamon.xml 2024-08-02T18:51:25.865 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-interval.xml 2024-08-02T18:51:25.866 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-frame-size.xml 2024-08-02T18:51:25.867 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-enum-mbus-code.xml 2024-08-02T18:51:25.868 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-crop.xml 2024-08-02T18:51:25.869 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-fmt.xml 2024-08-02T18:51:25.870 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-frame-interval.xml 2024-08-02T18:51:25.871 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subdev-g-selection.xml 2024-08-02T18:51:25.872 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-subscribe-event.xml 2024-08-02T18:51:25.873 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_525.gif.b64 2024-08-02T18:51:25.874 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_625.gif.b64 2024-08-02T18:51:25.875 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media/vbi_hsync.gif.b64 2024-08-02T18:51:25.876 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/media_api.tmpl 2024-08-02T18:51:25.877 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/mtdnand.tmpl 2024-08-02T18:51:25.878 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/networking.tmpl 2024-08-02T18:51:25.878 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/rapidio.tmpl 2024-08-02T18:51:25.879 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/regulator.tmpl 2024-08-02T18:51:25.880 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/s390-drivers.tmpl 2024-08-02T18:51:25.881 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/scsi.tmpl 2024-08-02T18:51:25.882 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/sh.tmpl 2024-08-02T18:51:25.883 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/stylesheet.xsl 2024-08-02T18:51:25.884 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/tracepoint.tmpl 2024-08-02T18:51:25.884 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/uio-howto.tmpl 2024-08-02T18:51:25.885 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/usb.tmpl 2024-08-02T18:51:25.886 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/w1.tmpl 2024-08-02T18:51:25.887 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/writing-an-alsa-driver.tmpl 2024-08-02T18:51:25.889 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/writing_musb_glue_layer.tmpl 2024-08-02T18:51:25.890 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/writing_usb_driver.tmpl 2024-08-02T18:51:25.891 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/DocBook/z8530book.tmpl 2024-08-02T18:51:25.892 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/ 2024-08-02T18:51:25.893 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/1024x768.S 2024-08-02T18:51:25.894 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/1280x1024.S 2024-08-02T18:51:25.895 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/1600x1200.S 2024-08-02T18:51:25.896 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/1680x1050.S 2024-08-02T18:51:25.897 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/1920x1080.S 2024-08-02T18:51:25.897 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/800x600.S 2024-08-02T18:51:25.898 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/HOWTO.txt 2024-08-02T18:51:25.899 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/Makefile 2024-08-02T18:51:25.900 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/edid.S 2024-08-02T18:51:25.901 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/EDID/hex 2024-08-02T18:51:25.902 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/HOWTO 2024-08-02T18:51:25.903 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/IPMI.txt 2024-08-02T18:51:25.904 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/IRQ-affinity.txt 2024-08-02T18:51:25.904 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/IRQ-domain.txt 2024-08-02T18:51:25.905 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/IRQ.txt 2024-08-02T18:51:25.906 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/Intel-IOMMU.txt 2024-08-02T18:51:25.907 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/Makefile 2024-08-02T18:51:25.908 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ManagementStyle 2024-08-02T18:51:25.909 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/PCI/ 2024-08-02T18:51:25.910 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/PCI/00-INDEX 2024-08-02T18:51:25.911 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/PCI/MSI-HOWTO.txt 2024-08-02T18:51:25.912 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/PCI/PCIEBUS-HOWTO.txt 2024-08-02T18:51:25.913 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/PCI/pci-error-recovery.txt 2024-08-02T18:51:25.914 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/PCI/pci-iov-howto.txt 2024-08-02T18:51:25.915 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/PCI/pci.txt 2024-08-02T18:51:25.916 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/PCI/pcieaer-howto.txt 2024-08-02T18:51:25.918 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/ 2024-08-02T18:51:25.920 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/00-INDEX 2024-08-02T18:51:25.921 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/NMI-RCU.txt 2024-08-02T18:51:25.923 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/RTFP.txt 2024-08-02T18:51:25.931 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/UP.txt 2024-08-02T18:51:25.935 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/arrayRCU.txt 2024-08-02T18:51:25.940 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/checklist.txt 2024-08-02T18:51:25.948 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/listRCU.txt 2024-08-02T18:51:25.957 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/lockdep-splat.txt 2024-08-02T18:51:25.964 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/lockdep.txt 2024-08-02T18:51:25.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/rcu.txt 2024-08-02T18:51:25.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/rcu_dereference.txt 2024-08-02T18:51:25.970 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/rcubarrier.txt 2024-08-02T18:51:25.972 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/rculist_nulls.txt 2024-08-02T18:51:25.973 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/rcuref.txt 2024-08-02T18:51:25.975 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/stallwarn.txt 2024-08-02T18:51:25.976 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/torture.txt 2024-08-02T18:51:25.977 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/trace.txt 2024-08-02T18:51:25.978 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/RCU/whatisRCU.txt 2024-08-02T18:51:25.980 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/SAK.txt 2024-08-02T18:51:25.981 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/SM501.txt 2024-08-02T18:51:25.982 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/SecurityBugs 2024-08-02T18:51:25.983 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/SubmitChecklist 2024-08-02T18:51:25.984 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/SubmittingDrivers 2024-08-02T18:51:25.986 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/SubmittingPatches 2024-08-02T18:51:25.987 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/VGA-softcursor.txt 2024-08-02T18:51:25.988 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/accounting/ 2024-08-02T18:51:25.989 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/accounting/.gitignore 2024-08-02T18:51:25.990 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/accounting/Makefile 2024-08-02T18:51:25.992 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/accounting/cgroupstats.txt 2024-08-02T18:51:25.993 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/accounting/delay-accounting.txt 2024-08-02T18:51:25.994 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/accounting/getdelays.c 2024-08-02T18:51:25.995 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/accounting/taskstats-struct.txt 2024-08-02T18:51:25.997 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/accounting/taskstats.txt 2024-08-02T18:51:25.998 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/ 2024-08-02T18:51:25.999 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/apei/ 2024-08-02T18:51:26.000 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/apei/einj.txt 2024-08-02T18:51:26.001 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/apei/output_format.txt 2024-08-02T18:51:26.002 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/debug.txt 2024-08-02T18:51:26.003 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/dsdt-override.txt 2024-08-02T18:51:26.004 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/enumeration.txt 2024-08-02T18:51:26.006 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/gpio-properties.txt 2024-08-02T18:51:26.008 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/initrd_table_override.txt 2024-08-02T18:51:26.008 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/method-customizing.txt 2024-08-02T18:51:26.009 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/method-tracing.txt 2024-08-02T18:51:26.010 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/namespace.txt 2024-08-02T18:51:26.012 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/scan_handlers.txt 2024-08-02T18:51:26.015 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/acpi/video_extension.txt 2024-08-02T18:51:26.016 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/aoe/ 2024-08-02T18:51:26.017 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/aoe/aoe.txt 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.016+0000 7f0e08ff9640 1 -- 172.21.15.103:0/1698018999 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55b809c37430 con 0x55b809d51cf0 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.016+0000 7f0e08ff9640 10 client.15999 handle_command_reply: tid=0 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.016+0000 7f0e2a1d2740 1 client.15999 shutdown 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/1698018999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 msgr2=0x55b809cdaa00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cdaa00 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f0e100a39b0 tx=0x7f0e1009b330 comp rx=0 tx=0).stop 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/1698018999 shutdown_connections 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b809d51cf0 0x55b809d540e0 crc :-1 s=READY pgs=81 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b809cd6970 0x55b809d4ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b809ccc0d0 0x55b809cdaf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e08ff9640 0 client.15999 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 --2- 172.21.15.103:0/1698018999 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b809ccb7b0 0x55b809cdaa00 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/1698018999 >> 172.21.15.103:0/1698018999 conn(0x55b809cc7d20 msgr2=0x55b809cd37f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/1698018999 shutdown_connections 2024-08-02T18:51:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 1 -- 172.21.15.103:0/1698018999 wait complete. 2024-08-02T18:51:26.020 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e2a1d2740 20 client.15999 trim_cache size 0 max 16384 2024-08-02T18:51:26.020 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/aoe/autoload.sh 2024-08-02T18:51:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:51:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:51:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:51:26.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:51:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e273a4640 1 -- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0e0c0a2da0 msgr2=0x7f0e0c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e273a4640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0e0c0a2da0 0x7f0e0c0a5260 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f0e1804a000 tx=0x7f0e1804b000 comp rx=0 tx=0).stop 2024-08-02T18:51:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e273a4640 1 -- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e20100710 msgr2=0x7f0e200fc8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.017+0000 7f0e273a4640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e20100710 0x7f0e200fc8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f0e1000b4a0 tx=0x7f0e1000b8a0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.018+0000 7f0e273a4640 1 -- 172.21.15.103:0/19403641 shutdown_connections 2024-08-02T18:51:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.018+0000 7f0e273a4640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0e0c0a2da0 0x7f0e0c0a5260 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.018+0000 7f0e273a4640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0e20106720 0x7f0e200fd370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.018+0000 7f0e273a4640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0e201010b0 0x7f0e200fce30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.018+0000 7f0e273a4640 1 --2- 172.21.15.103:0/19403641 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0e20100710 0x7f0e200fc8f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.018+0000 7f0e273a4640 1 -- 172.21.15.103:0/19403641 >> 172.21.15.103:0/19403641 conn(0x7f0e200fc3d0 msgr2=0x7f0e2006a210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.018+0000 7f0e273a4640 1 -- 172.21.15.103:0/19403641 shutdown_connections 2024-08-02T18:51:26.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:26.018+0000 7f0e273a4640 1 -- 172.21.15.103:0/19403641 wait complete. 2024-08-02T18:51:26.024 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/aoe/status.sh 2024-08-02T18:51:26.024 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/aoe/todo.txt 2024-08-02T18:51:26.024 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/aoe/udev-install.sh 2024-08-02T18:51:26.024 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/aoe/udev.txt 2024-08-02T18:51:26.024 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/applying-patches.txt 2024-08-02T18:51:26.025 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/ 2024-08-02T18:51:26.025 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/00-INDEX 2024-08-02T18:51:26.025 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Atmel/ 2024-08-02T18:51:26.025 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Atmel/README 2024-08-02T18:51:26.026 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Booting 2024-08-02T18:51:26.027 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/CCN.txt 2024-08-02T18:51:26.028 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/IXP4xx 2024-08-02T18:51:26.029 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Interrupts 2024-08-02T18:51:26.030 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Makefile 2024-08-02T18:51:26.032 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Marvell/ 2024-08-02T18:51:26.033 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Marvell/README 2024-08-02T18:51:26.034 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Netwinder 2024-08-02T18:51:26.036 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/OMAP/ 2024-08-02T18:51:26.037 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/OMAP/DSS 2024-08-02T18:51:26.038 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/OMAP/omap_pm 2024-08-02T18:51:26.040 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Porting 2024-08-02T18:51:26.041 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/README 2024-08-02T18:51:26.042 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/ 2024-08-02T18:51:26.043 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/ADSBitsy 2024-08-02T18:51:26.045 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/Assabet 2024-08-02T18:51:26.046 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/Brutus 2024-08-02T18:51:26.047 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/CERF 2024-08-02T18:51:26.049 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/FreeBird 2024-08-02T18:51:26.050 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsClient 2024-08-02T18:51:26.051 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/GraphicsMaster 2024-08-02T18:51:26.053 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/HUW_WEBPANEL 2024-08-02T18:51:26.054 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/Itsy 2024-08-02T18:51:26.055 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/LART 2024-08-02T18:51:26.056 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/PLEB 2024-08-02T18:51:26.058 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/Pangolin 2024-08-02T18:51:26.060 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/Tifon 2024-08-02T18:51:26.060 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/Victor 2024-08-02T18:51:26.062 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/Yopy 2024-08-02T18:51:26.063 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/empeg 2024-08-02T18:51:26.064 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/nanoEngine 2024-08-02T18:51:26.065 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SA1100/serial_UART 2024-08-02T18:51:26.067 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/ 2024-08-02T18:51:26.068 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/.gitignore 2024-08-02T18:51:26.069 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/Makefile 2024-08-02T18:51:26.071 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/vrl4.c 2024-08-02T18:51:26.072 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-mmcif.txt 2024-08-02T18:51:26.073 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SH-Mobile/zboot-rom-sdhi.txt 2024-08-02T18:51:26.074 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SPEAr/ 2024-08-02T18:51:26.075 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/SPEAr/overview.txt 2024-08-02T18:51:26.077 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/ 2024-08-02T18:51:26.078 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/CPUfreq.txt 2024-08-02T18:51:26.079 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/EB2410ITX.txt 2024-08-02T18:51:26.080 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/GPIO.txt 2024-08-02T18:51:26.082 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/H1940.txt 2024-08-02T18:51:26.083 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/NAND.txt 2024-08-02T18:51:26.084 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Overview.txt 2024-08-02T18:51:26.086 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2412.txt 2024-08-02T18:51:26.087 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/S3C2413.txt 2024-08-02T18:51:26.088 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/SMDK2440.txt 2024-08-02T18:51:26.090 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/Suspend.txt 2024-08-02T18:51:26.091 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung-S3C24XX/USB-Host.txt 2024-08-02T18:51:26.092 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung/ 2024-08-02T18:51:26.093 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung/GPIO.txt 2024-08-02T18:51:26.094 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung/Overview.txt 2024-08-02T18:51:26.097 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Samsung/clksrc-change-registers.awk 2024-08-02T18:51:26.097 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/Setup 2024-08-02T18:51:26.098 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/VFP/ 2024-08-02T18:51:26.100 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/VFP/release-notes.txt 2024-08-02T18:51:26.101 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/cluster-pm-race-avoidance.txt 2024-08-02T18:51:26.102 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/firmware.txt 2024-08-02T18:51:26.103 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/kernel_mode_neon.txt 2024-08-02T18:51:26.105 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/kernel_user_helpers.txt 2024-08-02T18:51:26.106 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/mem_alignment 2024-08-02T18:51:26.107 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/memory.txt 2024-08-02T18:51:26.109 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/msm/ 2024-08-02T18:51:26.110 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/msm/gpiomux.txt 2024-08-02T18:51:26.112 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/nwfpe/ 2024-08-02T18:51:26.112 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/nwfpe/NOTES 2024-08-02T18:51:26.114 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/nwfpe/README 2024-08-02T18:51:26.115 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/nwfpe/README.FPE 2024-08-02T18:51:26.116 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/nwfpe/TODO 2024-08-02T18:51:26.117 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/pxa/ 2024-08-02T18:51:26.118 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/pxa/mfp.txt 2024-08-02T18:51:26.120 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sti/ 2024-08-02T18:51:26.121 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sti/overview.txt 2024-08-02T18:51:26.122 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sti/stih407-overview.txt 2024-08-02T18:51:26.124 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sti/stih415-overview.txt 2024-08-02T18:51:26.125 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sti/stih416-overview.txt 2024-08-02T18:51:26.126 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sti/stih418-overview.txt 2024-08-02T18:51:26.128 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sunxi/ 2024-08-02T18:51:26.129 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sunxi/README 2024-08-02T18:51:26.130 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/sunxi/clocks.txt 2024-08-02T18:51:26.131 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/swp_emulation 2024-08-02T18:51:26.133 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/tcm.txt 2024-08-02T18:51:26.134 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/uefi.txt 2024-08-02T18:51:26.135 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm/vlocks.txt 2024-08-02T18:51:26.136 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm64/ 2024-08-02T18:51:26.138 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm64/booting.txt 2024-08-02T18:51:26.139 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm64/legacy_instructions.txt 2024-08-02T18:51:26.140 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm64/memory.txt 2024-08-02T18:51:26.141 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/arm64/tagged-pointers.txt 2024-08-02T18:51:26.143 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/assoc_array.txt 2024-08-02T18:51:26.144 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/atomic_ops.txt 2024-08-02T18:51:26.146 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/auxdisplay/ 2024-08-02T18:51:26.147 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/auxdisplay/.gitignore 2024-08-02T18:51:26.148 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/auxdisplay/Makefile 2024-08-02T18:51:26.149 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b 2024-08-02T18:51:26.151 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/auxdisplay/cfag12864b-example.c 2024-08-02T18:51:26.152 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/auxdisplay/ks0108 2024-08-02T18:51:26.153 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/backlight/ 2024-08-02T18:51:26.154 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/backlight/lp855x-driver.txt 2024-08-02T18:51:26.156 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/bad_memory.txt 2024-08-02T18:51:26.157 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/basic_profiling.txt 2024-08-02T18:51:26.158 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/bcache.txt 2024-08-02T18:51:26.160 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/binfmt_misc.txt 2024-08-02T18:51:26.161 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blackfin/ 2024-08-02T18:51:26.162 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blackfin/00-INDEX 2024-08-02T18:51:26.163 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blackfin/Makefile 2024-08-02T18:51:26.165 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blackfin/bfin-gpio-notes.txt 2024-08-02T18:51:26.166 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blackfin/bfin-spi-notes.txt 2024-08-02T18:51:26.167 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blackfin/gptimers-example.c 2024-08-02T18:51:26.169 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/ 2024-08-02T18:51:26.170 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/00-INDEX 2024-08-02T18:51:26.171 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/biodoc.txt 2024-08-02T18:51:26.172 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/biovecs.txt 2024-08-02T18:51:26.173 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/capability.txt 2024-08-02T18:51:26.175 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/cfq-iosched.txt 2024-08-02T18:51:26.176 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/cmdline-partition.txt 2024-08-02T18:51:26.177 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/data-integrity.txt 2024-08-02T18:51:26.178 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/deadline-iosched.txt 2024-08-02T18:51:26.180 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/ioprio.txt 2024-08-02T18:51:26.181 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/null_blk.txt 2024-08-02T18:51:26.182 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/queue-sysfs.txt 2024-08-02T18:51:26.183 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/request.txt 2024-08-02T18:51:26.185 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/stat.txt 2024-08-02T18:51:26.186 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/switching-sched.txt 2024-08-02T18:51:26.187 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/block/writeback_cache_control.txt 2024-08-02T18:51:26.188 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/ 2024-08-02T18:51:26.190 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/00-INDEX 2024-08-02T18:51:26.191 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/README.DAC960 2024-08-02T18:51:26.192 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/cciss.txt 2024-08-02T18:51:26.193 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/cpqarray.txt 2024-08-02T18:51:26.195 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/ 2024-08-02T18:51:26.196 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-8.3-data-packets.svg 2024-08-02T18:51:26.197 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/DRBD-data-packets.svg 2024-08-02T18:51:26.198 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/README.txt 2024-08-02T18:51:26.199 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/conn-states-8.dot 2024-08-02T18:51:26.201 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/data-structure-v9.txt 2024-08-02T18:51:26.202 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/disk-states-8.dot 2024-08-02T18:51:26.203 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/drbd-connection-state-overview.dot 2024-08-02T18:51:26.205 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/drbd/node-states-8.dot 2024-08-02T18:51:26.206 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/floppy.txt 2024-08-02T18:51:26.207 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/mflash.txt 2024-08-02T18:51:26.209 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/nbd.txt 2024-08-02T18:51:26.210 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/paride.txt 2024-08-02T18:51:26.211 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/ramdisk.txt 2024-08-02T18:51:26.212 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/blockdev/zram.txt 2024-08-02T18:51:26.213 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/braille-console.txt 2024-08-02T18:51:26.214 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/bt8xxgpio.txt 2024-08-02T18:51:26.215 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/btmrvl.txt 2024-08-02T18:51:26.216 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/bus-devices/ 2024-08-02T18:51:26.217 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/bus-devices/ti-gpmc.txt 2024-08-02T18:51:26.218 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/bus-virt-phys-mapping.txt 2024-08-02T18:51:26.219 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cachetlb.txt 2024-08-02T18:51:26.219 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cdrom/ 2024-08-02T18:51:26.220 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cdrom/00-INDEX 2024-08-02T18:51:26.221 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cdrom/Makefile 2024-08-02T18:51:26.222 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cdrom/cdrom-standard.tex 2024-08-02T18:51:26.223 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cdrom/ide-cd 2024-08-02T18:51:26.224 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cdrom/packet-writing.txt 2024-08-02T18:51:26.225 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/ 2024-08-02T18:51:26.226 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/00-INDEX 2024-08-02T18:51:26.226 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/blkio-controller.txt 2024-08-02T18:51:26.227 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/cgroups.txt 2024-08-02T18:51:26.228 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/cpuacct.txt 2024-08-02T18:51:26.229 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/cpusets.txt 2024-08-02T18:51:26.230 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/devices.txt 2024-08-02T18:51:26.231 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/freezer-subsystem.txt 2024-08-02T18:51:26.231 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/hugetlb.txt 2024-08-02T18:51:26.232 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/memcg_test.txt 2024-08-02T18:51:26.233 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/memory.txt 2024-08-02T18:51:26.234 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/net_cls.txt 2024-08-02T18:51:26.235 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/net_prio.txt 2024-08-02T18:51:26.236 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cgroups/unified-hierarchy.txt 2024-08-02T18:51:26.236 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/circular-buffers.txt 2024-08-02T18:51:26.237 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/clk.txt 2024-08-02T18:51:26.238 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/coccinelle.txt 2024-08-02T18:51:26.239 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/connector/ 2024-08-02T18:51:26.240 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/connector/.gitignore 2024-08-02T18:51:26.241 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/connector/Makefile 2024-08-02T18:51:26.242 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/connector/cn_test.c 2024-08-02T18:51:26.242 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/connector/connector.txt 2024-08-02T18:51:26.243 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/connector/ucon.c 2024-08-02T18:51:26.244 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/console/ 2024-08-02T18:51:26.245 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/console/console.txt 2024-08-02T18:51:26.246 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/ 2024-08-02T18:51:26.247 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/amd-powernow.txt 2024-08-02T18:51:26.247 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/boost.txt 2024-08-02T18:51:26.248 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/core.txt 2024-08-02T18:51:26.249 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/cpu-drivers.txt 2024-08-02T18:51:26.250 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-nforce2.txt 2024-08-02T18:51:26.250 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/cpufreq-stats.txt 2024-08-02T18:51:26.251 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/governors.txt 2024-08-02T18:51:26.252 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/index.txt 2024-08-02T18:51:26.253 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/intel-pstate.txt 2024-08-02T18:51:26.253 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/pcc-cpufreq.txt 2024-08-02T18:51:26.254 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-freq/user-guide.txt 2024-08-02T18:51:26.255 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-hotplug.txt 2024-08-02T18:51:26.256 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpu-load.txt 2024-08-02T18:51:26.257 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpuidle/ 2024-08-02T18:51:26.258 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpuidle/core.txt 2024-08-02T18:51:26.259 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpuidle/driver.txt 2024-08-02T18:51:26.259 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpuidle/governor.txt 2024-08-02T18:51:26.260 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cpuidle/sysfs.txt 2024-08-02T18:51:26.261 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cputopology.txt 2024-08-02T18:51:26.262 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/crc32.txt 2024-08-02T18:51:26.263 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cris/ 2024-08-02T18:51:26.264 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/cris/README 2024-08-02T18:51:26.265 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/crypto/ 2024-08-02T18:51:26.266 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/crypto/api-intro.txt 2024-08-02T18:51:26.267 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/crypto/asymmetric-keys.txt 2024-08-02T18:51:26.268 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/crypto/async-tx-api.txt 2024-08-02T18:51:26.269 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/crypto/crypto-API-userspace.txt 2024-08-02T18:51:26.269 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/crypto/descore-readme.txt 2024-08-02T18:51:26.270 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dcdbas.txt 2024-08-02T18:51:26.271 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/debugging-modules.txt 2024-08-02T18:51:26.272 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/debugging-via-ohci1394.txt 2024-08-02T18:51:26.273 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dell_rbu.txt 2024-08-02T18:51:26.274 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/ 2024-08-02T18:51:26.274 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/1.Intro 2024-08-02T18:51:26.275 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/2.Process 2024-08-02T18:51:26.276 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/3.Early-stage 2024-08-02T18:51:26.277 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/4.Coding 2024-08-02T18:51:26.278 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/5.Posting 2024-08-02T18:51:26.278 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/6.Followthrough 2024-08-02T18:51:26.279 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/7.AdvancedTopics 2024-08-02T18:51:26.280 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/development-process/8.Conclusion 2024-08-02T18:51:26.280 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/ 2024-08-02T18:51:26.281 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/cache-policies.txt 2024-08-02T18:51:26.282 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/cache.txt 2024-08-02T18:51:26.283 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/delay.txt 2024-08-02T18:51:26.284 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/dm-crypt.txt 2024-08-02T18:51:26.285 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/dm-flakey.txt 2024-08-02T18:51:26.285 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/dm-io.txt 2024-08-02T18:51:26.286 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/dm-log.txt 2024-08-02T18:51:26.287 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/dm-queue-length.txt 2024-08-02T18:51:26.288 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/dm-raid.txt 2024-08-02T18:51:26.289 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/dm-service-time.txt 2024-08-02T18:51:26.289 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/dm-uevent.txt 2024-08-02T18:51:26.290 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/era.txt 2024-08-02T18:51:26.291 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/kcopyd.txt 2024-08-02T18:51:26.292 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/linear.txt 2024-08-02T18:51:26.293 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/persistent-data.txt 2024-08-02T18:51:26.293 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/snapshot.txt 2024-08-02T18:51:26.294 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/statistics.txt 2024-08-02T18:51:26.295 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/striped.txt 2024-08-02T18:51:26.296 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/switch.txt 2024-08-02T18:51:26.297 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/thin-provisioning.txt 2024-08-02T18:51:26.298 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/verity.txt 2024-08-02T18:51:26.301 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/device-mapper/zero.txt 2024-08-02T18:51:26.301 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devices.txt 2024-08-02T18:51:26.302 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/ 2024-08-02T18:51:26.303 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/00-INDEX 2024-08-02T18:51:26.303 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ 2024-08-02T18:51:26.304 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ABI.txt 2024-08-02T18:51:26.305 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/ 2024-08-02T18:51:26.306 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/interrupts.txt 2024-08-02T18:51:26.306 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arc/pmu.txt 2024-08-02T18:51:26.307 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ 2024-08-02T18:51:26.308 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/adapteva.txt 2024-08-02T18:51:26.309 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/ 2024-08-02T18:51:26.309 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-clk-manager.txt 2024-08-02T18:51:26.310 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-sdram-edac.txt 2024-08-02T18:51:26.311 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/altera/socfpga-system.txt 2024-08-02T18:51:26.312 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/amlogic.txt 2024-08-02T18:51:26.313 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arch_timer.txt 2024-08-02T18:51:26.313 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/arm-boards 2024-08-02T18:51:26.314 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp-pmsu.txt 2024-08-02T18:51:26.315 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-370-xp.txt 2024-08-02T18:51:26.316 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-375.txt 2024-08-02T18:51:26.317 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-380-mpcore-soc-ctrl.txt 2024-08-02T18:51:26.317 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-38x.txt 2024-08-02T18:51:26.318 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armada-cpu-reset.txt 2024-08-02T18:51:26.319 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/armadeus.txt 2024-08-02T18:51:26.320 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-at91.txt 2024-08-02T18:51:26.321 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/atmel-pmc.txt 2024-08-02T18:51:26.321 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/axxia.txt 2024-08-02T18:51:26.322 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/ 2024-08-02T18:51:26.323 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm11351.txt 2024-08-02T18:51:26.324 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm21664.txt 2024-08-02T18:51:26.324 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/bcm63138.txt 2024-08-02T18:51:26.325 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/brcm,bcm11351-cpu-method 2024-08-02T18:51:26.326 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/cygnus.txt 2024-08-02T18:51:26.327 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-resetmgr.txt 2024-08-02T18:51:26.328 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-timer.txt 2024-08-02T18:51:26.328 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm/kona-wdt.txt 2024-08-02T18:51:26.329 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm2835.txt 2024-08-02T18:51:26.330 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/bcm4708.txt 2024-08-02T18:51:26.331 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/brcm-brcmstb.txt 2024-08-02T18:51:26.332 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda.txt 2024-08-02T18:51:26.332 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/ 2024-08-02T18:51:26.333 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/combophy.txt 2024-08-02T18:51:26.334 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/l2ecc.txt 2024-08-02T18:51:26.335 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/calxeda/mem-ctrlr.txt 2024-08-02T18:51:26.335 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cavium-thunder.txt 2024-08-02T18:51:26.336 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cci.txt 2024-08-02T18:51:26.337 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ccn.txt 2024-08-02T18:51:26.338 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coherency-fabric.txt 2024-08-02T18:51:26.339 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/coresight.txt 2024-08-02T18:51:26.339 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/ 2024-08-02T18:51:26.340 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpu-enable-method/marvell,berlin-smp 2024-08-02T18:51:26.341 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/cpus.txt 2024-08-02T18:51:26.342 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci.txt 2024-08-02T18:51:26.342 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/ 2024-08-02T18:51:26.343 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/davinci/cp-intc.txt 2024-08-02T18:51:26.344 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/digicolor.txt 2024-08-02T18:51:26.345 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/ 2024-08-02T18:51:26.345 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/power_domain.txt 2024-08-02T18:51:26.346 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/exynos/smp-sysram.txt 2024-08-02T18:51:26.347 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/ 2024-08-02T18:51:26.347 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/firmware/tlm,trusted-foundations.txt 2024-08-02T18:51:26.348 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fsl.txt 2024-08-02T18:51:26.349 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/fw-cfg.txt 2024-08-02T18:51:26.350 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/geniatech.txt 2024-08-02T18:51:26.351 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic-v3.txt 2024-08-02T18:51:26.352 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/gic.txt 2024-08-02T18:51:26.352 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/global_timer.txt 2024-08-02T18:51:26.353 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/ 2024-08-02T18:51:26.354 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/hisilicon/hisilicon.txt 2024-08-02T18:51:26.354 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/idle-states.txt 2024-08-02T18:51:26.355 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/insignal-boards.txt 2024-08-02T18:51:26.356 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/ 2024-08-02T18:51:26.357 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/keystone/keystone.txt 2024-08-02T18:51:26.358 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/kirkwood.txt 2024-08-02T18:51:26.359 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/l2cc.txt 2024-08-02T18:51:26.360 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx-mic.txt 2024-08-02T18:51:26.361 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/lpc32xx.txt 2024-08-02T18:51:26.362 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,berlin.txt 2024-08-02T18:51:26.362 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,dove.txt 2024-08-02T18:51:26.363 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/marvell,kirkwood.txt 2024-08-02T18:51:26.364 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek.txt 2024-08-02T18:51:26.365 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/ 2024-08-02T18:51:26.366 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mediatek/mediatek,sysirq.txt 2024-08-02T18:51:26.366 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/moxart.txt 2024-08-02T18:51:26.367 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/ 2024-08-02T18:51:26.368 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/feroceon.txt 2024-08-02T18:51:26.369 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/intc.txt 2024-08-02T18:51:26.369 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/mrvl.txt 2024-08-02T18:51:26.370 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/tauros2.txt 2024-08-02T18:51:26.371 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mrvl/timer.txt 2024-08-02T18:51:26.372 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ 2024-08-02T18:51:26.372 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,kpss-acc.txt 2024-08-02T18:51:26.374 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/qcom,saw2.txt 2024-08-02T18:51:26.374 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/ssbi.txt 2024-08-02T18:51:26.375 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/msm/timer.txt 2024-08-02T18:51:26.376 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/mvebu-system-controller.txt 2024-08-02T18:51:26.376 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/nspire.txt 2024-08-02T18:51:26.377 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/olimex.txt 2024-08-02T18:51:26.378 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/ 2024-08-02T18:51:26.379 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/counter.txt 2024-08-02T18:51:26.379 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/crossbar.txt 2024-08-02T18:51:26.380 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dmm.txt 2024-08-02T18:51:26.381 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/dsp.txt 2024-08-02T18:51:26.382 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/intc.txt 2024-08-02T18:51:26.383 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/iva.txt 2024-08-02T18:51:26.384 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/l3-noc.txt 2024-08-02T18:51:26.384 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/mpu.txt 2024-08-02T18:51:26.385 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/omap.txt 2024-08-02T18:51:26.386 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/prcm.txt 2024-08-02T18:51:26.387 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/omap/timer.txt 2024-08-02T18:51:26.387 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/picoxcell.txt 2024-08-02T18:51:26.388 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/pmu.txt 2024-08-02T18:51:26.389 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/primecell.txt 2024-08-02T18:51:26.392 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/psci.txt 2024-08-02T18:51:26.393 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip.txt 2024-08-02T18:51:26.394 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/ 2024-08-02T18:51:26.394 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu-sram.txt 2024-08-02T18:51:26.395 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/pmu.txt 2024-08-02T18:51:26.396 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rockchip/smp-sram.txt 2024-08-02T18:51:26.397 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/rtsm-dcscb.txt 2024-08-02T18:51:26.398 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung-boards.txt 2024-08-02T18:51:26.399 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/ 2024-08-02T18:51:26.399 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-adc.txt 2024-08-02T18:51:26.400 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/exynos-chipid.txt 2024-08-02T18:51:26.401 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/interrupt-combiner.txt 2024-08-02T18:51:26.401 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/pmu.txt 2024-08-02T18:51:26.402 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/samsung/sysreg.txt 2024-08-02T18:51:26.403 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/shmobile.txt 2024-08-02T18:51:26.404 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sirf.txt 2024-08-02T18:51:26.404 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-misc.txt 2024-08-02T18:51:26.405 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear-timer.txt 2024-08-02T18:51:26.406 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear.txt 2024-08-02T18:51:26.407 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/ 2024-08-02T18:51:26.407 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/spear/shirq.txt 2024-08-02T18:51:26.408 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sprd.txt 2024-08-02T18:51:26.409 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-nomadik.txt 2024-08-02T18:51:26.410 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ste-u300.txt 2024-08-02T18:51:26.411 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sti.txt 2024-08-02T18:51:26.411 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/sunxi.txt 2024-08-02T18:51:26.412 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra.txt 2024-08-02T18:51:26.413 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/ 2024-08-02T18:51:26.414 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-ahb.txt 2024-08-02T18:51:26.415 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-emc.txt 2024-08-02T18:51:26.416 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-flowctrl.txt 2024-08-02T18:51:26.417 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-mc.txt 2024-08-02T18:51:26.417 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra20-pmc.txt 2024-08-02T18:51:26.418 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/tegra/nvidia,tegra30-mc.txt 2024-08-02T18:51:26.419 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/topology.txt 2024-08-02T18:51:26.420 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/twd.txt 2024-08-02T18:51:26.421 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/ 2024-08-02T18:51:26.421 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/ux500/power_domain.txt 2024-08-02T18:51:26.422 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-fpga-irq.txt 2024-08-02T18:51:26.423 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/versatile-sysreg.txt 2024-08-02T18:51:26.424 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-scc.txt 2024-08-02T18:51:26.424 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress-sysreg.txt 2024-08-02T18:51:26.425 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vexpress.txt 2024-08-02T18:51:26.426 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vic.txt 2024-08-02T18:51:26.427 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500.txt 2024-08-02T18:51:26.428 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/ 2024-08-02T18:51:26.429 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-intc.txt 2024-08-02T18:51:26.429 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-pmc.txt 2024-08-02T18:51:26.430 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/vt8500/via,vt8500-timer.txt 2024-08-02T18:51:26.430 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xen.txt 2024-08-02T18:51:26.431 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/arm/xilinx.txt 2024-08-02T18:51:26.432 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ 2024-08-02T18:51:26.433 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-platform.txt 2024-08-02T18:51:26.433 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/ahci-st.txt 2024-08-02T18:51:26.434 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/apm-xgene.txt 2024-08-02T18:51:26.435 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/atmel-at91_cf.txt 2024-08-02T18:51:26.436 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/cavium-compact-flash.txt 2024-08-02T18:51:26.437 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/exynos-sata.txt 2024-08-02T18:51:26.437 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/fsl-sata.txt 2024-08-02T18:51:26.438 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-pata.txt 2024-08-02T18:51:26.439 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/imx-sata.txt 2024-08-02T18:51:26.440 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/marvell.txt 2024-08-02T18:51:26.440 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/pata-arasan.txt 2024-08-02T18:51:26.441 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/qcom-sata.txt 2024-08-02T18:51:26.442 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_highbank.txt 2024-08-02T18:51:26.443 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/sata_rcar.txt 2024-08-02T18:51:26.443 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ata/tegra-sata.txt 2024-08-02T18:51:26.444 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/btmrvl.txt 2024-08-02T18:51:26.445 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ 2024-08-02T18:51:26.446 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/bcma.txt 2024-08-02T18:51:26.446 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/brcm,gisb-arb.txt 2024-08-02T18:51:26.447 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/imx-weim.txt 2024-08-02T18:51:26.448 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/mvebu-mbus.txt 2024-08-02T18:51:26.449 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/omap-ocp2scp.txt 2024-08-02T18:51:26.450 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/bus/ti-gpmc.txt 2024-08-02T18:51:26.450 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/ 2024-08-02T18:51:26.451 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/clocks.txt 2024-08-02T18:51:26.452 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/dscr.txt 2024-08-02T18:51:26.452 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/emifa.txt 2024-08-02T18:51:26.453 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/interrupt.txt 2024-08-02T18:51:26.454 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/soc.txt 2024-08-02T18:51:26.455 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/c6x/timer64.txt 2024-08-02T18:51:26.456 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/chosen.txt 2024-08-02T18:51:26.456 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ 2024-08-02T18:51:26.457 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/alphascale,acc.txt 2024-08-02T18:51:26.458 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/altr_socfpga.txt 2024-08-02T18:51:26.458 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/arm-integrator.txt 2024-08-02T18:51:26.459 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/at91-clock.txt 2024-08-02T18:51:26.460 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/axi-clkgen.txt 2024-08-02T18:51:26.461 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-cygnus-clock.txt 2024-08-02T18:51:26.462 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/bcm-kona-clock.txt 2024-08-02T18:51:26.462 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/calxeda.txt 2024-08-02T18:51:26.463 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-exynos-audss.txt 2024-08-02T18:51:26.464 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-palmas-clk32kg-clocks.txt 2024-08-02T18:51:26.465 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clk-s5pv210-audss.txt 2024-08-02T18:51:26.466 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clock-bindings.txt 2024-08-02T18:51:26.466 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/clps711x-clock.txt 2024-08-02T18:51:26.467 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/efm32-clock.txt 2024-08-02T18:51:26.468 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/emev2-clock.txt 2024-08-02T18:51:26.469 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos3250-clock.txt 2024-08-02T18:51:26.469 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4-clock.txt 2024-08-02T18:51:26.470 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos4415-clock.txt 2024-08-02T18:51:26.471 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5250-clock.txt 2024-08-02T18:51:26.472 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5260-clock.txt 2024-08-02T18:51:26.473 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5410-clock.txt 2024-08-02T18:51:26.473 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5420-clock.txt 2024-08-02T18:51:26.474 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos5440-clock.txt 2024-08-02T18:51:26.475 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/exynos7-clock.txt 2024-08-02T18:51:26.476 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-clock.txt 2024-08-02T18:51:26.477 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/fixed-factor-clock.txt 2024-08-02T18:51:26.478 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/gpio-gate-clock.txt 2024-08-02T18:51:26.479 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hi3620-clock.txt 2024-08-02T18:51:26.480 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/hix5hd2-clock.txt 2024-08-02T18:51:26.480 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx1-clock.txt 2024-08-02T18:51:26.481 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx21-clock.txt 2024-08-02T18:51:26.482 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx23-clock.txt 2024-08-02T18:51:26.483 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx25-clock.txt 2024-08-02T18:51:26.484 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx27-clock.txt 2024-08-02T18:51:26.485 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx28-clock.txt 2024-08-02T18:51:26.486 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx31-clock.txt 2024-08-02T18:51:26.487 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx35-clock.txt 2024-08-02T18:51:26.488 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx5-clock.txt 2024-08-02T18:51:26.488 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6q-clock.txt 2024-08-02T18:51:26.489 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sl-clock.txt 2024-08-02T18:51:26.490 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/imx6sx-clock.txt 2024-08-02T18:51:26.491 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-gate.txt 2024-08-02T18:51:26.492 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/keystone-pll.txt 2024-08-02T18:51:26.493 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/lsi,axm5516-clks.txt 2024-08-02T18:51:26.494 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,mmp2.txt 2024-08-02T18:51:26.495 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa168.txt 2024-08-02T18:51:26.496 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/marvell,pxa910.txt 2024-08-02T18:51:26.497 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77686.txt 2024-08-02T18:51:26.498 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/maxim,max77802.txt 2024-08-02T18:51:26.498 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/moxa,moxart-clock.txt 2024-08-02T18:51:26.499 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-core-clock.txt 2024-08-02T18:51:26.500 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-corediv-clock.txt 2024-08-02T18:51:26.501 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-cpu-clock.txt 2024-08-02T18:51:26.502 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/mvebu-gated-clock.txt 2024-08-02T18:51:26.502 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nspire-clock.txt 2024-08-02T18:51:26.505 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra114-car.txt 2024-08-02T18:51:26.505 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra124-car.txt 2024-08-02T18:51:26.506 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra20-car.txt 2024-08-02T18:51:26.506 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/nvidia,tegra30-car.txt 2024-08-02T18:51:26.506 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/prima2-clock.txt 2024-08-02T18:51:26.507 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/pxa-clock.txt 2024-08-02T18:51:26.508 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,gcc.txt 2024-08-02T18:51:26.509 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,lcc.txt 2024-08-02T18:51:26.510 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qcom,mmcc.txt 2024-08-02T18:51:26.510 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/qoriq-clock.txt 2024-08-02T18:51:26.511 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-div6-clocks.txt 2024-08-02T18:51:26.512 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,cpg-mstp-clocks.txt 2024-08-02T18:51:26.513 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a73a4-cpg-clocks.txt 2024-08-02T18:51:26.513 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7740-cpg-clocks.txt 2024-08-02T18:51:26.514 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,r8a7779-cpg-clocks.txt 2024-08-02T18:51:26.515 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rcar-gen2-cpg-clocks.txt 2024-08-02T18:51:26.516 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,rz-cpg-clocks.txt 2024-08-02T18:51:26.517 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/renesas,sh73a0-cpg-clocks.txt 2024-08-02T18:51:26.517 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3188-cru.txt 2024-08-02T18:51:26.518 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip,rk3288-cru.txt 2024-08-02T18:51:26.519 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/rockchip.txt 2024-08-02T18:51:26.520 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2410-clock.txt 2024-08-02T18:51:26.520 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2412-clock.txt 2024-08-02T18:51:26.521 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c2443-clock.txt 2024-08-02T18:51:26.522 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s3c64xx-clock.txt 2024-08-02T18:51:26.523 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/samsung,s5pv210-clock.txt 2024-08-02T18:51:26.523 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si5351.txt 2024-08-02T18:51:26.524 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/silabs,si570.txt 2024-08-02T18:51:26.525 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st,nomadik.txt 2024-08-02T18:51:26.526 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/ 2024-08-02T18:51:26.527 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-divmux.txt 2024-08-02T18:51:26.527 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-mux.txt 2024-08-02T18:51:26.528 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-pll.txt 2024-08-02T18:51:26.529 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-prediv.txt 2024-08-02T18:51:26.530 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen-vcc.txt 2024-08-02T18:51:26.531 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,clkgen.txt 2024-08-02T18:51:26.532 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,flexgen.txt 2024-08-02T18:51:26.533 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/st/st,quadfs.txt 2024-08-02T18:51:26.533 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ste-u300-syscon-clock.txt 2024-08-02T18:51:26.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/sunxi.txt 2024-08-02T18:51:26.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti,cdce706.txt 2024-08-02T18:51:26.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti-keystone-pllctrl.txt 2024-08-02T18:51:26.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/ 2024-08-02T18:51:26.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/apll.txt 2024-08-02T18:51:26.539 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/autoidle.txt 2024-08-02T18:51:26.539 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/clockdomain.txt 2024-08-02T18:51:26.540 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/composite.txt 2024-08-02T18:51:26.541 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/divider.txt 2024-08-02T18:51:26.542 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dpll.txt 2024-08-02T18:51:26.543 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/dra7-atl.txt 2024-08-02T18:51:26.544 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fapll.txt 2024-08-02T18:51:26.545 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/fixed-factor-clock.txt 2024-08-02T18:51:26.547 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/gate.txt 2024-08-02T18:51:26.547 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/interface.txt 2024-08-02T18:51:26.548 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/ti/mux.txt 2024-08-02T18:51:26.549 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vf610-clock.txt 2024-08-02T18:51:26.550 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/vt8500.txt 2024-08-02T18:51:26.550 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/xgene.txt 2024-08-02T18:51:26.552 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/clock/zynq-7000.txt 2024-08-02T18:51:26.552 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/ 2024-08-02T18:51:26.553 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/arm_big_little_dt.txt 2024-08-02T18:51:26.554 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-dt.txt 2024-08-02T18:51:26.555 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-exynos5440.txt 2024-08-02T18:51:26.556 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/cpufreq/cpufreq-spear.txt 2024-08-02T18:51:26.557 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/ 2024-08-02T18:51:26.557 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/amd-ccp.txt 2024-08-02T18:51:26.558 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/atmel-crypto.txt 2024-08-02T18:51:26.559 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-dcp.txt 2024-08-02T18:51:26.560 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-imx-sahara.txt 2024-08-02T18:51:26.561 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec2.txt 2024-08-02T18:51:26.562 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec4.txt 2024-08-02T18:51:26.563 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/fsl-sec6.txt 2024-08-02T18:51:26.563 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/mv_cesa.txt 2024-08-02T18:51:26.564 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-aes.txt 2024-08-02T18:51:26.565 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-des.txt 2024-08-02T18:51:26.566 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/omap-sham.txt 2024-08-02T18:51:26.567 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/picochip-spacc.txt 2024-08-02T18:51:26.568 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/qcom-qce.txt 2024-08-02T18:51:26.569 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/crypto/samsung-sss.txt 2024-08-02T18:51:26.570 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/ 2024-08-02T18:51:26.571 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/ 2024-08-02T18:51:26.572 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/devfreq/event/exynos-ppmu.txt 2024-08-02T18:51:26.572 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ 2024-08-02T18:51:26.573 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/arm-pl330.txt 2024-08-02T18:51:26.574 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-dma.txt 2024-08-02T18:51:26.575 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/atmel-xdma.txt 2024-08-02T18:51:26.576 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/bcm2835-dma.txt 2024-08-02T18:51:26.577 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/dma.txt 2024-08-02T18:51:26.577 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-edma.txt 2024-08-02T18:51:26.578 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-dma.txt 2024-08-02T18:51:26.579 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-imx-sdma.txt 2024-08-02T18:51:26.579 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/fsl-mxs-dma.txt 2024-08-02T18:51:26.580 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/img-mdc-dma.txt 2024-08-02T18:51:26.581 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/k3dma.txt 2024-08-02T18:51:26.582 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mmp-dma.txt 2024-08-02T18:51:26.583 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/moxa,moxart-dma.txt 2024-08-02T18:51:26.584 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mpc512x-dma.txt 2024-08-02T18:51:26.585 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/mv-xor.txt 2024-08-02T18:51:26.586 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/nbpfaxi.txt 2024-08-02T18:51:26.587 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_adm.txt 2024-08-02T18:51:26.588 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/qcom_bam_dma.txt 2024-08-02T18:51:26.589 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/rcar-audmapp.txt 2024-08-02T18:51:26.590 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/renesas,rcar-dmac.txt 2024-08-02T18:51:26.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/shdma.txt 2024-08-02T18:51:26.592 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sirfsoc-dma.txt 2024-08-02T18:51:26.593 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/snps-dma.txt 2024-08-02T18:51:26.594 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-coh901318.txt 2024-08-02T18:51:26.595 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ste-dma40.txt 2024-08-02T18:51:26.596 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/sun6i-dma.txt 2024-08-02T18:51:26.596 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/tegra20-apbdma.txt 2024-08-02T18:51:26.597 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/ti-edma.txt 2024-08-02T18:51:26.598 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/ 2024-08-02T18:51:26.599 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_dma.txt 2024-08-02T18:51:26.600 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/dma/xilinx/xilinx_vdma.txt 2024-08-02T18:51:26.601 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/ 2024-08-02T18:51:26.602 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/ 2024-08-02T18:51:26.603 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/armada/marvell,dove-lcd.txt 2024-08-02T18:51:26.604 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/ 2024-08-02T18:51:26.605 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/atmel/hlcdc-dc.txt 2024-08-02T18:51:26.606 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/ 2024-08-02T18:51:26.606 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/bridge/dw_hdmi.txt 2024-08-02T18:51:26.607 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/ 2024-08-02T18:51:26.608 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/i2c/tda998x.txt 2024-08-02T18:51:26.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ 2024-08-02T18:51:26.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/fsl-imx-drm.txt 2024-08-02T18:51:26.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/hdmi.txt 2024-08-02T18:51:26.612 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/imx/ldb.txt 2024-08-02T18:51:26.613 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/ 2024-08-02T18:51:26.614 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/gpu.txt 2024-08-02T18:51:26.615 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/hdmi.txt 2024-08-02T18:51:26.616 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/msm/mdp.txt 2024-08-02T18:51:26.617 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/ 2024-08-02T18:51:26.618 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/panel.txt 2024-08-02T18:51:26.618 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/slave.txt 2024-08-02T18:51:26.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tfp410.txt 2024-08-02T18:51:26.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/drm/tilcdc/tilcdc.txt 2024-08-02T18:51:26.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/eeprom.txt 2024-08-02T18:51:26.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/ 2024-08-02T18:51:26.622 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-palmas.txt 2024-08-02T18:51:26.623 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-rt8973a.txt 2024-08-02T18:51:26.624 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/extcon/extcon-sm5502.txt 2024-08-02T18:51:26.624 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/ 2024-08-02T18:51:26.625 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/mxsfb.txt 2024-08-02T18:51:26.626 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/fb/sm501fb.txt 2024-08-02T18:51:26.627 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/ 2024-08-02T18:51:26.628 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/fpga/altera-socfpga-fpga-mgr.txt 2024-08-02T18:51:26.628 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/ 2024-08-02T18:51:26.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/fuse/nvidia,tegra20-fuse.txt 2024-08-02T18:51:26.630 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/ 2024-08-02T18:51:26.632 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/8xxx_gpio.txt 2024-08-02T18:51:26.633 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/abilis,tb10x-gpio.txt 2024-08-02T18:51:26.635 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cavium-octeon-gpio.txt 2024-08-02T18:51:26.637 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/cirrus,clps711x-mctrl-gpio.txt 2024-08-02T18:51:26.638 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fsl-imx-gpio.txt 2024-08-02T18:51:26.639 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/fujitsu,mb86s70-gpio.txt 2024-08-02T18:51:26.641 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74x164.txt 2024-08-02T18:51:26.642 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-74xx-mmio.txt 2024-08-02T18:51:26.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-adnp.txt 2024-08-02T18:51:26.644 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-bcm-kona.txt 2024-08-02T18:51:26.645 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-clps711x.txt 2024-08-02T18:51:26.646 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-davinci.txt 2024-08-02T18:51:26.647 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-dsp-keystone.txt 2024-08-02T18:51:26.648 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-fan.txt 2024-08-02T18:51:26.649 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-grgpio.txt 2024-08-02T18:51:26.650 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-lp3943.txt 2024-08-02T18:51:26.651 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-max732x.txt 2024-08-02T18:51:26.652 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mcp23s08.txt 2024-08-02T18:51:26.653 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mm-lantiq.txt 2024-08-02T18:51:26.654 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-msm.txt 2024-08-02T18:51:26.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mvebu.txt 2024-08-02T18:51:26.657 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-mxs.txt 2024-08-02T18:51:26.657 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-nmk.txt 2024-08-02T18:51:26.659 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-omap.txt 2024-08-02T18:51:26.661 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-palmas.txt 2024-08-02T18:51:26.662 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pca953x.txt 2024-08-02T18:51:26.663 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-pcf857x.txt 2024-08-02T18:51:26.665 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-poweroff.txt 2024-08-02T18:51:26.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-restart.txt 2024-08-02T18:51:26.668 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-samsung.txt 2024-08-02T18:51:26.669 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stericsson-coh901.txt 2024-08-02T18:51:26.671 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stmpe.txt 2024-08-02T18:51:26.672 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-stp-xway.txt 2024-08-02T18:51:26.674 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-sx150x.txt 2024-08-02T18:51:26.675 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-twl4030.txt 2024-08-02T18:51:26.676 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090-pdc.txt 2024-08-02T18:51:26.678 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-tz1090.txt 2024-08-02T18:51:26.679 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-vf610.txt 2024-08-02T18:51:26.681 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene-sb.txt 2024-08-02T18:51:26.683 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xgene.txt 2024-08-02T18:51:26.684 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-xilinx.txt 2024-08-02T18:51:26.685 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zevio.txt 2024-08-02T18:51:26.687 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio-zynq.txt 2024-08-02T18:51:26.688 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio.txt 2024-08-02T18:51:26.690 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_atmel.txt 2024-08-02T18:51:26.691 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/gpio_lpc32xx.txt 2024-08-02T18:51:26.693 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/moxa,moxart-gpio.txt 2024-08-02T18:51:26.694 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/mrvl-gpio.txt 2024-08-02T18:51:26.696 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/nvidia,tegra20-gpio.txt 2024-08-02T18:51:26.697 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/pl061-gpio.txt 2024-08-02T18:51:26.699 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/renesas,gpio-rcar.txt 2024-08-02T18:51:26.700 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/snps-dwapb-gpio.txt 2024-08-02T18:51:26.702 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/sodaville.txt 2024-08-02T18:51:26.703 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpio/spear_spics.txt 2024-08-02T18:51:26.704 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/ 2024-08-02T18:51:26.706 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,gk20a.txt 2024-08-02T18:51:26.708 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/nvidia,tegra20-host1x.txt 2024-08-02T18:51:26.709 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-g2d.txt 2024-08-02T18:51:26.711 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/samsung-rotator.txt 2024-08-02T18:51:26.712 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/gpu/st,stih4xx.txt 2024-08-02T18:51:26.714 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/graph.txt 2024-08-02T18:51:26.715 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/ 2024-08-02T18:51:26.716 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hid/hid-over-i2c.txt 2024-08-02T18:51:26.718 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/ 2024-08-02T18:51:26.719 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/client-devices.txt 2024-08-02T18:51:26.720 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/nokia-modem.txt 2024-08-02T18:51:26.722 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hsi/omap-ssi.txt 2024-08-02T18:51:26.723 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ 2024-08-02T18:51:26.725 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ads1015.txt 2024-08-02T18:51:26.726 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/g762.txt 2024-08-02T18:51:26.728 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ibmpowernv.txt 2024-08-02T18:51:26.729 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/lm90.txt 2024-08-02T18:51:26.731 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ltc2978.txt 2024-08-02T18:51:26.732 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/ntc_thermistor.txt 2024-08-02T18:51:26.734 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/pwm-fan.txt 2024-08-02T18:51:26.735 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwmon/vexpress.txt 2024-08-02T18:51:26.737 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/ 2024-08-02T18:51:26.738 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/atmel-trng.txt 2024-08-02T18:51:26.739 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/omap_rng.txt 2024-08-02T18:51:26.741 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/hwrng/timeriomem_rng.txt 2024-08-02T18:51:26.742 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ 2024-08-02T18:51:26.744 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,bcm2835-i2c.txt 2024-08-02T18:51:26.745 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/brcm,iproc-i2c.txt 2024-08-02T18:51:26.747 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-arb-gpio-challenge.txt 2024-08-02T18:51:26.749 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-at91.txt 2024-08-02T18:51:26.750 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-axxia.txt 2024-08-02T18:51:26.751 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-bcm-kona.txt 2024-08-02T18:51:26.753 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cadence.txt 2024-08-02T18:51:26.754 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cbus-gpio.txt 2024-08-02T18:51:26.756 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-cros-ec-tunnel.txt 2024-08-02T18:51:26.757 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-davinci.txt 2024-08-02T18:51:26.759 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-designware.txt 2024-08-02T18:51:26.760 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-efm32.txt 2024-08-02T18:51:26.762 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-exynos5.txt 2024-08-02T18:51:26.763 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-gpio.txt 2024-08-02T18:51:26.765 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-hix5hd2.txt 2024-08-02T18:51:26.766 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-img-scb.txt 2024-08-02T18:51:26.768 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-imx.txt 2024-08-02T18:51:26.770 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-meson.txt 2024-08-02T18:51:26.771 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mpc.txt 2024-08-02T18:51:26.773 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-gpio.txt 2024-08-02T18:51:26.774 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pca954x.txt 2024-08-02T18:51:26.776 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux-pinctrl.txt 2024-08-02T18:51:26.777 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mux.txt 2024-08-02T18:51:26.779 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mv64xxx.txt 2024-08-02T18:51:26.781 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-mxs.txt 2024-08-02T18:51:26.782 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-nomadik.txt 2024-08-02T18:51:26.784 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-ocores.txt 2024-08-02T18:51:26.785 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-octeon.txt 2024-08-02T18:51:26.787 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-omap.txt 2024-08-02T18:51:26.788 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-opal.txt 2024-08-02T18:51:26.790 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pnx.txt 2024-08-02T18:51:26.791 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa-pci-ce4100.txt 2024-08-02T18:51:26.793 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-pxa.txt 2024-08-02T18:51:26.794 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rcar.txt 2024-08-02T18:51:26.796 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-riic.txt 2024-08-02T18:51:26.796 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-rk3x.txt 2024-08-02T18:51:26.797 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-s3c2410.txt 2024-08-02T18:51:26.798 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sh_mobile.txt 2024-08-02T18:51:26.799 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sirf.txt 2024-08-02T18:51:26.800 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st-ddci2c.txt 2024-08-02T18:51:26.802 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-st.txt 2024-08-02T18:51:26.802 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-sunxi-p2wi.txt 2024-08-02T18:51:26.803 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-versatile.txt 2024-08-02T18:51:26.804 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-vt8500.txt 2024-08-02T18:51:26.805 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/i2c-xiic.txt 2024-08-02T18:51:26.807 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina209.txt 2024-08-02T18:51:26.807 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ina2xx.txt 2024-08-02T18:51:26.808 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/max6697.txt 2024-08-02T18:51:26.810 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/nvidia,tegra20-i2c.txt 2024-08-02T18:51:26.810 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/qcom,i2c-qup.txt 2024-08-02T18:51:26.811 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/ti,bq32k.txt 2024-08-02T18:51:26.813 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/i2c/trivial-devices.txt 2024-08-02T18:51:26.814 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/ 2024-08-02T18:51:26.814 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/ 2024-08-02T18:51:26.816 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/accel/bma180.txt 2024-08-02T18:51:26.817 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/ 2024-08-02T18:51:26.818 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/at91_adc.txt 2024-08-02T18:51:26.820 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/cc10001_adc.txt 2024-08-02T18:51:26.822 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/max1027-adc.txt 2024-08-02T18:51:26.823 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/nuvoton-nau7802.txt 2024-08-02T18:51:26.824 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-iadc.txt 2024-08-02T18:51:26.826 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/qcom,spmi-vadc.txt 2024-08-02T18:51:26.827 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/rockchip-saradc.txt 2024-08-02T18:51:26.829 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/twl4030-madc.txt 2024-08-02T18:51:26.830 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/vf610-adc.txt 2024-08-02T18:51:26.832 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/adc/xilinx-xadc.txt 2024-08-02T18:51:26.833 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ 2024-08-02T18:51:26.834 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/ad7303.txt 2024-08-02T18:51:26.836 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/dac/max5821.txt 2024-08-02T18:51:26.838 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/ 2024-08-02T18:51:26.839 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/frequency/adf4350.txt 2024-08-02T18:51:26.840 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/ 2024-08-02T18:51:26.842 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/humidity/dht11.txt 2024-08-02T18:51:26.843 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/iio-bindings.txt 2024-08-02T18:51:26.845 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/ 2024-08-02T18:51:26.846 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/apds9300.txt 2024-08-02T18:51:26.847 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/cm36651.txt 2024-08-02T18:51:26.849 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/gp2ap020a00f.txt 2024-08-02T18:51:26.850 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/light/tsl2563.txt 2024-08-02T18:51:26.852 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ 2024-08-02T18:51:26.853 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/ak8975.txt 2024-08-02T18:51:26.854 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/magnetometer/hmc5843.txt 2024-08-02T18:51:26.856 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/ 2024-08-02T18:51:26.857 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/proximity/as3935.txt 2024-08-02T18:51:26.859 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/sensorhub.txt 2024-08-02T18:51:26.860 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iio/st-sensors.txt 2024-08-02T18:51:26.862 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ 2024-08-02T18:51:26.863 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ads7846.txt 2024-08-02T18:51:26.864 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/atmel,maxtouch.txt 2024-08-02T18:51:26.866 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cap11xx.txt 2024-08-02T18:51:26.867 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/clps711x-keypad.txt 2024-08-02T18:51:26.869 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/cros-ec-keyb.txt 2024-08-02T18:51:26.870 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/e3x0-button.txt 2024-08-02T18:51:26.871 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elan_i2c.txt 2024-08-02T18:51:26.873 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/elants_i2c.txt 2024-08-02T18:51:26.874 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/fsl-mma8450.txt 2024-08-02T18:51:26.876 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-beeper.txt 2024-08-02T18:51:26.877 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys-polled.txt 2024-08-02T18:51:26.879 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-keys.txt 2024-08-02T18:51:26.880 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/gpio-matrix-keypad.txt 2024-08-02T18:51:26.882 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/imx-keypad.txt 2024-08-02T18:51:26.883 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/input-reset.txt 2024-08-02T18:51:26.885 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/lpc32xx-key.txt 2024-08-02T18:51:26.886 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/matrix-keymap.txt 2024-08-02T18:51:26.887 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/nvidia,tegra20-kbc.txt 2024-08-02T18:51:26.888 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/omap-keypad.txt 2024-08-02T18:51:26.890 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ps2keyb-mouse-apbps2.txt 2024-08-02T18:51:26.891 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pwm-beeper.txt 2024-08-02T18:51:26.892 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/pxa27x-keypad.txt 2024-08-02T18:51:26.894 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-keypad.txt 2024-08-02T18:51:26.895 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-pwrkey.txt 2024-08-02T18:51:26.896 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/qcom,pm8xxx-vib.txt 2024-08-02T18:51:26.897 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/regulator-haptic.txt 2024-08-02T18:51:26.898 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/rotary-encoder.txt 2024-08-02T18:51:26.900 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/samsung-keypad.txt 2024-08-02T18:51:26.901 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/spear-keyboard.txt 2024-08-02T18:51:26.902 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/st-keyscan.txt 2024-08-02T18:51:26.903 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/stmpe-keypad.txt 2024-08-02T18:51:26.905 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/sun4i-lradc-keys.txt 2024-08-02T18:51:26.906 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tca8418_keypad.txt 2024-08-02T18:51:26.907 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv260x.txt 2024-08-02T18:51:26.908 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,drv2667.txt 2024-08-02T18:51:26.910 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,nspire-keypad.txt 2024-08-02T18:51:26.911 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/ti,palmas-pwrbutton.txt 2024-08-02T18:51:26.912 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ 2024-08-02T18:51:26.913 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/auo_pixcir_ts.txt 2024-08-02T18:51:26.914 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/bu21013.txt 2024-08-02T18:51:26.918 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/edt-ft5x06.txt 2024-08-02T18:51:26.918 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/egalax-ts.txt 2024-08-02T18:51:26.918 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/lpc32xx-tsc.txt 2024-08-02T18:51:26.919 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/mms114.txt 2024-08-02T18:51:26.921 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/pixcir_i2c_ts.txt 2024-08-02T18:51:26.922 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sitronix-st1232.txt 2024-08-02T18:51:26.923 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/stmpe.txt 2024-08-02T18:51:26.924 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/sun4i.txt 2024-08-02T18:51:26.926 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/ti-tsc-adc.txt 2024-08-02T18:51:26.927 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/touchscreen.txt 2024-08-02T18:51:26.928 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2005.txt 2024-08-02T18:51:26.929 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/tsc2007.txt 2024-08-02T18:51:26.931 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/touchscreen/zforce_ts.txt 2024-08-02T18:51:26.932 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/tps65218-pwrbutton.txt 2024-08-02T18:51:26.933 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-keypad.txt 2024-08-02T18:51:26.934 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/input/twl4030-pwrbutton.txt 2024-08-02T18:51:26.935 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ 2024-08-02T18:51:26.936 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/abilis,tb10x-ictl.txt 2024-08-02T18:51:26.937 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun4i-ic.txt 2024-08-02T18:51:26.938 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/allwinner,sun67i-sc-nmi.txt 2024-08-02T18:51:26.939 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/atmel,aic.txt 2024-08-02T18:51:26.940 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm2835-armctrl-ic.txt 2024-08-02T18:51:26.940 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,bcm7120-l2-intc.txt 2024-08-02T18:51:26.942 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/brcm,l2-intc.txt 2024-08-02T18:51:26.942 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/cirrus,clps711x-intc.txt 2024-08-02T18:51:26.943 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/digicolor-ic.txt 2024-08-02T18:51:26.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 -- 172.21.15.103:0/2187123453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7104102260 msgr2=0x7f710410e790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 --2- 172.21.15.103:0/2187123453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7104102260 0x7f710410e790 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f70fc009cd0 tx=0x7f70fc02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 -- 172.21.15.103:0/2187123453 shutdown_connections 2024-08-02T18:51:26.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 --2- 172.21.15.103:0/2187123453 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7104102260 0x7f710410e790 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 --2- 172.21.15.103:0/2187123453 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71041018c0 0x7f7104101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 --2- 172.21.15.103:0/2187123453 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f71041078c0 0x7f7104107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 -- 172.21.15.103:0/2187123453 >> 172.21.15.103:0/2187123453 conn(0x7f71040fd620 msgr2=0x7f71040ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:26.945 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 -- 172.21.15.103:0/2187123453 shutdown_connections 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.409+0000 7f71094fb640 1 -- 172.21.15.103:0/2187123453 wait complete. 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71094fb640 1 Processor -- start 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71094fb640 1 -- start start 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71094fb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71041018c0 0x7f7104198260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71094fb640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7104102260 0x7f71041987a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71094fb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71041078c0 0x7f710419cb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71094fb640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7104111de0 con 0x7f71041018c0 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71094fb640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7104111c60 con 0x7f7104102260 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71094fb640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7104111f60 con 0x7f71041078c0 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f7102ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71041018c0 0x7f7104198260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f7102ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71041018c0 0x7f7104198260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40386/0 (socket says 172.21.15.103:40386) 2024-08-02T18:51:26.946 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f7102ffd640 1 -- 172.21.15.103:0/4171842986 learned_addr learned my addr 172.21.15.103:0/4171842986 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f70fbfff640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7104102260 0x7f71041987a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.410+0000 7f71037fe640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71041078c0 0x7f710419cb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7102ffd640 1 -- 172.21.15.103:0/4171842986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71041078c0 msgr2=0x7f710419cb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7102ffd640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71041078c0 0x7f710419cb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7102ffd640 1 -- 172.21.15.103:0/4171842986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7104102260 msgr2=0x7f71041987a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7102ffd640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7104102260 0x7f71041987a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7102ffd640 1 -- 172.21.15.103:0/4171842986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f710419d210 con 0x7f71041018c0 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f70fbfff640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7104102260 0x7f71041987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f71037fe640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71041078c0 0x7f710419cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7102ffd640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71041018c0 0x7f7104198260 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f70f400e9f0 tx=0x7f70f400eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7100ff9640 1 -- 172.21.15.103:0/4171842986 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f400cd80 con 0x7f71041018c0 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f71094fb640 1 -- 172.21.15.103:0/4171842986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f710419d500 con 0x7f71041018c0 2024-08-02T18:51:26.947 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7100ff9640 1 -- 172.21.15.103:0/4171842986 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f70f4010930 con 0x7f71041018c0 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f7100ff9640 1 -- 172.21.15.103:0/4171842986 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f4018b00 con 0x7f71041018c0 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.411+0000 7f71094fb640 1 -- 172.21.15.103:0/4171842986 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f71041a4de0 con 0x7f71041018c0 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.413+0000 7f7100ff9640 1 -- 172.21.15.103:0/4171842986 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f70f4018ca0 con 0x7f71041018c0 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f710b8f9740 1 Processor -- start 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f710b8f9740 1 -- start start 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f7100ff9640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70f00a2cf0 0x7f70f00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe4f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe609d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f710b8f9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b8bbdb4a40 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f710b8f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b8bbd4c9d0 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f710b8f9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b8bbdb0a00 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.948 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f71037fe640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70f00a2cf0 0x7f70f00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f7100ff9640 1 -- 172.21.15.103:0/4171842986 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f70f40cfb70 con 0x7f71041018c0 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40396/0 (socket says 172.21.15.103:40396) 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f70fbfff640 1 -- 172.21.15.103:0/1209182502 learned_addr learned my addr 172.21.15.103:0/1209182502 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.414+0000 7f7102ffd640 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe4f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f71037fe640 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe609d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70fbfff640 1 -- 172.21.15.103:0/1209182502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 msgr2=0x55b8bbe4f290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70fbfff640 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe4f290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70fbfff640 1 -- 172.21.15.103:0/1209182502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 msgr2=0x55b8bbe609d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70fbfff640 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe609d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70fbfff640 1 -- 172.21.15.103:0/1209182502 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8bbd53650 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f71037fe640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70f00a2cf0 0x7f70f00a51b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f70fc005fe0 tx=0x7f70fc009900 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:26.949 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70fbfff640 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5e0a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0114f0 tx=0x7f70ec0119b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fa682033aab7cc2 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70f97fa640 1 -- 172.21.15.103:0/1209182502 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011030 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70f97fa640 1 -- 172.21.15.103:0/1209182502 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f70ec0111d0 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.415+0000 7f70f97fa640 1 -- 172.21.15.103:0/1209182502 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec00f7e0 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 -- 172.21.15.103:0/1209182502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4f7d0 msgr2=0x55b8bbe5e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5e0a0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0114f0 tx=0x7f70ec0119b0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 -- 172.21.15.103:0/1209182502 shutdown_connections 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe609d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5e0a0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 --2- 172.21.15.103:0/1209182502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe4f290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 -- 172.21.15.103:0/1209182502 >> 172.21.15.103:0/1209182502 conn(0x55b8bbe4b580 msgr2=0x55b8bbe4b960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 -- 172.21.15.103:0/1209182502 shutdown_connections 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.416+0000 7f710b8f9740 1 -- 172.21.15.103:0/1209182502 wait complete. 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 1 -- start start 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 1 Processor -- start 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe5b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe5bf10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b8bbe611b0 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b8bbd6fb20 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b8bbe61330 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f710b8f9740 10 client.0 _ll_register_callbacks cb 0x55b8bbd6dbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:26.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f71037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe5bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f7102ffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe5b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f71037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe5bf10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40412/0 (socket says 172.21.15.103:40412) 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f71037fe640 1 -- 172.21.15.103:0/3635297880 learned_addr learned my addr 172.21.15.103:0/3635297880 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f71037fe640 1 -- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 msgr2=0x55b8bbe5b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f71037fe640 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f71037fe640 1 -- 172.21.15.103:0/3635297880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4eeb0 msgr2=0x55b8bbe5b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f71037fe640 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe5b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f71037fe640 1 -- 172.21.15.103:0/3635297880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8bbb263c0 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.417+0000 7f7102ffd640 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe5b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:26.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f71037fe640 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe5bf10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f70fc035000 tx=0x7f70fc031000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f89a25d93df10e83 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f70ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3635297880 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70fc051070 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3635297880 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f70fc030d30 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 1 -- 172.21.15.103:0/3635297880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70ec0111d0 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3635297880 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f70fc05d050 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 10 client.16011 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 1 -- 172.21.15.103:0/3635297880 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b8bbe6cdc0 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3635297880 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f70ec0111d0 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3635297880 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f70fc049040 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 10 client.16011 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 10 client.16011 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 20 client.16011 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x55b8bbe6e290 0x55b8bbe70730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 4 client.16011 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.418+0000 7f710b8f9740 1 -- 172.21.15.103:0/3635297880 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b8bbdc1fb0 con 0x55b8bbe6e290 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.419+0000 7f7102ffd640 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x55b8bbe6e290 0x55b8bbe70730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.419+0000 7f70ea7fc640 10 client.16011 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.419+0000 7f7102ffd640 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x55b8bbe6e290 0x55b8bbe70730 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=5ae48c7239f0946e server_cookie=998fd966ffd6f5d5 in_seq=0 out_seq=0 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3635297880 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b8bbdc1fb0 con 0x55b8bbe6e290 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f70ea7fc640 10 client.16011 handle_command_reply: tid=0 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 client.16011 shutdown 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 -- 172.21.15.103:0/3635297880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 msgr2=0x55b8bbe5bf10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe5bf10 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f70fc035000 tx=0x7f70fc031000 comp rx=0 tx=0).stop 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 -- 172.21.15.103:0/3635297880 shutdown_connections 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x55b8bbe6e290 0x55b8bbe70730 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe5bf10 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe5b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f70ea7fc640 0 client.16011 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3635297880 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe5b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 -- 172.21.15.103:0/3635297880 >> 172.21.15.103:0/3635297880 conn(0x55b8bbe4b580 msgr2=0x55b8bbe512e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 -- 172.21.15.103:0/3635297880 shutdown_connections 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 1 -- 172.21.15.103:0/3635297880 wait complete. 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.420+0000 7f710b8f9740 20 client.16011 trim_cache size 0 max 16384 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f710b8f9740 1 Processor -- start 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f710b8f9740 1 -- start start 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe4aaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe76000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe76540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.955 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f710b8f9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71041af410 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f710b8f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71041acce0 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f710b8f9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71041aab30 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f71037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe76540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe76000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f70fbfff640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe76000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:57166/0 (socket says 172.21.15.103:57166) 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.433+0000 7f71037fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe76540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40424/0 (socket says 172.21.15.103:40424) 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70fbfff640 1 -- 172.21.15.103:0/3394447297 learned_addr learned my addr 172.21.15.103:0/3394447297 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f7102ffd640 1 --2- 172.21.15.103:0/3394447297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe4aaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70fbfff640 1 -- 172.21.15.103:0/3394447297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 msgr2=0x55b8bbe4aaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3394447297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe4aaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70fbfff640 1 -- 172.21.15.103:0/3394447297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 msgr2=0x55b8bbe76540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:26.956 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3394447297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe76540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70fbfff640 1 -- 172.21.15.103:0/3394447297 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b8bbe57070 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3394447297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe76000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0058c0 tx=0x7f70ec009fd0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a66a3bd67756c765 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70f8ff9640 1 -- 172.21.15.103:0/3394447297 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec011100 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70f8ff9640 1 -- 172.21.15.103:0/3394447297 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f70ec0112a0 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.434+0000 7f70f8ff9640 1 -- 172.21.15.103:0/3394447297 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec003cf0 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 -- 172.21.15.103:0/3394447297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4f7d0 msgr2=0x55b8bbe76000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3394447297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe76000 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f70ec0058c0 tx=0x7f70ec009fd0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 -- 172.21.15.103:0/3394447297 shutdown_connections 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3394447297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe76540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3394447297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe76000 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3394447297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe4aaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 -- 172.21.15.103:0/3394447297 >> 172.21.15.103:0/3394447297 conn(0x55b8bbe4b580 msgr2=0x55b8bbe5d400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:26.957 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 -- 172.21.15.103:0/3394447297 shutdown_connections 2024-08-02T18:51:26.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 -- 172.21.15.103:0/3394447297 wait complete. 2024-08-02T18:51:26.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 -- start start 2024-08-02T18:51:26.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.435+0000 7f710b8f9740 1 Processor -- start 2024-08-02T18:51:26.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe61580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe61ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f710b8f9740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe62000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.958 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f710b8f9740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f71041ab1a0 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f710b8f9740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f71041ac610 con 0x55b8bbe5e5e0 2024-08-02T18:51:26.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f710b8f9740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f71041ab870 con 0x55b8bbe4f7d0 2024-08-02T18:51:26.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f710b8f9740 10 client.0 _ll_register_callbacks cb 0x7f70ec005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:26.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe61580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe61580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40426/0 (socket says 172.21.15.103:40426) 2024-08-02T18:51:26.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 -- 172.21.15.103:0/3127768661 learned_addr learned my addr 172.21.15.103:0/3127768661 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:26.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f71037fe640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe62000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.959 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe61ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 -- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 msgr2=0x55b8bbe61ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe61ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 -- 172.21.15.103:0/3127768661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 msgr2=0x55b8bbe62000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe62000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 -- 172.21.15.103:0/3127768661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b8bbed7170 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe61ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f71037fe640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe62000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f7102ffd640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe61580 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f70f40cd580 tx=0x7f70f4018f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac771a8f4d07986e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f70ea7fc640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3127768661 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70f409cb60 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3127768661 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f70f409a050 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.436+0000 7f710b8f9740 1 -- 172.21.15.103:0/3127768661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f70ec0112a0 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3127768661 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f70f40a0100 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.960 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f710b8f9740 10 client.16017 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f710b8f9740 1 -- 172.21.15.103:0/3127768661 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b8bbed84b0 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3127768661 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f70ec0112a0 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3127768661 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f70f4010ae0 con 0x55b8bbe4eeb0 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f710b8f9740 10 client.16017 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f710b8f9740 10 client.16017 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f710b8f9740 20 client.16017 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x55b8bbed8bd0 0x55b8bbedaff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f710b8f9740 4 client.16017 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f710b8f9740 1 -- 172.21.15.103:0/3127768661 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b8bbdbc4c0 con 0x55b8bbed8bd0 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.437+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x55b8bbed8bd0 0x55b8bbedaff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f70fbfff640 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x55b8bbed8bd0 0x55b8bbedaff0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=273383b4b14a1b2f server_cookie=a02c97589e58ba92 in_seq=0 out_seq=0 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f70ea7fc640 10 client.16017 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:51:26.961 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f70ea7fc640 1 -- 172.21.15.103:0/3127768661 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b8bbdbc4c0 con 0x55b8bbed8bd0 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f70ea7fc640 10 client.16017 handle_command_reply: tid=0 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 client.16017 shutdown 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 -- 172.21.15.103:0/3127768661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4eeb0 msgr2=0x55b8bbe61580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe61580 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f70f40cd580 tx=0x7f70f4018f90 comp rx=0 tx=0).stop 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 -- 172.21.15.103:0/3127768661 shutdown_connections 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b8bbe5e5e0 0x55b8bbe62000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b8bbe4f7d0 0x55b8bbe61ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x55b8bbed8bd0 0x55b8bbedaff0 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 --2- 172.21.15.103:0/3127768661 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b8bbe4eeb0 0x55b8bbe61580 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 -- 172.21.15.103:0/3127768661 >> 172.21.15.103:0/3127768661 conn(0x55b8bbe4b580 msgr2=0x55b8bbe5b450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:26.962 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f70ea7fc640 0 client.16017 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:51:26.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 -- 172.21.15.103:0/3127768661 shutdown_connections 2024-08-02T18:51:26.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 1 -- 172.21.15.103:0/3127768661 wait complete. 2024-08-02T18:51:26.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.438+0000 7f710b8f9740 20 client.16017 trim_cache size 0 max 16384 2024-08-02T18:51:26.963 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:51:26.963 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 -- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70f00a2cf0 msgr2=0x7f70f00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70f00a2cf0 0x7f70f00a51b0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f70fc005fe0 tx=0x7f70fc009900 comp rx=0 tx=0).stop 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 -- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71041018c0 msgr2=0x7f7104198260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71041018c0 0x7f7104198260 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f70f400e9f0 tx=0x7f70f400eeb0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 -- 172.21.15.103:0/4171842986 shutdown_connections 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70f00a2cf0 0x7f70f00a51b0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f71041078c0 0x7f710419cb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7104102260 0x7f71041987a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 --2- 172.21.15.103:0/4171842986 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f71041018c0 0x7f7104198260 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 -- 172.21.15.103:0/4171842986 >> 172.21.15.103:0/4171842986 conn(0x7f71040fd620 msgr2=0x7f71040fddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 -- 172.21.15.103:0/4171842986 shutdown_connections 2024-08-02T18:51:26.964 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:26.439+0000 7f71094fb640 1 -- 172.21.15.103:0/4171842986 wait complete. 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/interrupts.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/lsi,zevio-intc.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,armada-370-xp-mpic.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/marvell,orion-intc.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/mips-gic.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/opencores,or1k-pic.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,intc-irqpin.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/renesas,irqc.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/samsung,s3c24xx-irq.txt 2024-08-02T18:51:26.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/snps,dw-apb-ictl.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,keystone-irq.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/interrupt-controller/ti,omap-intc-irq.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/arm,smmu.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/iommu.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra20-gart.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/nvidia,tegra30-smmu.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/renesas,ipmmu-vmsa.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/rockchip,iommu.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/samsung,sysmmu.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/iommu/ti,omap-iommu.txt 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/ 2024-08-02T18:51:26.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/common.txt 2024-08-02T18:51:26.969 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-gpio.txt 2024-08-02T18:51:26.969 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp55xx.txt 2024-08-02T18:51:26.969 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-lp8860.txt 2024-08-02T18:51:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:26 smithi151 ceph-mon[37155]: pgmap v54: 129 pgs: 129 active+clean; 81 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 MiB/s wr, 30 op/s 2024-08-02T18:51:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:26 smithi103 ceph-mon[32753]: pgmap v54: 129 pgs: 129 active+clean; 81 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 MiB/s wr, 30 op/s 2024-08-02T18:51:27.222 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-ns2.txt 2024-08-02T18:51:27.223 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/leds-pwm.txt 2024-08-02T18:51:27.224 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/pca963x.txt 2024-08-02T18:51:27.225 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/register-bit-led.txt 2024-08-02T18:51:27.226 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/leds/tca6507.txt 2024-08-02T18:51:27.227 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/ 2024-08-02T18:51:27.228 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2-timings.txt 2024-08-02T18:51:27.229 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/lpddr2/lpddr2.txt 2024-08-02T18:51:27.231 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/ 2024-08-02T18:51:27.231 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/altera-mailbox.txt 2024-08-02T18:51:27.232 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/mailbox.txt 2024-08-02T18:51:27.233 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mailbox/omap-mailbox.txt 2024-08-02T18:51:27.234 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/marvell.txt 2024-08-02T18:51:27.235 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ 2024-08-02T18:51:27.236 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/atmel-isi.txt 2024-08-02T18:51:27.236 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/coda.txt 2024-08-02T18:51:27.237 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-fimc-lite.txt 2024-08-02T18:51:27.238 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos-jpeg-codec.txt 2024-08-02T18:51:27.239 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos4-fimc-is.txt 2024-08-02T18:51:27.240 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/exynos5-gsc.txt 2024-08-02T18:51:27.240 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/gpio-ir-receiver.txt 2024-08-02T18:51:27.241 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/hix5hd2-ir.txt 2024-08-02T18:51:27.242 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ 2024-08-02T18:51:27.243 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7343.txt 2024-08-02T18:51:27.244 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/adv7604.txt 2024-08-02T18:51:27.244 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9m111.txt 2024-08-02T18:51:27.245 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/mt9p031.txt 2024-08-02T18:51:27.246 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/nokia,smia.txt 2024-08-02T18:51:27.247 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/ths8200.txt 2024-08-02T18:51:27.248 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp514x.txt 2024-08-02T18:51:27.249 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/i2c/tvp7002.txt 2024-08-02T18:51:27.250 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/img-ir-rev1.txt 2024-08-02T18:51:27.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:26 smithi121 ceph-mon[37236]: pgmap v54: 129 pgs: 129 active+clean; 81 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 9.5 KiB/s rd, 6.7 MiB/s wr, 30 op/s 2024-08-02T18:51:27.251 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/meson-ir.txt 2024-08-02T18:51:27.252 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/pxa-camera.txt 2024-08-02T18:51:27.253 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/rcar_vin.txt 2024-08-02T18:51:27.254 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/renesas,vsp1.txt 2024-08-02T18:51:27.254 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/s5p-mfc.txt 2024-08-02T18:51:27.255 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-fimc.txt 2024-08-02T18:51:27.256 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-mipi-csis.txt 2024-08-02T18:51:27.257 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5c73m3.txt 2024-08-02T18:51:27.258 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k5baf.txt 2024-08-02T18:51:27.258 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/samsung-s5k6a3.txt 2024-08-02T18:51:27.259 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sh_mobile_ceu.txt 2024-08-02T18:51:27.260 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/si4713.txt 2024-08-02T18:51:27.261 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/st-rc.txt 2024-08-02T18:51:27.262 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/sunxi-ir.txt 2024-08-02T18:51:27.263 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/ti-am437x-vpfe.txt 2024-08-02T18:51:27.264 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/media/video-interfaces.txt 2024-08-02T18:51:27.265 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ 2024-08-02T18:51:27.266 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ 2024-08-02T18:51:27.266 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/fsl/ifc.txt 2024-08-02T18:51:27.267 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-devbus.txt 2024-08-02T18:51:27.268 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/mvebu-sdram-controller.txt 2024-08-02T18:51:27.269 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/nvidia,tegra-mc.txt 2024-08-02T18:51:27.270 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/renesas-memory-controllers.txt 2024-08-02T18:51:27.270 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/synopsys.txt 2024-08-02T18:51:27.271 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti-aemif.txt 2024-08-02T18:51:27.272 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/ 2024-08-02T18:51:27.273 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/memory-controllers/ti/emif.txt 2024-08-02T18:51:27.274 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/ 2024-08-02T18:51:27.275 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta-intc.txt 2024-08-02T18:51:27.275 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/meta.txt 2024-08-02T18:51:27.276 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/metag/pdc-intc.txt 2024-08-02T18:51:27.277 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ 2024-08-02T18:51:27.278 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/88pm860x.txt 2024-08-02T18:51:27.279 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ab8500.txt 2024-08-02T18:51:27.280 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/arizona.txt 2024-08-02T18:51:27.281 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3711.txt 2024-08-02T18:51:27.282 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/as3722.txt 2024-08-02T18:51:27.283 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-gpbr.txt 2024-08-02T18:51:27.283 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-hlcdc.txt 2024-08-02T18:51:27.284 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-matrix.txt 2024-08-02T18:51:27.285 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/atmel-smc.txt 2024-08-02T18:51:27.286 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bcm590xx.txt 2024-08-02T18:51:27.287 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/bfticu.txt 2024-08-02T18:51:27.288 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/cros-ec.txt 2024-08-02T18:51:27.288 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9052-i2c.txt 2024-08-02T18:51:27.289 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9055.txt 2024-08-02T18:51:27.290 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/da9063.txt 2024-08-02T18:51:27.291 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/hi6421.txt 2024-08-02T18:51:27.292 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/lp3943.txt 2024-08-02T18:51:27.292 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max14577.txt 2024-08-02T18:51:27.293 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77686.txt 2024-08-02T18:51:27.294 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max77693.txt 2024-08-02T18:51:27.295 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8925.txt 2024-08-02T18:51:27.296 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/max8998.txt 2024-08-02T18:51:27.297 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/mc13xxx.txt 2024-08-02T18:51:27.298 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-host.txt 2024-08-02T18:51:27.299 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/omap-usb-tll.txt 2024-08-02T18:51:27.300 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/palmas.txt 2024-08-02T18:51:27.300 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom,spmi-pmic.txt 2024-08-02T18:51:27.301 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-pm8xxx.txt 2024-08-02T18:51:27.302 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qcom-rpm.txt 2024-08-02T18:51:27.303 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/qriox.txt 2024-08-02T18:51:27.304 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rk808.txt 2024-08-02T18:51:27.304 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/rn5t618.txt 2024-08-02T18:51:27.305 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mpa01.txt 2024-08-02T18:51:27.306 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/s2mps11.txt 2024-08-02T18:51:27.307 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/stmpe.txt 2024-08-02T18:51:27.308 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/sun6i-prcm.txt 2024-08-02T18:51:27.309 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/syscon.txt 2024-08-02T18:51:27.310 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tc3589x.txt 2024-08-02T18:51:27.311 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/ti-keystone-devctrl.txt 2024-08-02T18:51:27.312 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps6507x.txt 2024-08-02T18:51:27.313 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/tps65910.txt 2024-08-02T18:51:27.313 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl-familly.txt 2024-08-02T18:51:27.314 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-audio.txt 2024-08-02T18:51:27.315 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl4030-power.txt 2024-08-02T18:51:27.316 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mfd/twl6040.txt 2024-08-02T18:51:27.317 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/ 2024-08-02T18:51:27.319 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/ 2024-08-02T18:51:27.319 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/dsi/mipi-dsi-bus.txt 2024-08-02T18:51:27.320 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mipi/nvidia,tegra114-mipi.txt 2024-08-02T18:51:27.321 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ 2024-08-02T18:51:27.322 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/ 2024-08-02T18:51:27.326 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bcm3384-intc.txt 2024-08-02T18:51:27.326 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/bmips.txt 2024-08-02T18:51:27.326 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/cm-dsl.txt 2024-08-02T18:51:27.326 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/brcm/usb.txt 2024-08-02T18:51:27.327 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ 2024-08-02T18:51:27.328 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/bootbus.txt 2024-08-02T18:51:27.329 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/cib.txt 2024-08-02T18:51:27.330 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu.txt 2024-08-02T18:51:27.331 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/ciu2.txt 2024-08-02T18:51:27.331 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/dma-engine.txt 2024-08-02T18:51:27.332 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cavium/uctl.txt 2024-08-02T18:51:27.333 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/cpu_irq.txt 2024-08-02T18:51:27.334 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mips/ralink.txt 2024-08-02T18:51:27.335 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ 2024-08-02T18:51:27.336 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/allwinner,sunxi-sid.txt 2024-08-02T18:51:27.337 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/arm-charlcd.txt 2024-08-02T18:51:27.337 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/at25.txt 2024-08-02T18:51:27.338 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/atmel-ssc.txt 2024-08-02T18:51:27.339 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/bmp085.txt 2024-08-02T18:51:27.340 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/fsl,qoriq-mc.txt 2024-08-02T18:51:27.341 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ifm-csi.txt 2024-08-02T18:51:27.342 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/lis302.txt 2024-08-02T18:51:27.343 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/nvidia,tegra20-apbmisc.txt 2024-08-02T18:51:27.344 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/smc.txt 2024-08-02T18:51:27.344 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/sram.txt 2024-08-02T18:51:27.345 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/misc/ti,dac7512.txt 2024-08-02T18:51:27.346 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ 2024-08-02T18:51:27.347 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/arasan,sdhci.txt 2024-08-02T18:51:27.348 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/atmel-hsmci.txt 2024-08-02T18:51:27.349 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/brcm,bcm2835-sdhci.txt 2024-08-02T18:51:27.350 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/davinci_mmc.txt 2024-08-02T18:51:27.351 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/exynos-dw-mshc.txt 2024-08-02T18:51:27.351 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-esdhc.txt 2024-08-02T18:51:27.352 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-esdhc.txt 2024-08-02T18:51:27.353 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/fsl-imx-mmc.txt 2024-08-02T18:51:27.354 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/img-dw-mshc.txt 2024-08-02T18:51:27.355 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/k3-dw-mshc.txt 2024-08-02T18:51:27.356 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/kona-sdhci.txt 2024-08-02T18:51:27.356 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-emmc.txt 2024-08-02T18:51:27.357 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-pwrseq-simple.txt 2024-08-02T18:51:27.359 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc-spi-slot.txt 2024-08-02T18:51:27.360 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmc.txt 2024-08-02T18:51:27.361 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mmci.txt 2024-08-02T18:51:27.362 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/moxa,moxart-mmc.txt 2024-08-02T18:51:27.362 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/mxs-mmc.txt 2024-08-02T18:51:27.363 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/nvidia,tegra20-sdhci.txt 2024-08-02T18:51:27.364 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/orion-sdio.txt 2024-08-02T18:51:27.365 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/pxa-mmc.txt 2024-08-02T18:51:27.366 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/renesas,mmcif.txt 2024-08-02T18:51:27.367 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/rockchip-dw-mshc.txt 2024-08-02T18:51:27.368 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/samsung-sdhci.txt 2024-08-02T18:51:27.369 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-dove.txt 2024-08-02T18:51:27.371 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-fujitsu.txt 2024-08-02T18:51:27.372 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-msm.txt 2024-08-02T18:51:27.373 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-pxa.txt 2024-08-02T18:51:27.374 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-sirf.txt 2024-08-02T18:51:27.375 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-spear.txt 2024-08-02T18:51:27.377 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sdhci-st.txt 2024-08-02T18:51:27.378 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/socfpga-dw-mshc.txt 2024-08-02T18:51:27.379 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/sunxi-mmc.txt 2024-08-02T18:51:27.380 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/synopsys-dw-mshc.txt 2024-08-02T18:51:27.381 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap-hsmmc.txt 2024-08-02T18:51:27.382 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/ti-omap.txt 2024-08-02T18:51:27.383 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/tmio_mmc.txt 2024-08-02T18:51:27.385 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/usdhi6rol0.txt 2024-08-02T18:51:27.386 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mmc/vt8500-sdmmc.txt 2024-08-02T18:51:27.387 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/ 2024-08-02T18:51:27.388 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/arm-versatile.txt 2024-08-02T18:51:27.389 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-dataflash.txt 2024-08-02T18:51:27.390 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/atmel-nand.txt 2024-08-02T18:51:27.391 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/davinci-nand.txt 2024-08-02T18:51:27.392 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/denali-nand.txt 2024-08-02T18:51:27.394 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/diskonchip.txt 2024-08-02T18:51:27.395 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/elm.txt 2024-08-02T18:51:27.396 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/flctl-nand.txt 2024-08-02T18:51:27.397 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-quadspi.txt 2024-08-02T18:51:27.398 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsl-upm-nand.txt 2024-08-02T18:51:27.399 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/fsmc-nand.txt 2024-08-02T18:51:27.400 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpio-control-nand.txt 2024-08-02T18:51:27.402 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nand.txt 2024-08-02T18:51:27.403 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-nor.txt 2024-08-02T18:51:27.404 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmc-onenand.txt 2024-08-02T18:51:27.405 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/gpmi-nand.txt 2024-08-02T18:51:27.406 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/hisi504-nand.txt 2024-08-02T18:51:27.407 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-mlc.txt 2024-08-02T18:51:27.408 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/lpc32xx-slc.txt 2024-08-02T18:51:27.410 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/m25p80.txt 2024-08-02T18:51:27.411 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mtd-physmap.txt 2024-08-02T18:51:27.412 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/mxc-nand.txt 2024-08-02T18:51:27.413 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/nand.txt 2024-08-02T18:51:27.415 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/orion-nand.txt 2024-08-02T18:51:27.416 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/partition.txt 2024-08-02T18:51:27.417 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/pxa3xx-nand.txt 2024-08-02T18:51:27.419 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/spear_smi.txt 2024-08-02T18:51:27.420 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/st-fsm.txt 2024-08-02T18:51:27.421 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/mtd/sunxi-nand.txt 2024-08-02T18:51:27.422 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ 2024-08-02T18:51:27.423 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-emac.txt 2024-08-02T18:51:27.424 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun4i-mdio.txt 2024-08-02T18:51:27.425 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/allwinner,sun7i-a20-gmac.txt 2024-08-02T18:51:27.426 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/altera_tse.txt 2024-08-02T18:51:27.428 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe-phy.txt 2024-08-02T18:51:27.429 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/amd-xgbe.txt 2024-08-02T18:51:27.430 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/apm-xgene-enet.txt 2024-08-02T18:51:27.431 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/arc_emac.txt 2024-08-02T18:51:27.432 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcm87xx.txt 2024-08-02T18:51:27.434 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-bcmgenet.txt 2024-08-02T18:51:27.435 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-mdio-unimac.txt 2024-08-02T18:51:27.436 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-sf2.txt 2024-08-02T18:51:27.438 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/broadcom-systemport.txt 2024-08-02T18:51:27.438 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/calxeda-xgmac.txt 2024-08-02T18:51:27.440 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/ 2024-08-02T18:51:27.440 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/atmel-can.txt 2024-08-02T18:51:27.442 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/c_can.txt 2024-08-02T18:51:27.444 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/cc770.txt 2024-08-02T18:51:27.446 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/fsl-flexcan.txt 2024-08-02T18:51:27.447 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/grcan.txt 2024-08-02T18:51:27.448 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/m_can.txt 2024-08-02T18:51:27.450 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/microchip,mcp251x.txt 2024-08-02T18:51:27.452 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/mpc5xxx-mscan.txt 2024-08-02T18:51:27.454 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/rcar_can.txt 2024-08-02T18:51:27.455 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/sja1000.txt 2024-08-02T18:51:27.457 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/can/xilinx_can.txt 2024-08-02T18:51:27.458 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mdio.txt 2024-08-02T18:51:27.460 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-mix.txt 2024-08-02T18:51:27.461 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cavium-pip.txt 2024-08-02T18:51:27.463 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cdns-emac.txt 2024-08-02T18:51:27.464 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw-phy-sel.txt 2024-08-02T18:51:27.466 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/cpsw.txt 2024-08-02T18:51:27.468 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davicom-dm9000.txt 2024-08-02T18:51:27.469 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci-mdio.txt 2024-08-02T18:51:27.471 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/davinci_emac.txt 2024-08-02T18:51:27.473 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/ 2024-08-02T18:51:27.474 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/dsa/dsa.txt 2024-08-02T18:51:27.476 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/emac_rockchip.txt 2024-08-02T18:51:27.477 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ethernet.txt 2024-08-02T18:51:27.478 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fixed-link.txt 2024-08-02T18:51:27.479 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-fec.txt 2024-08-02T18:51:27.480 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/fsl-tsec-phy.txt 2024-08-02T18:51:27.481 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/gpmc-eth.txt 2024-08-02T18:51:27.483 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hip04-net.txt 2024-08-02T18:51:27.484 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/hisilicon-hix5hd2-gmac.txt 2024-08-02T18:51:27.485 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/ 2024-08-02T18:51:27.486 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/at86rf230.txt 2024-08-02T18:51:27.487 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/ieee802154/cc2520.txt 2024-08-02T18:51:27.488 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/keystone-netcp.txt 2024-08-02T18:51:27.489 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/lpc-eth.txt 2024-08-02T18:51:27.490 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/macb.txt 2024-08-02T18:51:27.491 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-armada-370-neta.txt 2024-08-02T18:51:27.493 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-mdio.txt 2024-08-02T18:51:27.494 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-orion-net.txt 2024-08-02T18:51:27.495 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pp2.txt 2024-08-02T18:51:27.496 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/marvell-pxa168.txt 2024-08-02T18:51:27.497 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-gpio.txt 2024-08-02T18:51:27.498 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-gpio.txt 2024-08-02T18:51:27.500 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux-mmioreg.txt 2024-08-02T18:51:27.501 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/mdio-mux.txt 2024-08-02T18:51:27.502 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/meson-dwmac.txt 2024-08-02T18:51:27.503 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ks8851.txt 2024-08-02T18:51:27.505 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel-ksz90x1.txt 2024-08-02T18:51:27.507 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/micrel.txt 2024-08-02T18:51:27.508 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/moxa,moxart-mac.txt 2024-08-02T18:51:27.510 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/ 2024-08-02T18:51:27.511 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/pn544.txt 2024-08-02T18:51:27.513 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfca.txt 2024-08-02T18:51:27.514 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/st21nfcb.txt 2024-08-02T18:51:27.516 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/nfc/trf7970a.txt 2024-08-02T18:51:27.517 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/opencores-ethoc.txt 2024-08-02T18:51:27.519 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/phy.txt 2024-08-02T18:51:27.521 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/qca-qca7000-spi.txt 2024-08-02T18:51:27.522 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/rockchip-dwmac.txt 2024-08-02T18:51:27.523 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/samsung-sxgbe.txt 2024-08-02T18:51:27.525 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sh_eth.txt 2024-08-02T18:51:27.526 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc-lan91c111.txt 2024-08-02T18:51:27.529 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/smsc911x.txt 2024-08-02T18:51:27.530 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/socfpga-dwmac.txt 2024-08-02T18:51:27.531 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/sti-dwmac.txt 2024-08-02T18:51:27.533 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/stmmac.txt 2024-08-02T18:51:27.534 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-rhine.txt 2024-08-02T18:51:27.535 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/via-velocity.txt 2024-08-02T18:51:27.537 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ 2024-08-02T18:51:27.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/brcm,bcm43xx-fmac.txt 2024-08-02T18:51:27.540 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/qcom,ath10k.txt 2024-08-02T18:51:27.541 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/net/wireless/ti,wl1251.txt 2024-08-02T18:51:27.543 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/ 2024-08-02T18:51:27.544 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/nios2.txt 2024-08-02T18:51:27.546 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/nios2/timer.txt 2024-08-02T18:51:27.547 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/ 2024-08-02T18:51:27.549 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/nvec/nvidia,nvec.txt 2024-08-02T18:51:27.550 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/open-pic.txt 2024-08-02T18:51:27.552 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/ 2024-08-02T18:51:27.553 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101aw03.txt 2024-08-02T18:51:27.555 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b101xtn01.txt 2024-08-02T18:51:27.556 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b116xw03.txt 2024-08-02T18:51:27.557 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133htn01.txt 2024-08-02T18:51:27.559 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/auo,b133xtn01.txt 2024-08-02T18:51:27.560 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/avic,tm070ddh03.txt 2024-08-02T18:51:27.562 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wa01a.txt 2024-08-02T18:51:27.563 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/chunghwa,claa101wb03.txt 2024-08-02T18:51:27.565 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et057090dhu.txt 2024-08-02T18:51:27.566 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,et070080dh6.txt 2024-08-02T18:51:27.569 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/edt,etm0700g0dh6.txt 2024-08-02T18:51:27.569 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/foxlink,fl500wvr00-a0t.txt 2024-08-02T18:51:27.571 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/giantplus,gpg482739qs5.txt 2024-08-02T18:51:27.572 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hannstar,hsd070pww1.txt 2024-08-02T18:51:27.574 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/hit,tx23d38vm0caa.txt 2024-08-02T18:51:27.575 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,g121i1-l01.txt 2024-08-02T18:51:27.577 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n116bge.txt 2024-08-02T18:51:27.578 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/innolux,n156bge-l21.txt 2024-08-02T18:51:27.579 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,ld070wx3-sl01.txt 2024-08-02T18:51:27.581 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lh500wx1-sd03.txt 2024-08-02T18:51:27.582 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/lg,lp129qe.txt 2024-08-02T18:51:27.583 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/panasonic,vvx10f004b00.txt 2024-08-02T18:51:27.584 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ld9040.txt 2024-08-02T18:51:27.586 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,ltn101nt05.txt 2024-08-02T18:51:27.587 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/samsung,s6e8aa0.txt 2024-08-02T18:51:27.588 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/sharp,lq101r1sx01.txt 2024-08-02T18:51:27.589 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/panel/simple-panel.txt 2024-08-02T18:51:27.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ 2024-08-02T18:51:27.592 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/83xx-512x-pci.txt 2024-08-02T18:51:27.594 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/designware-pcie.txt 2024-08-02T18:51:27.595 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,imx6q-pcie.txt 2024-08-02T18:51:27.596 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/fsl,pci.txt 2024-08-02T18:51:27.598 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/host-generic-pci.txt 2024-08-02T18:51:27.599 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/layerscape-pci.txt 2024-08-02T18:51:27.600 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/mvebu-pci.txt 2024-08-02T18:51:27.601 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/nvidia,tegra20-pcie.txt 2024-08-02T18:51:27.603 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-keystone.txt 2024-08-02T18:51:27.604 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci-rcar-gen2.txt 2024-08-02T18:51:27.605 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/pci.txt 2024-08-02T18:51:27.607 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ralink,rt3883-pci.txt 2024-08-02T18:51:27.608 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/rcar-pci.txt 2024-08-02T18:51:27.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/samsung,exynos5440-pcie.txt 2024-08-02T18:51:27.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/spear13xx-pcie.txt 2024-08-02T18:51:27.612 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/ti-pci.txt 2024-08-02T18:51:27.613 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/v3-v360epc-pci.txt 2024-08-02T18:51:27.615 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/versatile.txt 2024-08-02T18:51:27.616 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xgene-pci.txt 2024-08-02T18:51:27.617 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pci/xilinx-pcie.txt 2024-08-02T18:51:27.619 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ 2024-08-02T18:51:27.620 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/apm-xgene-phy.txt 2024-08-02T18:51:27.622 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/bcm-phy.txt 2024-08-02T18:51:27.623 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-sata-phy.txt 2024-08-02T18:51:27.625 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/berlin-usb-phy.txt 2024-08-02T18:51:27.626 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/hix5hd2-phy.txt 2024-08-02T18:51:27.627 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-bindings.txt 2024-08-02T18:51:27.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy28lp.txt 2024-08-02T18:51:27.630 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-miphy365x.txt 2024-08-02T18:51:27.631 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-mvebu.txt 2024-08-02T18:51:27.633 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih407-usb.txt 2024-08-02T18:51:27.634 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/phy-stih41x-usb.txt 2024-08-02T18:51:27.635 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-apq8064-sata-phy.txt 2024-08-02T18:51:27.637 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-dwc3-usb-phy.txt 2024-08-02T18:51:27.638 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/qcom-ipq806x-sata-phy.txt 2024-08-02T18:51:27.639 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rcar-gen2-phy.txt 2024-08-02T18:51:27.640 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/rockchip-usb-phy.txt 2024-08-02T18:51:27.642 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/samsung-phy.txt 2024-08-02T18:51:27.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/st-spear-miphy.txt 2024-08-02T18:51:27.644 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/sun4i-usb-phy.txt 2024-08-02T18:51:27.646 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/phy/ti-phy.txt 2024-08-02T18:51:27.647 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ 2024-08-02T18:51:27.648 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/abilis,tb10x-iomux.txt 2024-08-02T18:51:27.650 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/allwinner,sunxi-pinctrl.txt 2024-08-02T18:51:27.651 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/atmel,at91-pinctrl.txt 2024-08-02T18:51:27.652 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm11351-pinctrl.txt 2024-08-02T18:51:27.654 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/brcm,bcm2835-gpio.txt 2024-08-02T18:51:27.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx-pinctrl.txt 2024-08-02T18:51:27.656 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx25-pinctrl.txt 2024-08-02T18:51:27.658 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx27-pinctrl.txt 2024-08-02T18:51:27.659 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx35-pinctrl.txt 2024-08-02T18:51:27.660 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx51-pinctrl.txt 2024-08-02T18:51:27.662 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx53-pinctrl.txt 2024-08-02T18:51:27.663 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6dl-pinctrl.txt 2024-08-02T18:51:27.664 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6q-pinctrl.txt 2024-08-02T18:51:27.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sl-pinctrl.txt 2024-08-02T18:51:27.667 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,imx6sx-pinctrl.txt 2024-08-02T18:51:27.668 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,mxs-pinctrl.txt 2024-08-02T18:51:27.669 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/fsl,vf610-pinctrl.txt 2024-08-02T18:51:27.670 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pdc-pinctrl.txt 2024-08-02T18:51:27.671 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/img,tz1090-pinctrl.txt 2024-08-02T18:51:27.672 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,falcon-pinumx.txt 2024-08-02T18:51:27.673 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/lantiq,xway-pinumx.txt 2024-08-02T18:51:27.674 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-370-pinctrl.txt 2024-08-02T18:51:27.675 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-375-pinctrl.txt 2024-08-02T18:51:27.676 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-38x-pinctrl.txt 2024-08-02T18:51:27.677 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,armada-xp-pinctrl.txt 2024-08-02T18:51:27.677 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,dove-pinctrl.txt 2024-08-02T18:51:27.678 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,kirkwood-pinctrl.txt 2024-08-02T18:51:27.680 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,mvebu-pinctrl.txt 2024-08-02T18:51:27.681 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/marvell,orion-pinctrl.txt 2024-08-02T18:51:27.682 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/meson,pinctrl.txt 2024-08-02T18:51:27.682 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra114-pinmux.txt 2024-08-02T18:51:27.683 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-pinmux.txt 2024-08-02T18:51:27.684 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra124-xusb-padctl.txt 2024-08-02T18:51:27.685 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra20-pinmux.txt 2024-08-02T18:51:27.686 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/nvidia,tegra30-pinmux.txt 2024-08-02T18:51:27.687 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-bindings.txt 2024-08-02T18:51:27.688 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-palmas.txt 2024-08-02T18:51:27.689 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-single.txt 2024-08-02T18:51:27.689 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-sirf.txt 2024-08-02T18:51:27.690 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-st.txt 2024-08-02T18:51:27.692 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl-vt8500.txt 2024-08-02T18:51:27.693 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/pinctrl_spear.txt 2024-08-02T18:51:27.694 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8064-pinctrl.txt 2024-08-02T18:51:27.696 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,apq8084-pinctrl.txt 2024-08-02T18:51:27.697 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,ipq8064-pinctrl.txt 2024-08-02T18:51:27.698 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8916-pinctrl.txt 2024-08-02T18:51:27.700 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8960-pinctrl.txt 2024-08-02T18:51:27.701 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,msm8974-pinctrl.txt 2024-08-02T18:51:27.702 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-gpio.txt 2024-08-02T18:51:27.704 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/qcom,pmic-mpp.txt 2024-08-02T18:51:27.705 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/renesas,pfc-pinctrl.txt 2024-08-02T18:51:27.706 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/rockchip,pinctrl.txt 2024-08-02T18:51:27.708 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/samsung-pinctrl.txt 2024-08-02T18:51:27.709 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,abx500.txt 2024-08-02T18:51:27.710 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ste,nomadik.txt 2024-08-02T18:51:27.711 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/ti,omap-pinctrl.txt 2024-08-02T18:51:27.713 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pinctrl/xlnx,zynq-pinctrl.txt 2024-08-02T18:51:27.714 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ 2024-08-02T18:51:27.715 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/bq2415x.txt 2024-08-02T18:51:27.716 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/isp1704.txt 2024-08-02T18:51:27.717 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/ltc2941.txt 2024-08-02T18:51:27.718 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/opp.txt 2024-08-02T18:51:27.719 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power-controller.txt 2024-08-02T18:51:27.720 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/power_domain.txt 2024-08-02T18:51:27.721 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/renesas,sysc-rmobile.txt 2024-08-02T18:51:27.721 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ 2024-08-02T18:51:27.722 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/keystone-reset.txt 2024-08-02T18:51:27.723 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/ltc2952-poweroff.txt 2024-08-02T18:51:27.724 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/st-reset.txt 2024-08-02T18:51:27.725 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/reset/syscon-reboot.txt 2024-08-02T18:51:27.725 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rockchip-io-domain.txt 2024-08-02T18:51:27.726 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/rx51-battery.txt 2024-08-02T18:51:27.727 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power/twl-charger.txt 2024-08-02T18:51:27.728 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ 2024-08-02T18:51:27.729 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/ 2024-08-02T18:51:27.729 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/btemp.txt 2024-08-02T18:51:27.730 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/chargalg.txt 2024-08-02T18:51:27.731 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/charger.txt 2024-08-02T18:51:27.733 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ab8500/fg.txt 2024-08-02T18:51:27.733 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/axxia-reset.txt 2024-08-02T18:51:27.734 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/charger-manager.txt 2024-08-02T18:51:27.734 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/gpio-charger.txt 2024-08-02T18:51:27.735 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/imx-snvs-poweroff.txt 2024-08-02T18:51:27.736 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/lp8727_charger.txt 2024-08-02T18:51:27.737 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max17042_battery.txt 2024-08-02T18:51:27.738 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/max8925_batter.txt 2024-08-02T18:51:27.739 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/msm-poweroff.txt 2024-08-02T18:51:27.740 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/olpc_battery.txt 2024-08-02T18:51:27.741 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/power_supply.txt 2024-08-02T18:51:27.742 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/qnap-poweroff.txt 2024-08-02T18:51:27.743 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/restart-poweroff.txt 2024-08-02T18:51:27.744 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/sbs_sbs-battery.txt 2024-08-02T18:51:27.745 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/ti,bq24735.txt 2024-08-02T18:51:27.745 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/power_supply/tps65090.txt 2024-08-02T18:51:27.746 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/ 2024-08-02T18:51:27.747 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ 2024-08-02T18:51:27.747 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/akebono.txt 2024-08-02T18:51:27.748 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/cpm.txt 2024-08-02T18:51:27.749 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/emac.txt 2024-08-02T18:51:27.750 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/hsta.txt 2024-08-02T18:51:27.751 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ndfc.txt 2024-08-02T18:51:27.752 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/ppc440spe-adma.txt 2024-08-02T18:51:27.752 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/4xx/reboot.txt 2024-08-02T18:51:27.753 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ 2024-08-02T18:51:27.754 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/board.txt 2024-08-02T18:51:27.755 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cache_sram.txt 2024-08-02T18:51:27.756 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ccf.txt 2024-08-02T18:51:27.756 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/ 2024-08-02T18:51:27.757 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm.txt 2024-08-02T18:51:27.758 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/ 2024-08-02T18:51:27.759 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/brg.txt 2024-08-02T18:51:27.759 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/i2c.txt 2024-08-02T18:51:27.760 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/pic.txt 2024-08-02T18:51:27.761 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/cpm/usb.txt 2024-08-02T18:51:27.762 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/gpio.txt 2024-08-02T18:51:27.763 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/network.txt 2024-08-02T18:51:27.764 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe.txt 2024-08-02T18:51:27.765 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ 2024-08-02T18:51:27.766 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/firmware.txt 2024-08-02T18:51:27.767 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/par_io.txt 2024-08-02T18:51:27.767 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/pincfg.txt 2024-08-02T18:51:27.768 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/ucc.txt 2024-08-02T18:51:27.769 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/qe/usb.txt 2024-08-02T18:51:27.770 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpm_qe/serial.txt 2024-08-02T18:51:27.771 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/cpus.txt 2024-08-02T18:51:27.771 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dcsr.txt 2024-08-02T18:51:27.772 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/diu.txt 2024-08-02T18:51:27.773 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/dma.txt 2024-08-02T18:51:27.774 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/ecm.txt 2024-08-02T18:51:27.774 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/fman.txt 2024-08-02T18:51:27.776 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/gtm.txt 2024-08-02T18:51:27.776 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/guts.txt 2024-08-02T18:51:27.777 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/interlaken-lac.txt 2024-08-02T18:51:27.779 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/l2cache.txt 2024-08-02T18:51:27.779 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/lbc.txt 2024-08-02T18:51:27.779 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcm.txt 2024-08-02T18:51:27.780 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mcu-mpc8349emitx.txt 2024-08-02T18:51:27.781 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mem-ctrlr.txt 2024-08-02T18:51:27.782 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5121-psc.txt 2024-08-02T18:51:27.783 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpc5200.txt 2024-08-02T18:51:27.783 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-msgr.txt 2024-08-02T18:51:27.784 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic-timer.txt 2024-08-02T18:51:27.785 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/mpic.txt 2024-08-02T18:51:27.786 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/msi-pic.txt 2024-08-02T18:51:27.787 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pamu.txt 2024-08-02T18:51:27.787 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/pmc.txt 2024-08-02T18:51:27.788 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/raideng.txt 2024-08-02T18:51:27.789 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio-rmu.txt 2024-08-02T18:51:27.790 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/fsl/srio.txt 2024-08-02T18:51:27.790 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/ 2024-08-02T18:51:27.791 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/gamecube.txt 2024-08-02T18:51:27.792 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/powerpc/nintendo/wii.txt 2024-08-02T18:51:27.793 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/ 2024-08-02T18:51:27.794 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pps/pps-gpio.txt 2024-08-02T18:51:27.794 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ 2024-08-02T18:51:27.796 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-02T18:51:27.796 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-hlcdc-pwm.txt 2024-08-02T18:51:27.796 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-pwm.txt 2024-08-02T18:51:27.797 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/atmel-tcb-pwm.txt 2024-08-02T18:51:27.798 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/bcm-kona-pwm.txt 2024-08-02T18:51:27.799 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/cirrus,clps711x-pwm.txt 2024-08-02T18:51:27.799 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/img-pwm.txt 2024-08-02T18:51:27.800 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/imx-pwm.txt 2024-08-02T18:51:27.800 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/lpc32xx-pwm.txt 2024-08-02T18:51:27.801 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/mxs-pwm.txt 2024-08-02T18:51:27.802 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nvidia,tegra20-pwm.txt 2024-08-02T18:51:27.803 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/nxp,pca9685-pwm.txt 2024-08-02T18:51:27.804 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-bcm2835.txt 2024-08-02T18:51:27.804 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-fsl-ftm.txt 2024-08-02T18:51:27.805 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-lp3943.txt 2024-08-02T18:51:27.806 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-rockchip.txt 2024-08-02T18:51:27.807 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-samsung.txt 2024-08-02T18:51:27.807 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-st.txt 2024-08-02T18:51:27.808 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-sun4i.txt 2024-08-02T18:51:27.809 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiecap.txt 2024-08-02T18:51:27.810 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tiehrpwm.txt 2024-08-02T18:51:27.811 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm-tipwmss.txt 2024-08-02T18:51:27.811 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pwm.txt 2024-08-02T18:51:27.812 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/pxa-pwm.txt 2024-08-02T18:51:27.813 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/renesas,tpu-pwm.txt 2024-08-02T18:51:27.814 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/spear-pwm.txt 2024-08-02T18:51:27.814 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwm.txt 2024-08-02T18:51:27.815 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/ti,twl-pwmled.txt 2024-08-02T18:51:27.816 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/pwm/vt8500-pwm.txt 2024-08-02T18:51:27.817 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/ 2024-08-02T18:51:27.818 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regmap/regmap.txt 2024-08-02T18:51:27.818 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ 2024-08-02T18:51:27.819 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm800.txt 2024-08-02T18:51:27.820 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/88pm860x.txt 2024-08-02T18:51:27.821 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/act8865-regulator.txt 2024-08-02T18:51:27.823 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/anatop-regulator.txt 2024-08-02T18:51:27.823 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/as3722-regulator.txt 2024-08-02T18:51:27.823 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9210.txt 2024-08-02T18:51:27.824 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/da9211.txt 2024-08-02T18:51:27.824 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fan53555.txt 2024-08-02T18:51:27.825 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/fixed-regulator.txt 2024-08-02T18:51:27.826 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/gpio-regulator.txt 2024-08-02T18:51:27.827 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/isl9305.txt 2024-08-02T18:51:27.828 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/lp872x.txt 2024-08-02T18:51:27.828 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ltc3589.txt 2024-08-02T18:51:27.829 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max1586-regulator.txt 2024-08-02T18:51:27.830 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max77802.txt 2024-08-02T18:51:27.831 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8660.txt 2024-08-02T18:51:27.831 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8907.txt 2024-08-02T18:51:27.832 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8925-regulator.txt 2024-08-02T18:51:27.833 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8952.txt 2024-08-02T18:51:27.834 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8973-regulator.txt 2024-08-02T18:51:27.834 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/max8997-regulator.txt 2024-08-02T18:51:27.835 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/mt6397-regulator.txt 2024-08-02T18:51:27.836 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/palmas-pmic.txt 2024-08-02T18:51:27.837 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pbias-regulator.txt 2024-08-02T18:51:27.838 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pfuze100.txt 2024-08-02T18:51:27.838 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/pwm-regulator.txt 2024-08-02T18:51:27.839 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/regulator.txt 2024-08-02T18:51:27.840 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/s5m8767-regulator.txt 2024-08-02T18:51:27.841 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/sky81452-regulator.txt 2024-08-02T18:51:27.842 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/ti-abb-regulator.txt 2024-08-02T18:51:27.842 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps51632-regulator.txt 2024-08-02T18:51:27.843 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps62360-regulator.txt 2024-08-02T18:51:27.844 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65090.txt 2024-08-02T18:51:27.845 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65217.txt 2024-08-02T18:51:27.846 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps65218.txt 2024-08-02T18:51:27.847 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/tps6586x.txt 2024-08-02T18:51:27.847 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/twl-regulator.txt 2024-08-02T18:51:27.848 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/regulator/vexpress.txt 2024-08-02T18:51:27.849 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/ 2024-08-02T18:51:27.850 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reserved-memory/reserved-memory.txt 2024-08-02T18:51:27.851 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/ 2024-08-02T18:51:27.852 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/allwinner,sunxi-clock-reset.txt 2024-08-02T18:51:27.852 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/fsl,imx-src.txt 2024-08-02T18:51:27.853 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/reset.txt 2024-08-02T18:51:27.854 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/sirf,rstc.txt 2024-08-02T18:51:27.854 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/socfpga-reset.txt 2024-08-02T18:51:27.855 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-picophyreset.txt 2024-08-02T18:51:27.856 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-powerdown.txt 2024-08-02T18:51:27.857 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/reset/st,sti-softreset.txt 2024-08-02T18:51:27.857 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/resource-names.txt 2024-08-02T18:51:27.859 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/ 2024-08-02T18:51:27.860 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/apm,rng.txt 2024-08-02T18:51:27.860 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/brcm,bcm2835.txt 2024-08-02T18:51:27.861 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rng/qcom,prng.txt 2024-08-02T18:51:27.861 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/ 2024-08-02T18:51:27.862 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/armada-380-rtc.txt 2024-08-02T18:51:27.863 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91rm9200-rtc.txt 2024-08-02T18:51:27.864 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/atmel,at91sam9-rtc.txt 2024-08-02T18:51:27.865 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dallas,ds1339.txt 2024-08-02T18:51:27.865 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/dw-apb.txt 2024-08-02T18:51:27.866 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/haoyu,hym8563.txt 2024-08-02T18:51:27.867 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/imxdi-rtc.txt 2024-08-02T18:51:27.868 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/isil,isl12057.txt 2024-08-02T18:51:27.868 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/lpc32xx-rtc.txt 2024-08-02T18:51:27.869 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/maxim,ds1742.txt 2024-08-02T18:51:27.870 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/moxa,moxart-rtc.txt 2024-08-02T18:51:27.871 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nvidia,tegra20-rtc.txt 2024-08-02T18:51:27.871 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/nxp,rtc-2123.txt 2024-08-02T18:51:27.872 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/olpc-xo1-rtc.txt 2024-08-02T18:51:27.873 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/orion-rtc.txt 2024-08-02T18:51:27.874 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/pxa-rtc.txt 2024-08-02T18:51:27.875 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-cmos.txt 2024-08-02T18:51:27.875 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-omap.txt 2024-08-02T18:51:27.876 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-opal.txt 2024-08-02T18:51:27.877 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/rtc-palmas.txt 2024-08-02T18:51:27.878 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/s3c-rtc.txt 2024-08-02T18:51:27.878 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sa1100-rtc.txt 2024-08-02T18:51:27.879 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/snvs-rtc.txt 2024-08-02T18:51:27.880 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/spear-rtc.txt 2024-08-02T18:51:27.881 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/stmp3xxx-rtc.txt 2024-08-02T18:51:27.882 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sun6i-rtc.txt 2024-08-02T18:51:27.882 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/sunxi-rtc.txt 2024-08-02T18:51:27.883 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/twl-rtc.txt 2024-08-02T18:51:27.885 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/via,vt8500-rtc.txt 2024-08-02T18:51:27.885 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/rtc/xgene-rtc.txt 2024-08-02T18:51:27.886 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/ 2024-08-02T18:51:27.887 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/ 2024-08-02T18:51:27.887 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/security/tpm/st33zp24-i2c.txt 2024-08-02T18:51:27.888 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/ 2024-08-02T18:51:27.888 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/8250.txt 2024-08-02T18:51:27.889 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_jtaguart.txt 2024-08-02T18:51:27.890 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/altera_uart.txt 2024-08-02T18:51:27.891 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/arc-uart.txt 2024-08-02T18:51:27.891 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/atmel-usart.txt 2024-08-02T18:51:27.892 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/axis,etraxfs-uart.txt 2024-08-02T18:51:27.893 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/bcm63xx-uart.txt 2024-08-02T18:51:27.894 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cavium-uart.txt 2024-08-02T18:51:27.894 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cdns,uart.txt 2024-08-02T18:51:27.895 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/cirrus,clps711x-uart.txt 2024-08-02T18:51:27.896 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/digicolor-usart.txt 2024-08-02T18:51:27.897 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/efm32-uart.txt 2024-08-02T18:51:27.898 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-imx-uart.txt 2024-08-02T18:51:27.898 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-lpuart.txt 2024-08-02T18:51:27.899 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/fsl-mxs-auart.txt 2024-08-02T18:51:27.900 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/lantiq_asc.txt 2024-08-02T18:51:27.901 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/maxim,max310x.txt 2024-08-02T18:51:27.901 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl,pxa-ssp.txt 2024-08-02T18:51:27.902 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mrvl-serial.txt 2024-08-02T18:51:27.903 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/mtk-uart.txt 2024-08-02T18:51:27.904 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nvidia,tegra20-hsuart.txt 2024-08-02T18:51:27.904 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp,sc16is7xx.txt 2024-08-02T18:51:27.905 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/nxp-lpc32xx-hsuart.txt 2024-08-02T18:51:27.906 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/omap_serial.txt 2024-08-02T18:51:27.907 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/pl011.txt 2024-08-02T18:51:27.907 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qca,ar9330-uart.txt 2024-08-02T18:51:27.908 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uart.txt 2024-08-02T18:51:27.909 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/qcom,msm-uartdm.txt 2024-08-02T18:51:27.910 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/renesas,sci-serial.txt 2024-08-02T18:51:27.911 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/rs485.txt 2024-08-02T18:51:27.912 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/samsung_uart.txt 2024-08-02T18:51:27.913 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sirf-uart.txt 2024-08-02T18:51:27.913 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/snps-dw-apb-uart.txt 2024-08-02T18:51:27.914 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/sprd-uart.txt 2024-08-02T18:51:27.915 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/st-asc.txt 2024-08-02T18:51:27.915 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serial/vt8500-uart.txt 2024-08-02T18:51:27.916 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/ 2024-08-02T18:51:27.917 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/allwinner,sun4i-ps2.txt 2024-08-02T18:51:27.918 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/altera_ps2.txt 2024-08-02T18:51:27.918 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/olpc,ap-sp.txt 2024-08-02T18:51:27.919 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/serio/snps-arc_ps2.txt 2024-08-02T18:51:27.920 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ 2024-08-02T18:51:27.921 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/ 2024-08-02T18:51:27.921 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman-portals.txt 2024-08-02T18:51:27.922 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/bman.txt 2024-08-02T18:51:27.923 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman-portals.txt 2024-08-02T18:51:27.924 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/fsl/qman.txt 2024-08-02T18:51:27.924 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/ 2024-08-02T18:51:27.925 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/qcom/qcom,gsbi.txt 2024-08-02T18:51:27.926 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/ 2024-08-02T18:51:27.927 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-dma.txt 2024-08-02T18:51:27.927 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/soc/ti/keystone-navigator-qmss.txt 2024-08-02T18:51:27.928 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ 2024-08-02T18:51:27.929 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,adau1701.txt 2024-08-02T18:51:27.930 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-i2s.txt 2024-08-02T18:51:27.930 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,axi-spdif-tx.txt 2024-08-02T18:51:27.931 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/adi,ssm2602.txt 2024-08-02T18:51:27.932 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4104.txt 2024-08-02T18:51:27.933 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4554.c 2024-08-02T18:51:27.933 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak4642.txt 2024-08-02T18:51:27.934 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ak5386.txt 2024-08-02T18:51:27.938 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5623.txt 2024-08-02T18:51:27.938 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/alc5632.txt 2024-08-02T18:51:27.939 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/armada-370db-audio.txt 2024-08-02T18:51:27.939 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/arndale.txt 2024-08-02T18:51:27.939 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-at91sam9g20ek-wm8731-audio.txt 2024-08-02T18:51:27.939 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-sam9x5-wm8731-audio.txt 2024-08-02T18:51:27.940 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel-wm8904.txt 2024-08-02T18:51:27.940 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/atmel_ac97c.txt 2024-08-02T18:51:27.941 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/bcm2835-i2s.txt 2024-08-02T18:51:27.942 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cdns,xtfpga-i2s.txt 2024-08-02T18:51:27.943 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs35l32.txt 2024-08-02T18:51:27.944 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4265.txt 2024-08-02T18:51:27.944 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4270.txt 2024-08-02T18:51:27.945 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs4271.txt 2024-08-02T18:51:27.947 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l52.txt 2024-08-02T18:51:27.948 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l56.txt 2024-08-02T18:51:27.948 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42l73.txt 2024-08-02T18:51:27.948 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/cs42xx8.txt 2024-08-02T18:51:27.949 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/da9055.txt 2024-08-02T18:51:27.950 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-evm-audio.txt 2024-08-02T18:51:27.951 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/davinci-mcasp-audio.txt 2024-08-02T18:51:27.951 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/designware-i2s.txt 2024-08-02T18:51:27.952 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/es8328.txt 2024-08-02T18:51:27.953 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/eukrea-tlv320.txt 2024-08-02T18:51:27.954 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,asrc.txt 2024-08-02T18:51:27.955 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,esai.txt 2024-08-02T18:51:27.955 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,spdif.txt 2024-08-02T18:51:27.956 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl,ssi.txt 2024-08-02T18:51:27.957 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-asoc-card.txt 2024-08-02T18:51:27.958 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/fsl-sai.txt 2024-08-02T18:51:27.959 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/hdmi.txt 2024-08-02T18:51:27.959 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-es8328.txt 2024-08-02T18:51:27.960 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-sgtl5000.txt 2024-08-02T18:51:27.961 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-spdif.txt 2024-08-02T18:51:27.962 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audio-wm8962.txt 2024-08-02T18:51:27.963 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/imx-audmux.txt 2024-08-02T18:51:27.963 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ingenic,jz4740-i2s.txt 2024-08-02T18:51:27.964 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98090.txt 2024-08-02T18:51:27.965 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98095.txt 2024-08-02T18:51:27.965 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/max98357a.txt 2024-08-02T18:51:27.966 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa-ssp.txt 2024-08-02T18:51:27.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mrvl,pxa2xx-pcm.txt 2024-08-02T18:51:27.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mvebu-audio.txt 2024-08-02T18:51:27.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-audio-sgtl5000.txt 2024-08-02T18:51:27.969 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/mxs-saif.txt 2024-08-02T18:51:27.970 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nokia,rx51.txt 2024-08-02T18:51:27.971 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-alc5632.txt 2024-08-02T18:51:27.971 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-max98090.txt 2024-08-02T18:51:27.972 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5640.txt 2024-08-02T18:51:27.973 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-rt5677.txt 2024-08-02T18:51:27.975 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-trimslice.txt 2024-08-02T18:51:27.976 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8753.txt 2024-08-02T18:51:27.976 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm8903.txt 2024-08-02T18:51:27.976 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra-audio-wm9712.txt 2024-08-02T18:51:27.977 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-ac97.txt 2024-08-02T18:51:27.977 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-das.txt 2024-08-02T18:51:27.978 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra20-i2s.txt 2024-08-02T18:51:27.979 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-ahub.txt 2024-08-02T18:51:27.980 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-hda.txt 2024-08-02T18:51:27.981 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/nvidia,tegra30-i2s.txt 2024-08-02T18:51:27.981 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-abe-twl6040.txt 2024-08-02T18:51:27.982 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-dmic.txt 2024-08-02T18:51:27.983 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcbsp.txt 2024-08-02T18:51:27.983 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-mcpdm.txt 2024-08-02T18:51:27.984 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/omap-twl4030.txt 2024-08-02T18:51:27.985 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm1792a.txt 2024-08-02T18:51:27.986 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/pcm512x.txt 2024-08-02T18:51:27.987 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,fsi.txt 2024-08-02T18:51:27.988 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/renesas,rsnd.txt 2024-08-02T18:51:27.988 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rockchip-i2s.txt 2024-08-02T18:51:27.989 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5631.txt 2024-08-02T18:51:27.990 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5640.txt 2024-08-02T18:51:27.991 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/rt5677.txt 2024-08-02T18:51:27.992 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,odroidx2-max98090.txt 2024-08-02T18:51:27.992 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung,smdk-wm8994.txt 2024-08-02T18:51:27.993 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/samsung-i2s.txt 2024-08-02T18:51:27.994 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sgtl5000.txt 2024-08-02T18:51:27.995 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/simple-card.txt 2024-08-02T18:51:27.996 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-codec.txt 2024-08-02T18:51:27.996 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio-port.txt 2024-08-02T18:51:27.997 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-audio.txt 2024-08-02T18:51:27.998 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/sirf-usp.txt 2024-08-02T18:51:27.999 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/snow.txt 2024-08-02T18:51:27.999 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/soc-ac97link.txt 2024-08-02T18:51:28.000 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-receiver.txt 2024-08-02T18:51:28.001 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/spdif-transmitter.txt 2024-08-02T18:51:28.002 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm2518.txt 2024-08-02T18:51:28.002 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ssm4567.txt 2024-08-02T18:51:28.003 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta32x.txt 2024-08-02T18:51:28.004 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/st,sta350.txt 2024-08-02T18:51:28.005 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tas2552.txt 2024-08-02T18:51:28.005 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tdm-slot.txt 2024-08-02T18:51:28.006 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,pcm1681.txt 2024-08-02T18:51:28.007 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ti,tas5086.txt 2024-08-02T18:51:28.008 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic31xx.txt 2024-08-02T18:51:28.008 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic32x4.txt 2024-08-02T18:51:28.009 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tlv320aic3x.txt 2024-08-02T18:51:28.010 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/tpa6130a2.txt 2024-08-02T18:51:28.011 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ts3a227e.txt 2024-08-02T18:51:28.012 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-mop500.txt 2024-08-02T18:51:28.013 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/ux500-msp.txt 2024-08-02T18:51:28.013 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/widgets.txt 2024-08-02T18:51:28.014 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8510.txt 2024-08-02T18:51:28.015 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8523.txt 2024-08-02T18:51:28.016 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8580.txt 2024-08-02T18:51:28.016 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8711.txt 2024-08-02T18:51:28.017 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8728.txt 2024-08-02T18:51:28.018 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8731.txt 2024-08-02T18:51:28.019 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8737.txt 2024-08-02T18:51:28.019 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8741.txt 2024-08-02T18:51:28.020 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8750.txt 2024-08-02T18:51:28.021 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8753.txt 2024-08-02T18:51:28.022 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8770.txt 2024-08-02T18:51:28.023 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8776.txt 2024-08-02T18:51:28.023 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8804.txt 2024-08-02T18:51:28.024 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8903.txt 2024-08-02T18:51:28.025 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8904.txt 2024-08-02T18:51:28.026 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8960.txt 2024-08-02T18:51:28.027 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8962.txt 2024-08-02T18:51:28.027 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/sound/wm8994.txt 2024-08-02T18:51:28.028 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ 2024-08-02T18:51:28.029 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/brcm,bcm2835-spi.txt 2024-08-02T18:51:28.030 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/efm32-spi.txt 2024-08-02T18:51:28.030 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-imx-cspi.txt 2024-08-02T18:51:28.031 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/fsl-spi.txt 2024-08-02T18:51:28.032 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/mxs-spi.txt 2024-08-02T18:51:28.033 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra114-spi.txt 2024-08-02T18:51:28.034 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-sflash.txt 2024-08-02T18:51:28.034 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/nvidia,tegra20-slink.txt 2024-08-02T18:51:28.035 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/omap-spi.txt 2024-08-02T18:51:28.036 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/qcom,spi-qup.txt 2024-08-02T18:51:28.037 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-hspi.txt 2024-08-02T18:51:28.038 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/sh-msiof.txt 2024-08-02T18:51:28.038 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/snps,dw-apb-ssi.txt 2024-08-02T18:51:28.039 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-bus.txt 2024-08-02T18:51:28.040 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-cadence.txt 2024-08-02T18:51:28.041 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-davinci.txt 2024-08-02T18:51:28.041 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-dw.txt 2024-08-02T18:51:28.042 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-fsl-dspi.txt 2024-08-02T18:51:28.043 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-gpio.txt 2024-08-02T18:51:28.044 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-img-spfi.txt 2024-08-02T18:51:28.044 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-meson.txt 2024-08-02T18:51:28.045 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-octeon.txt 2024-08-02T18:51:28.046 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-orion.txt 2024-08-02T18:51:28.047 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rockchip.txt 2024-08-02T18:51:28.048 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-rspi.txt 2024-08-02T18:51:28.048 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-samsung.txt 2024-08-02T18:51:28.049 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sc18is602.txt 2024-08-02T18:51:28.050 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sirf.txt 2024-08-02T18:51:28.051 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-st-ssc.txt 2024-08-02T18:51:28.051 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun4i.txt 2024-08-02T18:51:28.052 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-sun6i.txt 2024-08-02T18:51:28.053 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi-xtensa-xtfpga.txt 2024-08-02T18:51:28.054 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_altera.txt 2024-08-02T18:51:28.054 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_atmel.txt 2024-08-02T18:51:28.055 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_oc_tiny.txt 2024-08-02T18:51:28.056 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/spi_pl022.txt 2024-08-02T18:51:28.057 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spi/ti_qspi.txt 2024-08-02T18:51:28.058 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/ 2024-08-02T18:51:28.059 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/qcom,spmi-pmic-arb.txt 2024-08-02T18:51:28.059 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/spmi/spmi.txt 2024-08-02T18:51:28.060 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/ 2024-08-02T18:51:28.061 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/ 2024-08-02T18:51:28.062 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/ 2024-08-02T18:51:28.062 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:28.063 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/lpc32xx-adc.txt 2024-08-02T18:51:28.063 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/mxs-lradc.txt 2024-08-02T18:51:28.064 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/staging/iio/adc/spear-adc.txt 2024-08-02T18:51:28.065 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/submitting-patches.txt 2024-08-02T18:51:28.066 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ 2024-08-02T18:51:28.067 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/armada-thermal.txt 2024-08-02T18:51:28.067 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/db8500-thermal.txt 2024-08-02T18:51:28.068 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/dove-thermal.txt 2024-08-02T18:51:28.069 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/exynos-thermal.txt 2024-08-02T18:51:28.070 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/imx-thermal.txt 2024-08-02T18:51:28.070 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/kirkwood-thermal.txt 2024-08-02T18:51:28.071 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rcar-thermal.txt 2024-08-02T18:51:28.072 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/rockchip-thermal.txt 2024-08-02T18:51:28.073 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/spear-thermal.txt 2024-08-02T18:51:28.073 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/st-thermal.txt 2024-08-02T18:51:28.074 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/tegra-soctherm.txt 2024-08-02T18:51:28.075 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/thermal.txt 2024-08-02T18:51:28.076 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/thermal/ti_soc_thermal.txt 2024-08-02T18:51:28.077 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ 2024-08-02T18:51:28.078 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun4i-timer.txt 2024-08-02T18:51:28.079 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/allwinner,sun5i-a13-hstimer.txt 2024-08-02T18:51:28.079 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/amlogic,meson6-timer.txt 2024-08-02T18:51:28.080 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/arm,sp804.txt 2024-08-02T18:51:28.081 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/brcm,bcm2835-system-timer.txt 2024-08-02T18:51:28.081 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cadence,ttc-timer.txt 2024-08-02T18:51:28.082 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/cirrus,clps711x-timer.txt 2024-08-02T18:51:28.083 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/digicolor-timer.txt 2024-08-02T18:51:28.084 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/energymicro,efm32-timer.txt 2024-08-02T18:51:28.085 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,ftm-timer.txt 2024-08-02T18:51:28.085 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/fsl,imxgpt.txt 2024-08-02T18:51:28.086 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/lsi,zevio-timer.txt 2024-08-02T18:51:28.087 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,armada-370-xp-timer.txt 2024-08-02T18:51:28.088 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/marvell,orion-timer.txt 2024-08-02T18:51:28.088 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/mediatek,mtk-timer.txt 2024-08-02T18:51:28.089 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/moxa,moxart-timer.txt 2024-08-02T18:51:28.090 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra20-timer.txt 2024-08-02T18:51:28.091 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/nvidia,tegra30-timer.txt 2024-08-02T18:51:28.092 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,cmt.txt 2024-08-02T18:51:28.092 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,mtu2.txt 2024-08-02T18:51:28.093 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/renesas,tmu.txt 2024-08-02T18:51:28.094 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/rockchip,rk3288-timer.txt 2024-08-02T18:51:28.095 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/samsung,exynos4210-mct.txt 2024-08-02T18:51:28.096 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/stericsson-u300-apptimer.txt 2024-08-02T18:51:28.097 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/timer/ti,keystone-timer.txt 2024-08-02T18:51:28.098 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ 2024-08-02T18:51:28.099 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/ufs/ufshcd-pltfrm.txt 2024-08-02T18:51:28.099 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/unittest.txt 2024-08-02T18:51:28.100 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ 2024-08-02T18:51:28.101 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/am33xx-usb.txt 2024-08-02T18:51:28.102 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/atmel-usb.txt 2024-08-02T18:51:28.102 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-imx.txt 2024-08-02T18:51:28.103 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-qcom.txt 2024-08-02T18:51:28.104 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-usb2.txt 2024-08-02T18:51:28.105 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ci-hdrc-zevio.txt 2024-08-02T18:51:28.106 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc2.txt 2024-08-02T18:51:28.107 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3-st.txt 2024-08-02T18:51:28.108 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/dwc3.txt 2024-08-02T18:51:28.108 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-omap.txt 2024-08-02T18:51:28.109 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-orion.txt 2024-08-02T18:51:28.110 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ehci-st.txt 2024-08-02T18:51:28.111 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/exynos-usb.txt 2024-08-02T18:51:28.111 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/fsl-usb.txt 2024-08-02T18:51:28.112 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/generic.txt 2024-08-02T18:51:28.113 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/gr-udc.txt 2024-08-02T18:51:28.114 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/isp1301.txt 2024-08-02T18:51:28.115 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-phy.txt 2024-08-02T18:51:28.115 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/keystone-usb.txt 2024-08-02T18:51:28.116 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/lpc32xx-udc.txt 2024-08-02T18:51:28.117 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/msm-hsusb.txt 2024-08-02T18:51:28.118 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/mxs-phy.txt 2024-08-02T18:51:28.119 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-ehci.txt 2024-08-02T18:51:28.120 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/nvidia,tegra20-usb-phy.txt 2024-08-02T18:51:28.120 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-nxp.txt 2024-08-02T18:51:28.121 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-omap3.txt 2024-08-02T18:51:28.122 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ohci-st.txt 2024-08-02T18:51:28.123 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/omap-usb.txt 2024-08-02T18:51:28.124 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/pxa-usb.txt 2024-08-02T18:51:28.125 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/qcom,dwc3.txt 2024-08-02T18:51:28.126 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/renesas_usbhs.txt 2024-08-02T18:51:28.126 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-hsotg.txt 2024-08-02T18:51:28.127 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/samsung-usbphy.txt 2024-08-02T18:51:28.128 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/spear-usb.txt 2024-08-02T18:51:28.129 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/twlxxxx-usb.txt 2024-08-02T18:51:28.130 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/udc-xilinx.txt 2024-08-02T18:51:28.131 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ehci.txt 2024-08-02T18:51:28.131 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-nop-xceiv.txt 2024-08-02T18:51:28.132 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-ohci.txt 2024-08-02T18:51:28.133 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-uhci.txt 2024-08-02T18:51:28.134 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb-xhci.txt 2024-08-02T18:51:28.135 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usb3503.txt 2024-08-02T18:51:28.136 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/usbmisc-imx.txt 2024-08-02T18:51:28.136 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/usb/ux500-usb.txt 2024-08-02T18:51:28.137 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/vendor-prefixes.txt 2024-08-02T18:51:28.138 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ 2024-08-02T18:51:28.139 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7123.txt 2024-08-02T18:51:28.142 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/adi,adv7511.txt 2024-08-02T18:51:28.142 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/analog-tv-connector.txt 2024-08-02T18:51:28.142 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/arm,pl11x.txt 2024-08-02T18:51:28.142 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/atmel,lcdc.txt 2024-08-02T18:51:28.143 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/ 2024-08-02T18:51:28.144 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/88pm860x.txt 2024-08-02T18:51:28.145 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/gpio-backlight.txt 2024-08-02T18:51:28.146 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/lp855x.txt 2024-08-02T18:51:28.147 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/max8925-backlight.txt 2024-08-02T18:51:28.148 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/pwm-backlight.txt 2024-08-02T18:51:28.148 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/backlight/tps65217-backlight.txt 2024-08-02T18:51:28.149 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ 2024-08-02T18:51:28.150 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ps8622.txt 2024-08-02T18:51:28.151 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/bridge/ptn3460.txt 2024-08-02T18:51:28.152 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/cirrus,clps711x-fb.txt 2024-08-02T18:51:28.153 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/display-timing.txt 2024-08-02T18:51:28.153 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dvi-connector.txt 2024-08-02T18:51:28.154 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/dw_hdmi-rockchip.txt 2024-08-02T18:51:28.155 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos7-decon.txt 2024-08-02T18:51:28.156 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dp.txt 2024-08-02T18:51:28.157 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_dsim.txt 2024-08-02T18:51:28.157 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmi.txt 2024-08-02T18:51:28.158 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiddc.txt 2024-08-02T18:51:28.160 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_hdmiphy.txt 2024-08-02T18:51:28.160 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/exynos_mixer.txt 2024-08-02T18:51:28.161 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/fsl,imx-fb.txt 2024-08-02T18:51:28.162 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/hdmi-connector.txt 2024-08-02T18:51:28.163 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/lgphilips,lb035q02.txt 2024-08-02T18:51:28.164 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dpi.txt 2024-08-02T18:51:28.165 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/panel-dsi-cm.txt 2024-08-02T18:51:28.165 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/renesas,du.txt 2024-08-02T18:51:28.166 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-drm.txt 2024-08-02T18:51:28.476 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/rockchip-vop.txt 2024-08-02T18:51:28.477 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/samsung-fimd.txt 2024-08-02T18:51:28.478 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sharp,ls037v7dw01.txt 2024-08-02T18:51:28.479 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer-sunxi.txt 2024-08-02T18:51:28.480 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/simple-framebuffer.txt 2024-08-02T18:51:28.481 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/sony,acx565akm.txt 2024-08-02T18:51:28.482 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1289fb.txt 2024-08-02T18:51:28.482 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ssd1307fb.txt 2024-08-02T18:51:28.483 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/thine,thc63lvdm83d 2024-08-02T18:51:28.484 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,dra7-dss.txt 2024-08-02T18:51:28.485 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap-dss.txt 2024-08-02T18:51:28.486 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap2-dss.txt 2024-08-02T18:51:28.487 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap3-dss.txt 2024-08-02T18:51:28.488 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap4-dss.txt 2024-08-02T18:51:28.489 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,omap5-dss.txt 2024-08-02T18:51:28.490 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,opa362.txt 2024-08-02T18:51:28.490 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tfp410.txt 2024-08-02T18:51:28.491 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/ti,tpd12s015.txt 2024-08-02T18:51:28.492 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/toppoly,td028ttec1.txt 2024-08-02T18:51:28.493 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/tpo,td043mtea1.txt 2024-08-02T18:51:28.494 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/vga-connector.txt 2024-08-02T18:51:28.494 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/via,vt8500-fb.txt 2024-08-02T18:51:28.495 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,prizm-ge-rops.txt 2024-08-02T18:51:28.496 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/video/wm,wm8505-fb.txt 2024-08-02T18:51:28.497 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/ 2024-08-02T18:51:28.499 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/virtio/mmio.txt 2024-08-02T18:51:28.499 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/ 2024-08-02T18:51:28.500 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/fsl-imx-owire.txt 2024-08-02T18:51:28.501 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/omap-hdq.txt 2024-08-02T18:51:28.502 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/w1/w1-gpio.txt 2024-08-02T18:51:28.503 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ 2024-08-02T18:51:28.504 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-at91rm9200-wdt.txt 2024-08-02T18:51:28.504 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/atmel-wdt.txt 2024-08-02T18:51:28.505 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/brcm,bcm2835-pm-wdog.txt 2024-08-02T18:51:28.506 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/cadence-wdt.txt 2024-08-02T18:51:28.507 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/davinci-wdt.txt 2024-08-02T18:51:28.508 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/dw_wdt.txt 2024-08-02T18:51:28.508 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/fsl-imx-wdt.txt 2024-08-02T18:51:28.509 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/gpio-wdt.txt 2024-08-02T18:51:28.510 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/imgpdc-wdt.txt 2024-08-02T18:51:28.511 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/ingenic,jz4740-wdt.txt 2024-08-02T18:51:28.512 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/marvel.txt 2024-08-02T18:51:28.513 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/men-a021-wdt.txt 2024-08-02T18:51:28.513 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/meson6-wdt.txt 2024-08-02T18:51:28.514 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/moxa,moxart-watchdog.txt 2024-08-02T18:51:28.515 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/mtk-wdt.txt 2024-08-02T18:51:28.516 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/of-xilinx-wdt.txt 2024-08-02T18:51:28.517 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/omap-wdt.txt 2024-08-02T18:51:28.518 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/pnx4008-wdt.txt 2024-08-02T18:51:28.518 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qca-ar7130-wdt.txt 2024-08-02T18:51:28.519 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/qcom-wdt.txt 2024-08-02T18:51:28.520 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/rt2880-wdt.txt 2024-08-02T18:51:28.521 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/samsung-wdt.txt 2024-08-02T18:51:28.521 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sirfsoc_wdt.txt 2024-08-02T18:51:28.522 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/stericsson-coh901327.txt 2024-08-02T18:51:28.523 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/sunxi-wdt.txt 2024-08-02T18:51:28.524 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/watchdog/twl4030-wdt.txt 2024-08-02T18:51:28.525 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ 2024-08-02T18:51:28.526 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/ce4100.txt 2024-08-02T18:51:28.526 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/interrupt.txt 2024-08-02T18:51:28.527 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/x86/timer.txt 2024-08-02T18:51:28.528 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/xilinx.txt 2024-08-02T18:51:28.529 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/ 2024-08-02T18:51:28.530 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/bindings/xillybus/xillybus.txt 2024-08-02T18:51:28.530 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/booting-without-of.txt 2024-08-02T18:51:28.531 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/changesets.txt 2024-08-02T18:51:28.532 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/dynamic-resolution-notes.txt 2024-08-02T18:51:28.533 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/of_selftest.txt 2024-08-02T18:51:28.534 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/overlay-notes.txt 2024-08-02T18:51:28.535 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/todo.txt 2024-08-02T18:51:28.536 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/devicetree/usage-model.txt 2024-08-02T18:51:28.536 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/digsig.txt 2024-08-02T18:51:28.537 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dma-buf-sharing.txt 2024-08-02T18:51:28.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dmaengine/ 2024-08-02T18:51:28.539 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dmaengine/00-INDEX 2024-08-02T18:51:28.540 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dmaengine/client.txt 2024-08-02T18:51:28.541 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dmaengine/dmatest.txt 2024-08-02T18:51:28.541 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dmaengine/provider.txt 2024-08-02T18:51:28.542 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dontdiff 2024-08-02T18:51:28.543 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/ 2024-08-02T18:51:28.544 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/binding.txt 2024-08-02T18:51:28.545 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/bus.txt 2024-08-02T18:51:28.545 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/class.txt 2024-08-02T18:51:28.546 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/design-patterns.txt 2024-08-02T18:51:28.547 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/device.txt 2024-08-02T18:51:28.548 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/devres.txt 2024-08-02T18:51:28.549 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/driver.txt 2024-08-02T18:51:28.550 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/overview.txt 2024-08-02T18:51:28.550 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/platform.txt 2024-08-02T18:51:28.551 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/driver-model/porting.txt 2024-08-02T18:51:28.552 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/ 2024-08-02T18:51:28.553 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/README.dvb-usb 2024-08-02T18:51:28.554 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/avermedia.txt 2024-08-02T18:51:28.555 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/bt8xx.txt 2024-08-02T18:51:28.555 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/cards.txt 2024-08-02T18:51:28.556 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/ci.txt 2024-08-02T18:51:28.560 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/contributors.txt 2024-08-02T18:51:28.561 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/faq.txt 2024-08-02T18:51:28.562 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/get_dvb_firmware 2024-08-02T18:51:28.563 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/lmedm04.txt 2024-08-02T18:51:28.564 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/opera-firmware.txt 2024-08-02T18:51:28.565 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/readme.txt 2024-08-02T18:51:28.565 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/technisat.txt 2024-08-02T18:51:28.566 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/ttusb-dec.txt 2024-08-02T18:51:28.567 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dvb/udev.txt 2024-08-02T18:51:28.568 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/dynamic-debug-howto.txt 2024-08-02T18:51:28.569 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/early-userspace/ 2024-08-02T18:51:28.570 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/early-userspace/README 2024-08-02T18:51:28.571 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/early-userspace/buffer-format.txt 2024-08-02T18:51:28.572 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/edac.txt 2024-08-02T18:51:28.573 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/efi-stub.txt 2024-08-02T18:51:28.575 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/eisa.txt 2024-08-02T18:51:28.575 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/email-clients.txt 2024-08-02T18:51:28.576 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/extcon/ 2024-08-02T18:51:28.576 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/extcon/porting-android-switch-class 2024-08-02T18:51:28.577 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fault-injection/ 2024-08-02T18:51:28.578 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fault-injection/fault-injection.txt 2024-08-02T18:51:28.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2604597812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc102b00 msgr2=0x7fdbbc102ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2604597812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc102b00 0x7fdbbc102ee0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fdbac009cd0 tx=0x7fdbac02a8d0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2604597812 shutdown_connections 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2604597812 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc108030 0x7fdbbc10e9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2604597812 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc1034b0 0x7fdbbc1078f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2604597812 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc102b00 0x7fdbbc102ee0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2604597812 >> 172.21.15.103:0/2604597812 conn(0x7fdbbc0fc500 msgr2=0x7fdbbc0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2604597812 shutdown_connections 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2604597812 wait complete. 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.564+0000 7fdbc12c0640 1 Processor -- start 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbc12c0640 1 -- start start 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbc12c0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc102b00 0x7fdbbc1983c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbc12c0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc1034b0 0x7fdbbc198900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbc12c0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc108030 0x7fdbbc19cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbc12c0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc111f20 con 0x7fdbbc1034b0 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbc12c0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc111da0 con 0x7fdbbc102b00 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbc12c0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1120a0 con 0x7fdbbc108030 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc102b00 0x7fdbbc1983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc102b00 0x7fdbbc1983c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:57200/0 (socket says 172.21.15.103:57200) 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 -- 172.21.15.103:0/2891080082 learned_addr learned my addr 172.21.15.103:0/2891080082 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc1034b0 0x7fdbbc198900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc108030 0x7fdbbc19cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 -- 172.21.15.103:0/2891080082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc108030 msgr2=0x7fdbbc19cc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc108030 0x7fdbbc19cc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 -- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc1034b0 msgr2=0x7fdbbc198900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc1034b0 0x7fdbbc198900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 -- 172.21.15.103:0/2891080082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbbc19d370 con 0x7fdbbc102b00 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc1034b0 0x7fdbbc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.565+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc102b00 0x7fdbbc1983c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdbac006010 tx=0x7fdbac031650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.566+0000 7fdba3fff640 1 -- 172.21.15.103:0/2891080082 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac02f7e0 con 0x7fdbbc102b00 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.566+0000 7fdba3fff640 1 -- 172.21.15.103:0/2891080082 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbac02fe80 con 0x7fdbbc102b00 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.566+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2891080082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbbc19d600 con 0x7fdbbc102b00 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.566+0000 7fdba3fff640 1 -- 172.21.15.103:0/2891080082 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac046480 con 0x7fdbbc102b00 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.566+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2891080082 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbbc1a4f40 con 0x7fdbbc102b00 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.568+0000 7fdba3fff640 1 -- 172.21.15.103:0/2891080082 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fdbac0306b0 con 0x7fdbbc102b00 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.568+0000 7fdbc36be740 1 Processor -- start 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbc36be740 1 -- start start 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef413d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef41910 0x55ab0ef4bc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbc36be740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ab0eea6a40 con 0x55ab0ef40ff0 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbc36be740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ab0ee3e9d0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbc36be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ab0eea2a00 con 0x55ab0ef41910 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef413d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef413d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40444/0 (socket says 172.21.15.103:40444) 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/844259028 learned_addr learned my addr 172.21.15.103:0/844259028 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdba3fff640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdba40a2d70 0x7fdba40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef41910 0x55ab0ef4bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdba40a2d70 0x7fdba40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdba3fff640 1 -- 172.21.15.103:0/2891080082 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fdbac0f0590 con 0x7fdbbc102b00 2024-08-02T18:51:28.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbba7fc640 1 -- 172.21.15.103:0/844259028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef41910 msgr2=0x55ab0ef4bc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef41910 0x55ab0ef4bc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbba7fc640 1 -- 172.21.15.103:0/844259028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 msgr2=0x55ab0ef413d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef413d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbba7fc640 1 -- 172.21.15.103:0/844259028 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab0ee45650 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.569+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef41910 0x55ab0ef4bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4e5c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc06a000 tx=0x7fdbb00117b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9040b42f4eeac3be server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdba17fa640 1 -- 172.21.15.103:0/844259028 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb0012450 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdba17fa640 1 -- 172.21.15.103:0/844259028 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbb0012af0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdba17fa640 1 -- 172.21.15.103:0/844259028 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb000fbb0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 -- 172.21.15.103:0/844259028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef4c1d0 msgr2=0x55ab0ef4e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4e5c0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc06a000 tx=0x7fdbb00117b0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdba40a2d70 0x7fdba40a5230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400bfd0 tx=0x7fdbb4004730 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 -- 172.21.15.103:0/844259028 shutdown_connections 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4e5c0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef41910 0x55ab0ef4bc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 --2- 172.21.15.103:0/844259028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef413d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 -- 172.21.15.103:0/844259028 >> 172.21.15.103:0/844259028 conn(0x55ab0ef3d580 msgr2=0x55ab0ef3d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 -- 172.21.15.103:0/844259028 shutdown_connections 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.570+0000 7fdbc36be740 1 -- 172.21.15.103:0/844259028 wait complete. 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 1 -- start start 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 1 Processor -- start 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef4bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef48f90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef496d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55ab0ef4eda0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55ab0ee61b20 con 0x55ab0ef41910 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55ab0ef4ef20 con 0x55ab0ef40ff0 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbc36be740 10 client.0 _ll_register_callbacks cb 0x55ab0ee5fbb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbba7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef48f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef496d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40450/0 (socket says 172.21.15.103:40450) 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbba7fc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef48f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:57210/0 (socket says 172.21.15.103:57210) 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/1146596810 learned_addr learned my addr 172.21.15.103:0/1146596810 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.571+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef4bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/1146596810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 msgr2=0x55ab0ef4bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef4bc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/1146596810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 msgr2=0x55ab0ef48f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:28.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef48f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/1146596810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab0ec183c0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef48f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef496d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4011870 tx=0x7fdbb40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a91e5d6d6c9d20e server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdb9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdb9eff5640 1 -- 172.21.15.103:0/1146596810 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4019070 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdb9eff5640 1 -- 172.21.15.103:0/1146596810 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fdbb4010de0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbc36be740 1 -- 172.21.15.103:0/1146596810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbb0012af0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdb9eff5640 1 -- 172.21.15.103:0/1146596810 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbb4031050 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbc36be740 10 client.16029 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdbc36be740 1 -- 172.21.15.103:0/1146596810 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ab0ef5a830 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.572+0000 7fdb9eff5640 1 -- 172.21.15.103:0/1146596810 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbb0012af0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdb9eff5640 1 -- 172.21.15.103:0/1146596810 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdbb400f4b0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdbc36be740 10 client.16029 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdbc36be740 10 client.16029 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdbc36be740 20 client.16029 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ab0ef5bcf0 0x55ab0ef5e100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdbc36be740 4 client.16029 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdbc36be740 1 -- 172.21.15.103:0/1146596810 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55ab0eeb3fb0 con 0x55ab0ef5bcf0 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ab0ef5bcf0 0x55ab0ef5e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ab0ef5bcf0 0x55ab0ef5e100 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=c99244f91d96ba3a server_cookie=a6427d17953de706 in_seq=0 out_seq=0 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.573+0000 7fdb9eff5640 10 client.16029 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdb9eff5640 1 -- 172.21.15.103:0/1146596810 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55ab0eeb3fb0 con 0x55ab0ef5bcf0 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdb9eff5640 10 client.16029 handle_command_reply: tid=0 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 client.16029 shutdown 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 -- 172.21.15.103:0/1146596810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 msgr2=0x55ab0ef496d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.588 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef496d0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fdbb4011870 tx=0x7fdbb40046c0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 -- 172.21.15.103:0/1146596810 shutdown_connections 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef496d0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ab0ef5bcf0 0x55ab0ef5e100 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef48f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1146596810 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef4bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdb9eff5640 0 client.16029 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 -- 172.21.15.103:0/1146596810 >> 172.21.15.103:0/1146596810 conn(0x55ab0ef3d580 msgr2=0x55ab0ef432b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.574+0000 7fdbc36be740 1 -- 172.21.15.103:0/1146596810 shutdown_connections 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.575+0000 7fdbc36be740 1 -- 172.21.15.103:0/1146596810 wait complete. 2024-08-02T18:51:28.589 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.575+0000 7fdbc36be740 20 client.16029 trim_cache size 0 max 16384 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fault-injection/notifier-error-inject.txt 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fault-injection/provoke-crashes.txt 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/ 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/00-INDEX 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/api.txt 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/arkfb.txt 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/aty128fb.txt 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/cirrusfb.txt 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/cmap_xfbdev.txt 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/deferred_io.txt 2024-08-02T18:51:28.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/efifb.txt 2024-08-02T18:51:28.592 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/ep93xx-fb.txt 2024-08-02T18:51:28.592 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/fbcon.txt 2024-08-02T18:51:28.592 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/framebuffer.txt 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbc36be740 1 Processor -- start 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbc36be740 1 -- start start 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef48870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef58030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef63980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbc36be740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1b14d0 con 0x55ab0ef40ff0 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbc36be740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1aeda0 con 0x55ab0ef41910 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbc36be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1acbf0 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbbaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef48870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbbaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef48870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40452/0 (socket says 172.21.15.103:40452) 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.588+0000 7fdbbaffd640 1 -- 172.21.15.103:0/1152418443 learned_addr learned my addr 172.21.15.103:0/1152418443 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef58030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef63980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdbbaffd640 1 -- 172.21.15.103:0/1152418443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef4c1d0 msgr2=0x55ab0ef63980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef63980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdbbaffd640 1 -- 172.21.15.103:0/1152418443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 msgr2=0x55ab0ef58030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef58030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.594 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdbbaffd640 1 -- 172.21.15.103:0/1152418443 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ab0ef58570 con 0x55ab0ef40ff0 2024-08-02T18:51:28.594 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/gxfb.txt 2024-08-02T18:51:28.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef48870 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0b9250 tx=0x7fdbac08e840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b1cfcea2bcd78c0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:28.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdba0ff9640 1 -- 172.21.15.103:0/1152418443 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac087910 con 0x55ab0ef40ff0 2024-08-02T18:51:28.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdba0ff9640 1 -- 172.21.15.103:0/1152418443 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbac036040 con 0x55ab0ef40ff0 2024-08-02T18:51:28.595 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.589+0000 7fdba0ff9640 1 -- 172.21.15.103:0/1152418443 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbac0bab80 con 0x55ab0ef40ff0 2024-08-02T18:51:28.595 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/intel810.txt 2024-08-02T18:51:28.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 -- 172.21.15.103:0/1152418443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 msgr2=0x55ab0ef48870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef48870 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fdbac0b9250 tx=0x7fdbac08e840 comp rx=0 tx=0).stop 2024-08-02T18:51:28.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 -- 172.21.15.103:0/1152418443 shutdown_connections 2024-08-02T18:51:28.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef63980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef58030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 --2- 172.21.15.103:0/1152418443 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef48870 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 -- 172.21.15.103:0/1152418443 >> 172.21.15.103:0/1152418443 conn(0x55ab0ef3d580 msgr2=0x55ab0ef3c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:28.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 -- 172.21.15.103:0/1152418443 shutdown_connections 2024-08-02T18:51:28.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 -- 172.21.15.103:0/1152418443 wait complete. 2024-08-02T18:51:28.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 -- start start 2024-08-02T18:51:28.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.590+0000 7fdbc36be740 1 Processor -- start 2024-08-02T18:51:28.597 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/intelfb.txt 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef547a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef4cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbc36be740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbc36be740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1ad260 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbc36be740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1ae6d0 con 0x55ab0ef41910 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbc36be740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdbbc1ad930 con 0x55ab0ef40ff0 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbc36be740 10 client.0 _ll_register_callbacks cb 0x7fdbb4005c50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:40464/0 (socket says 172.21.15.103:40464) 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/270723898 learned_addr learned my addr 172.21.15.103:0/270723898 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbba7fc640 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef4cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef547a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 msgr2=0x55ab0ef547a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef547a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/270723898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 msgr2=0x55ab0ef4cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef4cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 -- 172.21.15.103:0/270723898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ab0ef4da50 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbbb7fe640 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4d3e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400bc60 tx=0x7fdbb400f6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a9369e05dcc425f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdb9eff5640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdb9eff5640 1 -- 172.21.15.103:0/270723898 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbb4019050 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdb9eff5640 1 -- 172.21.15.103:0/270723898 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fdbb4013240 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.600 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.591+0000 7fdbc36be740 1 -- 172.21.15.103:0/270723898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdbac036040 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.601 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/internals.txt 2024-08-02T18:51:28.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdb9eff5640 1 -- 172.21.15.103:0/270723898 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fdbb4044050 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.601 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbc36be740 10 client.16035 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbc36be740 1 -- 172.21.15.103:0/270723898 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55ab0efc6950 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdb9eff5640 1 -- 172.21.15.103:0/270723898 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdbac036040 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdb9eff5640 1 -- 172.21.15.103:0/270723898 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7fdbb4011100 con 0x55ab0ef4c1d0 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbc36be740 10 client.16035 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbc36be740 10 client.16035 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbc36be740 20 client.16035 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbc36be740 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ab0efc6e60 0x55ab0efc9250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbc36be740 4 client.16035 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:51:28.602 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbc36be740 1 -- 172.21.15.103:0/270723898 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55ab0eeae4c0 con 0x55ab0efc6e60 2024-08-02T18:51:28.602 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/lxfb.txt 2024-08-02T18:51:28.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.592+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ab0efc6e60 0x55ab0efc9250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:28.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdb9eff5640 10 client.16035 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:51:28.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbbaffd640 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ab0efc6e60 0x55ab0efc9250 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e0f15aa3872996a2 server_cookie=8e0996b976e8db5c in_seq=0 out_seq=0 2024-08-02T18:51:28.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdb9eff5640 1 -- 172.21.15.103:0/270723898 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55ab0eeae4c0 con 0x55ab0efc6e60 2024-08-02T18:51:28.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdb9eff5640 10 client.16035 handle_command_reply: tid=0 2024-08-02T18:51:28.603 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 client.16035 shutdown 2024-08-02T18:51:28.604 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/matroxfb.txt 2024-08-02T18:51:28.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 -- 172.21.15.103:0/270723898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 msgr2=0x55ab0ef4d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.604 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4d3e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400bc60 tx=0x7fdbb400f6e0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 -- 172.21.15.103:0/270723898 shutdown_connections 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55ab0ef4c1d0 0x55ab0ef4d3e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x55ab0efc6e60 0x55ab0efc9250 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55ab0ef41910 0x55ab0ef4cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdb9eff5640 0 client.16035 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 --2- 172.21.15.103:0/270723898 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55ab0ef40ff0 0x55ab0ef547a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 -- 172.21.15.103:0/270723898 >> 172.21.15.103:0/270723898 conn(0x55ab0ef3d580 msgr2=0x55ab0ef42a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 -- 172.21.15.103:0/270723898 shutdown_connections 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 1 -- 172.21.15.103:0/270723898 wait complete. 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.593+0000 7fdbc36be740 20 client.16035 trim_cache size 0 max 16384 2024-08-02T18:51:28.605 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:51:28.606 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/metronomefb.txt 2024-08-02T18:51:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdba40a2d70 msgr2=0x7fdba40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.606 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdba40a2d70 0x7fdba40a5230 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fdbb400bfd0 tx=0x7fdbb4004730 comp rx=0 tx=0).stop 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2891080082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc102b00 msgr2=0x7fdbbc1983c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc102b00 0x7fdbbc1983c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdbac006010 tx=0x7fdbac031650 comp rx=0 tx=0).stop 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2891080082 shutdown_connections 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdba40a2d70 0x7fdba40a5230 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdbbc108030 0x7fdbbc19cc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdbbc1034b0 0x7fdbbc198900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 --2- 172.21.15.103:0/2891080082 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdbbc102b00 0x7fdbbc1983c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2891080082 >> 172.21.15.103:0/2891080082 conn(0x7fdbbc0fc500 msgr2=0x7fdbbc105a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2891080082 shutdown_connections 2024-08-02T18:51:28.607 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:28.594+0000 7fdbc12c0640 1 -- 172.21.15.103:0/2891080082 wait complete. 2024-08-02T18:51:28.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/modedb.txt 2024-08-02T18:51:28.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/pvr2fb.txt 2024-08-02T18:51:28.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/pxafb.txt 2024-08-02T18:51:28.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/s3fb.txt 2024-08-02T18:51:28.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/sa1100fb.txt 2024-08-02T18:51:28.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/sh7760fb.txt 2024-08-02T18:51:28.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/sisfb.txt 2024-08-02T18:51:28.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/sm501.txt 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/sstfb.txt 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/tgafb.txt 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/tridentfb.txt 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/udlfb.txt 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/uvesafb.txt 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/vesafb.txt 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/viafb.modes 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/viafb.txt 2024-08-02T18:51:28.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fb/vt8623fb.txt 2024-08-02T18:51:28.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ 2024-08-02T18:51:28.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/.gitignore 2024-08-02T18:51:28.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/00-INDEX 2024-08-02T18:51:28.611 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/9p.txt 2024-08-02T18:51:28.612 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/Locking 2024-08-02T18:51:28.613 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/Makefile 2024-08-02T18:51:28.614 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/adfs.txt 2024-08-02T18:51:28.615 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/affs.txt 2024-08-02T18:51:28.616 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/afs.txt 2024-08-02T18:51:28.616 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/autofs4-mount-control.txt 2024-08-02T18:51:28.617 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/autofs4.txt 2024-08-02T18:51:28.619 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/automount-support.txt 2024-08-02T18:51:28.619 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/befs.txt 2024-08-02T18:51:28.620 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/bfs.txt 2024-08-02T18:51:28.620 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/btrfs.txt 2024-08-02T18:51:28.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/caching/ 2024-08-02T18:51:28.622 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/caching/backend-api.txt 2024-08-02T18:51:28.623 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/caching/cachefiles.txt 2024-08-02T18:51:28.624 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/caching/fscache.txt 2024-08-02T18:51:28.624 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/caching/netfs-api.txt 2024-08-02T18:51:28.625 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/caching/object.txt 2024-08-02T18:51:28.626 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/caching/operations.txt 2024-08-02T18:51:28.627 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ceph.txt 2024-08-02T18:51:28.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/cifs/ 2024-08-02T18:51:28.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/cifs/AUTHORS 2024-08-02T18:51:28.630 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/cifs/CHANGES 2024-08-02T18:51:28.630 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/cifs/README 2024-08-02T18:51:28.631 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/cifs/TODO 2024-08-02T18:51:28.631 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/cifs/cifs.txt 2024-08-02T18:51:28.632 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/cifs/winucase_convert.pl 2024-08-02T18:51:28.633 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/coda.txt 2024-08-02T18:51:28.634 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/configfs/ 2024-08-02T18:51:28.635 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/configfs/Makefile 2024-08-02T18:51:28.636 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs.txt 2024-08-02T18:51:28.637 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_explicit.c 2024-08-02T18:51:28.638 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/configfs/configfs_example_macros.c 2024-08-02T18:51:28.639 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/cramfs.txt 2024-08-02T18:51:28.639 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/dax.txt 2024-08-02T18:51:28.640 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/debugfs.txt 2024-08-02T18:51:28.641 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/devpts.txt 2024-08-02T18:51:28.642 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/directory-locking 2024-08-02T18:51:28.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/dlmfs.txt 2024-08-02T18:51:28.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/dnotify.txt 2024-08-02T18:51:28.644 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/dnotify_test.c 2024-08-02T18:51:28.645 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ecryptfs.txt 2024-08-02T18:51:28.646 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/efivarfs.txt 2024-08-02T18:51:28.647 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/exofs.txt 2024-08-02T18:51:28.648 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ext2.txt 2024-08-02T18:51:28.649 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ext3.txt 2024-08-02T18:51:28.649 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ext4.txt 2024-08-02T18:51:28.650 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/f2fs.txt 2024-08-02T18:51:28.651 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/fiemap.txt 2024-08-02T18:51:28.652 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/files.txt 2024-08-02T18:51:28.653 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/fuse.txt 2024-08-02T18:51:28.654 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/gfs2-glocks.txt 2024-08-02T18:51:28.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/gfs2-uevents.txt 2024-08-02T18:51:28.656 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/gfs2.txt 2024-08-02T18:51:28.657 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/hfs.txt 2024-08-02T18:51:28.658 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/hfsplus.txt 2024-08-02T18:51:28.660 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/hpfs.txt 2024-08-02T18:51:28.660 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/inotify.txt 2024-08-02T18:51:28.661 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/isofs.txt 2024-08-02T18:51:28.662 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/jfs.txt 2024-08-02T18:51:28.663 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/locks.txt 2024-08-02T18:51:28.664 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/logfs.txt 2024-08-02T18:51:28.665 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/mandatory-locking.txt 2024-08-02T18:51:28.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ncpfs.txt 2024-08-02T18:51:28.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/ 2024-08-02T18:51:28.667 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/00-INDEX 2024-08-02T18:51:28.668 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/Exporting 2024-08-02T18:51:28.669 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/fault_injection.txt 2024-08-02T18:51:28.670 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/idmapper.txt 2024-08-02T18:51:28.671 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/knfsd-stats.txt 2024-08-02T18:51:28.671 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs-rdma.txt 2024-08-02T18:51:28.672 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs.txt 2024-08-02T18:51:28.673 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfs41-server.txt 2024-08-02T18:51:28.674 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsd-admin-interfaces.txt 2024-08-02T18:51:28.675 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/nfsroot.txt 2024-08-02T18:51:28.676 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs-block-server.txt 2024-08-02T18:51:28.677 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/pnfs.txt 2024-08-02T18:51:28.678 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-cache.txt 2024-08-02T18:51:28.679 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nfs/rpc-server-gss.txt 2024-08-02T18:51:28.680 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/nilfs2.txt 2024-08-02T18:51:28.681 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ntfs.txt 2024-08-02T18:51:28.681 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ocfs2.txt 2024-08-02T18:51:28.682 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/omfs.txt 2024-08-02T18:51:28.683 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/overlayfs.txt 2024-08-02T18:51:28.684 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/path-lookup.txt 2024-08-02T18:51:28.685 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/ 2024-08-02T18:51:28.686 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/design_notes.txt 2024-08-02T18:51:28.686 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/info.txt 2024-08-02T18:51:28.687 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/pohmelfs/network_protocol.txt 2024-08-02T18:51:28.688 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/porting 2024-08-02T18:51:28.689 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/proc.txt 2024-08-02T18:51:28.690 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/qnx6.txt 2024-08-02T18:51:28.691 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/quota.txt 2024-08-02T18:51:28.692 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ramfs-rootfs-initramfs.txt 2024-08-02T18:51:28.693 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/relay.txt 2024-08-02T18:51:28.694 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/romfs.txt 2024-08-02T18:51:28.695 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/seq_file.txt 2024-08-02T18:51:28.696 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/sharedsubtree.txt 2024-08-02T18:51:28.697 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/spufs.txt 2024-08-02T18:51:28.698 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/squashfs.txt 2024-08-02T18:51:28.699 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/sysfs-pci.txt 2024-08-02T18:51:28.700 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/sysfs-tagging.txt 2024-08-02T18:51:28.700 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/sysfs.txt 2024-08-02T18:51:28.701 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/sysv-fs.txt 2024-08-02T18:51:28.702 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/tmpfs.txt 2024-08-02T18:51:28.703 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ubifs.txt 2024-08-02T18:51:28.704 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/udf.txt 2024-08-02T18:51:28.705 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/ufs.txt 2024-08-02T18:51:28.706 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/vfat.txt 2024-08-02T18:51:28.706 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/vfs.txt 2024-08-02T18:51:28.707 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/xfs-delayed-logging-design.txt 2024-08-02T18:51:28.708 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/xfs-self-describing-metadata.txt 2024-08-02T18:51:28.709 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/filesystems/xfs.txt 2024-08-02T18:51:28.710 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/firmware_class/ 2024-08-02T18:51:28.711 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/firmware_class/README 2024-08-02T18:51:28.711 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/firmware_class/hotplug-script 2024-08-02T18:51:28.712 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/flexible-arrays.txt 2024-08-02T18:51:28.713 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/ 2024-08-02T18:51:28.714 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/00-INDEX 2024-08-02T18:51:28.715 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/API.txt 2024-08-02T18:51:28.716 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/FMC-and-SDB.txt 2024-08-02T18:51:28.717 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/carrier.txt 2024-08-02T18:51:28.718 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/fmc-chardev.txt 2024-08-02T18:51:28.718 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/fmc-fakedev.txt 2024-08-02T18:51:28.719 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/fmc-trivial.txt 2024-08-02T18:51:28.720 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/fmc-write-eeprom.txt 2024-08-02T18:51:28.721 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/identifiers.txt 2024-08-02T18:51:28.722 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/mezzanine.txt 2024-08-02T18:51:28.723 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/fmc/parameters.txt 2024-08-02T18:51:28.724 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/ 2024-08-02T18:51:28.724 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/README.txt 2024-08-02T18:51:28.725 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/atomic-ops.txt 2024-08-02T18:51:28.726 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/booting.txt 2024-08-02T18:51:28.727 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/clock.txt 2024-08-02T18:51:28.728 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/configuring.txt 2024-08-02T18:51:28.729 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/features.txt 2024-08-02T18:51:28.730 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/gdbinit 2024-08-02T18:51:28.731 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/gdbstub.txt 2024-08-02T18:51:28.732 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/kernel-ABI.txt 2024-08-02T18:51:28.733 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/frv/mmu-layout.txt 2024-08-02T18:51:28.734 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/futex-requeue-pi.txt 2024-08-02T18:51:28.735 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gcov.txt 2024-08-02T18:51:28.736 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gdb-kernel-debugging.txt 2024-08-02T18:51:28.737 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gpio/ 2024-08-02T18:51:28.738 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gpio/00-INDEX 2024-08-02T18:51:28.739 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gpio/board.txt 2024-08-02T18:51:28.740 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gpio/consumer.txt 2024-08-02T18:51:28.741 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gpio/driver.txt 2024-08-02T18:51:28.742 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gpio/gpio-legacy.txt 2024-08-02T18:51:28.743 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gpio/gpio.txt 2024-08-02T18:51:28.744 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/gpio/sysfs.txt 2024-08-02T18:51:28.745 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hid/ 2024-08-02T18:51:28.745 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hid/hid-sensor.txt 2024-08-02T18:51:28.746 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hid/hid-transport.txt 2024-08-02T18:51:28.747 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hid/hiddev.txt 2024-08-02T18:51:28.748 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hid/hidraw.txt 2024-08-02T18:51:28.749 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hid/uhid.txt 2024-08-02T18:51:28.750 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/highuid.txt 2024-08-02T18:51:28.751 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hsi.txt 2024-08-02T18:51:28.752 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hw_random.txt 2024-08-02T18:51:28.753 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ 2024-08-02T18:51:28.754 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ab8500 2024-08-02T18:51:28.755 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/abituguru 2024-08-02T18:51:28.756 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/abituguru-datasheet 2024-08-02T18:51:28.757 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/abituguru3 2024-08-02T18:51:28.758 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/abx500 2024-08-02T18:51:28.759 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/acpi_power_meter 2024-08-02T18:51:28.760 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ad7314 2024-08-02T18:51:28.762 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adc128d818 2024-08-02T18:51:28.762 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adm1021 2024-08-02T18:51:28.762 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adm1025 2024-08-02T18:51:28.763 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adm1026 2024-08-02T18:51:28.764 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adm1031 2024-08-02T18:51:28.765 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adm1275 2024-08-02T18:51:28.766 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adm9240 2024-08-02T18:51:28.767 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ads1015 2024-08-02T18:51:28.767 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ads7828 2024-08-02T18:51:28.768 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adt7410 2024-08-02T18:51:28.769 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adt7411 2024-08-02T18:51:28.770 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adt7462 2024-08-02T18:51:28.771 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adt7470 2024-08-02T18:51:28.772 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/adt7475 2024-08-02T18:51:28.773 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/amc6821 2024-08-02T18:51:28.773 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/asb100 2024-08-02T18:51:28.774 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/asc7621 2024-08-02T18:51:28.775 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/coretemp 2024-08-02T18:51:28.776 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/da9052 2024-08-02T18:51:28.777 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/da9055 2024-08-02T18:51:28.778 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/dme1737 2024-08-02T18:51:28.778 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ds1621 2024-08-02T18:51:28.779 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ds620 2024-08-02T18:51:28.780 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/emc1403 2024-08-02T18:51:28.781 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/emc2103 2024-08-02T18:51:28.782 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/emc6w201 2024-08-02T18:51:28.783 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/f71805f 2024-08-02T18:51:28.783 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/f71882fg 2024-08-02T18:51:28.784 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/fam15h_power 2024-08-02T18:51:28.785 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/g760a 2024-08-02T18:51:28.786 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/g762 2024-08-02T18:51:28.787 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/gl518sm 2024-08-02T18:51:28.788 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/hih6130 2024-08-02T18:51:28.789 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/htu21 2024-08-02T18:51:28.789 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/hwmon-kernel-api.txt 2024-08-02T18:51:28.790 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ibmaem 2024-08-02T18:51:28.791 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ibmpowernv 2024-08-02T18:51:28.792 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ina209 2024-08-02T18:51:28.793 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ina2xx 2024-08-02T18:51:28.794 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/it87 2024-08-02T18:51:28.795 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/jc42 2024-08-02T18:51:28.796 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/k10temp 2024-08-02T18:51:28.796 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/k8temp 2024-08-02T18:51:28.797 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lineage-pem 2024-08-02T18:51:28.798 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm25066 2024-08-02T18:51:28.799 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm63 2024-08-02T18:51:28.799 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm70 2024-08-02T18:51:28.800 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm73 2024-08-02T18:51:28.801 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm75 2024-08-02T18:51:28.802 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm77 2024-08-02T18:51:28.803 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm78 2024-08-02T18:51:28.803 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm80 2024-08-02T18:51:28.804 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm83 2024-08-02T18:51:28.805 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm85 2024-08-02T18:51:28.806 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm87 2024-08-02T18:51:28.807 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm90 2024-08-02T18:51:28.808 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm92 2024-08-02T18:51:28.808 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm93 2024-08-02T18:51:28.809 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm95234 2024-08-02T18:51:28.810 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/lm95245 2024-08-02T18:51:28.813 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ltc2945 2024-08-02T18:51:28.813 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ltc2978 2024-08-02T18:51:28.814 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ltc4151 2024-08-02T18:51:28.815 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ltc4215 2024-08-02T18:51:28.816 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ltc4245 2024-08-02T18:51:28.816 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ltc4260 2024-08-02T18:51:28.817 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ltc4261 2024-08-02T18:51:28.818 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max16064 2024-08-02T18:51:28.819 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max16065 2024-08-02T18:51:28.820 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max1619 2024-08-02T18:51:28.820 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max1668 2024-08-02T18:51:28.821 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max197 2024-08-02T18:51:28.822 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max34440 2024-08-02T18:51:28.823 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max6639 2024-08-02T18:51:28.823 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max6642 2024-08-02T18:51:28.824 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max6650 2024-08-02T18:51:28.825 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max6697 2024-08-02T18:51:28.826 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/max8688 2024-08-02T18:51:28.828 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/mc13783-adc 2024-08-02T18:51:28.829 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/mcp3021 2024-08-02T18:51:28.831 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/menf21bmc 2024-08-02T18:51:28.832 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/nct6683 2024-08-02T18:51:28.834 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/nct6775 2024-08-02T18:51:28.835 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/nct7802 2024-08-02T18:51:28.836 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ntc_thermistor 2024-08-02T18:51:28.838 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/pc87360 2024-08-02T18:51:28.839 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/pc87427 2024-08-02T18:51:28.841 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/pcf8591 2024-08-02T18:51:28.842 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/pmbus 2024-08-02T18:51:28.843 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/pmbus-core 2024-08-02T18:51:28.844 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/powr1220 2024-08-02T18:51:28.845 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/pwm-fan 2024-08-02T18:51:28.846 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/sch5627 2024-08-02T18:51:28.847 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/sch5636 2024-08-02T18:51:28.848 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/sht15 2024-08-02T18:51:28.849 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/sht21 2024-08-02T18:51:28.850 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/shtc1 2024-08-02T18:51:28.851 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/sis5595 2024-08-02T18:51:28.851 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/smm665 2024-08-02T18:51:28.852 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/smsc47b397 2024-08-02T18:51:28.853 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/smsc47m1 2024-08-02T18:51:28.854 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/smsc47m192 2024-08-02T18:51:28.855 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/submitting-patches 2024-08-02T18:51:28.856 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/sysfs-interface 2024-08-02T18:51:28.856 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/thmc50 2024-08-02T18:51:28.857 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/tmp102 2024-08-02T18:51:28.858 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/tmp103 2024-08-02T18:51:28.859 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/tmp401 2024-08-02T18:51:28.860 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/tmp421 2024-08-02T18:51:28.861 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/tps40422 2024-08-02T18:51:28.862 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/twl4030-madc-hwmon 2024-08-02T18:51:28.862 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ucd9000 2024-08-02T18:51:28.863 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/ucd9200 2024-08-02T18:51:28.864 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/userspace-tools 2024-08-02T18:51:28.865 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/vexpress 2024-08-02T18:51:28.866 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/via686a 2024-08-02T18:51:28.867 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/vt1211 2024-08-02T18:51:28.868 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83627ehf 2024-08-02T18:51:28.869 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83627hf 2024-08-02T18:51:28.870 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83781d 2024-08-02T18:51:28.870 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83791d 2024-08-02T18:51:28.871 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83792d 2024-08-02T18:51:28.872 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83793 2024-08-02T18:51:28.873 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83795 2024-08-02T18:51:28.874 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83l785ts 2024-08-02T18:51:28.875 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/w83l786ng 2024-08-02T18:51:28.876 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/wm831x 2024-08-02T18:51:28.877 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/wm8350 2024-08-02T18:51:28.878 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwmon/zl6100 2024-08-02T18:51:28.879 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/hwspinlock.txt 2024-08-02T18:51:28.880 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/ 2024-08-02T18:51:28.880 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/ 2024-08-02T18:51:28.881 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1535 2024-08-02T18:51:28.882 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali1563 2024-08-02T18:51:28.883 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ali15x3 2024-08-02T18:51:28.883 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd756 2024-08-02T18:51:28.884 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-amd8111 2024-08-02T18:51:28.885 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-diolan-u2c 2024-08-02T18:51:28.886 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-i801 2024-08-02T18:51:28.887 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ismt 2024-08-02T18:51:28.888 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-nforce2 2024-08-02T18:51:28.889 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-ocores 2024-08-02T18:51:28.890 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport 2024-08-02T18:51:28.891 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-parport-light 2024-08-02T18:51:28.892 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-pca-isa 2024-08-02T18:51:28.893 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-piix4 2024-08-02T18:51:28.894 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis5595 2024-08-02T18:51:28.894 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis630 2024-08-02T18:51:28.895 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-sis96x 2024-08-02T18:51:28.896 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-taos-evm 2024-08-02T18:51:28.897 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-via 2024-08-02T18:51:28.898 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/i2c-viapro 2024-08-02T18:51:28.899 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/busses/scx200_acb 2024-08-02T18:51:28.900 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/dev-interface 2024-08-02T18:51:28.901 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/fault-codes 2024-08-02T18:51:28.902 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/functionality 2024-08-02T18:51:28.903 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/i2c-protocol 2024-08-02T18:51:28.904 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/i2c-stub 2024-08-02T18:51:28.904 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/instantiating-devices 2024-08-02T18:51:28.905 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/muxes/ 2024-08-02T18:51:28.906 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/muxes/i2c-mux-gpio 2024-08-02T18:51:28.907 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/old-module-parameters 2024-08-02T18:51:28.907 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/smbus-protocol 2024-08-02T18:51:28.908 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/summary 2024-08-02T18:51:28.909 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/ten-bit-addresses 2024-08-02T18:51:28.910 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/upgrading-clients 2024-08-02T18:51:28.911 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2c/writing-clients 2024-08-02T18:51:28.912 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2o/ 2024-08-02T18:51:28.913 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2o/README 2024-08-02T18:51:28.913 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/i2o/ioctl 2024-08-02T18:51:28.914 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/ 2024-08-02T18:51:28.915 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/.gitignore 2024-08-02T18:51:28.916 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/IRQ-redir.txt 2024-08-02T18:51:28.917 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/Makefile 2024-08-02T18:51:28.917 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/README 2024-08-02T18:51:28.918 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/aliasing-test.c 2024-08-02T18:51:29.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:28 smithi151 ceph-mon[37155]: pgmap v55: 129 pgs: 129 active+clean; 81 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 26 op/s 2024-08-02T18:51:29.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:28 smithi103 ceph-mon[32753]: pgmap v55: 129 pgs: 129 active+clean; 81 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 26 op/s 2024-08-02T18:51:29.087 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/aliasing.txt 2024-08-02T18:51:29.088 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/efirtc.txt 2024-08-02T18:51:29.089 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/err_inject.txt 2024-08-02T18:51:29.090 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/fsys.txt 2024-08-02T18:51:29.091 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/mca.txt 2024-08-02T18:51:29.092 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/serial.txt 2024-08-02T18:51:29.093 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ia64/xen.txt 2024-08-02T18:51:29.094 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ide/ 2024-08-02T18:51:29.095 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ide/00-INDEX 2024-08-02T18:51:29.095 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-cd.1994-2004 2024-08-02T18:51:29.096 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-floppy.1996-2002 2024-08-02T18:51:29.097 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ide/ChangeLog.ide-tape.1995-2002 2024-08-02T18:51:29.098 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ide/ide-tape.txt 2024-08-02T18:51:29.099 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ide/ide.txt 2024-08-02T18:51:29.100 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ide/warm-plug-howto.txt 2024-08-02T18:51:29.101 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/infiniband/ 2024-08-02T18:51:29.101 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/infiniband/core_locking.txt 2024-08-02T18:51:29.102 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/infiniband/ipoib.txt 2024-08-02T18:51:29.103 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/infiniband/sysfs.txt 2024-08-02T18:51:29.104 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/infiniband/user_mad.txt 2024-08-02T18:51:29.105 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/infiniband/user_verbs.txt 2024-08-02T18:51:29.106 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/init.txt 2024-08-02T18:51:29.107 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/initrd.txt 2024-08-02T18:51:29.108 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/ 2024-08-02T18:51:29.109 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/alps.txt 2024-08-02T18:51:29.110 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/amijoy.txt 2024-08-02T18:51:29.110 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/appletouch.txt 2024-08-02T18:51:29.111 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/atarikbd.txt 2024-08-02T18:51:29.112 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/bcm5974.txt 2024-08-02T18:51:29.113 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/cd32.txt 2024-08-02T18:51:29.113 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/cma3000_d0x.txt 2024-08-02T18:51:29.114 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/cs461x.txt 2024-08-02T18:51:29.115 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/edt-ft5x06.txt 2024-08-02T18:51:29.116 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/elantech.txt 2024-08-02T18:51:29.117 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/event-codes.txt 2024-08-02T18:51:29.118 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/ff.txt 2024-08-02T18:51:29.122 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/gamepad.txt 2024-08-02T18:51:29.122 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/gameport-programming.txt 2024-08-02T18:51:29.122 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/gpio-tilt.txt 2024-08-02T18:51:29.122 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/iforce-protocol.txt 2024-08-02T18:51:29.122 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/input-programming.txt 2024-08-02T18:51:29.123 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/input.txt 2024-08-02T18:51:29.124 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/interactive.fig 2024-08-02T18:51:29.125 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/joystick-api.txt 2024-08-02T18:51:29.125 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/joystick-parport.txt 2024-08-02T18:51:29.126 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/joystick.txt 2024-08-02T18:51:29.127 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/multi-touch-protocol.txt 2024-08-02T18:51:29.128 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/notifier.txt 2024-08-02T18:51:29.129 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/ntrig.txt 2024-08-02T18:51:29.130 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/rotary-encoder.txt 2024-08-02T18:51:29.131 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/sentelic.txt 2024-08-02T18:51:29.132 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/shape.fig 2024-08-02T18:51:29.133 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/walkera0701.txt 2024-08-02T18:51:29.133 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/xpad.txt 2024-08-02T18:51:29.134 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/input/yealink.txt 2024-08-02T18:51:29.135 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/intel_txt.txt 2024-08-02T18:51:29.136 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/io-mapping.txt 2024-08-02T18:51:29.137 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/io_ordering.txt 2024-08-02T18:51:29.138 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ioctl/ 2024-08-02T18:51:29.139 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ioctl/00-INDEX 2024-08-02T18:51:29.140 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ioctl/botching-up-ioctls.txt 2024-08-02T18:51:29.141 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ioctl/cdrom.txt 2024-08-02T18:51:29.142 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ioctl/hdio.txt 2024-08-02T18:51:29.142 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ioctl/ioctl-decoding.txt 2024-08-02T18:51:29.143 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ioctl/ioctl-number.txt 2024-08-02T18:51:29.144 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/iostats.txt 2024-08-02T18:51:29.145 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/irqflags-tracing.txt 2024-08-02T18:51:29.146 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isapnp.txt 2024-08-02T18:51:29.147 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/ 2024-08-02T18:51:29.148 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/00-INDEX 2024-08-02T18:51:29.148 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/CREDITS 2024-08-02T18:51:29.149 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/HiSax.cert 2024-08-02T18:51:29.150 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/INTERFACE 2024-08-02T18:51:29.151 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.CAPI 2024-08-02T18:51:29.152 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/INTERFACE.fax 2024-08-02T18:51:29.153 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README 2024-08-02T18:51:29.154 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.FAQ 2024-08-02T18:51:29.155 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.HiSax 2024-08-02T18:51:29.157 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.act2000 2024-08-02T18:51:29.157 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.audio 2024-08-02T18:51:29.158 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.avmb1 2024-08-02T18:51:29.159 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.concap 2024-08-02T18:51:29.160 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.diversion 2024-08-02T18:51:29.161 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.fax 2024-08-02T18:51:29.162 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.gigaset 2024-08-02T18:51:29.162 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.hfc-pci 2024-08-02T18:51:29.163 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.hysdn 2024-08-02T18:51:29.164 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.icn 2024-08-02T18:51:29.165 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.mISDN 2024-08-02T18:51:29.166 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.pcbit 2024-08-02T18:51:29.167 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.sc 2024-08-02T18:51:29.168 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.syncppp 2024-08-02T18:51:29.169 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/README.x25 2024-08-02T18:51:29.169 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/isdn/syncPPP.FAQ 2024-08-02T18:51:29.170 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ja_JP/ 2024-08-02T18:51:29.171 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ja_JP/HOWTO 2024-08-02T18:51:29.172 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ja_JP/SubmitChecklist 2024-08-02T18:51:29.173 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ja_JP/SubmittingPatches 2024-08-02T18:51:29.173 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ja_JP/stable_api_nonsense.txt 2024-08-02T18:51:29.174 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ja_JP/stable_kernel_rules.txt 2024-08-02T18:51:29.175 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/java.txt 2024-08-02T18:51:29.176 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kasan.txt 2024-08-02T18:51:29.178 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kbuild/ 2024-08-02T18:51:29.178 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kbuild/00-INDEX 2024-08-02T18:51:29.179 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kbuild/headers_install.txt 2024-08-02T18:51:29.180 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kbuild/kbuild.txt 2024-08-02T18:51:29.181 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kbuild/kconfig-language.txt 2024-08-02T18:51:29.181 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kbuild/kconfig.txt 2024-08-02T18:51:29.182 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kbuild/makefiles.txt 2024-08-02T18:51:29.183 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kbuild/modules.txt 2024-08-02T18:51:29.184 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kdump/ 2024-08-02T18:51:29.185 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kdump/gdbmacros.txt 2024-08-02T18:51:29.185 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kdump/kdump.txt 2024-08-02T18:51:29.186 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kernel-doc-nano-HOWTO.txt 2024-08-02T18:51:29.187 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kernel-docs.txt 2024-08-02T18:51:29.188 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kernel-parameters.txt 2024-08-02T18:51:29.190 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kernel-per-CPU-kthreads.txt 2024-08-02T18:51:29.190 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kmemcheck.txt 2024-08-02T18:51:29.191 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kmemleak.txt 2024-08-02T18:51:29.192 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ko_KR/ 2024-08-02T18:51:29.193 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ko_KR/HOWTO 2024-08-02T18:51:29.194 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ko_KR/stable_api_nonsense.txt 2024-08-02T18:51:29.195 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kobject.txt 2024-08-02T18:51:29.196 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kprobes.txt 2024-08-02T18:51:29.197 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kref.txt 2024-08-02T18:51:29.197 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/kselftest.txt 2024-08-02T18:51:29.199 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/ 2024-08-02T18:51:29.199 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/.gitignore 2024-08-02T18:51:29.200 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/00-INDEX 2024-08-02T18:51:29.201 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/Makefile 2024-08-02T18:51:29.202 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/asus-laptop.txt 2024-08-02T18:51:29.203 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/disk-shock-protection.txt 2024-08-02T18:51:29.203 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/dslm.c 2024-08-02T18:51:29.204 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/freefall.c 2024-08-02T18:51:29.205 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/laptop-mode.txt 2024-08-02T18:51:29.206 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/sony-laptop.txt 2024-08-02T18:51:29.207 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/sonypi.txt 2024-08-02T18:51:29.208 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/thinkpad-acpi.txt 2024-08-02T18:51:29.209 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/laptops/toshiba_haps.txt 2024-08-02T18:51:29.210 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ldm.txt 2024-08-02T18:51:29.211 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/ 2024-08-02T18:51:29.211 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/00-INDEX 2024-08-02T18:51:29.212 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/leds-blinkm.txt 2024-08-02T18:51:29.213 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/leds-class.txt 2024-08-02T18:51:29.214 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/leds-lm3556.txt 2024-08-02T18:51:29.215 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/leds-lp3944.txt 2024-08-02T18:51:29.215 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/leds-lp5521.txt 2024-08-02T18:51:29.216 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/leds-lp5523.txt 2024-08-02T18:51:29.217 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/leds-lp5562.txt 2024-08-02T18:51:29.217 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/leds-lp55xx.txt 2024-08-02T18:51:29.218 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/ledtrig-oneshot.txt 2024-08-02T18:51:29.219 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/leds/ledtrig-transient.txt 2024-08-02T18:51:29.220 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/local_ops.txt 2024-08-02T18:51:29.220 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/ 2024-08-02T18:51:29.221 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/00-INDEX 2024-08-02T18:51:29.222 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/lglock.txt 2024-08-02T18:51:29.223 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/lockdep-design.txt 2024-08-02T18:51:29.224 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/lockstat.txt 2024-08-02T18:51:29.225 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/locktorture.txt 2024-08-02T18:51:29.226 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/mutex-design.txt 2024-08-02T18:51:29.226 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/rt-mutex-design.txt 2024-08-02T18:51:29.227 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/rt-mutex.txt 2024-08-02T18:51:29.228 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/spinlocks.txt 2024-08-02T18:51:29.229 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/locking/ww-mutex-design.txt 2024-08-02T18:51:29.230 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/lockup-watchdogs.txt 2024-08-02T18:51:29.231 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/logo.gif 2024-08-02T18:51:29.232 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/logo.txt 2024-08-02T18:51:29.233 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/lzo.txt 2024-08-02T18:51:29.234 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/m68k/ 2024-08-02T18:51:29.235 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/m68k/00-INDEX 2024-08-02T18:51:29.236 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/m68k/README.buddha 2024-08-02T18:51:29.237 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/m68k/kernel-options.txt 2024-08-02T18:51:29.238 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/magic-number.txt 2024-08-02T18:51:29.239 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mailbox.txt 2024-08-02T18:51:29.240 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/md.txt 2024-08-02T18:51:29.241 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/media-framework.txt 2024-08-02T18:51:29.242 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/memory-barriers.txt 2024-08-02T18:51:29.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:28 smithi121 ceph-mon[37236]: pgmap v55: 129 pgs: 129 active+clean; 81 MiB data, 400 MiB used, 1.0 TiB / 1.0 TiB avail; 8.2 KiB/s rd, 6.7 MiB/s wr, 26 op/s 2024-08-02T18:51:29.318 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/memory-devices/ 2024-08-02T18:51:29.319 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/memory-devices/ti-emif.txt 2024-08-02T18:51:29.320 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/memory-hotplug.txt 2024-08-02T18:51:29.321 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/metag/ 2024-08-02T18:51:29.321 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/metag/00-INDEX 2024-08-02T18:51:29.322 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/metag/kernel-ABI.txt 2024-08-02T18:51:29.323 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/ 2024-08-02T18:51:29.324 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/Makefile 2024-08-02T18:51:29.324 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mic_overview.txt 2024-08-02T18:51:29.325 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mpssd/ 2024-08-02T18:51:29.326 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mpssd/.gitignore 2024-08-02T18:51:29.327 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mpssd/Makefile 2024-08-02T18:51:29.327 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mpssd/micctrl 2024-08-02T18:51:29.328 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mpssd/mpss 2024-08-02T18:51:29.329 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.c 2024-08-02T18:51:29.330 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mpssd/mpssd.h 2024-08-02T18:51:29.331 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mic/mpssd/sysfs.c 2024-08-02T18:51:29.332 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mips/ 2024-08-02T18:51:29.333 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mips/00-INDEX 2024-08-02T18:51:29.334 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mips/AU1xxx_IDE.README 2024-08-02T18:51:29.334 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/ 2024-08-02T18:51:29.335 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/Makefile 2024-08-02T18:51:29.336 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/ad525x_dpot.txt 2024-08-02T18:51:29.337 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/apds990x.txt 2024-08-02T18:51:29.338 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/bh1770glc.txt 2024-08-02T18:51:29.339 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/c2port.txt 2024-08-02T18:51:29.340 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/eeprom 2024-08-02T18:51:29.341 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/ics932s401 2024-08-02T18:51:29.342 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/isl29003 2024-08-02T18:51:29.343 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/lis3lv02d 2024-08-02T18:51:29.343 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/max6875 2024-08-02T18:51:29.344 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/mei/ 2024-08-02T18:51:29.345 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/mei/.gitignore 2024-08-02T18:51:29.345 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/mei/Makefile 2024-08-02T18:51:29.346 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/mei/TODO 2024-08-02T18:51:29.347 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-amt-version.c 2024-08-02T18:51:29.348 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei-client-bus.txt 2024-08-02T18:51:29.349 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/mei/mei.txt 2024-08-02T18:51:29.350 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/misc-devices/spear-pcie-gadget.txt 2024-08-02T18:51:29.350 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mmc/ 2024-08-02T18:51:29.351 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mmc/00-INDEX 2024-08-02T18:51:29.352 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mmc/mmc-async-req.txt 2024-08-02T18:51:29.353 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-attrs.txt 2024-08-02T18:51:29.354 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mmc/mmc-dev-parts.txt 2024-08-02T18:51:29.355 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mn10300/ 2024-08-02T18:51:29.356 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mn10300/ABI.txt 2024-08-02T18:51:29.357 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mn10300/compartmentalisation.txt 2024-08-02T18:51:29.357 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/module-signing.txt 2024-08-02T18:51:29.358 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mono.txt 2024-08-02T18:51:29.359 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mtd/ 2024-08-02T18:51:29.360 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mtd/nand/ 2024-08-02T18:51:29.362 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mtd/nand/pxa3xx-nand.txt 2024-08-02T18:51:29.363 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mtd/nand_ecc.txt 2024-08-02T18:51:29.364 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/mtd/spi-nor.txt 2024-08-02T18:51:29.365 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/namespaces/ 2024-08-02T18:51:29.366 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/namespaces/compatibility-list.txt 2024-08-02T18:51:29.366 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/namespaces/resource-control.txt 2024-08-02T18:51:29.367 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/netlabel/ 2024-08-02T18:51:29.368 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/netlabel/00-INDEX 2024-08-02T18:51:29.369 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/netlabel/cipso_ipv4.txt 2024-08-02T18:51:29.369 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/netlabel/draft-ietf-cipso-ipsecurity-01.txt 2024-08-02T18:51:29.370 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/netlabel/introduction.txt 2024-08-02T18:51:29.371 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/netlabel/lsm_interface.txt 2024-08-02T18:51:29.372 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ 2024-08-02T18:51:29.372 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/00-INDEX 2024-08-02T18:51:29.373 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/3c509.txt 2024-08-02T18:51:29.374 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/6pack.txt 2024-08-02T18:51:29.374 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/LICENSE.qla3xxx 2024-08-02T18:51:29.375 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlcnic 2024-08-02T18:51:29.376 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/LICENSE.qlge 2024-08-02T18:51:29.377 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/Makefile 2024-08-02T18:51:29.377 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/PLIP.txt 2024-08-02T18:51:29.378 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/README.ipw2100 2024-08-02T18:51:29.379 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/README.ipw2200 2024-08-02T18:51:29.382 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/README.sb1000 2024-08-02T18:51:29.382 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/alias.txt 2024-08-02T18:51:29.382 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/altera_tse.txt 2024-08-02T18:51:29.382 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/arcnet-hardware.txt 2024-08-02T18:51:29.383 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/arcnet.txt 2024-08-02T18:51:29.384 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/atm.txt 2024-08-02T18:51:29.384 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ax25.txt 2024-08-02T18:51:29.385 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/batman-adv.txt 2024-08-02T18:51:29.386 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/baycom.txt 2024-08-02T18:51:29.387 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/bonding.txt 2024-08-02T18:51:29.389 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/bridge.txt 2024-08-02T18:51:29.390 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-02T18:51:29.390 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/caif/ 2024-08-02T18:51:29.391 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/caif/Linux-CAIF.txt 2024-08-02T18:51:29.391 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/caif/README 2024-08-02T18:51:29.393 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/caif/spi_porting.txt 2024-08-02T18:51:29.393 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/can.txt 2024-08-02T18:51:29.393 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/cdc_mbim.txt 2024-08-02T18:51:29.394 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/cops.txt 2024-08-02T18:51:29.395 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/cs89x0.txt 2024-08-02T18:51:29.395 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/cxacru-cf.py 2024-08-02T18:51:29.396 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/cxacru.txt 2024-08-02T18:51:29.397 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/cxgb.txt 2024-08-02T18:51:29.398 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/dccp.txt 2024-08-02T18:51:29.398 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/dctcp.txt 2024-08-02T18:51:29.399 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/de4x5.txt 2024-08-02T18:51:29.400 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/decnet.txt 2024-08-02T18:51:29.401 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/dl2k.txt 2024-08-02T18:51:29.401 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/dm9000.txt 2024-08-02T18:51:29.402 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/dmfe.txt 2024-08-02T18:51:29.403 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/dns_resolver.txt 2024-08-02T18:51:29.404 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/driver.txt 2024-08-02T18:51:29.404 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/e100.txt 2024-08-02T18:51:29.405 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/e1000.txt 2024-08-02T18:51:29.406 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/e1000e.txt 2024-08-02T18:51:29.407 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/eql.txt 2024-08-02T18:51:29.407 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/fib_trie.txt 2024-08-02T18:51:29.408 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/filter.txt 2024-08-02T18:51:29.409 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/fore200e.txt 2024-08-02T18:51:29.410 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/framerelay.txt 2024-08-02T18:51:29.410 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/gen_stats.txt 2024-08-02T18:51:29.411 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/generic-hdlc.txt 2024-08-02T18:51:29.412 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/generic_netlink.txt 2024-08-02T18:51:29.413 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/gianfar.txt 2024-08-02T18:51:29.414 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/i40e.txt 2024-08-02T18:51:29.414 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/i40evf.txt 2024-08-02T18:51:29.415 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ieee802154.txt 2024-08-02T18:51:29.416 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/igb.txt 2024-08-02T18:51:29.417 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/igbvf.txt 2024-08-02T18:51:29.417 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ip-sysctl.txt 2024-08-02T18:51:29.418 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ip_dynaddr.txt 2024-08-02T18:51:29.419 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ipddp.txt 2024-08-02T18:51:29.420 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/iphase.txt 2024-08-02T18:51:29.420 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ipsec.txt 2024-08-02T18:51:29.421 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ipv6.txt 2024-08-02T18:51:29.422 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ipvlan.txt 2024-08-02T18:51:29.423 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ipvs-sysctl.txt 2024-08-02T18:51:29.424 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/irda.txt 2024-08-02T18:51:29.424 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ixgb.txt 2024-08-02T18:51:29.425 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ixgbe.txt 2024-08-02T18:51:29.426 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ixgbevf.txt 2024-08-02T18:51:29.427 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/l2tp.txt 2024-08-02T18:51:29.427 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/lapb-module.txt 2024-08-02T18:51:29.428 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ltpc.txt 2024-08-02T18:51:29.429 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/mac80211-auth-assoc-deauth.txt 2024-08-02T18:51:29.430 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/mac80211-injection.txt 2024-08-02T18:51:29.431 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/ 2024-08-02T18:51:29.431 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/README 2024-08-02T18:51:29.432 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/hostapd.conf 2024-08-02T18:51:29.433 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/mac80211_hwsim/wpa_supplicant.conf 2024-08-02T18:51:29.433 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/multiqueue.txt 2024-08-02T18:51:29.434 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/netconsole.txt 2024-08-02T18:51:29.435 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/netdev-FAQ.txt 2024-08-02T18:51:29.436 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/netdev-features.txt 2024-08-02T18:51:29.437 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/netdevices.txt 2024-08-02T18:51:29.437 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/netif-msg.txt 2024-08-02T18:51:29.438 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/netlink_mmap.txt 2024-08-02T18:51:29.439 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/nf_conntrack-sysctl.txt 2024-08-02T18:51:29.440 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/nfc.txt 2024-08-02T18:51:29.440 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/openvswitch.txt 2024-08-02T18:51:29.441 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/operstates.txt 2024-08-02T18:51:29.442 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/packet_mmap.txt 2024-08-02T18:51:29.443 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/phonet.txt 2024-08-02T18:51:29.443 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/phy.txt 2024-08-02T18:51:29.444 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/pktgen.txt 2024-08-02T18:51:29.445 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/policy-routing.txt 2024-08-02T18:51:29.446 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ppp_generic.txt 2024-08-02T18:51:29.447 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/proc_net_tcp.txt 2024-08-02T18:51:29.447 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/radiotap-headers.txt 2024-08-02T18:51:29.448 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/ray_cs.txt 2024-08-02T18:51:29.449 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/rds.txt 2024-08-02T18:51:29.450 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/regulatory.txt 2024-08-02T18:51:29.450 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/rxrpc.txt 2024-08-02T18:51:29.451 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/s2io.txt 2024-08-02T18:51:29.452 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/scaling.txt 2024-08-02T18:51:29.453 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/sctp.txt 2024-08-02T18:51:29.453 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/secid.txt 2024-08-02T18:51:29.454 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/skfp.txt 2024-08-02T18:51:29.455 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/smc9.txt 2024-08-02T18:51:29.456 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/spider_net.txt 2024-08-02T18:51:29.456 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/stmmac.txt 2024-08-02T18:51:29.457 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/switchdev.txt 2024-08-02T18:51:29.458 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/tc-actions-env-rules.txt 2024-08-02T18:51:29.459 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/tcp-thin.txt 2024-08-02T18:51:29.459 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/tcp.txt 2024-08-02T18:51:29.460 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/team.txt 2024-08-02T18:51:29.461 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/timestamping.txt 2024-08-02T18:51:29.462 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/timestamping/ 2024-08-02T18:51:29.462 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/timestamping/.gitignore 2024-08-02T18:51:29.463 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/timestamping/Makefile 2024-08-02T18:51:29.464 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/timestamping/hwtstamp_config.c 2024-08-02T18:51:29.465 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/timestamping/timestamping.c 2024-08-02T18:51:29.465 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/timestamping/txtimestamp.c 2024-08-02T18:51:29.466 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/tlan.txt 2024-08-02T18:51:29.467 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/tproxy.txt 2024-08-02T18:51:29.468 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/tuntap.txt 2024-08-02T18:51:29.469 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/udplite.txt 2024-08-02T18:51:29.469 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/vortex.txt 2024-08-02T18:51:29.470 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/vxge.txt 2024-08-02T18:51:29.471 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/vxlan.txt 2024-08-02T18:51:29.472 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/x25-iface.txt 2024-08-02T18:51:29.472 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/x25.txt 2024-08-02T18:51:29.473 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/xfrm_proc.txt 2024-08-02T18:51:29.474 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/xfrm_sync.txt 2024-08-02T18:51:29.475 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/xfrm_sysctl.txt 2024-08-02T18:51:29.475 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/networking/z8530drv.txt 2024-08-02T18:51:29.476 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/nfc/ 2024-08-02T18:51:29.477 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/nfc/nfc-hci.txt 2024-08-02T18:51:29.478 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/nfc/nfc-pn544.txt 2024-08-02T18:51:29.478 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/nios2/ 2024-08-02T18:51:29.479 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/nios2/README 2024-08-02T18:51:29.480 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/nommu-mmap.txt 2024-08-02T18:51:29.481 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/numastat.txt 2024-08-02T18:51:29.482 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/oops-tracing.txt 2024-08-02T18:51:29.482 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/padata.txt 2024-08-02T18:51:29.483 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/parisc/ 2024-08-02T18:51:29.484 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/parisc/00-INDEX 2024-08-02T18:51:29.485 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/parisc/debugging 2024-08-02T18:51:29.485 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/parisc/registers 2024-08-02T18:51:29.486 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/parport-lowlevel.txt 2024-08-02T18:51:29.487 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/parport.txt 2024-08-02T18:51:29.488 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pcmcia/ 2024-08-02T18:51:29.489 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pcmcia/.gitignore 2024-08-02T18:51:29.489 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pcmcia/Makefile 2024-08-02T18:51:29.490 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pcmcia/crc32hash.c 2024-08-02T18:51:29.491 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pcmcia/devicetable.txt 2024-08-02T18:51:29.491 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pcmcia/driver-changes.txt 2024-08-02T18:51:29.492 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pcmcia/driver.txt 2024-08-02T18:51:29.493 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pcmcia/locking.txt 2024-08-02T18:51:29.494 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/percpu-rw-semaphore.txt 2024-08-02T18:51:29.494 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/phy.txt 2024-08-02T18:51:29.495 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/phy/ 2024-08-02T18:51:29.496 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/phy/samsung-usb2.txt 2024-08-02T18:51:29.497 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pi-futex.txt 2024-08-02T18:51:29.498 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pinctrl.txt 2024-08-02T18:51:29.498 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/platform/ 2024-08-02T18:51:29.499 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/platform/x86-laptop-drivers.txt 2024-08-02T18:51:29.500 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pnp.txt 2024-08-02T18:51:29.501 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/ 2024-08-02T18:51:29.501 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/00-INDEX 2024-08-02T18:51:29.502 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/apm-acpi.txt 2024-08-02T18:51:29.503 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/basic-pm-debugging.txt 2024-08-02T18:51:29.504 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/charger-manager.txt 2024-08-02T18:51:29.504 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/devices.txt 2024-08-02T18:51:29.505 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/drivers-testing.txt 2024-08-02T18:51:29.506 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/freezing-of-tasks.txt 2024-08-02T18:51:29.507 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/interface.txt 2024-08-02T18:51:29.507 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/notifiers.txt 2024-08-02T18:51:29.508 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/opp.txt 2024-08-02T18:51:29.509 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/pci.txt 2024-08-02T18:51:29.510 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/pm_qos_interface.txt 2024-08-02T18:51:29.510 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/power_supply_class.txt 2024-08-02T18:51:29.511 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/powercap/ 2024-08-02T18:51:29.512 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/powercap/powercap.txt 2024-08-02T18:51:29.513 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/regulator/ 2024-08-02T18:51:29.513 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/regulator/consumer.txt 2024-08-02T18:51:29.514 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/regulator/design.txt 2024-08-02T18:51:29.515 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/regulator/machine.txt 2024-08-02T18:51:29.515 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/regulator/overview.txt 2024-08-02T18:51:29.516 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/regulator/regulator.txt 2024-08-02T18:51:29.517 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/runtime_pm.txt 2024-08-02T18:51:29.518 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/s2ram.txt 2024-08-02T18:51:29.518 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/states.txt 2024-08-02T18:51:29.519 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/suspend-and-cpuhotplug.txt 2024-08-02T18:51:29.520 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/suspend-and-interrupts.txt 2024-08-02T18:51:29.521 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/swsusp-and-swap-files.txt 2024-08-02T18:51:29.522 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/swsusp-dmcrypt.txt 2024-08-02T18:51:29.522 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/swsusp.txt 2024-08-02T18:51:29.523 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/tricks.txt 2024-08-02T18:51:29.524 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/userland-swsusp.txt 2024-08-02T18:51:29.525 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/power/video.txt 2024-08-02T18:51:29.525 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/ 2024-08-02T18:51:29.526 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/00-INDEX 2024-08-02T18:51:29.527 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/bootwrapper.txt 2024-08-02T18:51:29.528 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/cpu_families.txt 2024-08-02T18:51:29.528 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/cpu_features.txt 2024-08-02T18:51:29.529 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/cxl.txt 2024-08-02T18:51:29.530 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/eeh-pci-error-recovery.txt 2024-08-02T18:51:29.531 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/firmware-assisted-dump.txt 2024-08-02T18:51:29.531 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/hvcs.txt 2024-08-02T18:51:29.532 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/mpc52xx.txt 2024-08-02T18:51:29.533 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/pmu-ebb.txt 2024-08-02T18:51:29.534 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/ptrace.txt 2024-08-02T18:51:29.534 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/qe_firmware.txt 2024-08-02T18:51:29.535 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/powerpc/transactional_memory.txt 2024-08-02T18:51:29.536 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pps/ 2024-08-02T18:51:29.537 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pps/pps.txt 2024-08-02T18:51:29.537 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/prctl/ 2024-08-02T18:51:29.538 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/prctl/.gitignore 2024-08-02T18:51:29.539 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/prctl/Makefile 2024-08-02T18:51:29.540 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-ctxt-sw-stress-test.c 2024-08-02T18:51:29.540 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-on-off-stress-test.c 2024-08-02T18:51:29.541 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/prctl/disable-tsc-test.c 2024-08-02T18:51:29.542 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/prctl/no_new_privs.txt 2024-08-02T18:51:29.542 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/prctl/seccomp_filter.txt 2024-08-02T18:51:29.543 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/preempt-locking.txt 2024-08-02T18:51:29.544 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/printk-formats.txt 2024-08-02T18:51:29.545 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pti/ 2024-08-02T18:51:29.546 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pti/pti_intel_mid.txt 2024-08-02T18:51:29.546 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ptp/ 2024-08-02T18:51:29.547 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ptp/.gitignore 2024-08-02T18:51:29.548 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ptp/Makefile 2024-08-02T18:51:29.549 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ptp/ptp.txt 2024-08-02T18:51:29.549 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ptp/testptp.c 2024-08-02T18:51:29.550 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ptp/testptp.mk 2024-08-02T18:51:29.551 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/pwm.txt 2024-08-02T18:51:29.552 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/ramoops.txt 2024-08-02T18:51:29.552 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/rapidio/ 2024-08-02T18:51:29.553 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/rapidio/rapidio.txt 2024-08-02T18:51:29.554 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/rapidio/sysfs.txt 2024-08-02T18:51:29.555 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/rapidio/tsi721.txt 2024-08-02T18:51:29.555 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/rbtree.txt 2024-08-02T18:51:29.556 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/remoteproc.txt 2024-08-02T18:51:29.557 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/rfkill.txt 2024-08-02T18:51:29.558 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/robust-futex-ABI.txt 2024-08-02T18:51:29.559 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/robust-futexes.txt 2024-08-02T18:51:29.560 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/rpmsg.txt 2024-08-02T18:51:29.560 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/rtc.txt 2024-08-02T18:51:29.561 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/ 2024-08-02T18:51:29.562 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/00-INDEX 2024-08-02T18:51:29.563 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/3270.ChangeLog 2024-08-02T18:51:29.563 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/3270.txt 2024-08-02T18:51:29.564 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/CommonIO 2024-08-02T18:51:29.565 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/DASD 2024-08-02T18:51:29.566 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/Debugging390.txt 2024-08-02T18:51:29.567 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/cds.txt 2024-08-02T18:51:29.568 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/config3270.sh 2024-08-02T18:51:29.569 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/driver-model.txt 2024-08-02T18:51:29.569 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/kvm.txt 2024-08-02T18:51:29.570 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/monreader.txt 2024-08-02T18:51:29.571 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/qeth.txt 2024-08-02T18:51:29.572 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/s390dbf.txt 2024-08-02T18:51:29.572 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/s390/zfcpdump.txt 2024-08-02T18:51:29.573 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/ 2024-08-02T18:51:29.574 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/00-INDEX 2024-08-02T18:51:29.574 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/completion.txt 2024-08-02T18:51:29.575 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/sched-arch.txt 2024-08-02T18:51:29.576 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/sched-bwc.txt 2024-08-02T18:51:29.577 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/sched-deadline.txt 2024-08-02T18:51:29.577 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/sched-design-CFS.txt 2024-08-02T18:51:29.578 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/sched-domains.txt 2024-08-02T18:51:29.579 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/sched-nice-design.txt 2024-08-02T18:51:29.580 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/sched-rt-group.txt 2024-08-02T18:51:29.581 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scheduler/sched-stats.txt 2024-08-02T18:51:29.581 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ 2024-08-02T18:51:29.582 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/00-INDEX 2024-08-02T18:51:29.583 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/53c700.txt 2024-08-02T18:51:29.586 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/BusLogic.txt 2024-08-02T18:51:29.586 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.1992-1997 2024-08-02T18:51:29.586 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.arcmsr 2024-08-02T18:51:29.587 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ips 2024-08-02T18:51:29.587 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.lpfc 2024-08-02T18:51:29.589 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid 2024-08-02T18:51:29.589 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.megaraid_sas 2024-08-02T18:51:29.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.ncr53c8xx 2024-08-02T18:51:29.591 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx 2024-08-02T18:51:29.592 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ChangeLog.sym53c8xx_2 2024-08-02T18:51:29.593 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/FlashPoint.txt 2024-08-02T18:51:29.594 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/LICENSE.FlashPoint 2024-08-02T18:51:29.594 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla2xxx 2024-08-02T18:51:29.595 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/LICENSE.qla4xxx 2024-08-02T18:51:29.596 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/Mylex.txt 2024-08-02T18:51:29.597 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/NinjaSCSI.txt 2024-08-02T18:51:29.597 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/aacraid.txt 2024-08-02T18:51:29.598 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/advansys.txt 2024-08-02T18:51:29.599 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/aha152x.txt 2024-08-02T18:51:29.599 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/aic79xx.txt 2024-08-02T18:51:29.600 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/aic7xxx.txt 2024-08-02T18:51:29.601 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/arcmsr_spec.txt 2024-08-02T18:51:29.602 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/bfa.txt 2024-08-02T18:51:29.602 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/bnx2fc.txt 2024-08-02T18:51:29.603 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/cxgb3i.txt 2024-08-02T18:51:29.604 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/dc395x.txt 2024-08-02T18:51:29.605 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/dpti.txt 2024-08-02T18:51:29.605 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/dtc3x80.txt 2024-08-02T18:51:29.606 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/g_NCR5380.txt 2024-08-02T18:51:29.607 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/hpsa.txt 2024-08-02T18:51:29.608 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/hptiop.txt 2024-08-02T18:51:29.608 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/in2000.txt 2024-08-02T18:51:29.609 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/libsas.txt 2024-08-02T18:51:29.610 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/link_power_management_policy.txt 2024-08-02T18:51:29.612 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/lpfc.txt 2024-08-02T18:51:29.612 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/megaraid.txt 2024-08-02T18:51:29.612 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ncr53c8xx.txt 2024-08-02T18:51:29.613 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/osd.txt 2024-08-02T18:51:29.614 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/osst.txt 2024-08-02T18:51:29.615 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ppa.txt 2024-08-02T18:51:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/qlogicfas.txt 2024-08-02T18:51:29.616 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi-changer.txt 2024-08-02T18:51:29.617 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi-generic.txt 2024-08-02T18:51:29.618 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi-parameters.txt 2024-08-02T18:51:29.619 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi.txt 2024-08-02T18:51:29.620 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi_eh.txt 2024-08-02T18:51:29.620 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi_fc_transport.txt 2024-08-02T18:51:29.621 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi_mid_low_api.txt 2024-08-02T18:51:29.622 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/ 2024-08-02T18:51:29.623 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/Makefile 2024-08-02T18:51:29.623 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/scsi_transport_srp/rport_state_diagram.dot 2024-08-02T18:51:29.624 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/st.txt 2024-08-02T18:51:29.625 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/sym53c500_cs.txt 2024-08-02T18:51:29.626 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/sym53c8xx_2.txt 2024-08-02T18:51:29.626 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/tmscsim.txt 2024-08-02T18:51:29.627 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/ufs.txt 2024-08-02T18:51:29.628 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/scsi/wd719x.txt 2024-08-02T18:51:29.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/ 2024-08-02T18:51:29.629 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/00-INDEX 2024-08-02T18:51:29.630 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/IMA-templates.txt 2024-08-02T18:51:29.631 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/LSM.txt 2024-08-02T18:51:29.632 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/SELinux.txt 2024-08-02T18:51:29.632 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/Smack.txt 2024-08-02T18:51:29.633 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/Yama.txt 2024-08-02T18:51:29.634 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/apparmor.txt 2024-08-02T18:51:29.635 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/credentials.txt 2024-08-02T18:51:29.636 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/keys-ecryptfs.txt 2024-08-02T18:51:29.636 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/keys-request-key.txt 2024-08-02T18:51:29.637 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/keys-trusted-encrypted.txt 2024-08-02T18:51:29.638 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/keys.txt 2024-08-02T18:51:29.638 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/security/tomoyo.txt 2024-08-02T18:51:29.639 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial-console.txt 2024-08-02T18:51:29.640 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/ 2024-08-02T18:51:29.641 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/00-INDEX 2024-08-02T18:51:29.641 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/README.cycladesZ 2024-08-02T18:51:29.642 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/driver 2024-08-02T18:51:29.643 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/moxa-smartio 2024-08-02T18:51:29.644 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/n_gsm.txt 2024-08-02T18:51:29.645 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/rocket.txt 2024-08-02T18:51:29.645 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/serial-rs485.txt 2024-08-02T18:51:29.646 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/serial/tty.txt 2024-08-02T18:51:29.647 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sgi-ioc4.txt 2024-08-02T18:51:29.647 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sh/ 2024-08-02T18:51:29.648 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sh/new-machine.txt 2024-08-02T18:51:29.649 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sh/register-banks.txt 2024-08-02T18:51:29.650 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/smsc_ece1099.txt 2024-08-02T18:51:29.651 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/ 2024-08-02T18:51:29.651 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/ 2024-08-02T18:51:29.652 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/ALSA-Configuration.txt 2024-08-02T18:51:29.653 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/Audigy-mixer.txt 2024-08-02T18:51:29.654 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/Audiophile-Usb.txt 2024-08-02T18:51:29.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/Bt87x.txt 2024-08-02T18:51:29.655 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/CMIPCI.txt 2024-08-02T18:51:29.656 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/Channel-Mapping-API.txt 2024-08-02T18:51:29.657 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/ControlNames.txt 2024-08-02T18:51:29.658 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:29.658 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Controls.txt 2024-08-02T18:51:29.658 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio-Models.txt 2024-08-02T18:51:29.659 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/HD-Audio.txt 2024-08-02T18:51:29.660 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/Joystick.txt 2024-08-02T18:51:29.661 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/MIXART.txt 2024-08-02T18:51:29.661 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/OSS-Emulation.txt 2024-08-02T18:51:29.662 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/Procfile.txt 2024-08-02T18:51:29.663 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/README.maya44 2024-08-02T18:51:29.664 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/SB-Live-mixer.txt 2024-08-02T18:51:29.664 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/VIA82xx-mixer.txt 2024-08-02T18:51:29.665 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/alsa-parameters.txt 2024-08-02T18:51:29.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/compress_offload.txt 2024-08-02T18:51:29.666 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/emu10k1-jack.txt 2024-08-02T18:51:29.667 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/hda_codec.txt 2024-08-02T18:51:29.668 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/hdspm.txt 2024-08-02T18:51:29.669 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/powersave.txt 2024-08-02T18:51:29.669 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/seq_oss.html 2024-08-02T18:51:29.670 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/serial-u16550.txt 2024-08-02T18:51:29.671 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/ 2024-08-02T18:51:29.672 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DAI.txt 2024-08-02T18:51:29.673 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/DPCM.txt 2024-08-02T18:51:29.673 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/clocking.txt 2024-08-02T18:51:29.674 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/codec.txt 2024-08-02T18:51:29.675 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/dapm.txt 2024-08-02T18:51:29.676 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/jack.txt 2024-08-02T18:51:29.676 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/machine.txt 2024-08-02T18:51:29.678 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/overview.txt 2024-08-02T18:51:29.679 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/platform.txt 2024-08-02T18:51:29.680 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/alsa/soc/pops_clicks.txt 2024-08-02T18:51:29.681 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/ 2024-08-02T18:51:29.682 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/ALS 2024-08-02T18:51:29.682 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/AudioExcelDSP16 2024-08-02T18:51:29.683 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/CMI8330 2024-08-02T18:51:29.684 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/ESS 2024-08-02T18:51:29.685 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/ESS1868 2024-08-02T18:51:29.686 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/Introduction 2024-08-02T18:51:29.688 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/MultiSound 2024-08-02T18:51:29.688 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/OPL3 2024-08-02T18:51:29.689 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/Opti 2024-08-02T18:51:29.690 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/PAS16 2024-08-02T18:51:29.691 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/PSS 2024-08-02T18:51:29.692 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/PSS-updates 2024-08-02T18:51:29.693 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/README.OSS 2024-08-02T18:51:29.694 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/README.modules 2024-08-02T18:51:29.695 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/README.ymfsb 2024-08-02T18:51:29.696 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/SoundPro 2024-08-02T18:51:29.697 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/Soundblaster 2024-08-02T18:51:29.698 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/Tropez+ 2024-08-02T18:51:29.699 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/VIBRA16 2024-08-02T18:51:29.700 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/WaveArtist 2024-08-02T18:51:29.701 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/btaudio 2024-08-02T18:51:29.702 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/mwave 2024-08-02T18:51:29.703 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/oss-parameters.txt 2024-08-02T18:51:29.704 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sound/oss/ultrasound 2024-08-02T18:51:29.705 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sparse.txt 2024-08-02T18:51:29.706 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/ 2024-08-02T18:51:29.707 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/.gitignore 2024-08-02T18:51:29.708 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/00-INDEX 2024-08-02T18:51:29.709 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/Makefile 2024-08-02T18:51:29.710 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/butterfly 2024-08-02T18:51:29.711 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/ep93xx_spi 2024-08-02T18:51:29.712 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/pxa2xx 2024-08-02T18:51:29.713 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/spi-lm70llp 2024-08-02T18:51:29.715 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/spi-sc18is602 2024-08-02T18:51:29.716 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/spi-summary 2024-08-02T18:51:29.718 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/spidev 2024-08-02T18:51:29.718 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/spidev_fdx.c 2024-08-02T18:51:29.719 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/spi/spidev_test.c 2024-08-02T18:51:29.719 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/stable_api_nonsense.txt 2024-08-02T18:51:29.720 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/stable_kernel_rules.txt 2024-08-02T18:51:29.721 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/static-keys.txt 2024-08-02T18:51:29.722 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/svga.txt 2024-08-02T18:51:29.724 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/ 2024-08-02T18:51:29.725 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/00-INDEX 2024-08-02T18:51:29.726 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/README 2024-08-02T18:51:29.727 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/abi.txt 2024-08-02T18:51:29.728 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/fs.txt 2024-08-02T18:51:29.729 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/kernel.txt 2024-08-02T18:51:29.730 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/net.txt 2024-08-02T18:51:29.731 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/sunrpc.txt 2024-08-02T18:51:29.732 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysctl/vm.txt 2024-08-02T18:51:29.732 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysfs-rules.txt 2024-08-02T18:51:29.734 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/sysrq.txt 2024-08-02T18:51:29.734 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/target/ 2024-08-02T18:51:29.736 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.py 2024-08-02T18:51:29.736 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/target/tcm_mod_builder.txt 2024-08-02T18:51:29.737 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/target/tcmu-design.txt 2024-08-02T18:51:29.739 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/thermal/ 2024-08-02T18:51:29.740 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/thermal/cpu-cooling-api.txt 2024-08-02T18:51:29.741 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal 2024-08-02T18:51:29.742 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/thermal/exynos_thermal_emulation 2024-08-02T18:51:29.743 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/thermal/intel_powerclamp.txt 2024-08-02T18:51:29.744 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/thermal/nouveau_thermal 2024-08-02T18:51:29.744 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/thermal/sysfs-api.txt 2024-08-02T18:51:29.746 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/thermal/x86_pkg_temperature_thermal 2024-08-02T18:51:29.747 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/this_cpu_ops.txt 2024-08-02T18:51:29.748 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/ 2024-08-02T18:51:29.748 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/.gitignore 2024-08-02T18:51:29.749 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/00-INDEX 2024-08-02T18:51:29.750 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/Makefile 2024-08-02T18:51:29.751 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/NO_HZ.txt 2024-08-02T18:51:29.752 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/highres.txt 2024-08-02T18:51:29.753 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/hpet.txt 2024-08-02T18:51:29.754 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/hpet_example.c 2024-08-02T18:51:29.755 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/hrtimers.txt 2024-08-02T18:51:29.756 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/timekeeping.txt 2024-08-02T18:51:29.757 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/timer_stats.txt 2024-08-02T18:51:29.758 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/timers/timers-howto.txt 2024-08-02T18:51:29.759 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/tpm/ 2024-08-02T18:51:29.760 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/tpm/xen-tpmfront.txt 2024-08-02T18:51:29.761 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/ 2024-08-02T18:51:29.762 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/coresight.txt 2024-08-02T18:51:29.763 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/events-kmem.txt 2024-08-02T18:51:29.764 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/events-nmi.txt 2024-08-02T18:51:29.765 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/events-power.txt 2024-08-02T18:51:29.766 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/events.txt 2024-08-02T18:51:29.767 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/ftrace-design.txt 2024-08-02T18:51:29.768 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/ftrace.txt 2024-08-02T18:51:29.770 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/function-graph-fold.vim 2024-08-02T18:51:29.770 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/kprobetrace.txt 2024-08-02T18:51:29.771 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/mmiotrace.txt 2024-08-02T18:51:29.772 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/postprocess/ 2024-08-02T18:51:29.773 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-pagealloc-postprocess.pl 2024-08-02T18:51:29.774 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/postprocess/trace-vmscan-postprocess.pl 2024-08-02T18:51:29.775 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/ring-buffer-design.txt 2024-08-02T18:51:29.776 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/tracepoint-analysis.txt 2024-08-02T18:51:29.777 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/tracepoints.txt 2024-08-02T18:51:29.778 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/trace/uprobetracer.txt 2024-08-02T18:51:29.779 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/unaligned-memory-access.txt 2024-08-02T18:51:29.780 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/unicode.txt 2024-08-02T18:51:29.781 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/unshare.txt 2024-08-02T18:51:29.785 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/ 2024-08-02T18:51:29.787 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/CREDITS 2024-08-02T18:51:29.787 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/URB.txt 2024-08-02T18:51:29.787 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/WUSB-Design-overview.txt 2024-08-02T18:51:29.787 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/acm.txt 2024-08-02T18:51:29.788 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/anchors.txt 2024-08-02T18:51:29.788 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/authorization.txt 2024-08-02T18:51:29.789 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/bulk-streams.txt 2024-08-02T18:51:29.790 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/callbacks.txt 2024-08-02T18:51:29.791 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/chipidea.txt 2024-08-02T18:51:29.792 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/dma.txt 2024-08-02T18:51:29.793 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/dwc3.txt 2024-08-02T18:51:29.794 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/ehci.txt 2024-08-02T18:51:29.795 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/error-codes.txt 2024-08-02T18:51:29.796 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/functionfs.txt 2024-08-02T18:51:29.797 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/gadget-testing.txt 2024-08-02T18:51:29.798 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/gadget_configfs.txt 2024-08-02T18:51:29.799 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/gadget_hid.txt 2024-08-02T18:51:29.800 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/gadget_multi.txt 2024-08-02T18:51:29.801 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/gadget_printer.txt 2024-08-02T18:51:29.801 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/gadget_serial.txt 2024-08-02T18:51:29.803 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/hotplug.txt 2024-08-02T18:51:29.804 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/iuu_phoenix.txt 2024-08-02T18:51:29.804 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/linux-cdc-acm.inf 2024-08-02T18:51:29.806 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/linux.inf 2024-08-02T18:51:29.807 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/mass-storage.txt 2024-08-02T18:51:29.808 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/misc_usbsevseg.txt 2024-08-02T18:51:29.809 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/mtouchusb.txt 2024-08-02T18:51:29.810 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/ohci.txt 2024-08-02T18:51:29.811 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/persist.txt 2024-08-02T18:51:29.812 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/power-management.txt 2024-08-02T18:51:29.815 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/proc_usb_info.txt 2024-08-02T18:51:29.815 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/rio.txt 2024-08-02T18:51:29.815 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/usb-help.txt 2024-08-02T18:51:29.816 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/usb-serial.txt 2024-08-02T18:51:29.817 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/usbmon.txt 2024-08-02T18:51:29.818 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/usb/wusb-cbaf 2024-08-02T18:51:29.819 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vDSO/ 2024-08-02T18:51:29.820 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vDSO/.gitignore 2024-08-02T18:51:29.821 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vDSO/Makefile 2024-08-02T18:51:29.822 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vDSO/parse_vdso.c 2024-08-02T18:51:29.825 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vDSO/vdso_standalone_test_x86.c 2024-08-02T18:51:29.826 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vDSO/vdso_test.c 2024-08-02T18:51:29.827 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vfio.txt 2024-08-02T18:51:29.828 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vgaarbiter.txt 2024-08-02T18:51:29.829 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video-output.txt 2024-08-02T18:51:29.831 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/ 2024-08-02T18:51:29.832 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/4CCs.txt 2024-08-02T18:51:29.832 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/API.html 2024-08-02T18:51:29.834 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.au0828 2024-08-02T18:51:29.834 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.bttv 2024-08-02T18:51:29.835 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx23885 2024-08-02T18:51:29.836 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.cx88 2024-08-02T18:51:29.837 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.em28xx 2024-08-02T18:51:29.838 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.ivtv 2024-08-02T18:51:29.839 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7134 2024-08-02T18:51:29.841 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.saa7164 2024-08-02T18:51:29.842 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tm6000 2024-08-02T18:51:29.842 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.tuner 2024-08-02T18:51:29.844 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/CARDLIST.usbvision 2024-08-02T18:51:29.845 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/Makefile 2024-08-02T18:51:29.846 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/README.cpia2 2024-08-02T18:51:29.846 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/README.cx88 2024-08-02T18:51:29.848 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/README.davinci-vpbe 2024-08-02T18:51:29.848 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/README.ir 2024-08-02T18:51:29.849 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/README.ivtv 2024-08-02T18:51:29.851 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/README.pvrusb2 2024-08-02T18:51:29.851 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/README.saa7134 2024-08-02T18:51:29.852 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/Zoran 2024-08-02T18:51:29.854 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/ 2024-08-02T18:51:29.854 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/CONTRIBUTORS 2024-08-02T18:51:29.855 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/Cards 2024-08-02T18:51:29.856 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/ICs 2024-08-02T18:51:29.857 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/Insmod-options 2024-08-02T18:51:29.858 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/MAKEDEV 2024-08-02T18:51:29.859 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modprobe.conf 2024-08-02T18:51:29.860 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/Modules.conf 2024-08-02T18:51:29.862 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/PROBLEMS 2024-08-02T18:51:29.862 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/README 2024-08-02T18:51:29.863 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.WINVIEW 2024-08-02T18:51:29.864 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.freeze 2024-08-02T18:51:29.865 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/README.quirks 2024-08-02T18:51:29.866 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/Sound-FAQ 2024-08-02T18:51:29.867 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/Specs 2024-08-02T18:51:29.868 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/THANKS 2024-08-02T18:51:29.869 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/bttv/Tuners 2024-08-02T18:51:29.870 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cafe_ccic 2024-08-02T18:51:29.871 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cpia2_overview.txt 2024-08-02T18:51:29.872 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx18.txt 2024-08-02T18:51:29.873 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/ 2024-08-02T18:51:29.874 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.hm12 2024-08-02T18:51:29.875 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/README.vbi 2024-08-02T18:51:29.876 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-calling.txt 2024-08-02T18:51:29.877 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-api.txt 2024-08-02T18:51:29.878 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-decoder-regs.txt 2024-08-02T18:51:29.880 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-dma.txt 2024-08-02T18:51:29.881 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-encoder-api.txt 2024-08-02T18:51:29.881 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-memory.txt 2024-08-02T18:51:29.882 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-osd-api.txt 2024-08-02T18:51:29.883 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx2341x/fw-upload.txt 2024-08-02T18:51:29.884 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx88/ 2024-08-02T18:51:29.885 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/cx88/hauppauge-wintv-cx88-ir.txt 2024-08-02T18:51:29.886 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/extract_xc3028.pl 2024-08-02T18:51:29.887 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/fimc.txt 2024-08-02T18:51:29.888 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/gspca.txt 2024-08-02T18:51:29.889 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/hauppauge-wintv-cx88-ir.txt 2024-08-02T18:51:29.890 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/lifeview.txt 2024-08-02T18:51:29.891 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/meye.txt 2024-08-02T18:51:29.892 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/not-in-cx2388x-datasheet.txt 2024-08-02T18:51:29.893 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/omap3isp.txt 2024-08-02T18:51:29.894 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/omap4_camera.txt 2024-08-02T18:51:29.895 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/pxa_camera.txt 2024-08-02T18:51:29.896 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/radiotrack.txt 2024-08-02T18:51:29.898 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/sh_mobile_ceu_camera.txt 2024-08-02T18:51:29.898 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/si470x.txt 2024-08-02T18:51:29.899 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/si4713.txt 2024-08-02T18:51:29.900 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/si476x.txt 2024-08-02T18:51:29.901 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/soc-camera.txt 2024-08-02T18:51:29.902 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/uvcvideo.txt 2024-08-02T18:51:29.903 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/v4l2-controls.txt 2024-08-02T18:51:29.904 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/v4l2-framework.txt 2024-08-02T18:51:29.905 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/v4l2-pci-skeleton.c 2024-08-02T18:51:29.906 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/videobuf 2024-08-02T18:51:29.907 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/vivid.txt 2024-08-02T18:51:29.908 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/video4linux/zr364xx.txt 2024-08-02T18:51:29.910 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/ 2024-08-02T18:51:29.910 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/00-INDEX 2024-08-02T18:51:29.911 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/ 2024-08-02T18:51:29.912 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/00-INDEX 2024-08-02T18:51:29.913 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/api.txt 2024-08-02T18:51:29.915 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/cpuid.txt 2024-08-02T18:51:29.916 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/ 2024-08-02T18:51:29.917 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/README 2024-08-02T18:51:29.918 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/arm-vgic.txt 2024-08-02T18:51:29.919 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/mpic.txt 2024-08-02T18:51:29.920 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/s390_flic.txt 2024-08-02T18:51:29.921 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vfio.txt 2024-08-02T18:51:29.922 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/vm.txt 2024-08-02T18:51:29.923 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/devices/xics.txt 2024-08-02T18:51:29.924 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/hypercalls.txt 2024-08-02T18:51:29.925 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/locking.txt 2024-08-02T18:51:29.926 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/mmu.txt 2024-08-02T18:51:29.927 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/msr.txt 2024-08-02T18:51:29.928 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/nested-vmx.txt 2024-08-02T18:51:29.928 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/ppc-pv.txt 2024-08-02T18:51:29.929 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/review-checklist.txt 2024-08-02T18:51:29.930 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/s390-diag.txt 2024-08-02T18:51:29.931 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/kvm/timekeeping.txt 2024-08-02T18:51:29.932 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/paravirt_ops.txt 2024-08-02T18:51:29.933 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/uml/ 2024-08-02T18:51:29.934 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/virtual/uml/UserModeLinux-HOWTO.txt 2024-08-02T18:51:29.936 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/ 2024-08-02T18:51:29.937 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/.gitignore 2024-08-02T18:51:29.938 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/00-INDEX 2024-08-02T18:51:29.939 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/active_mm.txt 2024-08-02T18:51:29.940 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/balance 2024-08-02T18:51:29.941 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/cleancache.txt 2024-08-02T18:51:29.942 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/frontswap.txt 2024-08-02T18:51:29.943 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/highmem.txt 2024-08-02T18:51:29.944 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/hugetlbpage.txt 2024-08-02T18:51:29.945 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/hwpoison.txt 2024-08-02T18:51:29.946 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/ksm.txt 2024-08-02T18:51:29.947 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/numa 2024-08-02T18:51:29.948 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/numa_memory_policy.txt 2024-08-02T18:51:29.949 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/overcommit-accounting 2024-08-02T18:51:29.950 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/page_migration 2024-08-02T18:51:29.951 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/page_owner.txt 2024-08-02T18:51:29.952 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/pagemap.txt 2024-08-02T18:51:29.953 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/remap_file_pages.txt 2024-08-02T18:51:29.954 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/slub.txt 2024-08-02T18:51:29.955 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/soft-dirty.txt 2024-08-02T18:51:29.956 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/split_page_table_lock 2024-08-02T18:51:29.957 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/transhuge.txt 2024-08-02T18:51:29.958 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/unevictable-lru.txt 2024-08-02T18:51:29.959 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vm/zswap.txt 2024-08-02T18:51:29.960 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/vme_api.txt 2024-08-02T18:51:29.961 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/volatile-considered-harmful.txt 2024-08-02T18:51:29.962 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/ 2024-08-02T18:51:29.963 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/00-INDEX 2024-08-02T18:51:29.964 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/masters/ 2024-08-02T18:51:29.965 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/masters/00-INDEX 2024-08-02T18:51:29.966 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/masters/ds2482 2024-08-02T18:51:29.967 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/masters/ds2490 2024-08-02T18:51:29.968 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/masters/mxc-w1 2024-08-02T18:51:29.969 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/masters/omap-hdq 2024-08-02T18:51:29.970 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/masters/w1-gpio 2024-08-02T18:51:29.971 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/slaves/ 2024-08-02T18:51:29.972 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/slaves/00-INDEX 2024-08-02T18:51:29.973 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2406 2024-08-02T18:51:29.974 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds2423 2024-08-02T18:51:29.975 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/slaves/w1_ds28e04 2024-08-02T18:51:29.976 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/slaves/w1_therm 2024-08-02T18:51:29.977 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/w1.generic 2024-08-02T18:51:29.978 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/w1/w1.netlink 2024-08-02T18:51:29.979 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/ 2024-08-02T18:51:29.980 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/Makefile 2024-08-02T18:51:29.981 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/convert_drivers_to_kernel_api.txt 2024-08-02T18:51:29.982 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/hpwdt.txt 2024-08-02T18:51:29.983 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/pcwd-watchdog.txt 2024-08-02T18:51:29.984 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/src/ 2024-08-02T18:51:29.985 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/src/.gitignore 2024-08-02T18:51:29.986 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/src/Makefile 2024-08-02T18:51:29.987 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-simple.c 2024-08-02T18:51:29.988 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/src/watchdog-test.c 2024-08-02T18:51:29.989 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/watchdog-api.txt 2024-08-02T18:51:29.990 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/watchdog-kernel-api.txt 2024-08-02T18:51:29.992 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/watchdog-parameters.txt 2024-08-02T18:51:29.993 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/watchdog/wdt.txt 2024-08-02T18:51:29.994 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/wimax/ 2024-08-02T18:51:29.995 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/wimax/README.i2400m 2024-08-02T18:51:29.996 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/wimax/README.wimax 2024-08-02T18:51:29.997 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/workqueue.txt 2024-08-02T18:51:29.998 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/ 2024-08-02T18:51:29.999 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/00-INDEX 2024-08-02T18:51:30.000 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/boot.txt 2024-08-02T18:51:30.001 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/early-microcode.txt 2024-08-02T18:51:30.002 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/earlyprintk.txt 2024-08-02T18:51:30.003 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/entry_64.txt 2024-08-02T18:51:30.004 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/exception-tables.txt 2024-08-02T18:51:30.005 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/i386/ 2024-08-02T18:51:30.006 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/i386/IO-APIC.txt 2024-08-02T18:51:30.008 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/intel_mpx.txt 2024-08-02T18:51:30.009 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/mtrr.txt 2024-08-02T18:51:30.010 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/pat.txt 2024-08-02T18:51:30.011 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/tlb.txt 2024-08-02T18:51:30.012 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/usb-legacy-support.txt 2024-08-02T18:51:30.013 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/ 2024-08-02T18:51:30.014 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/00-INDEX 2024-08-02T18:51:30.014 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/boot-options.txt 2024-08-02T18:51:30.015 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/cpu-hotplug-spec 2024-08-02T18:51:30.017 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/fake-numa-for-cpusets 2024-08-02T18:51:30.018 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/kernel-stacks 2024-08-02T18:51:30.019 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/machinecheck 2024-08-02T18:51:30.020 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/mm.txt 2024-08-02T18:51:30.020 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/x86_64/uefi.txt 2024-08-02T18:51:30.021 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/x86/zero-page.txt 2024-08-02T18:51:30.022 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/xillybus.txt 2024-08-02T18:51:30.023 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/xtensa/ 2024-08-02T18:51:30.025 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/xtensa/atomctl.txt 2024-08-02T18:51:30.026 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/xtensa/mmu.txt 2024-08-02T18:51:30.027 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/xz.txt 2024-08-02T18:51:30.028 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/ 2024-08-02T18:51:30.029 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/CodingStyle 2024-08-02T18:51:30.030 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/HOWTO 2024-08-02T18:51:30.031 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/IRQ.txt 2024-08-02T18:51:30.032 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/SecurityBugs 2024-08-02T18:51:30.033 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingDrivers 2024-08-02T18:51:30.034 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/SubmittingPatches 2024-08-02T18:51:30.035 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/arm/ 2024-08-02T18:51:30.036 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/arm/Booting 2024-08-02T18:51:30.037 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/arm/kernel_user_helpers.txt 2024-08-02T18:51:30.038 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/arm64/ 2024-08-02T18:51:30.039 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/arm64/booting.txt 2024-08-02T18:51:30.040 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/arm64/memory.txt 2024-08-02T18:51:30.041 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/arm64/tagged-pointers.txt 2024-08-02T18:51:30.042 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/basic_profiling.txt 2024-08-02T18:51:30.043 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/email-clients.txt 2024-08-02T18:51:30.044 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/ 2024-08-02T18:51:30.045 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/filesystems/sysfs.txt 2024-08-02T18:51:30.046 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/gpio.txt 2024-08-02T18:51:30.047 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/io_ordering.txt 2024-08-02T18:51:30.049 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/magic-number.txt 2024-08-02T18:51:30.050 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/oops-tracing.txt 2024-08-02T18:51:30.051 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/sparse.txt 2024-08-02T18:51:30.052 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/stable_api_nonsense.txt 2024-08-02T18:51:30.053 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/stable_kernel_rules.txt 2024-08-02T18:51:30.054 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/ 2024-08-02T18:51:30.055 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/omap3isp.txt 2024-08-02T18:51:30.055 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/video4linux/v4l2-framework.txt 2024-08-02T18:51:30.056 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zh_CN/volatile-considered-harmful.txt 2024-08-02T18:51:30.058 INFO:tasks.workunit.client.0.smithi103.stdout:linux-4.0.5/Documentation/zorro.txt 2024-08-02T18:51:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 -- 172.21.15.103:0/253699924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb8100b50 msgr2=0x7f4eb8100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/253699924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb8100b50 0x7f4eb8100f30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f4eb4009900 tx=0x7f4eb402a480 comp rx=0 tx=0).stop 2024-08-02T18:51:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 -- 172.21.15.103:0/253699924 shutdown_connections 2024-08-02T18:51:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/253699924 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb8102c20 0x7f4eb810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/253699924 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb81022a0 0x7f4eb81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/253699924 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb8100b50 0x7f4eb8100f30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 -- 172.21.15.103:0/253699924 >> 172.21.15.103:0/253699924 conn(0x7f4eb80fc500 msgr2=0x7f4eb80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:30.165 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 -- 172.21.15.103:0/253699924 shutdown_connections 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.138+0000 7f4ebfb77640 1 -- 172.21.15.103:0/253699924 wait complete. 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebfb77640 1 Processor -- start 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebfb77640 1 -- start start 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebfb77640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb8100b50 0x7f4eb8198340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebfb77640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb81022a0 0x7f4eb8198880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebfb77640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb8102c20 0x7f4eb819cc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebfb77640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110e10 con 0x7f4eb81022a0 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebfb77640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110c90 con 0x7f4eb8102c20 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebfb77640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb8110f90 con 0x7f4eb8100b50 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebd112640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb81022a0 0x7f4eb8198880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebd112640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb81022a0 0x7f4eb8198880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33504/0 (socket says 172.21.15.103:33504) 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebd112640 1 -- 172.21.15.103:0/2799598850 learned_addr learned my addr 172.21.15.103:0/2799598850 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:30.166 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb8102c20 0x7f4eb819cc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.139+0000 7f4ebd913640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb8100b50 0x7f4eb8198340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4ebd112640 1 -- 172.21.15.103:0/2799598850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb8100b50 msgr2=0x7f4eb8198340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4ebd112640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb8100b50 0x7f4eb8198340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4ebd112640 1 -- 172.21.15.103:0/2799598850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb8102c20 msgr2=0x7f4eb819cc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4ebd112640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb8102c20 0x7f4eb819cc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4ebd112640 1 -- 172.21.15.103:0/2799598850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4eb819d2f0 con 0x7f4eb81022a0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4ebd112640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb81022a0 0x7f4eb8198880 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800d950 tx=0x7f4ea800de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4eaeffd640 1 -- 172.21.15.103:0/2799598850 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8017030 con 0x7f4eb81022a0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4eaeffd640 1 -- 172.21.15.103:0/2799598850 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ea8004020 con 0x7f4eb81022a0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4ebfb77640 1 -- 172.21.15.103:0/2799598850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4eb819d5e0 con 0x7f4eb81022a0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4eaeffd640 1 -- 172.21.15.103:0/2799598850 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea8004a00 con 0x7f4eb81022a0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.140+0000 7f4ebfb77640 1 -- 172.21.15.103:0/2799598850 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4eb81a4ec0 con 0x7f4eb81022a0 2024-08-02T18:51:30.167 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.143+0000 7f4eaeffd640 1 -- 172.21.15.103:0/2799598850 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f4ea80041d0 con 0x7f4eb81022a0 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.143+0000 7f4ec1f75740 1 Processor -- start 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.143+0000 7f4ec1f75740 1 -- start start 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a3b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a45c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a485c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b4769a0a40 con 0x55b476a3b910 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b4769389d0 con 0x55b476a3aff0 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b47699ca00 con 0x55b476a461d0 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a3b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebd913640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a45c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a3b3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:58354/0 (socket says 172.21.15.103:58354) 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 -- 172.21.15.103:0/1505726666 learned_addr learned my addr 172.21.15.103:0/1505726666 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebd112640 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a485c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.168 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4eaeffd640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4ea40a2d70 0x7f4ea40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 -- 172.21.15.103:0/1505726666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 msgr2=0x55b476a485c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a485c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 -- 172.21.15.103:0/1505726666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 msgr2=0x55b476a45c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a45c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 -- 172.21.15.103:0/1505726666 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b47693f650 con 0x55b476a3aff0 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4ea40a2d70 0x7f4ea40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4eaeffd640 1 -- 172.21.15.103:0/2799598850 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f4ea80cf0f0 con 0x7f4eb81022a0 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.144+0000 7f4ebe114640 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a3b3d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000a5d0 tx=0x7f4eb000a9d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d056e41eafdcf282 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ebd112640 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ebd913640 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a45c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ea3fff640 1 -- 172.21.15.103:0/1505726666 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb001a040 con 0x55b476a3aff0 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ea3fff640 1 -- 172.21.15.103:0/1505726666 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4eb0021b20 con 0x55b476a3aff0 2024-08-02T18:51:30.169 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ea3fff640 1 -- 172.21.15.103:0/1505726666 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb00203b0 con 0x55b476a3aff0 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ec1f75740 1 -- 172.21.15.103:0/1505726666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 msgr2=0x55b476a3b3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a3b3d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000a5d0 tx=0x7f4eb000a9d0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4ea40a2d70 0x7f4ea40a5230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0020000 tx=0x7f4eb0021000 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ec1f75740 1 -- 172.21.15.103:0/1505726666 shutdown_connections 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.145+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a485c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a45c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/1505726666 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a3b3d0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 -- 172.21.15.103:0/1505726666 >> 172.21.15.103:0/1505726666 conn(0x55b476a37580 msgr2=0x55b476a37960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 -- 172.21.15.103:0/1505726666 shutdown_connections 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 -- 172.21.15.103:0/1505726666 wait complete. 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 -- start start 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 Processor -- start 2024-08-02T18:51:30.170 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a430d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a43610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a43b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55b476a4d1b0 con 0x55b476a3b910 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55b47695bb20 con 0x55b476a3aff0 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.146+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55b476a4d330 con 0x55b476a461d0 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ec1f75740 10 client.0 _ll_register_callbacks cb 0x55b476959bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a43610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a43610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33534/0 (socket says 172.21.15.103:33534) 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 -- 172.21.15.103:0/2291260363 learned_addr learned my addr 172.21.15.103:0/2291260363 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd913640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a430d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a43b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 -- 172.21.15.103:0/2291260363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 msgr2=0x55b476a43b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:30.171 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a43b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 -- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 msgr2=0x55b476a430d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a430d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 -- 172.21.15.103:0/2291260363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b4767123c0 con 0x55b476a3b910 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a43b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd913640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ebd112640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a43610 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8000c00 tx=0x7f4ea8004540 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbaa186649de5d8 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ea17fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2291260363 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea809b9d0 con 0x55b476a3b910 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2291260363 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f4ea80bb0c0 con 0x55b476a3b910 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2291260363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4eb0021b20 con 0x55b476a3b910 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2291260363 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4ea809b2d0 con 0x55b476a3b910 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ec1f75740 10 client.16047 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.147+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2291260363 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b476a58de0 con 0x55b476a3b910 2024-08-02T18:51:30.172 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2291260363 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4eb0021b20 con 0x55b476a3b910 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2291260363 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4ea809a720 con 0x55b476a3b910 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ec1f75740 10 client.16047 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ec1f75740 10 client.16047 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ec1f75740 20 client.16047 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b476a5a1f0 0x55b476a5c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ec1f75740 4 client.16047 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2291260363 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b4769adfb0 con 0x55b476a5a1f0 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ebd913640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b476a5a1f0 0x55b476a5c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ea17fa640 10 client.16047 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.148+0000 7f4ebd913640 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b476a5a1f0 0x55b476a5c660 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=687bd80413583093 server_cookie=79b751d27dde2371 in_seq=0 out_seq=0 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2291260363 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55b4769adfb0 con 0x55b476a5a1f0 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ea17fa640 10 client.16047 handle_command_reply: tid=0 2024-08-02T18:51:30.173 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 client.16047 shutdown 2024-08-02T18:51:30.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2291260363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 msgr2=0x55b476a43610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a43610 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8000c00 tx=0x7f4ea8004540 comp rx=0 tx=0).stop 2024-08-02T18:51:30.178 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2291260363 shutdown_connections 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b476a5a1f0 0x55b476a5c660 crc :-1 s=READY pgs=82 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a43b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a43610 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2291260363 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a430d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ea17fa640 0 client.16047 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2291260363 >> 172.21.15.103:0/2291260363 conn(0x55b476a37580 msgr2=0x55b476a3d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2291260363 shutdown_connections 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.149+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2291260363 wait complete. 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.150+0000 7f4ec1f75740 20 client.16047 trim_cache size 0 max 16384 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.162+0000 7f4ec1f75740 1 Processor -- start 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.162+0000 7f4ec1f75740 1 -- start start 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.162+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a61f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.179 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.162+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a624b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.162+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a35d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.162+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81af390 con 0x55b476a3b910 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.162+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81acc60 con 0x55b476a3aff0 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.162+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81aaab0 con 0x55b476a461d0 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a624b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a624b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33546/0 (socket says 172.21.15.103:33546) 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 -- 172.21.15.103:0/657372973 learned_addr learned my addr 172.21.15.103:0/657372973 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd913640 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a61f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebe114640 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a35d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 -- 172.21.15.103:0/657372973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 msgr2=0x55b476a35d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a35d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 -- 172.21.15.103:0/657372973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 msgr2=0x55b476a61f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:30.180 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a61f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 -- 172.21.15.103:0/657372973 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b476a3b700 con 0x55b476a3b910 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd913640 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a61f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ebd112640 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a624b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80d10d0 tx=0x7f4ea8005cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3fbc4a05c69caf server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.163+0000 7f4ea37fe640 1 -- 172.21.15.103:0/657372973 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea809ae10 con 0x55b476a3b910 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.164+0000 7f4ea37fe640 1 -- 172.21.15.103:0/657372973 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ea809b9d0 con 0x55b476a3b910 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.164+0000 7f4ea37fe640 1 -- 172.21.15.103:0/657372973 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ea80bb310 con 0x55b476a3b910 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 -- 172.21.15.103:0/657372973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 msgr2=0x55b476a624b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a624b0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4ea80d10d0 tx=0x7f4ea8005cd0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 -- 172.21.15.103:0/657372973 shutdown_connections 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a461d0 0x55b476a35d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3b910 0x55b476a624b0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/657372973 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a3aff0 0x55b476a61f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.181 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 -- 172.21.15.103:0/657372973 >> 172.21.15.103:0/657372973 conn(0x55b476a37580 msgr2=0x55b476a3e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 -- 172.21.15.103:0/657372973 shutdown_connections 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 -- 172.21.15.103:0/657372973 wait complete. 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 -- start start 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.165+0000 7f4ec1f75740 1 Processor -- start 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3aff0 0x55b476a52b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a3b910 0x55b476a3fc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ec1f75740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a461d0 0x55b476a401b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81ab120 con 0x55b476a3aff0 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81ac590 con 0x55b476a461d0 2024-08-02T18:51:30.182 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebd913640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3aff0 0x55b476a52b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ec1f75740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4eb81ab7f0 con 0x55b476a3b910 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ec1f75740 10 client.0 _ll_register_callbacks cb 0x7f4ea8097a40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebd913640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3aff0 0x55b476a52b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33548/0 (socket says 172.21.15.103:33548) 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebd913640 1 -- 172.21.15.103:0/2813990765 learned_addr learned my addr 172.21.15.103:0/2813990765 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a461d0 0x55b476a401b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebd112640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a3b910 0x55b476a3fc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebe114640 1 -- 172.21.15.103:0/2813990765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a3b910 msgr2=0x55b476a3fc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a3b910 0x55b476a3fc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebe114640 1 -- 172.21.15.103:0/2813990765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3aff0 msgr2=0x55b476a52b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3aff0 0x55b476a52b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebe114640 1 -- 172.21.15.103:0/2813990765 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b476a40820 con 0x55b476a461d0 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebd112640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a3b910 0x55b476a3fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:30.183 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.166+0000 7f4ebd913640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3aff0 0x55b476a52b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ebe114640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a461d0 0x55b476a401b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000bfd0 tx=0x7f4eb00203b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ea9ba0c8f44717e3 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ea17fa640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2813990765 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4eb002f070 con 0x55b476a461d0 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2813990765 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4ea809b9d0 con 0x55b476a461d0 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2813990765 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f4eb0021aa0 con 0x55b476a461d0 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2813990765 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f4eb003b050 con 0x55b476a461d0 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 10 client.25514 fetch_fsmap learned FSMap version 26 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2813990765 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=4+}) -- 0x55b476ac4d00 con 0x55b476a461d0 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2813990765 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ea809b9d0 con 0x55b476a461d0 2024-08-02T18:51:30.184 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2813990765 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 26) ==== 8354+0+0 (secure 0 0 0) 0x7f4eb0028040 con 0x55b476a461d0 2024-08-02T18:51:30.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 10 client.25514 fetch_fsmap finished waiting for FSMap version 26 2024-08-02T18:51:30.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 10 client.25514 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:30.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 20 client.25514 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:30.185 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b476ac5260 0x55b476ac7680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 4 client.25514 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.167+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2813990765 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55b4769a84c0 con 0x55b476ac5260 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ebd913640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b476ac5260 0x55b476ac7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ea17fa640 10 client.25514 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ebd913640 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b476ac5260 0x55b476ac7680 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67f318f7720d90ea server_cookie=929a9f5c8040c829 in_seq=0 out_seq=0 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ea17fa640 1 -- 172.21.15.103:0/2813990765 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55b4769a84c0 con 0x55b476ac5260 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ea17fa640 10 client.25514 handle_command_reply: tid=0 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ec1f75740 1 client.25514 shutdown 2024-08-02T18:51:30.186 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a461d0 msgr2=0x55b476a401b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a461d0 0x55b476a401b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f4eb000bfd0 tx=0x7f4eb00203b0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2813990765 shutdown_connections 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55b476ac5260 0x55b476ac7680 crc :-1 s=READY pgs=83 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55b476a461d0 0x55b476a401b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55b476a3b910 0x55b476a3fc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ec1f75740 1 --2- 172.21.15.103:0/2813990765 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55b476a3aff0 0x55b476a52b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.168+0000 7f4ea17fa640 0 client.25514 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2813990765 >> 172.21.15.103:0/2813990765 conn(0x55b476a37580 msgr2=0x55b476a43090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2813990765 shutdown_connections 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ec1f75740 1 -- 172.21.15.103:0/2813990765 wait complete. 2024-08-02T18:51:30.187 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ec1f75740 20 client.25514 trim_cache size 0 max 16384 2024-08-02T18:51:30.188 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:51:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 -- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4ea40a2d70 msgr2=0x7f4ea40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4ea40a2d70 0x7f4ea40a5230 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0020000 tx=0x7f4eb0021000 comp rx=0 tx=0).stop 2024-08-02T18:51:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 -- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb81022a0 msgr2=0x7f4eb8198880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb81022a0 0x7f4eb8198880 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f4ea800d950 tx=0x7f4ea800de10 comp rx=0 tx=0).stop 2024-08-02T18:51:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 -- 172.21.15.103:0/2799598850 shutdown_connections 2024-08-02T18:51:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4ea40a2d70 0x7f4ea40a5230 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.190 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4eb8102c20 0x7f4eb819cc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4eb81022a0 0x7f4eb8198880 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 --2- 172.21.15.103:0/2799598850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4eb8100b50 0x7f4eb8198340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:30.191 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 -- 172.21.15.103:0/2799598850 >> 172.21.15.103:0/2799598850 conn(0x7f4eb80fc500 msgr2=0x7f4eb8069ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:30.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 -- 172.21.15.103:0/2799598850 shutdown_connections 2024-08-02T18:51:30.192 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:30.169+0000 7f4ebfb77640 1 -- 172.21.15.103:0/2799598850 wait complete. 2024-08-02T18:51:31.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:30 smithi103 ceph-mon[32753]: pgmap v56: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 7.2 MiB/s wr, 158 op/s 2024-08-02T18:51:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:30 smithi121 ceph-mon[37236]: pgmap v56: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 7.2 MiB/s wr, 158 op/s 2024-08-02T18:51:31.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:30 smithi151 ceph-mon[37155]: pgmap v56: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 571 KiB/s rd, 7.2 MiB/s wr, 158 op/s 2024-08-02T18:51:31.974 INFO:tasks.fwd_scrub.fs.[cephfs]:scrubbing fs: cephfs 2024-08-02T18:51:31.974 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub start / force,recursive 2024-08-02T18:51:32.236 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:32.717 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 -- 172.21.15.103:0/1920027417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81078c0 msgr2=0x7f74b8107ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 --2- 172.21.15.103:0/1920027417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81078c0 0x7f74b8107ca0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009930 tx=0x7f74b402a420 comp rx=0 tx=0).stop 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 -- 172.21.15.103:0/1920027417 shutdown_connections 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 --2- 172.21.15.103:0/1920027417 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74b8102260 0x7f74b810e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 --2- 172.21.15.103:0/1920027417 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b81018c0 0x7f74b8101d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 --2- 172.21.15.103:0/1920027417 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b81078c0 0x7f74b8107ca0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 -- 172.21.15.103:0/1920027417 >> 172.21.15.103:0/1920027417 conn(0x7f74b80fd620 msgr2=0x7f74b80ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 -- 172.21.15.103:0/1920027417 shutdown_connections 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 -- 172.21.15.103:0/1920027417 wait complete. 2024-08-02T18:51:32.718 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.692+0000 7f74c0730640 1 Processor -- start 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74c0730640 1 -- start start 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74c0730640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74b81018c0 0x7f74b81982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74c0730640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8102260 0x7f74b8198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74c0730640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b81078c0 0x7f74b819cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74c0730640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8111de0 con 0x7f74b8102260 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74c0730640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8111c60 con 0x7f74b81018c0 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74c0730640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f74b8111f60 con 0x7f74b81078c0 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8102260 0x7f74b8198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74b81018c0 0x7f74b81982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8102260 0x7f74b8198820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33558/0 (socket says 172.21.15.103:33558) 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 -- 172.21.15.103:0/1104041987 learned_addr learned my addr 172.21.15.103:0/1104041987 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:32.719 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74beccd640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b81078c0 0x7f74b819cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 -- 172.21.15.103:0/1104041987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b81078c0 msgr2=0x7f74b819cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b81078c0 0x7f74b819cbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 -- 172.21.15.103:0/1104041987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74b81018c0 msgr2=0x7f74b81982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74b81018c0 0x7f74b81982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 -- 172.21.15.103:0/1104041987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74b819d290 con 0x7f74b8102260 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74be4cc640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74b81018c0 0x7f74b81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.693+0000 7f74bdccb640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8102260 0x7f74b8198820 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f74a800d770 tx=0x7f74a800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.694+0000 7f74af7fe640 1 -- 172.21.15.103:0/1104041987 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8017070 con 0x7f74b8102260 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.694+0000 7f74af7fe640 1 -- 172.21.15.103:0/1104041987 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74a8005520 con 0x7f74b8102260 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.694+0000 7f74c0730640 1 -- 172.21.15.103:0/1104041987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74b819d580 con 0x7f74b8102260 2024-08-02T18:51:32.720 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.694+0000 7f74af7fe640 1 -- 172.21.15.103:0/1104041987 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8010460 con 0x7f74b8102260 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.694+0000 7f74c0730640 1 -- 172.21.15.103:0/1104041987 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74b81a4e60 con 0x7f74b8102260 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.696+0000 7f74af7fe640 1 -- 172.21.15.103:0/1104041987 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f74a8004ea0 con 0x7f74b8102260 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.696+0000 7f74af7fe640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f74a40a2cf0 0x7f74a40a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.697+0000 7f74be4cc640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f74a40a2cf0 0x7f74a40a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.697+0000 7f74af7fe640 1 -- 172.21.15.103:0/1104041987 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f74a80cf210 con 0x7f74b8102260 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.697+0000 7f74c2b2e740 1 Processor -- start 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.697+0000 7f74be4cc640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f74a40a2cf0 0x7f74a40a51b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009900 tx=0x7f74b40058d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.697+0000 7f74c2b2e740 1 -- start start 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7200 0x55a8467d75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467e1ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.721 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467e23e0 0x55a8467e47d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a84679ae40 con 0x55a8467e23e0 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a84673c7f0 con 0x55a8467d7200 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a8466e3fb0 con 0x55a8467d7b20 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74beccd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467e23e0 0x55a8467e47d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7200 0x55a8467d75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74bdccb640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467e1ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7200 0x55a8467d75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:58398/0 (socket says 172.21.15.103:58398) 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74be4cc640 1 -- 172.21.15.103:0/1310917740 learned_addr learned my addr 172.21.15.103:0/1310917740 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74bdccb640 1 -- 172.21.15.103:0/1310917740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7200 msgr2=0x55a8467d75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:32.722 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74bdccb640 1 --2- 172.21.15.103:0/1310917740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7200 0x55a8467d75e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74bdccb640 1 -- 172.21.15.103:0/1310917740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467e23e0 msgr2=0x55a8467e47d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74bdccb640 1 --2- 172.21.15.103:0/1310917740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467e23e0 0x55a8467e47d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74bdccb640 1 -- 172.21.15.103:0/1310917740 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8464ae6a0 con 0x55a8467d7b20 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74beccd640 1 --2- 172.21.15.103:0/1310917740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467e23e0 0x55a8467e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74bdccb640 1 --2- 172.21.15.103:0/1310917740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467e1ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74a80cc620 tx=0x7f74a809b100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ec680ec595a9aac server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74acff9640 1 -- 172.21.15.103:0/1310917740 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8020040 con 0x55a8467d7b20 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74acff9640 1 -- 172.21.15.103:0/1310917740 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74a809f7a0 con 0x55a8467d7b20 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.698+0000 7f74acff9640 1 -- 172.21.15.103:0/1310917740 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74a8005190 con 0x55a8467d7b20 2024-08-02T18:51:32.723 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.699+0000 7f74c2b2e740 1 -- 172.21.15.103:0/1310917740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 msgr2=0x55a8467e1ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.699+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/1310917740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467e1ea0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f74a80cc620 tx=0x7f74a809b100 comp rx=0 tx=0).stop 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.699+0000 7f74c2b2e740 1 -- 172.21.15.103:0/1310917740 shutdown_connections 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.699+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/1310917740 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467e23e0 0x55a8467e47d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.699+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/1310917740 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467e1ea0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.699+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/1310917740 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7200 0x55a8467d75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.699+0000 7f74c2b2e740 1 -- 172.21.15.103:0/1310917740 >> 172.21.15.103:0/1310917740 conn(0x55a8467d3790 msgr2=0x55a8467d3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 -- 172.21.15.103:0/1310917740 shutdown_connections 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 -- 172.21.15.103:0/1310917740 wait complete. 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 -- start start 2024-08-02T18:51:32.724 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 Processor -- start 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467df2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467df810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467e23e0 0x55a8467dfd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a8466f7cb0 con 0x55a8467d7200 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a8467387b0 con 0x55a8467e23e0 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a8467e93c0 con 0x55a8467d7b20 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467df2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467df2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33578/0 (socket says 172.21.15.103:33578) 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.700+0000 7f74be4cc640 1 -- 172.21.15.103:0/79604713 learned_addr learned my addr 172.21.15.103:0/79604713 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:32.725 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74c2b2e740 10 client.0 _ll_register_callbacks cb 0x55a84644bba0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:32.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74beccd640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467e23e0 0x55a8467dfd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74bdccb640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467df810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74be4cc640 1 -- 172.21.15.103:0/79604713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 msgr2=0x55a8467df810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:32.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74be4cc640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467df810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74be4cc640 1 -- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467e23e0 msgr2=0x55a8467dfd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:32.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74be4cc640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467e23e0 0x55a8467dfd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74be4cc640 1 -- 172.21.15.103:0/79604713 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a8466f6bc0 con 0x55a8467d7200 2024-08-02T18:51:32.726 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74beccd640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467e23e0 0x55a8467dfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74bdccb640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467df810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74be4cc640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467df2d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f74b4004770 tx=0x7f74b4009260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e053d19b3c80a00b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74a1ffb640 1 -- 172.21.15.103:0/79604713 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4035040 con 0x55a8467d7200 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74c2b2e740 1 -- 172.21.15.103:0/79604713 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74a809f7a0 con 0x55a8467d7200 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74a1ffb640 1 -- 172.21.15.103:0/79604713 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f74b4003d00 con 0x55a8467d7200 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74a1ffb640 1 -- 172.21.15.103:0/79604713 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f74b405b050 con 0x55a8467d7200 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74c2b2e740 10 client.16065 fetch_fsmap learned FSMap version 27 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74c2b2e740 1 -- 172.21.15.103:0/79604713 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a8467f52d0 con 0x55a8467d7200 2024-08-02T18:51:32.727 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.701+0000 7f74a1ffb640 1 -- 172.21.15.103:0/79604713 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74a809f7a0 con 0x55a8467d7200 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74a1ffb640 1 -- 172.21.15.103:0/79604713 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f74b404a5e0 con 0x55a8467d7200 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74c2b2e740 10 client.16065 fetch_fsmap finished waiting for FSMap version 27 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74c2b2e740 10 client.16065 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74c2b2e740 20 client.16065 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a8467f67e0 0x55a8467f8c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74c2b2e740 4 client.16065 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74c2b2e740 1 -- 172.21.15.103:0/79604713 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a846749d60 con 0x55a8467f67e0 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74bdccb640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a8467f67e0 0x55a8467f8c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74bdccb640 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a8467f67e0 0x55a8467f8c50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=903314ff52852fd0 server_cookie=448beeeeebb86959 in_seq=0 out_seq=0 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.702+0000 7f74a1ffb640 10 client.16065 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74a1ffb640 1 -- 172.21.15.103:0/79604713 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a846749d60 con 0x55a8467f67e0 2024-08-02T18:51:32.728 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74a1ffb640 10 client.16065 handle_command_reply: tid=0 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 client.16065 shutdown 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 -- 172.21.15.103:0/79604713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 msgr2=0x55a8467df2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467df2d0 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f74b4004770 tx=0x7f74b4009260 comp rx=0 tx=0).stop 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 -- 172.21.15.103:0/79604713 shutdown_connections 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a8467f67e0 0x55a8467f8c50 crc :-1 s=READY pgs=84 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467e23e0 0x55a8467dfd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467d7b20 0x55a8467df810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/79604713 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467df2d0 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 -- 172.21.15.103:0/79604713 >> 172.21.15.103:0/79604713 conn(0x55a8467d3790 msgr2=0x55a8467d9470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74a1ffb640 0 client.16065 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:32.729 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 -- 172.21.15.103:0/79604713 shutdown_connections 2024-08-02T18:51:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 1 -- 172.21.15.103:0/79604713 wait complete. 2024-08-02T18:51:32.730 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.703+0000 7f74c2b2e740 20 client.16065 trim_cache size 0 max 16384 2024-08-02T18:51:32.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74c2b2e740 1 Processor -- start 2024-08-02T18:51:32.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74c2b2e740 1 -- start start 2024-08-02T18:51:32.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e1240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 0x55a8467fe520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 0x55a8467fea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f74b81af3d0 con 0x55a8467d7200 2024-08-02T18:51:32.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74b81acca0 con 0x55a8467d7b20 2024-08-02T18:51:32.737 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f74b81aaaf0 con 0x55a8467e23e0 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e1240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e1240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33582/0 (socket says 172.21.15.103:33582) 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74be4cc640 1 -- 172.21.15.103:0/78558264 learned_addr learned my addr 172.21.15.103:0/78558264 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74bdccb640 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 0x55a8467fe520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74beccd640 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 0x55a8467fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74be4cc640 1 -- 172.21.15.103:0/78558264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 msgr2=0x55a8467fea60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74be4cc640 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 0x55a8467fea60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74be4cc640 1 -- 172.21.15.103:0/78558264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 msgr2=0x55a8467fe520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74be4cc640 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 0x55a8467fe520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.721+0000 7f74be4cc640 1 -- 172.21.15.103:0/78558264 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a8467dd820 con 0x55a8467d7200 2024-08-02T18:51:32.738 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.722+0000 7f74be4cc640 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e1240 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f74b402a940 tx=0x7f74b4003670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adfcb9829e0f556 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.722+0000 7f74a3fff640 1 -- 172.21.15.103:0/78558264 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4035040 con 0x55a8467d7200 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.722+0000 7f74a3fff640 1 -- 172.21.15.103:0/78558264 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74b4061440 con 0x55a8467d7200 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.722+0000 7f74a3fff640 1 -- 172.21.15.103:0/78558264 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b403c6a0 con 0x55a8467d7200 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.722+0000 7f74c2b2e740 1 -- 172.21.15.103:0/78558264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 msgr2=0x55a8467e1240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.722+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e1240 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f74b402a940 tx=0x7f74b4003670 comp rx=0 tx=0).stop 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 -- 172.21.15.103:0/78558264 shutdown_connections 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 0x55a8467fea60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 0x55a8467fe520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/78558264 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e1240 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 -- 172.21.15.103:0/78558264 >> 172.21.15.103:0/78558264 conn(0x55a8467d3790 msgr2=0x55a8467e0b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 -- 172.21.15.103:0/78558264 shutdown_connections 2024-08-02T18:51:32.739 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 -- 172.21.15.103:0/78558264 wait complete. 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 -- start start 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 Processor -- start 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e9770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 0x55a8467e9cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 0x55a84685f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f74b81ab160 con 0x55a8467d7200 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f74b81ac5d0 con 0x55a8467d7b20 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.723+0000 7f74c2b2e740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f74b81ab830 con 0x55a8467e23e0 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74c2b2e740 10 client.0 _ll_register_callbacks cb 0x7f74b40319f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e9770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.740 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e9770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33594/0 (socket says 172.21.15.103:33594) 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 -- 172.21.15.103:0/3345361209 learned_addr learned my addr 172.21.15.103:0/3345361209 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74bdccb640 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 0x55a8467e9cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74beccd640 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 0x55a84685f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 -- 172.21.15.103:0/3345361209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 msgr2=0x55a84685f4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 0x55a84685f4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 -- 172.21.15.103:0/3345361209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 msgr2=0x55a8467e9cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 0x55a8467e9cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 -- 172.21.15.103:0/3345361209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a84685fa20 con 0x55a8467d7200 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74be4cc640 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e9770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f74b404a9b0 tx=0x7f74b404a8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=392b5151b13a4b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74a1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:32.741 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74a1ffb640 1 -- 172.21.15.103:0/3345361209 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74b4035040 con 0x55a8467d7200 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74a1ffb640 1 -- 172.21.15.103:0/3345361209 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f74b4003d10 con 0x55a8467d7200 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.724+0000 7f74c2b2e740 1 -- 172.21.15.103:0/3345361209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f74b4061440 con 0x55a8467d7200 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.725+0000 7f74a1ffb640 1 -- 172.21.15.103:0/3345361209 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7f74b4077050 con 0x55a8467d7200 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.725+0000 7f74c2b2e740 10 client.16071 fetch_fsmap learned FSMap version 27 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.725+0000 7f74c2b2e740 1 -- 172.21.15.103:0/3345361209 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55a846860ba0 con 0x55a8467d7200 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.725+0000 7f74a1ffb640 1 -- 172.21.15.103:0/3345361209 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f74b4061440 con 0x55a8467d7200 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74a1ffb640 1 -- 172.21.15.103:0/3345361209 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7f74b403c770 con 0x55a8467d7200 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74c2b2e740 10 client.16071 fetch_fsmap finished waiting for FSMap version 27 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74c2b2e740 10 client.16071 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74c2b2e740 20 client.16071 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:32.742 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a846861180 0x55a8468635a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74c2b2e740 4 client.16071 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}] 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74c2b2e740 1 -- 172.21.15.103:0/3345361209 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub start", "path": "/", "scrubops": ["force", "recursive"]}) -- 0x55a846744270 con 0x55a846861180 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74bdccb640 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a846861180 0x55a8468635a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74bdccb640 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a846861180 0x55a8468635a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7407551c4aadef00 server_cookie=10ddefb071ceed79 in_seq=0 out_seq=0 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.726+0000 7f74a1ffb640 10 client.16071 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74a1ffb640 1 -- 172.21.15.103:0/3345361209 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+110 (crc 0 0 0) 0x55a846744270 con 0x55a846861180 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74a1ffb640 10 client.16071 handle_command_reply: tid=0 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 client.16071 shutdown 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 -- 172.21.15.103:0/3345361209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 msgr2=0x55a8467e9770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e9770 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f74b404a9b0 tx=0x7f74b404a8d0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.743 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 -- 172.21.15.103:0/3345361209 shutdown_connections 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a846861180 0x55a8468635a0 crc :-1 s=READY pgs=85 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a8467e23e0 0x55a84685f4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74a1ffb640 0 client.16071 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a8467d7b20 0x55a8467e9cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 --2- 172.21.15.103:0/3345361209 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a8467d7200 0x55a8467e9770 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.727+0000 7f74c2b2e740 1 -- 172.21.15.103:0/3345361209 >> 172.21.15.103:0/3345361209 conn(0x55a8467d3790 msgr2=0x55a8467e1350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.728+0000 7f74c2b2e740 1 -- 172.21.15.103:0/3345361209 shutdown_connections 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.728+0000 7f74c2b2e740 1 -- 172.21.15.103:0/3345361209 wait complete. 2024-08-02T18:51:32.744 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.728+0000 7f74c2b2e740 20 client.16071 trim_cache size 0 max 16384 2024-08-02T18:51:32.745 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:51:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "return_code": 0, 2024-08-02T18:51:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "scrub_tag": "0ce33446-702f-4048-a802-6f209b87f610", 2024-08-02T18:51:32.745 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": "asynchronous" 2024-08-02T18:51:32.745 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:51:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.728+0000 7f74c0730640 1 -- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f74a40a2cf0 msgr2=0x7f74a40a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.728+0000 7f74c0730640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f74a40a2cf0 0x7f74a40a51b0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f74b4009900 tx=0x7f74b40058d0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.728+0000 7f74c0730640 1 -- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8102260 msgr2=0x7f74b8198820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.728+0000 7f74c0730640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8102260 0x7f74b8198820 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f74a800d770 tx=0x7f74a800dc30 comp rx=0 tx=0).stop 2024-08-02T18:51:32.746 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.729+0000 7f74c0730640 1 -- 172.21.15.103:0/1104041987 shutdown_connections 2024-08-02T18:51:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.729+0000 7f74c0730640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f74a40a2cf0 0x7f74a40a51b0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.729+0000 7f74c0730640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f74b81078c0 0x7f74b819cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.729+0000 7f74c0730640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f74b8102260 0x7f74b8198820 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.729+0000 7f74c0730640 1 --2- 172.21.15.103:0/1104041987 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f74b81018c0 0x7f74b81982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.729+0000 7f74c0730640 1 -- 172.21.15.103:0/1104041987 >> 172.21.15.103:0/1104041987 conn(0x7f74b80fd620 msgr2=0x7f74b80fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.729+0000 7f74c0730640 1 -- 172.21.15.103:0/1104041987 shutdown_connections 2024-08-02T18:51:32.747 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:32.729+0000 7f74c0730640 1 -- 172.21.15.103:0/1104041987 wait complete. 2024-08-02T18:51:33.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: pgmap v57: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 7.2 MiB/s wr, 155 op/s 2024-08-02T18:51:33.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:33.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: scrub summary: active paths [/] 2024-08-02T18:51:33.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000321 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000312 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000031e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.074 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000323 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000031a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000031b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000313 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000319 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000317 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000318 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000322 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000311 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000316 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000031d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000326 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000325 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000339 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.076 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000338 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.077 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.077 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.077 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.077 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.077 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000363 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.077 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000341 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.077 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000037a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.077 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000364 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.078 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.078 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003af (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.079 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.079 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000343 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.079 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.079 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.079 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.079 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.080 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.080 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.080 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.081 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.081 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000038d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.081 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.081 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.082 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000365 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.082 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.082 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.082 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.083 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.083 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.083 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003d4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.083 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.083 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.902+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a0 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc auth v522 ap=1 s=5652 n(v0 rc2024-08-02T18:51:22.719164+0000 b5652 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002a0:[<0x10000000231/sysfs-class-uwb_rc v522>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002a0:[<0x10000000231/sysfs-class-uwb_rc v522>,<0x10000000205/testing v900>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.083 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.902+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000263 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe auth v540 ap=1 s=4609 n(v0 rc2024-08-02T18:51:22.669165+0000 b4609 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000263:[<0x10000000231/sysfs-bus-fcoe v540>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000263:[<0x10000000231/sysfs-bus-fcoe v540>,<0x10000000205/testing v900>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.083 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.903+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f8 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi auth v618 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f8:[<0x10000000231/sysfs-platform-asus-wmi v618>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002f8:[<0x10000000231/sysfs-platform-asus-wmi v618>,<0x10000000205/testing v900>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.084 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.903+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000232 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget auth v492 ap=1 s=1258 n(v0 rc2024-08-02T18:51:22.627166+0000 b1258 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a84000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000232:[<0x10000000231/configfs-spear-pcie-gadget v492>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000232:[<0x10000000231/configfs-spear-pcie-gadget v492>,<0x10000000205/testing v900>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.084 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.903+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi auth v436 ap=1 s=365 n(v0 rc2024-08-02T18:51:22.635166+0000 b365 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000023b:[<0x10000000231/configfs-usb-gadget-midi v436>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000023b:[<0x10000000231/configfs-usb-gadget-midi v436>,<0x10000000205/testing v900>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.084 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.904+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002dc [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map auth v610 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a85080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002dc:[<0x10000000231/sysfs-firmware-efi-runtime-map v610>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002dc:[<0x10000000231/sysfs-firmware-efi-runtime-map v610>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.084 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.904+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000240 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial auth v512 ap=1 s=273 n(v0 rc2015-06-06T15:21:22.000000+0000 b273 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a84580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000240:[<0x10000000231/configfs-usb-gadget-serial v512>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000240:[<0x10000000231/configfs-usb-gadget-serial v512>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.084 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.904+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002da [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi auth v608 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a85600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002da:[<0x10000000231/sysfs-firmware-dmi v608>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002da:[<0x10000000231/sysfs-firmware-dmi v608>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.084 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.904+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000271 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio auth v394 ap=1 s=1075 n(v0 rc2024-08-02T18:51:22.680165+0000 b1075 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a84b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000271:[<0x10000000231/sysfs-bus-mdio v394>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000271:[<0x10000000231/sysfs-bus-mdio v394>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.084 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.769+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000321 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff5e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000321:[<0x10000000310/libata.tmpl v34>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000321:[<0x10000000310/libata.tmpl v34>,<0x10000000203/DocBook v2103>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.084 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.769+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000312 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff811b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000312:[<0x10000000310/80211.tmpl v4>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000312:[<0x10000000310/80211.tmpl v4>,<0x10000000203/DocBook v2103>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.085 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.770+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff811080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000031e:[<0x10000000310/kernel-hacking.tmpl v28>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000031e:[<0x10000000310/kernel-hacking.tmpl v28>,<0x10000000203/DocBook v2103>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.085 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.770+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000323 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff811600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000323:[<0x10000000310/lsm.tmpl v38>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000323:[<0x10000000310/lsm.tmpl v38>,<0x10000000203/DocBook v2103>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.085 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.770+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff813180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000031a:[<0x10000000310/filesystems.tmpl v20>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000031a:[<0x10000000310/filesystems.tmpl v20>,<0x10000000203/DocBook v2103>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.085 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.771+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff813700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000031c:[<0x10000000310/genericirq.tmpl v24>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000031c:[<0x10000000310/genericirq.tmpl v24>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.085 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.771+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000314 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff818000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000314:[<0x10000000310/alsa-driver-api.tmpl v8>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000314:[<0x10000000310/alsa-driver-api.tmpl v8>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.085 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.771+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff818580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000031b:[<0x10000000310/gadget.tmpl v22>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000031b:[<0x10000000310/gadget.tmpl v22>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.085 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.772+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000313 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff81a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000313:[<0x10000000310/Makefile v6>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000313:[<0x10000000310/Makefile v6>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.085 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000353 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000384 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000348 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000037c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000388 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.086 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000349 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000371 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000038b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000382 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000036a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000034f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.087 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003d2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003ce (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000383 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000385 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000380 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.088 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003bc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000357 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000360 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000035b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003ca (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000035d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000036d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.089 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.090 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.904+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ce [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek auth v606 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a85b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ce:[<0x10000000231/sysfs-driver-input-axp-pek v606>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002ce:[<0x10000000231/sysfs-driver-input-axp-pek v606>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.090 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.905+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x auth v334 ap=1 s=10279 n(v0 rc2024-08-02T18:51:22.662165+0000 b10279 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a86100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000025b:[<0x10000000231/sysfs-bus-coresight-devices-etm3x v334>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000025b:[<0x10000000231/sysfs-bus-coresight-devices-etm3x v334>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.090 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.905+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000294 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan auth v532 ap=1 s=1454 n(v0 rc2024-08-02T18:51:22.709164+0000 b1454 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a86680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000294:[<0x10000000231/sysfs-class-net-grcan v532>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000294:[<0x10000000231/sysfs-class-net-grcan v532>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.090 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.905+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002de [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log auth v612 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a86c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002de:[<0x10000000231/sysfs-firmware-log v612>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002de:[<0x10000000231/sysfs-firmware-log v612>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.090 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.905+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000023a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage auth v526 ap=1 s=1063 n(v0 rc2024-08-02T18:51:22.634166+0000 b1063 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a87180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000023a:[<0x10000000231/configfs-usb-gadget-mass-storage v526>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000023a:[<0x10000000231/configfs-usb-gadget-mass-storage v526>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.091 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.905+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e1 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi auth v614 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a87700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e1:[<0x10000000231/sysfs-firmware-sfi v614>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002e1:[<0x10000000231/sysfs-firmware-sfi v614>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.091 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.906+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b2 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup auth v382 ap=1 s=589 n(v0 rc2024-08-02T18:51:22.733164+0000 b589 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a90000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b2:[<0x10000000231/sysfs-devices-power_resources_wakeup v382>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002b2:[<0x10000000231/sysfs-devices-power_resources_wakeup v382>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.091 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.906+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f5 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module auth v616 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a90580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f5:[<0x10000000231/sysfs-module v616>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002f5:[<0x10000000231/sysfs-module v616>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.091 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.906+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000302 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power auth v620 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a90b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000302:[<0x10000000231/sysfs-power v620>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000302:[<0x10000000231/sysfs-power v620>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.091 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.772+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000315 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff81b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000315:[<0x10000000310/crypto-API.tmpl v10>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000315:[<0x10000000310/crypto-API.tmpl v10>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.091 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.773+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000319 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff824000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000319:[<0x10000000310/drm.tmpl v18>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000319:[<0x10000000310/drm.tmpl v18>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.092 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.773+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000320 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff824b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000320:[<0x10000000310/kgdb.tmpl v32>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000320:[<0x10000000310/kgdb.tmpl v32>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.092 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.773+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000317 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff824580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000317:[<0x10000000310/device-drivers.tmpl v14>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000317:[<0x10000000310/device-drivers.tmpl v14>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.092 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.773+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000318 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff825080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000318:[<0x10000000310/deviceiobook.tmpl v16>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000318:[<0x10000000310/deviceiobook.tmpl v16>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.092 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.774+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff825b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000031f:[<0x10000000310/kernel-locking.tmpl v30>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000031f:[<0x10000000310/kernel-locking.tmpl v30>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.092 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.774+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000322 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff826100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000322:[<0x10000000310/librs.tmpl v36>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000322:[<0x10000000310/librs.tmpl v36>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.092 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.774+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000311 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff826c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000311:[<0x10000000310/.gitignore v2>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000311:[<0x10000000310/.gitignore v2>,<0x10000000203/DocBook v2105>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.092 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.774+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000316 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff827180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000316:[<0x10000000310/debugobjects.tmpl v12>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000316:[<0x10000000310/debugobjects.tmpl v12>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.092 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.775+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000031d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff827700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000031d:[<0x10000000310/kernel-api.tmpl v26>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000031d:[<0x10000000310/kernel-api.tmpl v26>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.093 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.906+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000303 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps auth v622 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a91080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000303:[<0x10000000231/sysfs-pps v622>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000303:[<0x10000000231/sysfs-pps v622>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.093 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.906+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a8 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc auth v588 ap=1 s=985 n(v0 rc2024-08-02T18:51:22.725164+0000 b985 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169f8000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002a8:[<0x10000000231/sysfs-devices-mmc v588>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002a8:[<0x10000000231/sysfs-devices-mmc v588>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.093 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.907+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000027f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency auth v594 ap=1 s=358 n(v0 rc2024-08-02T18:51:22.692165+0000 b358 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169bc680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000027f:[<0x10000000231/sysfs-cfq-target-latency v594>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000027f:[<0x10000000231/sysfs-cfq-target-latency v594>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.093 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.907+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ee [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm auth v620 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169bcc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ee:[<0x10000000231/sysfs-kernel-mm v620>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002ee:[<0x10000000231/sysfs-kernel-mm v620>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.093 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.907+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000291 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net auth v310 ap=1 s=7235 n(v0 rc2024-08-02T18:51:22.707164+0000 b7235 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169bd180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000291:[<0x10000000231/sysfs-class-net v310>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000291:[<0x10000000231/sysfs-class-net v310>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.093 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.907+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a9 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online auth v342 ap=1 s=1008 n(v0 rc2024-08-02T18:51:22.726164+0000 b1008 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169bd700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002a9:[<0x10000000231/sysfs-devices-online v342>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002a9:[<0x10000000231/sysfs-devices-online v342>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.094 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.907+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000281 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870 auth v422 ap=1 s=2380 n(v0 rc2024-08-02T18:51:22.694165+0000 b2380 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169f8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000281:[<0x10000000231/sysfs-class-backlight-driver-adp8870 v422>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000281:[<0x10000000231/sysfs-class-backlight-driver-adp8870 v422>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.094 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.907+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bf [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch auth v454 ap=1 s=531 n(v0 rc2024-08-02T18:51:22.743164+0000 b531 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169f8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002bf:[<0x10000000231/sysfs-driver-hid-multitouch v454>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002bf:[<0x10000000231/sysfs-driver-hid-multitouch v454>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.094 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.908+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000273 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei auth v364 ap=1 s=247 n(v0 rc2024-08-02T18:51:22.682165+0000 b247 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169f9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000273:[<0x10000000231/sysfs-bus-mei v364>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000273:[<0x10000000231/sysfs-bus-mei v364>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.094 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.777+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000324 [...4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/ auth v120 ap=1 f(v0 m2024-08-02T18:51:25.874105+0000 16=14+2) n(v3 rc2024-08-02T18:51:25.874105+0000 196=193+3) (inest lock) (ifile excl) caps={24881=pAsLsXsFsx/pAsLsXsFsxcral@1},l=24881 | importingcaps=0 dirfrag=1 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x562aff82d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000324:[<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000324:[<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-02T18:51:25.874105+0000 16=14+2)","ondisk_value.rstat":"n(v0 rc2024-08-02T18:51:25.874105+0000 196=193+3)","memory_value.dirstat":"f(v0 m2024-08-02T18:51:25.874105+0000 16=14+2)","memory_value.rstat":"n(v3 rc2024-08-02T18:51:25.874105+0000 196=193+3)","error_str":""},"return_code":0} 2024-08-02T18:51:33.094 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.777+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64 auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff82db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033c:[<0x10000000324/pipeline.png.b64 v48>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000033c:[<0x10000000324/pipeline.png.b64 v48>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.094 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.778+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033e [...4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/ auth fragtree_t(*^3) v389 ap=1 f(v0 m2024-08-02T18:51:25.871105+0000 166=166+0) n(v0 rc2024-08-02T18:51:25.871105+0000 167=166+1) (inest lock) (ifile excl) caps={24881=pAsLsXsFsx/pAsLsXsFsxcral@1},l=24881 | importingcaps=0 dirfrag=8 caps=1 replicated=0 dirty=1 authpin=1 scrubqueue=0 0x562aff82e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x1000000033e:[<0x10000000324/v4l v354>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x1000000033e:[<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-02T18:51:25.871105+0000 166=166+0)","ondisk_value.rstat":"n(v0 rc2024-08-02T18:51:25.871105+0000 167=166+1)","memory_value.dirstat":"f(v0 m2024-08-02T18:51:25.871105+0000 166=166+0)","memory_value.rstat":"n(v0 rc2024-08-02T18:51:25.871105+0000 167=166+1)","error_str":""},"return_code":0} 2024-08-02T18:51:33.094 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.778+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000337 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64 auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff82ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000337:[<0x10000000324/dvbstb.png.b64 v38>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000337:[<0x10000000324/dvbstb.png.b64 v38>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.094 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.778+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000326 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64 auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff82f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000326:[<0x10000000324/bayer.png.b64 v4>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000326:[<0x10000000324/bayer.png.b64 v4>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.095 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.778+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64 auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff82f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033d:[<0x10000000324/selection.png.b64 v50>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000033d:[<0x10000000324/selection.png.b64 v50>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.095 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.778+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000325 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff836000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000325:[<0x10000000324/Makefile v2>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000325:[<0x10000000324/Makefile v2>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.095 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.778+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000339 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64 auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff836580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000339:[<0x10000000324/fieldseq_tb.gif.b64 v42>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000339:[<0x10000000324/fieldseq_tb.gif.b64 v42>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.095 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.779+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000328 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64 auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff837600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000328:[<0x10000000324/crop.gif.b64 v8>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000328:[<0x10000000324/crop.gif.b64 v8>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.095 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.908+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fe [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim auth v624 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169f9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002fe:[<0x10000000231/sysfs-platform-kim v624>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002fe:[<0x10000000231/sysfs-platform-kim v624>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.095 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.908+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000251 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata auth v316 ap=1 s=2485 n(v0 rc2024-08-02T18:51:22.654165+0000 b2485 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169f9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000251:[<0x10000000231/sysfs-ata v316>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000251:[<0x10000000231/sysfs-ata v316>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.096 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.908+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000234 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm auth v322 ap=1 s=270 n(v0 rc2015-06-06T15:21:22.000000+0000 b270 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169fa100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000234:[<0x10000000231/configfs-usb-gadget-acm v322>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000234:[<0x10000000231/configfs-usb-gadget-acm v322>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.096 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.908+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000025a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10 auth v570 ap=1 s=1079 n(v0 rc2024-08-02T18:51:22.661165+0000 b1079 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169fac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000025a:[<0x10000000231/sysfs-bus-coresight-devices-etb10 v570>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000025a:[<0x10000000231/sysfs-bus-coresight-devices-etb10 v570>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.096 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.908+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ca [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos auth v606 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169fa680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ca:[<0x10000000231/sysfs-driver-hid-roccat-ryos v606>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002ca:[<0x10000000231/sysfs-driver-hid-roccat-ryos v606>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.096 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.908+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c3 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku auth v430 ap=1 s=8101 n(v0 rc2024-08-02T18:51:22.747164+0000 b8101 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169fb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002c3:[<0x10000000231/sysfs-driver-hid-roccat-isku v430>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002c3:[<0x10000000231/sysfs-driver-hid-roccat-isku v430>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.096 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.909+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b7 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun auth v506 ap=1 s=600 n(v0 rc2024-08-02T18:51:22.737164+0000 b600 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169fb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b7:[<0x10000000231/sysfs-devices-sun v506>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002b7:[<0x10000000231/sysfs-devices-sun v506>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.096 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.909+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002df [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap auth v612 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a0e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002df:[<0x10000000231/sysfs-firmware-memmap v612>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002df:[<0x10000000231/sysfs-firmware-memmap v612>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.096 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.909+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs auth v616 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a0e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e4:[<0x10000000231/sysfs-fs-f2fs v616>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002e4:[<0x10000000231/sysfs-fs-f2fs v616>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.779+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64 auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff837b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033a:[<0x10000000324/nv12mt.gif.b64 v44>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000033a:[<0x10000000324/nv12mt.gif.b64 v44>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.779+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000338 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64 auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff838100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000338:[<0x10000000324/fieldseq_bt.gif.b64 v40>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000338:[<0x10000000324/fieldseq_bt.gif.b64 v40>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.779+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000329 [...4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ auth v36 ap=1 f(v0 m2024-08-02T18:51:24.603129+0000 13=13+0) n(v0 rc2024-08-02T18:51:24.603129+0000 14=13+1) (inest lock) (ifile excl) caps={24881=pAsLsXsFsx/pAsLsXsFsxcral@1},l=24881 | importingcaps=0 dirfrag=1 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff838680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(2)0x10000000329:[<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[]","memoryvalue":"(2)0x10000000329:[<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":true,"passed":true,"read_ret_val":0,"ondisk_value.dirstat":"f(v0 m2024-08-02T18:51:24.603129+0000 13=13+0)","ondisk_value.rstat":"n(v0 rc2024-08-02T18:51:24.603129+0000 14=13+1)","memory_value.dirstat":"f(v0 m2024-08-02T18:51:24.603129+0000 13=13+0)","memory_value.rstat":"n(v0 rc2024-08-02T18:51:24.603129+0000 14=13+1)","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.780+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000327 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64 auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff838c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000327:[<0x10000000324/constraints.png.b64 v6>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000327:[<0x10000000324/constraints.png.b64 v6>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.780+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64 auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff839180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033b:[<0x10000000324/nv12mt_example.gif.b64 v46>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000033b:[<0x10000000324/nv12mt_example.gif.b64 v46>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.780+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml auth v32 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff839700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034e:[<0x1000000033e/dev-raw-vbi.xml v32>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000034e:[<0x1000000033e/dev-raw-vbi.xml v32>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.780+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000363 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml auth v74 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff83e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000363:[<0x1000000033e/keytable.c.xml v74>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000363:[<0x1000000033e/keytable.c.xml v74>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.780+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000341 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff83e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000341:[<0x1000000033e/capture.c.xml v6>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000341:[<0x1000000033e/capture.c.xml v6>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.097 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.780+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml auth v120 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff83f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000037a:[<0x1000000033e/pixfmt-sbggr8.xml v120>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000037a:[<0x1000000033e/pixfmt-sbggr8.xml v120>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.098 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.909+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ad [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power auth v360 ap=1 s=11803 n(v0 rc2024-08-02T18:51:22.729164+0000 b11803 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a0eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ad:[<0x10000000231/sysfs-devices-power v360>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002ad:[<0x10000000231/sysfs-devices-power v360>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.098 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.909+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e3 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4 auth v614 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a0f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e3:[<0x10000000231/sysfs-fs-ext4 v614>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002e3:[<0x10000000231/sysfs-fs-ext4 v614>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.098 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.909+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000272 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media auth v528 ap=1 s=268 n(v0 rc2024-08-02T18:51:22.681165+0000 b268 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a0f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000272:[<0x10000000231/sysfs-bus-media v528>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000272:[<0x10000000231/sysfs-bus-media v528>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.098 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.909+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000248 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad auth v566 ap=1 s=465 n(v0 rc2024-08-02T18:51:22.646165+0000 b465 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a10100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000248:[<0x10000000231/debugfs-ideapad v566>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000248:[<0x10000000231/debugfs-ideapad v566>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.098 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.909+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ba [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu auth v508 ap=1 s=670 n(v0 rc2015-06-06T15:21:22.000000+0000 b670 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a0fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ba:[<0x10000000231/sysfs-devices-system-xen_cpu v508>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002ba:[<0x10000000231/sysfs-devices-system-xen_cpu v508>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.098 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.910+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cc [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1 auth v608 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a10680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002cc:[<0x10000000231/sysfs-driver-hid-srws1 v608>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002cc:[<0x10000000231/sysfs-driver-hid-srws1 v608>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.099 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.910+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fb [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg auth v622 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a10c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002fb:[<0x10000000231/sysfs-platform-chipidea-usb-otg v622>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002fb:[<0x10000000231/sysfs-platform-chipidea-usb-otg v622>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.099 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.910+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000300 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb auth v626 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a11180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000300:[<0x10000000231/sysfs-platform-tahvo-usb v626>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000300:[<0x10000000231/sysfs-platform-tahvo-usb v626>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.099 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.910+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d7 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback auth v610 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a11700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002d7:[<0x10000000231/sysfs-driver-xen-blkback v610>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002d7:[<0x10000000231/sysfs-driver-xen-blkback v610>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.099 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.781+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000364 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml auth v76 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff83f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000364:[<0x1000000033e/libv4l.xml v76>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000364:[<0x1000000033e/libv4l.xml v76>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.099 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.781+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000373 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml auth v106 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff83fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000373:[<0x1000000033e/pixfmt-nv12mt.xml v106>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000373:[<0x1000000033e/pixfmt-nv12mt.xml v106>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.099 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.781+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003af [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml auth v226 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff840680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003af:[<0x1000000033e/vidioc-dv-timings-cap.xml v226>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003af:[<0x1000000033e/vidioc-dv-timings-cap.xml v226>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.100 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.781+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c2 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml auth v264 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff840c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c2:[<0x1000000033e/vidioc-g-enc-index.xml v264>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c2:[<0x1000000033e/vidioc-g-enc-index.xml v264>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.100 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.781+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000343 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff841180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000343:[<0x1000000033e/compat.xml v10>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000343:[<0x1000000033e/compat.xml v10>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.100 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.781+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cd [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml auth v286 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff841700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003cd:[<0x1000000033e/vidioc-g-selection.xml v286>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003cd:[<0x1000000033e/vidioc-g-selection.xml v286>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.100 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.782+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf auth v96 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff880000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036e:[<0x1000000033e/pipeline.pdf v96>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000036e:[<0x1000000033e/pipeline.pdf v96>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.100 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.782+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c5 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml auth v270 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff880580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c5:[<0x1000000033e/vidioc-g-fmt.xml v270>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c5:[<0x1000000033e/vidioc-g-fmt.xml v270>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.100 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.782+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c3 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml auth v266 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff880b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c3:[<0x1000000033e/vidioc-g-ext-ctrls.xml v266>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c3:[<0x1000000033e/vidioc-g-ext-ctrls.xml v266>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.100 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.910+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000290 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd auth v346 ap=1 s=7568 n(v0 rc2024-08-02T18:51:22.706164+0000 b7568 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a18000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000290:[<0x10000000231/sysfs-class-mtd v346>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000290:[<0x10000000231/sysfs-class-mtd v346>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.100 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.910+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000298 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd auth v428 ap=1 s=2800 n(v0 rc2015-06-06T15:21:22.000000+0000 b2800 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a18580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000298:[<0x10000000231/sysfs-class-pktcdvd v428>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000298:[<0x10000000231/sysfs-class-pktcdvd v428>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.101 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.782+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b8 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml auth v244 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff881080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b8:[<0x1000000033e/vidioc-enuminput.xml v244>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b8:[<0x1000000033e/vidioc-enuminput.xml v244>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.101 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.782+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000393 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml auth v170 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff881600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000393:[<0x1000000033e/pixfmt-yuv420m.xml v170>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000393:[<0x1000000033e/pixfmt-yuv420m.xml v170>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.101 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.911+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ac [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb auth v464 ap=1 s=1541 n(v0 rc2015-06-06T15:21:22.000000+0000 b1541 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a18b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ac:[<0x10000000231/sysfs-devices-platform-sh_mobile_lcdc_fb v464>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002ac:[<0x10000000231/sysfs-devices-platform-sh_mobile_lcdc_fb v464>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.101 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.911+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000249 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc auth v568 ap=1 s=572 n(v0 rc2024-08-02T18:51:22.647165+0000 b572 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a19080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000249:[<0x10000000231/debugfs-olpc v568>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000249:[<0x10000000231/debugfs-olpc v568>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.101 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.911+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a2 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev auth v338 ap=1 s=693 n(v0 rc2015-06-06T15:21:22.000000+0000 b693 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a19600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002a2:[<0x10000000231/sysfs-dev v338>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002a2:[<0x10000000231/sysfs-dev v338>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.102 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.782+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000387 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml auth v146 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff882100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000387:[<0x1000000033e/pixfmt-srggb8.xml v146>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000387:[<0x1000000033e/pixfmt-srggb8.xml v146>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.102 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.782+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c8 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml auth v276 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff881b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c8:[<0x1000000033e/vidioc-g-jpegcomp.xml v276>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c8:[<0x1000000033e/vidioc-g-jpegcomp.xml v276>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.102 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.783+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml auth v158 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff882680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000038d:[<0x1000000033e/pixfmt-y12.xml v158>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000038d:[<0x1000000033e/pixfmt-y12.xml v158>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.103 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.911+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533 auth v410 ap=1 s=1541 n(v0 rc2024-08-02T18:51:22.703164+0000 b1541 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a19b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000028c:[<0x10000000231/sysfs-class-led-driver-lm3533 v410>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000028c:[<0x10000000231/sysfs-class-led-driver-lm3533 v410>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.103 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.911+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000239 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback auth v550 ap=1 s=189 n(v0 rc2024-08-02T18:51:22.633166+0000 b189 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a1a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000239:[<0x10000000231/configfs-usb-gadget-loopback v550>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000239:[<0x10000000231/configfs-usb-gadget-loopback v550>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.103 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.783+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000390 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml auth v164 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff882c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000390:[<0x1000000033e/pixfmt-yuv410.xml v164>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000390:[<0x1000000033e/pixfmt-yuv410.xml v164>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.103 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.783+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml auth v156 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff883180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000038c:[<0x1000000033e/pixfmt-y10b.xml v156>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000038c:[<0x1000000033e/pixfmt-y10b.xml v156>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.911+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c6 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure auth v488 ap=1 s=5616 n(v0 rc2024-08-02T18:51:22.749164+0000 b5616 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a1a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002c6:[<0x10000000231/sysfs-driver-hid-roccat-konepure v488>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002c6:[<0x10000000231/sysfs-driver-hid-roccat-konepure v488>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.104 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.911+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000260 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format auth v328 ap=1 s=704 n(v0 rc2024-08-02T18:51:22.666165+0000 b704 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a1ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000260:[<0x10000000231/sysfs-bus-event_source-devices-format v328>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000260:[<0x10000000231/sysfs-bus-event_source-devices-format v328>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: pgmap v57: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 7.2 MiB/s wr, 155 op/s 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: scrub summary: active paths [/] 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000321 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000312 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000031e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000323 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000031a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.105 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000031b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000313 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000319 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000317 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000318 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000322 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000311 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000316 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000031d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.106 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000326 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000325 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000339 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000338 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.107 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000363 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000341 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000037a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000364 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003af (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000343 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.108 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000038d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000365 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003d4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.109 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000353 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000384 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000348 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000037c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000388 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.110 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000349 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000371 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000038b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000382 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000036a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.111 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000034f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003d2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003ce (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000383 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000385 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.112 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000380 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003bc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000357 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000360 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000035b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003ca (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000035d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000036d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:32 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.113 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.783+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000365 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml auth v78 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff883700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000365:[<0x1000000033e/lirc_device_interface.xml v78>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000365:[<0x1000000033e/lirc_device_interface.xml v78>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.114 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.783+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000370 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml auth v100 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff890000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000370:[<0x1000000033e/pixfmt-m420.xml v100>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000370:[<0x1000000033e/pixfmt-m420.xml v100>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.114 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.783+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000344 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff890b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000344:[<0x1000000033e/controls.xml v12>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000344:[<0x1000000033e/controls.xml v12>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.114 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.783+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000362 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml auth v72 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff890580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000362:[<0x1000000033e/io.xml v72>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000362:[<0x1000000033e/io.xml v72>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.114 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.912+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e8 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085 auth v618 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a1b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e8:[<0x10000000231/sysfs-i2c-bmp085 v618>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002e8:[<0x10000000231/sysfs-i2c-bmp085 v618>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.115 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.912+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000306 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty auth v628 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a1b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000306:[<0x10000000231/sysfs-tty v628>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000306:[<0x10000000231/sysfs-tty v628>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.115 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.784+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg auth v194 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff891080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039f:[<0x1000000033e/subdev-image-processing-crop.svg v194>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000039f:[<0x1000000033e/subdev-image-processing-crop.svg v194>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.115 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.784+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b6 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml auth v240 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff891600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b6:[<0x1000000033e/vidioc-enumaudio.xml v240>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b6:[<0x1000000033e/vidioc-enumaudio.xml v240>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.115 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.784+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml auth v300 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff891b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d4:[<0x1000000033e/vidioc-qbuf.xml v300>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003d4:[<0x1000000033e/vidioc-qbuf.xml v300>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.115 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.912+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000307 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf auth v630 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a20000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000307:[<0x10000000231/sysfs-wusb_cbaf v630>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000307:[<0x10000000231/sysfs-wusb_cbaf v630>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.116 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.912+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000277 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform auth v458 ap=1 s=1138 n(v0 rc2024-08-02T18:51:22.685165+0000 b1138 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a4a100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000277:[<0x10000000231/sysfs-bus-platform v458>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000277:[<0x10000000231/sysfs-bus-platform v458>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.116 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.912+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b6 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc auth v544 ap=1 s=2073 n(v0 rc2024-08-02T18:51:22.736164+0000 b2073 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a4a680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b6:[<0x10000000231/sysfs-devices-soc v544>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002b6:[<0x10000000231/sysfs-devices-soc v544>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.116 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.912+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f1 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab auth v618 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a4ac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f1:[<0x10000000231/sysfs-kernel-slab v618>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002f1:[<0x10000000231/sysfs-kernel-slab v618>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.116 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.912+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone auth v560 ap=1 s=5060 n(v0 rc2015-06-06T15:21:22.000000+0000 b5060 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a4b180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002c4:[<0x10000000231/sysfs-driver-hid-roccat-kone v560>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002c4:[<0x10000000231/sysfs-driver-hid-roccat-kone v560>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.116 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.784+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bf [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml auth v258 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff892100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003bf:[<0x1000000033e/vidioc-g-ctrl.xml v258>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003bf:[<0x1000000033e/vidioc-g-ctrl.xml v258>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.116 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.784+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000353 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml auth v42 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff892680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000353:[<0x1000000033e/dev-teletext.xml v42>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000353:[<0x1000000033e/dev-teletext.xml v42>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.117 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.784+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000368 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml auth v84 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff893180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000368:[<0x1000000033e/media-func-ioctl.xml v84>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000368:[<0x1000000033e/media-func-ioctl.xml v84>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.117 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.784+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000384 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml auth v140 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff892c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000384:[<0x1000000033e/pixfmt-srggb10dpcm8.xml v140>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000384:[<0x1000000033e/pixfmt-srggb10dpcm8.xml v140>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.117 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.912+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000259 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma auth v384 ap=1 s=945 n(v0 rc2015-06-06T15:21:22.000000+0000 b945 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a4b700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000259:[<0x10000000231/sysfs-bus-bcma v384>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000259:[<0x10000000231/sysfs-bus-bcma v384>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.117 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.913+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f9 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91 auth v622 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169bab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f9:[<0x10000000231/sysfs-platform-at91 v622>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002f9:[<0x10000000231/sysfs-platform-at91 v622>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.117 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.785+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000348 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff893700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000348:[<0x1000000033e/dev-effect.xml v20>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000348:[<0x1000000033e/dev-effect.xml v20>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.117 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.785+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml auth v190 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039d:[<0x1000000033e/subdev-formats.xml v190>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000039d:[<0x1000000033e/subdev-formats.xml v190>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.118 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.913+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state auth v486 ap=1 s=1026 n(v0 rc2024-08-02T18:51:22.735164+0000 b1026 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169ba000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b4:[<0x10000000231/sysfs-devices-real_power_state v486>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002b4:[<0x10000000231/sysfs-devices-real_power_state v486>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.118 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.913+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a7 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory auth v596 ap=1 s=3712 n(v0 rc2015-06-06T15:21:22.000000+0000 b3712 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b169bb080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002a7:[<0x10000000231/sysfs-devices-memory v596>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002a7:[<0x10000000231/sysfs-devices-memory v596>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.118 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.913+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002ea [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params auth v614 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16946000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002ea:[<0x10000000231/sysfs-kernel-boot_params v614>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002ea:[<0x10000000231/sysfs-kernel-boot_params v614>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.118 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.785+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml auth v124 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000037c:[<0x1000000033e/pixfmt-sdr-cs14le.xml v124>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000037c:[<0x1000000033e/pixfmt-sdr-cs14le.xml v124>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.118 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.785+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a0 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia auth v196 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a0:[<0x1000000033e/subdev-image-processing-full.dia v196>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a0:[<0x1000000033e/subdev-image-processing-full.dia v196>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.118 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.785+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000388 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml auth v148 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000388:[<0x1000000033e/pixfmt-uv8.xml v148>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000388:[<0x1000000033e/pixfmt-uv8.xml v148>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.119 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.913+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d8 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront auth v608 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16946580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002d8:[<0x10000000231/sysfs-driver-xen-blkfront v608>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002d8:[<0x10000000231/sysfs-driver-xen-blkfront v608>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.119 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.913+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap auth v424 ap=1 s=5019 n(v0 rc2024-08-02T18:51:22.714164+0000 b5019 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16946b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000029a:[<0x10000000231/sysfs-class-powercap v424>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000029a:[<0x10000000231/sysfs-class-powercap v424>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.119 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.785+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b3 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml auth v234 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b3:[<0x1000000033e/vidioc-enum-frameintervals.xml v234>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b3:[<0x1000000033e/vidioc-enum-frameintervals.xml v234>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.119 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.785+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cc [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml auth v284 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003cc:[<0x1000000033e/vidioc-g-priority.xml v284>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003cc:[<0x1000000033e/vidioc-g-priority.xml v284>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.119 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.786+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a6 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf auth v208 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a6:[<0x1000000033e/vbi_525.pdf v208>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a6:[<0x1000000033e/vbi_525.pdf v208>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.120 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.786+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000395 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml auth v174 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89c680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000395:[<0x1000000033e/pixfmt-yuyv.xml v174>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000395:[<0x1000000033e/pixfmt-yuyv.xml v174>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.120 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.914+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000029e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration auth v446 ap=1 s=717 n(v0 rc2024-08-02T18:51:22.717164+0000 b717 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16947080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000029e:[<0x10000000231/sysfs-class-rtc-rtc0-device-rtc_calibration v446>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000029e:[<0x10000000231/sysfs-class-rtc-rtc0-device-rtc_calibration v446>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.120 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.914+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d9 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi auth v610 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16947600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002d9:[<0x10000000231/sysfs-firmware-acpi v610>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002d9:[<0x10000000231/sysfs-firmware-acpi v610>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.120 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.786+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000349 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89cc00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000349:[<0x1000000033e/dev-event.xml v22>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000349:[<0x1000000033e/dev-event.xml v22>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.120 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.786+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b2 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml auth v232 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89d180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b2:[<0x1000000033e/vidioc-enum-fmt.xml v232>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b2:[<0x1000000033e/vidioc-enum-fmt.xml v232>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.121 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.914+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000279 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg auth v582 ap=1 s=2975 n(v0 rc2024-08-02T18:51:22.687165+0000 b2975 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16947b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000279:[<0x10000000231/sysfs-bus-rpmsg v582>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000279:[<0x10000000231/sysfs-bus-rpmsg v582>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.121 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.914+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000297 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics auth v598 ap=1 s=6696 n(v0 rc2024-08-02T18:51:22.712164+0000 b6696 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16948100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000297:[<0x10000000231/sysfs-class-net-statistics v598>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000297:[<0x10000000231/sysfs-class-net-statistics v598>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.121 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.786+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d5 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml auth v302 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff89d700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d5:[<0x1000000033e/vidioc-query-dv-timings.xml v302>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003d5:[<0x1000000033e/vidioc-query-dv-timings.xml v302>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.121 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.786+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000371 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml auth v102 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8a4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000371:[<0x1000000033e/pixfmt-nv12.xml v102>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000371:[<0x1000000033e/pixfmt-nv12.xml v102>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.121 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.914+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000252 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block auth v348 ap=1 s=8870 n(v0 rc2024-08-02T18:51:22.655165+0000 b8870 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16948680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000252:[<0x10000000231/sysfs-block v348>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000252:[<0x10000000231/sysfs-block v348>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.121 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.914+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b8 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu auth v604 ap=1 s=9787 n(v0 rc2024-08-02T18:51:22.738164+0000 b9787 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16948c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b8:[<0x10000000231/sysfs-devices-system-cpu v604>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002b8:[<0x10000000231/sysfs-devices-system-cpu v604>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.122 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.914+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000244 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2 auth v474 ap=1 s=340 n(v0 rc2024-08-02T18:51:22.643166+0000 b340 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16949180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000244:[<0x10000000231/configfs-usb-gadget-uac2 v474>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000244:[<0x10000000231/configfs-usb-gadget-uac2 v474>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.122 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.787+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cb [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml auth v282 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8a4b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003cb:[<0x1000000033e/vidioc-g-parm.xml v282>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003cb:[<0x1000000033e/vidioc-g-parm.xml v282>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.122 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.787+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml auth v154 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8a5080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000038b:[<0x1000000033e/pixfmt-y10.xml v154>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000038b:[<0x1000000033e/pixfmt-y10.xml v154>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.122 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.787+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000382 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml auth v136 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8a5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000382:[<0x1000000033e/pixfmt-srggb10.xml v136>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000382:[<0x1000000033e/pixfmt-srggb10.xml v136>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.122 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.915+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d2 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop auth v606 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16949700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002d2:[<0x10000000231/sysfs-driver-samsung-laptop v606>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002d2:[<0x10000000231/sysfs-driver-samsung-laptop v606>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.122 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.915+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f0 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm auth v616 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1694e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f0:[<0x10000000231/sysfs-kernel-mm-ksm v616>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002f0:[<0x10000000231/sysfs-kernel-mm-ksm v616>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.123 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.787+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml auth v126 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8a5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000037d:[<0x1000000033e/pixfmt-sdr-cu08.xml v126>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000037d:[<0x1000000033e/pixfmt-sdr-cu08.xml v126>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.123 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.787+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000350 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml auth v36 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8a6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000350:[<0x1000000033e/dev-sdr.xml v36>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000350:[<0x1000000033e/dev-sdr.xml v36>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.123 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.915+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002b0 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2 auth v552 ap=1 s=614 n(v0 rc2015-06-06T15:21:22.000000+0000 b614 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1694e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002b0:[<0x10000000231/sysfs-devices-power_resources_D2 v552>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002b0:[<0x10000000231/sysfs-devices-power_resources_D2 v552>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.123 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.915+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002db [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi auth v612 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1694eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002db:[<0x10000000231/sysfs-firmware-efi v612>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002db:[<0x10000000231/sysfs-firmware-efi v612>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.124 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.788+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b5 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml auth v238 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8a6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b5:[<0x1000000033e/vidioc-enum-freq-bands.xml v238>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b5:[<0x1000000033e/vidioc-enum-freq-bands.xml v238>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.124 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.788+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml auth v204 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8a7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a4:[<0x1000000033e/v4l2.xml v204>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a4:[<0x1000000033e/v4l2.xml v204>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.124 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.788+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000396 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml auth v176 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b2000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000396:[<0x1000000033e/pixfmt-yvu420m.xml v176>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000396:[<0x1000000033e/pixfmt-yvu420m.xml v176>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.124 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.788+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000397 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml auth v178 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b2580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000397:[<0x1000000033e/pixfmt-yvyu.xml v178>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000397:[<0x1000000033e/pixfmt-yvyu.xml v178>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.124 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.915+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd auth v416 ap=1 s=681 n(v0 rc2024-08-02T18:51:22.701164+0000 b681 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1694f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000028a:[<0x10000000231/sysfs-class-lcd v416>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000028a:[<0x10000000231/sysfs-class-lcd v416>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.124 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.915+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000256 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram auth v370 ap=1 s=5060 n(v0 rc2024-08-02T18:51:22.658165+0000 b5060 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1694f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000256:[<0x10000000231/sysfs-block-zram v370>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000256:[<0x10000000231/sysfs-block-zram v370>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.125 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.788+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml auth v88 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b2b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036a:[<0x1000000033e/media-ioc-device-info.xml v88>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000036a:[<0x1000000033e/media-ioc-device-info.xml v88>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.125 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.788+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml auth v34 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b3080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034f:[<0x1000000033e/dev-rds.xml v34>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000034f:[<0x1000000033e/dev-rds.xml v34>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.125 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.789+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d2 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml auth v296 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b3600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d2:[<0x1000000033e/vidioc-overlay.xml v296>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003d2:[<0x1000000033e/vidioc-overlay.xml v296>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.125 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.916+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fd [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop auth v624 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1694fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002fd:[<0x10000000231/sysfs-platform-ideapad-laptop v624>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002fd:[<0x10000000231/sysfs-platform-ideapad-laptop v624>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.125 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.916+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000235 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm auth v374 ap=1 s=422 n(v0 rc2015-06-06T15:21:22.000000+0000 b422 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16950100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000235:[<0x10000000231/configfs-usb-gadget-ecm v374>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000235:[<0x10000000231/configfs-usb-gadget-ecm v374>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.125 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.916+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd auth v572 ap=1 s=448 n(v0 rc2024-08-02T18:51:22.649165+0000 b448 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16950680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000024b:[<0x10000000231/debugfs-pktcdvd v572>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000024b:[<0x10000000231/debugfs-pktcdvd v572>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.126 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.789+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000374 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml auth v108 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b3b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000374:[<0x1000000033e/pixfmt-nv16.xml v108>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000374:[<0x1000000033e/pixfmt-nv16.xml v108>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.126 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.789+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ce [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml auth v288 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b4100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ce:[<0x1000000033e/vidioc-g-sliced-vbi-cap.xml v288>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003ce:[<0x1000000033e/vidioc-g-sliced-vbi-cap.xml v288>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.126 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.789+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c7 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml auth v274 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b4680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c7:[<0x1000000033e/vidioc-g-input.xml v274>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c7:[<0x1000000033e/vidioc-g-input.xml v274>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.126 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.789+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml auth v268 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b4c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c4:[<0x1000000033e/vidioc-g-fbuf.xml v268>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c4:[<0x1000000033e/vidioc-g-fbuf.xml v268>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.126 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.916+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000261 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7 auth v320 ap=1 s=1928 n(v0 rc2024-08-02T18:51:22.667165+0000 b1928 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16950c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000261:[<0x10000000231/sysfs-bus-event_source-devices-hv_24x7 v320>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000261:[<0x10000000231/sysfs-bus-event_source-devices-hv_24x7 v320>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.127 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.916+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000267 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533 auth v400 ap=1 s=472 n(v0 rc2024-08-02T18:51:22.672165+0000 b472 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16951180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000267:[<0x10000000231/sysfs-bus-i2c-devices-lm3533 v400>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000267:[<0x10000000231/sysfs-bus-i2c-devices-lm3533 v400>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.127 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.789+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ac [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml auth v220 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b5180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ac:[<0x1000000033e/vidioc-dbg-g-register.xml v220>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003ac:[<0x1000000033e/vidioc-dbg-g-register.xml v220>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.127 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.789+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000378 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml auth v116 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8b5700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000378:[<0x1000000033e/pixfmt-packed-yuv.xml v116>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000378:[<0x1000000033e/pixfmt-packed-yuv.xml v116>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.128 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.916+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline auth v620 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16951700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f4:[<0x10000000231/sysfs-memory-page-offline v620>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002f4:[<0x10000000231/sysfs-memory-page-offline v620>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.128 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.917+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000262 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci auth v536 ap=1 s=1720 n(v0 rc2024-08-02T18:51:22.668165+0000 b1720 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000262:[<0x10000000231/sysfs-bus-event_source-devices-hv_gpci v536>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000262:[<0x10000000231/sysfs-bus-event_source-devices-hv_gpci v536>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.128 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.790+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ab [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml auth v218 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8bc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ab:[<0x1000000033e/vidioc-dbg-g-chip-info.xml v218>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003ab:[<0x1000000033e/vidioc-dbg-g-chip-info.xml v218>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.129 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.790+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml auth v28 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8bd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034c:[<0x1000000033e/dev-overlay.xml v28>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000034c:[<0x1000000033e/dev-overlay.xml v28>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.129 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.790+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000383 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml auth v138 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8bd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000383:[<0x1000000033e/pixfmt-srggb10alaw8.xml v138>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000383:[<0x1000000033e/pixfmt-srggb10alaw8.xml v138>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.129 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.917+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c5 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus auth v498 ap=1 s=5181 n(v0 rc2024-08-02T18:51:22.748164+0000 b5181 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002c5:[<0x10000000231/sysfs-driver-hid-roccat-koneplus v498>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002c5:[<0x10000000231/sysfs-driver-hid-roccat-koneplus v498>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.129 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.917+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002aa [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget auth v558 ap=1 s=667 n(v0 rc2024-08-02T18:51:22.727164+0000 b667 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695ab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002aa:[<0x10000000231/sysfs-devices-platform-_UDC_-gadget v558>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002aa:[<0x10000000231/sysfs-devices-platform-_UDC_-gadget v558>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.130 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.790+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000385 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml auth v142 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8bdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000385:[<0x1000000033e/pixfmt-srggb10p.xml v142>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000385:[<0x1000000033e/pixfmt-srggb10p.xml v142>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.130 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.790+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml auth v66 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8be680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000035f:[<0x1000000033e/func-select.xml v66>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000035f:[<0x1000000033e/func-select.xml v66>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.130 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.917+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160 auth v352 ap=1 s=300 n(v0 rc2024-08-02T18:51:22.676165+0000 b300 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695b080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000026c:[<0x10000000231/sysfs-bus-iio-gyro-bmg160 v352>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000026c:[<0x10000000231/sysfs-bus-iio-gyro-bmg160 v352>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.130 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.917+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000246 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe auth v404 ap=1 s=3784 n(v0 rc2024-08-02T18:51:22.645166+0000 b3784 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695bb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000246:[<0x10000000231/debugfs-driver-genwqe v404>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000246:[<0x10000000231/debugfs-driver-genwqe v404>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.130 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.917+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000287 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu auth v332 ap=1 s=508 n(v0 rc2015-06-06T15:21:22.000000+0000 b508 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695c100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000287:[<0x10000000231/sysfs-class-iommu v332>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000287:[<0x10000000231/sysfs-class-iommu v332>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.131 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.791+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000380 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml auth v132 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8bec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000380:[<0x1000000033e/pixfmt-sgbrg8.xml v132>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000380:[<0x1000000033e/pixfmt-sgbrg8.xml v132>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.131 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.791+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bc [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml auth v252 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8bf180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003bc:[<0x1000000033e/vidioc-g-audio.xml v252>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003bc:[<0x1000000033e/vidioc-g-audio.xml v252>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.131 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.791+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000357 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf auth v50 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8c8580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000357:[<0x1000000033e/fieldseq_tb.pdf v50>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000357:[<0x1000000033e/fieldseq_tb.pdf v50>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.131 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.791+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000354 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml auth v44 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8c8b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000354:[<0x1000000033e/driver.xml v44>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000354:[<0x1000000033e/driver.xml v44>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.131 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.917+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002f6 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2 auth v616 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a91b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002f6:[<0x10000000231/sysfs-ocfs2 v616>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002f6:[<0x10000000231/sysfs-ocfs2 v616>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.132 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.918+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002fc [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop auth v618 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a92100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002fc:[<0x10000000231/sysfs-platform-eeepc-laptop v618>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002fc:[<0x10000000231/sysfs-platform-eeepc-laptop v618>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.132 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.791+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000360 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml auth v68 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8c9600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000360:[<0x1000000033e/func-write.xml v68>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000360:[<0x1000000033e/func-write.xml v68>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.132 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.792+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml auth v58 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8c9080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000035b:[<0x1000000033e/func-munmap.xml v58>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000035b:[<0x1000000033e/func-munmap.xml v58>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.132 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.792+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000398 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml auth v180 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8ca100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000398:[<0x1000000033e/pixfmt.xml v180>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000398:[<0x1000000033e/pixfmt.xml v180>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.132 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.918+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c1 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys auth v592 ap=1 s=985 n(v0 rc2024-08-02T18:51:22.745164+0000 b985 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a92680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002c1:[<0x10000000231/sysfs-driver-hid-prodikeys v592>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002c1:[<0x10000000231/sysfs-driver-hid-prodikeys v592>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.132 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.918+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto auth v366 ap=1 s=1188 n(v0 rc2024-08-02T18:51:22.648165+0000 b1188 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b1695b600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000024a:[<0x10000000231/debugfs-pfo-nx-crypto v366>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000024a:[<0x10000000231/debugfs-pfo-nx-crypto v366>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.133 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.792+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ad [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml auth v222 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8c9b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ad:[<0x1000000033e/vidioc-decoder-cmd.xml v222>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003ad:[<0x1000000033e/vidioc-decoder-cmd.xml v222>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.133 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.792+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ca [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml auth v280 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8ca680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ca:[<0x1000000033e/vidioc-g-output.xml v280>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003ca:[<0x1000000033e/vidioc-g-output.xml v280>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.134 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.918+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000024d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm auth v368 ap=1 s=1180 n(v0 rc2015-06-06T15:21:22.000000+0000 b1180 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a91600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000024d:[<0x10000000231/evm v368>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000024d:[<0x10000000231/evm v368>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.134 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.918+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002a4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac auth v426 ap=1 s=6247 n(v0 rc2024-08-02T18:51:22.722164+0000 b6247 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a92c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002a4:[<0x10000000231/sysfs-devices-edac v426>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002a4:[<0x10000000231/sysfs-devices-edac v426>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.134 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.918+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000026d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als auth v386 ap=1 s=2051 n(v0 rc2024-08-02T18:51:22.677165+0000 b2051 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a93180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000026d:[<0x10000000231/sysfs-bus-iio-light-lm3533-als v386>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000026d:[<0x10000000231/sysfs-bus-iio-light-lm3533-als v386>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.134 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.918+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002d4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse auth v608 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a93700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002d4:[<0x10000000231/sysfs-driver-tegra-fuse v608>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002d4:[<0x10000000231/sysfs-driver-tegra-fuse v608>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.134 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.919+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000028f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt auth v444 ap=1 s=6215 n(v0 rc2024-08-02T18:51:22.705164+0000 b6215 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000028f:[<0x10000000231/sysfs-class-mic.txt v444>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000028f:[<0x10000000231/sysfs-class-mic.txt v444>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.134 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.919+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000289 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu auth v358 ap=1 s=1037 n(v0 rc2024-08-02T18:51:22.700164+0000 b1037 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000289:[<0x10000000231/sysfs-class-iommu-intel-iommu v358>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000289:[<0x10000000231/sysfs-class-iommu-intel-iommu v358>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.135 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.919+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000245 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc auth v440 ap=1 s=8923 n(v0 rc2024-08-02T18:51:22.644166+0000 b8923 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000245:[<0x10000000231/configfs-usb-gadget-uvc v440>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000245:[<0x10000000231/configfs-usb-gadget-uvc v440>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.135 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.919+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000250 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore auth v476 ap=1 s=1707 n(v0 rc2024-08-02T18:51:22.653165+0000 b1707 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000250:[<0x10000000231/pstore v476>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000250:[<0x10000000231/pstore v476>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.135 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.919+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000283 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi auth v356 ap=1 s=1656 n(v0 rc2024-08-02T18:51:22.695165+0000 b1656 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000283:[<0x10000000231/sysfs-class-bdi v356>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000283:[<0x10000000231/sysfs-class-bdi v356>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.135 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.919+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002cf [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start auth v606 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002cf:[<0x10000000231/sysfs-driver-intel-rapid-start v606>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002cf:[<0x10000000231/sysfs-driver-intel-rapid-start v606>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.135 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.920+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e2 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv auth v612 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e2:[<0x10000000231/sysfs-firmware-sgi_uv v612>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002e2:[<0x10000000231/sysfs-firmware-sgi_uv v612>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.135 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.920+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002c7 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus auth v466 ap=1 s=2657 n(v0 rc2024-08-02T18:51:22.750164+0000 b2657 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002c7:[<0x10000000231/sysfs-driver-hid-roccat-kovaplus v466>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002c7:[<0x10000000231/sysfs-driver-hid-roccat-kovaplus v466>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.135 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.920+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bb [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe auth v432 ap=1 s=2934 n(v0 rc2024-08-02T18:51:22.740164+0000 b2934 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002bb:[<0x10000000231/sysfs-driver-genwqe v432>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002bb:[<0x10000000231/sysfs-driver-genwqe v432>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.135 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.920+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002bd [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo auth v434 ap=1 s=2835 n(v0 rc2024-08-02T18:51:22.742164+0000 b2835 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002bd:[<0x10000000231/sysfs-driver-hid-lenovo v434>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002bd:[<0x10000000231/sysfs-driver-hid-lenovo v434>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.136 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.920+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000270 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs auth v336 ap=1 s=534 n(v0 rc2015-06-06T15:21:22.000000+0000 b534 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a9f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000270:[<0x10000000231/sysfs-bus-iio-trigger-sysfs v336>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000270:[<0x10000000231/sysfs-bus-iio-trigger-sysfs v336>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.136 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.920+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002e0 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw auth v610 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16aaa000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002e0:[<0x10000000231/sysfs-firmware-ofw v610>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002e0:[<0x10000000231/sysfs-firmware-ofw v610>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.136 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.920+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x100000002eb [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps auth v614 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16aaa580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000002eb:[<0x10000000231/sysfs-kernel-fscaps v614>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x100000002eb:[<0x10000000231/sysfs-kernel-fscaps v614>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.136 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000305 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp auth v620 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16aaab00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000305:[<0x10000000231/sysfs-ptp v620>,<0x10000000205/testing v900>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000305:[<0x10000000231/sysfs-ptp v620>,<0x10000000205/testing v903>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.136 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000222 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc auth v68 ap=1 s=2448 n(v0 rc2024-08-02T18:51:22.613166+0000 b2448 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a20b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000222:[<0x10000000216/sysfs-class-udc v68>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000222:[<0x10000000216/sysfs-class-udc v68>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.136 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight auth v98 ap=1 s=1914 n(v0 rc2024-08-02T18:51:22.609166+0000 b1914 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a21080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021e:[<0x10000000216/sysfs-class-backlight v98>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000021e:[<0x10000000216/sysfs-class-backlight v98>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.136 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend auth v82 ap=1 s=2532 n(v0 rc2024-08-02T18:51:22.608166+0000 b2532 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a21600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021d:[<0x10000000216/sysfs-bus-xen-backend v82>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000021d:[<0x10000000216/sysfs-bus-xen-backend v82>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.792+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d0 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml auth v292 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8cac00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d0:[<0x1000000033e/vidioc-g-tuner.xml v292>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003d0:[<0x1000000033e/vidioc-g-tuner.xml v292>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.792+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml auth v62 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8cb180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000035d:[<0x1000000033e/func-poll.xml v62>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000035d:[<0x1000000033e/func-poll.xml v62>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.793+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b1 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml auth v230 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8cb700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b1:[<0x1000000033e/vidioc-enum-dv-timings.xml v230>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b1:[<0x1000000033e/vidioc-enum-dv-timings.xml v230>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.793+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml auth v94 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d4000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036d:[<0x1000000033e/media-ioc-setup-link.xml v94>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000036d:[<0x1000000033e/media-ioc-setup-link.xml v94>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.793+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000358 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml auth v52 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d4580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000358:[<0x1000000033e/func-close.xml v52>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000358:[<0x1000000033e/func-close.xml v52>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.793+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000386 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml auth v144 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d5600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000386:[<0x1000000033e/pixfmt-srggb12.xml v144>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000386:[<0x1000000033e/pixfmt-srggb12.xml v144>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.794+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000346 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d5b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000346:[<0x1000000033e/dev-capture.xml v16>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000346:[<0x1000000033e/dev-capture.xml v16>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.794+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ba [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml auth v248 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d6100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ba:[<0x1000000033e/vidioc-enumstd.xml v248>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003ba:[<0x1000000033e/vidioc-enumstd.xml v248>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.137 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.794+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml auth v98 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d6680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036f:[<0x1000000033e/pixfmt-grey.xml v98>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000036f:[<0x1000000033e/pixfmt-grey.xml v98>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.794+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000361 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml auth v70 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d6c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000361:[<0x1000000033e/gen-errors.xml v70>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000361:[<0x1000000033e/gen-errors.xml v70>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.794+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a8 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf auth v212 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d7180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a8:[<0x1000000033e/vbi_hsync.pdf v212>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a8:[<0x1000000033e/vbi_hsync.pdf v212>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.794+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c6 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml auth v272 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8d7700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c6:[<0x1000000033e/vidioc-g-frequency.xml v272>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c6:[<0x1000000033e/vidioc-g-frequency.xml v272>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.794+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d3 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml auth v298 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e0000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d3:[<0x1000000033e/vidioc-prepare-buf.xml v298>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003d3:[<0x1000000033e/vidioc-prepare-buf.xml v298>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.794+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000377 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml auth v114 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e0580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000377:[<0x1000000033e/pixfmt-packed-rgb.xml v114>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000377:[<0x1000000033e/pixfmt-packed-rgb.xml v114>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.795+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b0 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml auth v228 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e0b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b0:[<0x1000000033e/vidioc-encoder-cmd.xml v228>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b0:[<0x1000000033e/vidioc-encoder-cmd.xml v228>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.795+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml auth v56 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e1080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000035a:[<0x1000000033e/func-mmap.xml v56>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000035a:[<0x1000000033e/func-mmap.xml v56>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.795+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a7 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf auth v210 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e1600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a7:[<0x1000000033e/vbi_625.pdf v210>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a7:[<0x1000000033e/vbi_625.pdf v210>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.138 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.795+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e1b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034b:[<0x1000000033e/dev-output.xml v26>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000034b:[<0x1000000033e/dev-output.xml v26>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.139 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile auth v54 ap=1 s=675 n(v0 rc2024-08-02T18:51:22.605166+0000 b675 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a21b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021a:[<0x10000000216/sysfs-acpi-pmprofile v54>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000021a:[<0x10000000216/sysfs-acpi-pmprofile v54>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.139 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000220 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm auth v60 ap=1 s=6913 n(v0 rc2024-08-02T18:51:22.611166+0000 b6913 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a22100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000220:[<0x10000000216/sysfs-class-tpm v60>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000220:[<0x10000000216/sysfs-class-tpm v60>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.139 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000229 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04 auth v78 ap=1 s=648 n(v0 rc2024-08-02T18:51:22.619166+0000 b648 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a22c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000229:[<0x10000000216/sysfs-driver-w1_ds28e04 v78>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000229:[<0x10000000216/sysfs-driver-w1_ds28e04 v78>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.139 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000227 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx auth v84 ap=1 s=377 n(v0 rc2015-06-06T15:21:22.000000+0000 b377 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a22680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000227:[<0x10000000216/sysfs-driver-qla2xxx v84>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000227:[<0x10000000216/sysfs-driver-qla2xxx v84>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.139 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.921+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog auth v62 ap=1 s=2207 n(v0 rc2024-08-02T18:51:22.622166+0000 b2207 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a23180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022c:[<0x10000000216/sysfs-firmware-opal-elog v62>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000022c:[<0x10000000216/sysfs-firmware-opal-elog v62>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.139 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.922+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000225 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory auth v74 ap=1 s=2656 n(v0 rc2024-08-02T18:51:22.616166+0000 b2656 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3c000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000225:[<0x10000000216/sysfs-devices-system-xen_memory v74>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000225:[<0x10000000216/sysfs-devices-system-xen_memory v74>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.139 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.922+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire auth v56 ap=1 s=4285 n(v0 rc2024-08-02T18:51:22.606166+0000 b4285 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a23700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021b:[<0x10000000216/sysfs-bus-firewire v56>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000021b:[<0x10000000216/sysfs-bus-firewire v56>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.922+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification auth v102 ap=1 s=190 n(v0 rc2024-08-02T18:51:22.624166+0000 b190 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3c580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022f:[<0x10000000216/thermal-notification v102>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000022f:[<0x10000000216/thermal-notification v102>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.922+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000230 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso auth v64 ap=1 s=1329 n(v0 rc2024-08-02T18:51:22.625166+0000 b1329 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3cb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000230:[<0x10000000216/vdso v64>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000230:[<0x10000000216/vdso v64>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.922+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000217 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev auth v72 ap=1 s=4140 n(v0 rc2024-08-02T18:51:22.603166+0000 b4140 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3d080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000217:[<0x10000000216/firewire-cdev v72>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000217:[<0x10000000216/firewire-cdev v72>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.922+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000224 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu auth v66 ap=1 s=979 n(v0 rc2024-08-02T18:51:22.615166+0000 b979 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3d600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000224:[<0x10000000216/sysfs-devices-system-cpu v66>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000224:[<0x10000000216/sysfs-devices-system-cpu v66>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.795+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia auth v192 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e2100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039e:[<0x1000000033e/subdev-image-processing-crop.dia v192>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000039e:[<0x1000000033e/subdev-image-processing-crop.dia v192>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.795+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003ae [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml auth v224 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e2680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003ae:[<0x1000000033e/vidioc-dqevent.xml v224>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003ae:[<0x1000000033e/vidioc-dqevent.xml v224>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.796+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a3 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg auth v202 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e2c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a3:[<0x1000000033e/subdev-image-processing-scaling-multi-source.svg v202>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a3:[<0x1000000033e/subdev-image-processing-scaling-multi-source.svg v202>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.796+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bb [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml auth v250 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8e3700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003bb:[<0x1000000033e/vidioc-expbuf.xml v250>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003bb:[<0x1000000033e/vidioc-expbuf.xml v250>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.140 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.796+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml auth v122 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8ee000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000037b:[<0x1000000033e/pixfmt-sdr-cs08.xml v122>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000037b:[<0x1000000033e/pixfmt-sdr-cs08.xml v122>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.796+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000381 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml auth v134 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8ee580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000381:[<0x1000000033e/pixfmt-sgrbg8.xml v134>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000381:[<0x1000000033e/pixfmt-sgrbg8.xml v134>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.796+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c0 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml auth v260 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8eeb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c0:[<0x1000000033e/vidioc-g-dv-timings.xml v260>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c0:[<0x1000000033e/vidioc-g-dv-timings.xml v260>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.796+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003be [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml auth v256 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8ef080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003be:[<0x1000000033e/vidioc-g-crop.xml v256>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003be:[<0x1000000033e/vidioc-g-crop.xml v256>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.797+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml auth v128 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8ef600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000037e:[<0x1000000033e/pixfmt-sdr-cu16le.xml v128>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000037e:[<0x1000000033e/pixfmt-sdr-cu16le.xml v128>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.797+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b9 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml auth v246 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8efb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b9:[<0x1000000033e/vidioc-enumoutput.xml v246>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b9:[<0x1000000033e/vidioc-enumoutput.xml v246>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.797+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000372 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml auth v104 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8f0100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000372:[<0x1000000033e/pixfmt-nv12m.xml v104>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000372:[<0x1000000033e/pixfmt-nv12m.xml v104>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.797+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml auth v186 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8f0680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039b:[<0x1000000033e/selection-api.xml v186>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000039b:[<0x1000000033e/selection-api.xml v186>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.797+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a2 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia auth v200 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8f0c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a2:[<0x1000000033e/subdev-image-processing-scaling-multi-source.dia v200>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a2:[<0x1000000033e/subdev-image-processing-scaling-multi-source.dia v200>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.797+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000391 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml auth v166 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8f1180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000391:[<0x1000000033e/pixfmt-yuv411p.xml v166>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000391:[<0x1000000033e/pixfmt-yuv411p.xml v166>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.797+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml auth v188 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8f1700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039c:[<0x1000000033e/selections-common.xml v188>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000039c:[<0x1000000033e/selections-common.xml v188>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fc000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034a:[<0x1000000033e/dev-osd.xml v24>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000034a:[<0x1000000033e/dev-osd.xml v24>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.141 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000389 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml auth v150 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fc580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000389:[<0x1000000033e/pixfmt-uyvy.xml v150>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000389:[<0x1000000033e/pixfmt-uyvy.xml v150>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.142 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000340 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fcb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000340:[<0x1000000033e/biblio.xml v4>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000340:[<0x1000000033e/biblio.xml v4>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.142 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.922+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill auth v58 ap=1 s=1979 n(v0 rc2024-08-02T18:51:22.610166+0000 b1979 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3db80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021f:[<0x10000000216/sysfs-class-rfkill v58>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000021f:[<0x10000000216/sysfs-class-rfkill v58>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.142 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000226 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp auth v100 ap=1 s=7796 n(v0 rc2024-08-02T18:51:22.617166+0000 b7796 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3e100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000226:[<0x10000000216/sysfs-driver-ib_srp v100>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000226:[<0x10000000216/sysfs-driver-ib_srp v100>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.143 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml auth v90 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fd080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036b:[<0x1000000033e/media-ioc-enum-entities.xml v90>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000036b:[<0x1000000033e/media-ioc-enum-entities.xml v90>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.143 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000369 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml auth v86 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fd600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000369:[<0x1000000033e/media-func-open.xml v86>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000369:[<0x1000000033e/media-func-open.xml v86>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.143 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000347 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fdb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000347:[<0x1000000033e/dev-codec.xml v18>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000347:[<0x1000000033e/dev-codec.xml v18>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.143 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a1 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg auth v198 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fe100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a1:[<0x1000000033e/subdev-image-processing-full.svg v198>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a1:[<0x1000000033e/subdev-image-processing-full.svg v198>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.143 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c1 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml auth v262 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fe680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c1:[<0x1000000033e/vidioc-g-edid.xml v262>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c1:[<0x1000000033e/vidioc-g-edid.xml v262>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.143 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.798+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000034d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml auth v30 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8ff180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000034d:[<0x1000000033e/dev-radio.xml v30>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000034d:[<0x1000000033e/dev-radio.xml v30>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.144 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.799+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000359 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml auth v54 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8fec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000359:[<0x1000000033e/func-ioctl.xml v54>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000359:[<0x1000000033e/func-ioctl.xml v54>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.144 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000228 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc auth v94 ap=1 s=2407 n(v0 rc2024-08-02T18:51:22.618166+0000 b2407 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3e680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000228:[<0x10000000216/sysfs-driver-usb-usbtmc v94>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000228:[<0x10000000216/sysfs-driver-usb-usbtmc v94>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.144 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars auth v86 ap=1 s=2441 n(v0 rc2024-08-02T18:51:22.620166+0000 b2441 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3ec00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022a:[<0x10000000216/sysfs-firmware-efi-vars v86>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000022a:[<0x10000000216/sysfs-firmware-efi-vars v86>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.144 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000221 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi auth v90 ap=1 s=6956 n(v0 rc2024-08-02T18:51:22.612166+0000 b6956 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3f180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000221:[<0x10000000216/sysfs-class-ubi v90>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000221:[<0x10000000216/sysfs-class-ubi v90>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.145 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.799+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000366 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml auth v80 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff8ff700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000366:[<0x1000000033e/media-controller.xml v80>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000366:[<0x1000000033e/media-controller.xml v80>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.145 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.799+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a9 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml auth v214 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff906000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a9:[<0x1000000033e/vidioc-create-bufs.xml v214>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a9:[<0x1000000033e/vidioc-create-bufs.xml v214>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.146 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000021c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb auth v96 ap=1 s=5051 n(v0 rc2024-08-02T18:51:22.607166+0000 b5051 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a48000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000021c:[<0x10000000216/sysfs-bus-usb v96>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000021c:[<0x10000000216/sysfs-bus-usb v96>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.146 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000223 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node auth v104 ap=1 s=3010 n(v0 rc2024-08-02T18:51:22.614166+0000 b3010 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a3f700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000223:[<0x10000000216/sysfs-devices-node v104>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000223:[<0x10000000216/sysfs-devices-node v104>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.146 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.799+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000379 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml auth v118 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff906b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000379:[<0x1000000033e/pixfmt-sbggr16.xml v118>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000379:[<0x1000000033e/pixfmt-sbggr16.xml v118>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.147 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.799+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003cf [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml auth v290 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff907080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003cf:[<0x1000000033e/vidioc-g-std.xml v290>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003cf:[<0x1000000033e/vidioc-g-std.xml v290>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.147 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000219 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls auth v70 ap=1 s=442 n(v0 rc2024-08-02T18:51:22.604166+0000 b442 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a48580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000219:[<0x10000000216/syscalls v70>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000219:[<0x10000000216/syscalls v70>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.147 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp auth v88 ap=1 s=2538 n(v0 rc2015-06-06T15:21:22.000000+0000 b2538 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a48b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022e:[<0x10000000216/sysfs-transport-srp v88>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000022e:[<0x10000000216/sysfs-transport-srp v88>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.148 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.799+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml auth v160 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff907b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000038e:[<0x1000000033e/pixfmt-y16.xml v160>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000038e:[<0x1000000033e/pixfmt-y16.xml v160>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.148 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.799+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000367 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml auth v82 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff907600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000367:[<0x1000000033e/media-func-close.xml v82>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000367:[<0x1000000033e/media-func-close.xml v82>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.148 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.799+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000392 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml auth v168 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff908680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000392:[<0x1000000033e/pixfmt-yuv420.xml v168>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000392:[<0x1000000033e/pixfmt-yuv420.xml v168>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.149 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.800+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000345 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff908100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000345:[<0x1000000033e/crop.pdf v14>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000345:[<0x1000000033e/crop.pdf v14>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.149 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.800+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml auth v152 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff908c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000038a:[<0x1000000033e/pixfmt-vyuy.xml v152>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000038a:[<0x1000000033e/pixfmt-vyuy.xml v152>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.149 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.923+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000218 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb auth v92 ap=1 s=457 n(v0 rc2015-06-06T15:21:22.000000+0000 b457 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a49080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000218:[<0x10000000216/o2cb v92>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000218:[<0x10000000216/o2cb v92>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.149 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.924+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module auth v76 ap=1 s=1331 n(v0 rc2015-06-06T15:21:22.000000+0000 b1331 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a49600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022d:[<0x10000000216/sysfs-module v76>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000022d:[<0x10000000216/sysfs-module v76>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.150 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T18:51:32.924+0000 7f08d904c640 -1 mds.2.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000022b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump auth v80 ap=1 s=1490 n(v0 rc2024-08-02T18:51:22.621166+0000 b1490 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x564b16a49b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000022b:[<0x10000000216/sysfs-firmware-opal-dump v80>,<0x10000000205/stable v702>,<0x10000000203/ABI v22>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000022b:[<0x10000000216/sysfs-firmware-opal-dump v80>,<0x10000000205/stable v905>,<0x10000000203/ABI v2096>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v20>,<0x10000000001/sv_1 v61>,<0x10000000000/qa v32>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.153 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.800+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000352 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml auth v40 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff909180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000352:[<0x1000000033e/dev-subdev.xml v40>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000352:[<0x1000000033e/dev-subdev.xml v40>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.800+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000038f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml auth v162 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff909700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000038f:[<0x1000000033e/pixfmt-y41p.xml v162>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000038f:[<0x1000000033e/pixfmt-y41p.xml v162>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.800+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000399 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml auth v182 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff912580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000399:[<0x1000000033e/planar-apis.xml v182>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000399:[<0x1000000033e/planar-apis.xml v182>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.800+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000356 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf auth v48 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff912b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000356:[<0x1000000033e/fieldseq_bt.pdf v48>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000356:[<0x1000000033e/fieldseq_bt.pdf v48>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.800+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml auth v60 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff913080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000035c:[<0x1000000033e/func-open.xml v60>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000035c:[<0x1000000033e/func-open.xml v60>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.801+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000376 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml auth v112 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff913600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000376:[<0x1000000033e/pixfmt-nv24.xml v112>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000376:[<0x1000000033e/pixfmt-nv24.xml v112>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.801+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003aa [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml auth v216 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff913b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003aa:[<0x1000000033e/vidioc-cropcap.xml v216>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003aa:[<0x1000000033e/vidioc-cropcap.xml v216>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.801+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000375 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml auth v110 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff914100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000375:[<0x1000000033e/pixfmt-nv16m.xml v110>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000375:[<0x1000000033e/pixfmt-nv16m.xml v110>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.801+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000355 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml auth v46 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff914680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000355:[<0x1000000033e/fdl-appendix.xml v46>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000355:[<0x1000000033e/fdl-appendix.xml v46>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.154 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.801+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000033f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff914c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000033f:[<0x1000000033e/.gitignore v2>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000033f:[<0x1000000033e/.gitignore v2>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.155 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.801+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000035e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml auth v64 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff915180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000035e:[<0x1000000033e/func-read.xml v64>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000035e:[<0x1000000033e/func-read.xml v64>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.155 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.802+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003bd [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml auth v254 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff915700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003bd:[<0x1000000033e/vidioc-g-audioout.xml v254>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003bd:[<0x1000000033e/vidioc-g-audioout.xml v254>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.155 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.802+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003a5 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml auth v206 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff920000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003a5:[<0x1000000033e/v4l2grab.c.xml v206>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003a5:[<0x1000000033e/v4l2grab.c.xml v206>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.156 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.802+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000039a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml auth v184 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff920b00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000039a:[<0x1000000033e/remote_controllers.xml v184>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000039a:[<0x1000000033e/remote_controllers.xml v184>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.156 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.802+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000351 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml auth v38 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff920580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000351:[<0x1000000033e/dev-sliced-vbi.xml v38>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000351:[<0x1000000033e/dev-sliced-vbi.xml v38>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.156 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.802+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b4 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml auth v236 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff921080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b4:[<0x1000000033e/vidioc-enum-framesizes.xml v236>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b4:[<0x1000000033e/vidioc-enum-framesizes.xml v236>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.156 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.802+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003c9 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml auth v278 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff921600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003c9:[<0x1000000033e/vidioc-g-modulator.xml v278>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003c9:[<0x1000000033e/vidioc-g-modulator.xml v278>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.156 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.802+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000342 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff921b80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000342:[<0x1000000033e/common.xml v8>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000342:[<0x1000000033e/common.xml v8>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.156 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.803+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000394 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml auth v172 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff922100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000394:[<0x1000000033e/pixfmt-yuv422p.xml v172>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x10000000394:[<0x1000000033e/pixfmt-yuv422p.xml v172>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.157 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.803+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000037f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml auth v130 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff922680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000037f:[<0x1000000033e/pixfmt-sdr-ru12le.xml v130>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000037f:[<0x1000000033e/pixfmt-sdr-ru12le.xml v130>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.157 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.803+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003d1 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml auth v294 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff922c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003d1:[<0x1000000033e/vidioc-log-status.xml v294>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003d1:[<0x1000000033e/vidioc-log-status.xml v294>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.157 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.803+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x100000003b7 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml auth v242 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff923180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x100000003b7:[<0x1000000033e/vidioc-enumaudioout.xml v242>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x100000003b7:[<0x1000000033e/vidioc-enumaudioout.xml v242>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.157 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.803+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000036c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml auth v92 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff923700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000036c:[<0x1000000033e/media-ioc-enum-links.xml v92>,<0x10000000324/v4l v359>,<0x10000000310/media v73>,<0x10000000203/DocBook v90>,<0x10000000202/Documentation v38>,<0x10000000201/linux-4.0.5 v15>,<0x10000000006/untar_tar v33>,<0x10000000005/tmp v33>,<0x100000001fb/client.0 v20>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v36>,<0x10000000001/sv_1 v55>,<0x10000000000/qa v44>,<0x1/volumes v44>]//[3]","memoryvalue":"(4)0x1000000036c:[<0x1000000033e/media-ioc-enum-links.xml v92>,<0x10000000324/v4l v389>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.157 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.803+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000331 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml auth v16 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff92e000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000331:[<0x10000000329/examples.xml v16>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000331:[<0x10000000329/examples.xml v16>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.157 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.804+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000335 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml auth v24 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff92e580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000335:[<0x10000000329/net.xml v24>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000335:[<0x10000000329/net.xml v24>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.804+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000332 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml auth v18 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff92eb00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000332:[<0x10000000329/frontend.xml v18>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000332:[<0x10000000329/frontend.xml v18>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.804+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000333 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml auth v20 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff92f080]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000333:[<0x10000000329/intro.xml v20>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000333:[<0x10000000329/intro.xml v20>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.804+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000330 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf auth v14 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff92f600]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000330:[<0x10000000329/dvbstb.pdf v14>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000330:[<0x10000000329/dvbstb.pdf v14>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.804+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000334 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml auth v22 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff92fb80]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000334:[<0x10000000329/kdapi.xml v22>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000334:[<0x10000000329/kdapi.xml v22>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.804+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032c [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml auth v6 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff930100]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032c:[<0x10000000329/ca.xml v6>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000032c:[<0x10000000329/ca.xml v6>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.804+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032f [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml auth v12 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff930680]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032f:[<0x10000000329/dvbproperty.xml v12>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000032f:[<0x10000000329/dvbproperty.xml v12>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.804+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x10000000336 [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml auth v26 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff930c00]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x10000000336:[<0x10000000329/video.xml v26>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x10000000336:[<0x10000000329/video.xml v26>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.805+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032d [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml auth v8 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff931180]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032d:[<0x10000000329/demux.xml v8>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000032d:[<0x10000000329/demux.xml v8>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.158 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.805+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032e [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml auth v10 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff931700]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032e:[<0x10000000329/dvbapi.xml v10>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000032e:[<0x10000000329/dvbapi.xml v10>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.159 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.805+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032b [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml auth v4 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff93a000]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032b:[<0x10000000329/audio.xml v4>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000032b:[<0x10000000329/audio.xml v4>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.159 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 18:51:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T18:51:32.805+0000 7fcd45428640 -1 mds.1.scrubstack _validate_inode_done scrub error on inode [inode 0x1000000032a [4,head] /volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore auth v2 ap=1 s=0 n(v0 1=1+0) (iauth excl) (ifile excl) (ixattr excl) cr={24881=0-4194304@3} caps={24881=pAsxLsXsxFsxcrwb/pAsxXsxFxwb@1},l=24881 | importingcaps=0 caps=1 replicated=0 authpin=1 scrubqueue=0 0x562aff93a580]: {"performed_validation":true,"passed_validation":false,"backtrace":{"checked":true,"passed":false,"read_ret_val":0,"ondisk_value":"(4)0x1000000032a:[<0x10000000329/.gitignore v2>,<0x10000000324/dvb v36>,<0x10000000310/media v66>,<0x10000000203/DocBook v80>,<0x10000000202/Documentation v28>,<0x10000000201/linux-4.0.5 v6>,<0x10000000006/untar_tar v22>,<0x10000000005/tmp v24>,<0x100000001fb/client.0 v14>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v30>,<0x10000000001/sv_1 v53>,<0x10000000000/qa v42>,<0x1/volumes v42>]//[3]","memoryvalue":"(4)0x1000000032a:[<0x10000000329/.gitignore v2>,<0x10000000324/dvb v36>,<0x10000000310/media v120>,<0x10000000203/DocBook v2107>,<0x10000000202/Documentation v532>,<0x10000000201/linux-4.0.5 v30>,<0x10000000006/untar_tar v46>,<0x10000000005/tmp v46>,<0x100000001fb/client.0 v30>,<0x100000001fa/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75 v48>,<0x10000000001/sv_1 v63>,<0x10000000000/qa v50>,<0x1/volumes v32>]//[3]","error_str":"On-disk backtrace is divergent or newer"},"raw_stats":{"checked":false,"passed":false,"read_ret_val":0,"ondisk_value.dirstat":"f()","ondisk_value.rstat":"n()","memory_value.dirstat":"f()","memory_value.rstat":"n()","error_str":""},"return_code":0} 2024-08-02T18:51:33.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: pgmap v57: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 7.2 MiB/s wr, 155 op/s 2024-08-02T18:51:33.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:33.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: scrub summary: active paths [/] 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000321 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000312 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000031e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000323 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000031a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000031c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000314 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000031b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000313 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000315 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000319 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000320 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000317 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000318 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000031f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000322 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000311 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000316 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000031d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000324 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000033c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000033e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000337 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000326 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000033d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000325 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000339 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000328 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000033a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000338 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000329 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000327 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000033b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000034e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000363 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000341 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000037a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000364 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000373 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003af (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000343 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003cd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000036e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000393 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000387 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000038d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000390 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000038c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000365 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000370 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000344 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000362 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000039f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003d4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003bf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000353 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000368 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000384 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000348 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000039d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000037c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000388 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003cc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000395 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000349 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003d5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000371 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003cb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000038b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000382 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000037d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000350 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000396 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000397 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000036a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000034f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003d2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000374 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003ce (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003ac (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000378 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003ab (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000034c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000383 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000385 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000035f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000380 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003bc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000357 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000354 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000360 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000035b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000398 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003ad (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003ca (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003d0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000035d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000036d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:32 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000358 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:33.578 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-02T18:51:33.849 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:51:34.120 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: scrub queued for path: / 2024-08-02T18:51:34.120 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.120 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: scrub summary: active paths [/] 2024-08-02T18:51:34.120 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000386 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.120 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000346 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.120 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000036f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000361 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000377 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000035a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.121 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000037b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000381 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003be (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000037e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000391 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.122 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000034a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000389 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000359 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.123 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000367 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000392 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000038a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000038f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.124 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000356 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000035c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003aa (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000033f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003a5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.125 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000342 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000394 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003d1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000335 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000332 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.126 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.128 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000336 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: scrub summary: active paths [/] 2024-08-02T18:51:34.129 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002a0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002dc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002da (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002ce (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000294 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002de (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.130 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002e1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000302 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000303 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002a8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002ee (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000291 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002a9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002bf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.131 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002fe (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000251 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002ca (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002df (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002e4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000248 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.132 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002fb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002d7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000290 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000249 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000028c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002c6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.133 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000306 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000307 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002c4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002f9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.134 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002a7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002d8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000029a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002d9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000297 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000244 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002d2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.135 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002f0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002db (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000028a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000256 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002fd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002aa (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.136 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000246 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002c1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000024a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000024d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002a4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002d4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.137 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000245 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000250 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002c7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002bb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x100000002eb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.138 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000222 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000021e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000021d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000021a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000022c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000021b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000224 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.139 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000226 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000021c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000223 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000219 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x10000000218 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.140 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:33 smithi103 ceph-mon[32753]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: scrub queued for path: / 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: scrub summary: active paths [/] 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000386 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000346 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000036f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000361 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000377 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000035a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.253 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000037b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000381 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003be (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000037e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000391 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000034a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000389 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000359 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000367 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000392 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000038a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000038f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000356 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.256 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000035c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003aa (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000033f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003a5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000342 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.257 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000394 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003d1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000335 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000332 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.258 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000336 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: scrub summary: active paths [/] 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002a0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002dc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.260 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.261 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002da (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.261 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.261 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002ce (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.261 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.261 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000294 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002de (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002e1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000302 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000303 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002a8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002ee (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000291 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002a9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.262 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002bf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002fe (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000251 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002ca (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002df (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002e4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.263 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000248 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002fb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002d7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000290 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.264 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000249 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000028c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002c6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.265 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000306 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000307 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002c4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002f9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.266 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002a7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002d8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000029a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002d9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000297 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000244 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002d2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.267 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002f0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002db (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000028a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000256 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002fd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.268 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002aa (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000246 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002c1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000024a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000024d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002a4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002d4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.269 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000245 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000250 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002c7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002bb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x100000002eb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.270 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000222 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.271 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000021e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.271 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000021d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.271 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000021a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.271 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.271 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.271 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.271 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000022c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000021b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000224 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000226 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.272 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000021c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000223 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000219 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x10000000218 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.273 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:33 smithi121 ceph-mon[37236]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: scrub queued for path: / 2024-08-02T18:51:34.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: scrub summary: active paths [/] 2024-08-02T18:51:34.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000386 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000346 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003ba (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000036f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000361 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003d3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000377 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000035a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000034b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000039e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003ae (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003bb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000037b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000381 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003be (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000037e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000372 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000039b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.323 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000391 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000039c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000034a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000389 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000340 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000036b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000369 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000347 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000034d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000359 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000366 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.324 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000379 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003cf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000038e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000367 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000392 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000345 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000038a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000352 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000038f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000399 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000356 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000035c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000376 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.325 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003aa (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000375 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000355 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000033f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000035e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003bd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003a5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000039a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000351 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003c9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000342 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000394 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.326 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000037f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003d1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000003b7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000036c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000331 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000335 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000332 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000333 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000330 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000334 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000032c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000032f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000336 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.327 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000032d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000032e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000032b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000032a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore) see mds.i log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: scrub summary: active paths [/] 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002a0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000263 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002f8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000232 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000023b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002dc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.328 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000240 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.330 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002da (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.330 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000271 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.330 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002ce (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.330 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000025b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.330 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000294 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.330 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002de (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.330 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000023a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.330 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002e1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002b2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002f5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000302 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000303 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002a8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000027f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002ee (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000291 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002a9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000281 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002bf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000273 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.331 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002fe (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000251 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000234 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000025a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002ca (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002c3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002b7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002df (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002e4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002ad (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002e3 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000272 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000248 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.332 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002ba (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002cc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002fb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000300 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002d7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000290 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000298 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002ac (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000249 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002a2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000028c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000239 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002c6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000260 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.333 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002e8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000306 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000307 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000277 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002b6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002f1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002c4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000259 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002f9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002b4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002a7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002ea (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002d8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.334 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000029a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000029e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002d9 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000279 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000297 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000252 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002b8 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000244 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002d2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002f0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002b0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002db (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000028a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.335 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000256 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002fd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000235 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000024b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000261 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000267 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002f4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000262 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002c5 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002aa (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000026c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000246 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000287 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002f6 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.336 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002fc (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002c1 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000024a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000024d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002a4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000026d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002d4 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000028f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000289 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000245 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000250 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000283 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002cf (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002e2 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.337 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002c7 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002bb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002bd (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000270 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002e0 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x100000002eb (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000305 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000222 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000021e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000021d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000021a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000220 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000229 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.338 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000227 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000022c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000225 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000021b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000022f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000230 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000217 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000224 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000021f (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000226 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000228 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000022a (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000221 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000021c (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.339 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000223 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.340 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000219 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.340 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000022e (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.340 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x10000000218 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.340 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000022d (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.340 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: Scrub error on inode 0x1000000022b (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump) see mds.c log and `damage ls` output for details 2024-08-02T18:51:34.340 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.340 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:33 smithi151 ceph-mon[37155]: scrub summary: idle+waiting paths [/] 2024-08-02T18:51:34.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 -- 172.21.15.103:0/702815502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced4102250 msgr2=0x7fced410e780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 --2- 172.21.15.103:0/702815502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced4102250 0x7fced410e780 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fcecc009cd0 tx=0x7fcecc02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 -- 172.21.15.103:0/702815502 shutdown_connections 2024-08-02T18:51:34.372 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 --2- 172.21.15.103:0/702815502 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced4102250 0x7fced410e780 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 --2- 172.21.15.103:0/702815502 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced41018b0 0x7fced4101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 --2- 172.21.15.103:0/702815502 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fced41078b0 0x7fced4107c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 -- 172.21.15.103:0/702815502 >> 172.21.15.103:0/702815502 conn(0x7fced40fd610 msgr2=0x7fced40ffa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 -- 172.21.15.103:0/702815502 shutdown_connections 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 -- 172.21.15.103:0/702815502 wait complete. 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 Processor -- start 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.359+0000 7fcedab7c640 1 -- start start 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fcedab7c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced41018b0 0x7fced4198210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fcedab7c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fced4102250 0x7fced4198750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fcedab7c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced41078b0 0x7fced419cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fcedab7c640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fced4111dd0 con 0x7fced41078b0 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fcedab7c640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fced4111c50 con 0x7fced4102250 2024-08-02T18:51:34.373 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fcedab7c640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fced4111f50 con 0x7fced41018b0 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced41078b0 0x7fced419cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced41078b0 0x7fced419cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33616/0 (socket says 172.21.15.103:33616) 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 -- 172.21.15.103:0/2692728701 learned_addr learned my addr 172.21.15.103:0/2692728701 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced8918640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced41018b0 0x7fced4198210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced3fff640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fced4102250 0x7fced4198750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 -- 172.21.15.103:0/2692728701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced41018b0 msgr2=0x7fced4198210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced41018b0 0x7fced4198210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 -- 172.21.15.103:0/2692728701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fced4102250 msgr2=0x7fced4198750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fced4102250 0x7fced4198750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 -- 172.21.15.103:0/2692728701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fced419d1c0 con 0x7fced41078b0 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.360+0000 7fced9119640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced41078b0 0x7fced419cae0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcecc006010 tx=0x7fcecc003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:34.374 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.361+0000 7fced1ffb640 1 -- 172.21.15.103:0/2692728701 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc004040 con 0x7fced41078b0 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.361+0000 7fced1ffb640 1 -- 172.21.15.103:0/2692728701 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcecc0046e0 con 0x7fced41078b0 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.361+0000 7fced1ffb640 1 -- 172.21.15.103:0/2692728701 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc046480 con 0x7fced41078b0 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.361+0000 7fcedab7c640 1 -- 172.21.15.103:0/2692728701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fced419d450 con 0x7fced41078b0 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.361+0000 7fcedab7c640 1 -- 172.21.15.103:0/2692728701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fced419d880 con 0x7fced41078b0 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.364+0000 7fced1ffb640 1 -- 172.21.15.103:0/2692728701 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fcecc030630 con 0x7fced41078b0 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.364+0000 7fcedcf7a740 1 Processor -- start 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.364+0000 7fcedcf7a740 1 -- start start 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.364+0000 7fced1ffb640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcec40a2d70 0x7fcec40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312e15f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x5571312ebeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312ee7e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.375 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x557131246980 con 0x5571312e1b30 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5571311dea70 con 0x5571312ec3f0 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x557131242940 con 0x5571312e1210 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced1ffb640 1 -- 172.21.15.103:0/2692728701 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fcecc02e030 con 0x7fced41078b0 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced3fff640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcec40a2d70 0x7fcec40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x5571312ebeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x5571312ebeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33618/0 (socket says 172.21.15.103:33618) 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced3fff640 1 -- 172.21.15.103:0/1529694333 learned_addr learned my addr 172.21.15.103:0/1529694333 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced8918640 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312e15f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced9119640 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312ee7e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.376 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced8918640 1 -- 172.21.15.103:0/1529694333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 msgr2=0x5571312ee7e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced8918640 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312ee7e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced8918640 1 -- 172.21.15.103:0/1529694333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 msgr2=0x5571312ebeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced8918640 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x5571312ebeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced8918640 1 -- 172.21.15.103:0/1529694333 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571312416e0 con 0x5571312e1210 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.365+0000 7fced3fff640 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x5571312ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.366+0000 7fced8918640 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312e15f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcec800bb70 tx=0x7fcec80107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=35cb9d91be7dfcaf server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.366+0000 7fced3fff640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcec40a2d70 0x7fcec40a5230 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcec000bfd0 tx=0x7fcec0005ef0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.366+0000 7fcebeffd640 1 -- 172.21.15.103:0/1529694333 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8004030 con 0x5571312e1210 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.366+0000 7fcebeffd640 1 -- 172.21.15.103:0/1529694333 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcec80041d0 con 0x5571312e1210 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.366+0000 7fcebeffd640 1 -- 172.21.15.103:0/1529694333 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec8011770 con 0x5571312e1210 2024-08-02T18:51:34.377 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1529694333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 msgr2=0x5571312e15f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312e15f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fcec800bb70 tx=0x7fcec80107a0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1529694333 shutdown_connections 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312ee7e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x5571312ebeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1529694333 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312e15f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1529694333 >> 172.21.15.103:0/1529694333 conn(0x5571312dd7a0 msgr2=0x5571312ddb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1529694333 shutdown_connections 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1529694333 wait complete. 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 -- start start 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.367+0000 7fcedcf7a740 1 Processor -- start 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1210 0x5571312e9330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1b30 0x5571312e9870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312e9db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.378 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5571312eefc0 con 0x5571312e1210 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x557131201aa0 con 0x5571312ec3f0 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5571312ef140 con 0x5571312e1b30 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fcedcf7a740 10 client.0 _ll_register_callbacks cb 0x5571311f0e60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced8918640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1210 0x5571312e9330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced8918640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1210 0x5571312e9330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33634/0 (socket says 172.21.15.103:33634) 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced8918640 1 -- 172.21.15.103:0/1180661745 learned_addr learned my addr 172.21.15.103:0/1180661745 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced9119640 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312e9db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced3fff640 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1b30 0x5571312e9870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced8918640 1 -- 172.21.15.103:0/1180661745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1b30 msgr2=0x5571312e9870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced8918640 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1b30 0x5571312e9870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced8918640 1 -- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 msgr2=0x5571312e9db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced8918640 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312e9db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.379 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced8918640 1 -- 172.21.15.103:0/1180661745 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571311e5650 con 0x5571312e1210 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.368+0000 7fced9119640 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312e9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fced8918640 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1210 0x5571312e9330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcec80045b0 tx=0x7fcec8003da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8394932f90462cbe server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fceb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fceb3fff640 1 -- 172.21.15.103:0/1180661745 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec800b740 con 0x5571312e1210 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1180661745 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec80041d0 con 0x5571312e1210 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fceb3fff640 1 -- 172.21.15.103:0/1180661745 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fcec80035f0 con 0x5571312e1210 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fceb3fff640 1 -- 172.21.15.103:0/1180661745 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcec80037f0 con 0x5571312e1210 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fcedcf7a740 10 client.16083 fetch_fsmap learned FSMap version 27 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1180661745 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x557130fb83c0 con 0x5571312e1210 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fceb3fff640 1 -- 172.21.15.103:0/1180661745 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcec80041d0 con 0x5571312e1210 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fceb3fff640 1 -- 172.21.15.103:0/1180661745 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcec8004ab0 con 0x5571312e1210 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fcedcf7a740 10 client.16083 fetch_fsmap finished waiting for FSMap version 27 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.369+0000 7fcedcf7a740 10 client.16083 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:34.380 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.370+0000 7fcedcf7a740 20 client.16083 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.370+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5571312fbe00 0x5571312fe1f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.370+0000 7fcedcf7a740 4 client.16083 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.370+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1180661745 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557131253ef0 con 0x5571312fbe00 2024-08-02T18:51:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.370+0000 7fced3fff640 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5571312fbe00 0x5571312fe1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.370+0000 7fced3fff640 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5571312fbe00 0x5571312fe1f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=540635b6f74988af server_cookie=6d70c0ddd54b12ad in_seq=0 out_seq=0 2024-08-02T18:51:34.381 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.370+0000 7fceb3fff640 10 client.16083 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:34.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fceb3fff640 1 -- 172.21.15.103:0/1180661745 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x557131253ef0 con 0x5571312fbe00 2024-08-02T18:51:34.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fceb3fff640 10 client.16083 handle_command_reply: tid=0 2024-08-02T18:51:34.382 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 client.16083 shutdown 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1180661745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1210 msgr2=0x5571312e9330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1210 0x5571312e9330 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fcec80045b0 tx=0x7fcec8003da0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1180661745 shutdown_connections 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5571312fbe00 0x5571312fe1f0 crc :-1 s=READY pgs=86 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fceb3fff640 0 client.16083 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312ec3f0 0x5571312e9db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1b30 0x5571312e9870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1180661745 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1210 0x5571312e9330 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1180661745 >> 172.21.15.103:0/1180661745 conn(0x5571312dd7a0 msgr2=0x5571312dc900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1180661745 shutdown_connections 2024-08-02T18:51:34.383 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.371+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1180661745 wait complete. 2024-08-02T18:51:34.384 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.372+0000 7fcedcf7a740 20 client.16083 trim_cache size 0 max 16384 2024-08-02T18:51:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fcedcf7a740 1 Processor -- start 2024-08-02T18:51:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fcedcf7a740 1 -- start start 2024-08-02T18:51:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1210 0x557131303a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x557131303fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312ec3f0 0x5571312e6590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fced41b1540 con 0x5571312e1b30 2024-08-02T18:51:34.392 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fced41aee10 con 0x5571312e1210 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fced41acc60 con 0x5571312ec3f0 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fced3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x557131303fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fced3fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x557131303fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33650/0 (socket says 172.21.15.103:33650) 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fced3fff640 1 -- 172.21.15.103:0/1027506155 learned_addr learned my addr 172.21.15.103:0/1027506155 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fced8918640 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1210 0x557131303a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.389+0000 7fced9119640 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312ec3f0 0x5571312e6590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fced3fff640 1 -- 172.21.15.103:0/1027506155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312ec3f0 msgr2=0x5571312e6590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fced3fff640 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312ec3f0 0x5571312e6590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fced3fff640 1 -- 172.21.15.103:0/1027506155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1210 msgr2=0x557131303a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fced3fff640 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1210 0x557131303a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fced3fff640 1 -- 172.21.15.103:0/1027506155 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5571312e1960 con 0x5571312e1b30 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fced8918640 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1210 0x557131303a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:34.393 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fced3fff640 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x557131303fb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcec0005d70 tx=0x7fcec0005e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e64579381d21b8d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:34.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fcebe7fc640 1 -- 172.21.15.103:0/1027506155 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec000ed50 con 0x5571312e1b30 2024-08-02T18:51:34.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fcebe7fc640 1 -- 172.21.15.103:0/1027506155 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcec0005520 con 0x5571312e1b30 2024-08-02T18:51:34.394 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.390+0000 7fcebe7fc640 1 -- 172.21.15.103:0/1027506155 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcec0004de0 con 0x5571312e1b30 2024-08-02T18:51:34.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1027506155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 msgr2=0x557131303fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x557131303fb0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fcec0005d70 tx=0x7fcec0005e20 comp rx=0 tx=0).stop 2024-08-02T18:51:34.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1027506155 shutdown_connections 2024-08-02T18:51:34.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312ec3f0 0x5571312e6590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312e1b30 0x557131303fb0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.397 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1027506155 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1210 0x557131303a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1027506155 >> 172.21.15.103:0/1027506155 conn(0x5571312dd7a0 msgr2=0x5571312eb2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1027506155 shutdown_connections 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1027506155 wait complete. 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 -- start start 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.391+0000 7fcedcf7a740 1 Processor -- start 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312efaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1b30 0x5571312f0030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fcedcf7a740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312ec3f0 0x5571312f4080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fced41ad2d0 con 0x5571312ec3f0 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fced41ae740 con 0x5571312e1b30 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fcedcf7a740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fced41ad9a0 con 0x5571312e1210 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fcedcf7a740 10 client.0 _ll_register_callbacks cb 0x7fcec0013460 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:34.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312ec3f0 0x5571312f4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312ec3f0 0x5571312f4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33654/0 (socket says 172.21.15.103:33654) 2024-08-02T18:51:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 -- 172.21.15.103:0/1707129473 learned_addr learned my addr 172.21.15.103:0/1707129473 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced8918640 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312efaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced3fff640 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1b30 0x5571312f0030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 -- 172.21.15.103:0/1707129473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 msgr2=0x5571312efaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312efaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 -- 172.21.15.103:0/1707129473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1b30 msgr2=0x5571312f0030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:34.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1b30 0x5571312f0030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 -- 172.21.15.103:0/1707129473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5571312f4720 con 0x5571312ec3f0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fced9119640 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312ec3f0 0x5571312f4080 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcecc031040 tx=0x7fcecc032fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96984aabf63dffbc server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.392+0000 7fceb3fff640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fceb3fff640 1 -- 172.21.15.103:0/1707129473 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcecc0bd7f0 con 0x5571312ec3f0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fceb3fff640 1 -- 172.21.15.103:0/1707129473 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fcecc0bc540 con 0x5571312ec3f0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1707129473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcec0005520 con 0x5571312ec3f0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fceb3fff640 1 -- 172.21.15.103:0/1707129473 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=27) ==== 24+0+0 (secure 0 0 0) 0x7fcecc0bd0f0 con 0x5571312ec3f0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 10 client.16089 fetch_fsmap learned FSMap version 27 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1707129473 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=27,monmap=4+}) -- 0x55713136a920 con 0x5571312ec3f0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fceb3fff640 1 -- 172.21.15.103:0/1707129473 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcec0005520 con 0x5571312ec3f0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fceb3fff640 1 -- 172.21.15.103:0/1707129473 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 27) ==== 8362+0+0 (secure 0 0 0) 0x7fcecc0d7030 con 0x5571312ec3f0 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 10 client.16089 fetch_fsmap finished waiting for FSMap version 27 2024-08-02T18:51:34.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 10 client.16089 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 20 client.16089 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5571312fbe00 0x55713136cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 4 client.16089 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.393+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1707129473 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub status"}) -- 0x55713124e400 con 0x5571312fbe00 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fced8918640 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5571312fbe00 0x55713136cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fceb3fff640 10 client.16089 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fced8918640 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5571312fbe00 0x55713136cfe0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ebb3b2dd967cd06f server_cookie=a9576fed318f5c66 in_seq=0 out_seq=0 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fceb3fff640 1 -- 172.21.15.103:0/1707129473 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+259 (crc 0 0 0) 0x55713124e400 con 0x5571312fbe00 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fceb3fff640 10 client.16089 handle_command_reply: tid=0 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 client.16089 shutdown 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1707129473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312ec3f0 msgr2=0x5571312f4080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312ec3f0 0x5571312f4080 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fcecc031040 tx=0x7fcecc032fa0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1707129473 shutdown_connections 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5571312fbe00 0x55713136cfe0 crc :-1 s=READY pgs=87 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5571312ec3f0 0x5571312f4080 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fceb3fff640 0 client.16089 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5571312e1b30 0x5571312f0030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 --2- 172.21.15.103:0/1707129473 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5571312e1210 0x5571312efaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.394+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1707129473 >> 172.21.15.103:0/1707129473 conn(0x5571312dd7a0 msgr2=0x5571312ea8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.395+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1707129473 shutdown_connections 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.395+0000 7fcedcf7a740 1 -- 172.21.15.103:0/1707129473 wait complete. 2024-08-02T18:51:34.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.395+0000 7fcedcf7a740 20 client.16089 trim_cache size 0 max 16384 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "IDLE (waiting for more scrubs)", 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": { 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout: "0ce33446-702f-4048-a802-6f209b87f610": { 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/", 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout: "tag": "0ce33446-702f-4048-a802-6f209b87f610", 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout: "options": "recursive,force" 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:51:34.403 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:51:34.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.395+0000 7fcedab7c640 1 -- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcec40a2d70 msgr2=0x7fcec40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.395+0000 7fcedab7c640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcec40a2d70 0x7fcec40a5230 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fcec000bfd0 tx=0x7fcec0005ef0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.395+0000 7fcedab7c640 1 -- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced41078b0 msgr2=0x7fced419cae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:34.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.395+0000 7fcedab7c640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced41078b0 0x7fced419cae0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fcecc006010 tx=0x7fcecc003f10 comp rx=0 tx=0).stop 2024-08-02T18:51:34.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.396+0000 7fcedab7c640 1 -- 172.21.15.103:0/2692728701 shutdown_connections 2024-08-02T18:51:34.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.396+0000 7fcedab7c640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcec40a2d70 0x7fcec40a5230 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.404 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.396+0000 7fcedab7c640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fced41078b0 0x7fced419cae0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.396+0000 7fcedab7c640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fced4102250 0x7fced4198750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.396+0000 7fcedab7c640 1 --2- 172.21.15.103:0/2692728701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fced41018b0 0x7fced4198210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:34.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.396+0000 7fcedab7c640 1 -- 172.21.15.103:0/2692728701 >> 172.21.15.103:0/2692728701 conn(0x7fced40fd610 msgr2=0x7fced40fdc00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:34.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.396+0000 7fcedab7c640 1 -- 172.21.15.103:0/2692728701 shutdown_connections 2024-08-02T18:51:34.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:51:34.396+0000 7fcedab7c640 1 -- 172.21.15.103:0/2692728701 wait complete. 2024-08-02T18:51:34.951 INFO:tasks.workunit.client.0.smithi103.stderr:+ tar cf doc.tar linux-4.0.5 2024-08-02T18:51:35.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:34 smithi103 ceph-mon[32753]: pgmap v58: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 7.2 MiB/s wr, 155 op/s 2024-08-02T18:51:35.171 INFO:tasks.cephfs.filesystem:scrub status for tag:0ce33446-702f-4048-a802-6f209b87f610 - {'path': '/', 'tag': '0ce33446-702f-4048-a802-6f209b87f610', 'options': 'recursive,force'} 2024-08-02T18:51:35.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:34 smithi121 ceph-mon[37236]: pgmap v58: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 7.2 MiB/s wr, 155 op/s 2024-08-02T18:51:35.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:34 smithi151 ceph-mon[37155]: pgmap v58: 129 pgs: 129 active+clean; 87 MiB data, 554 MiB used, 1.0 TiB / 1.0 TiB avail; 570 KiB/s rd, 7.2 MiB/s wr, 155 op/s 2024-08-02T18:51:35.873 INFO:tasks.workunit.client.0.smithi103.stderr:+ tar xf doc.tar 2024-08-02T18:51:37.259 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:36 smithi121 ceph-mon[37236]: pgmap v59: 129 pgs: 129 active+clean; 90 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 7.5 MiB/s wr, 209 op/s 2024-08-02T18:51:37.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:36 smithi151 ceph-mon[37155]: pgmap v59: 129 pgs: 129 active+clean; 90 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 7.5 MiB/s wr, 209 op/s 2024-08-02T18:51:37.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:36 smithi103 ceph-mon[32753]: pgmap v59: 129 pgs: 129 active+clean; 90 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 828 KiB/s rd, 7.5 MiB/s wr, 209 op/s 2024-08-02T18:51:38.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:37 smithi121 ceph-mon[37236]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-02T18:51:38.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:37 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:active 2024-08-02T18:51:38.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:37 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:38.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:37 smithi151 ceph-mon[37155]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-02T18:51:38.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:37 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:active 2024-08-02T18:51:38.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:37 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:38.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T18:51:37.837+0000 7f4e9562d640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-02T18:51:38.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:37 smithi103 ceph-mon[32753]: Health check failed: 1 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-02T18:51:38.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:37 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] up:active 2024-08-02T18:51:38.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:37 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 -- 172.21.15.103:0/1791594759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 msgr2=0x7f665810e280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.123 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 --2- 172.21.15.103:0/1791594759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 0x7f665810e280 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f6650009ca0 tx=0x7f665002a950 comp rx=0 tx=0).stop 2024-08-02T18:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 -- 172.21.15.103:0/1791594759 shutdown_connections 2024-08-02T18:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 --2- 172.21.15.103:0/1791594759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 0x7f665810e280 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 --2- 172.21.15.103:0/1791594759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66581032d0 0x7f665810b7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 --2- 172.21.15.103:0/1791594759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66581029b0 0x7f6658102d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.124 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 -- 172.21.15.103:0/1791594759 >> 172.21.15.103:0/1791594759 conn(0x7f66580776c0 msgr2=0x7f66580fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 -- 172.21.15.103:0/1791594759 shutdown_connections 2024-08-02T18:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 -- 172.21.15.103:0/1791594759 wait complete. 2024-08-02T18:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.106+0000 7f66602f0640 1 Processor -- start 2024-08-02T18:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f66602f0640 1 -- start start 2024-08-02T18:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f66602f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66581029b0 0x7f66581980b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.125 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f66602f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66581032d0 0x7f66581985f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f66602f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 0x7f665819c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f66602f0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6658111d00 con 0x7f665810be00 2024-08-02T18:51:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f66602f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6658111b80 con 0x7f66581029b0 2024-08-02T18:51:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f66602f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6658111e80 con 0x7f66581032d0 2024-08-02T18:51:39.126 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e88d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 0x7f665819c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665d88b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66581032d0 0x7f66581985f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665d88b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66581032d0 0x7f66581985f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:59996/0 (socket says 172.21.15.103:59996) 2024-08-02T18:51:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e88d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 0x7f665819c970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45802/0 (socket says 172.21.15.103:45802) 2024-08-02T18:51:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665d88b640 1 -- 172.21.15.103:0/3829066593 learned_addr learned my addr 172.21.15.103:0/3829066593 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:39.127 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e08c640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66581029b0 0x7f66581980b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e88d640 1 -- 172.21.15.103:0/3829066593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66581032d0 msgr2=0x7f66581985f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e88d640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66581032d0 0x7f66581985f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e88d640 1 -- 172.21.15.103:0/3829066593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66581029b0 msgr2=0x7f66581980b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e88d640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66581029b0 0x7f66581980b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e88d640 1 -- 172.21.15.103:0/3829066593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f665819d0a0 con 0x7f665810be00 2024-08-02T18:51:39.128 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665d88b640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66581032d0 0x7f66581985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f665e88d640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 0x7f665819c970 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6650009ca0 tx=0x7f665002f640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.107+0000 7f664f7fe640 1 -- 172.21.15.103:0/3829066593 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650034040 con 0x7f665810be00 2024-08-02T18:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.108+0000 7f664f7fe640 1 -- 172.21.15.103:0/3829066593 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6650030940 con 0x7f665810be00 2024-08-02T18:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.108+0000 7f664f7fe640 1 -- 172.21.15.103:0/3829066593 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6650004840 con 0x7f665810be00 2024-08-02T18:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.108+0000 7f66602f0640 1 -- 172.21.15.103:0/3829066593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f665819d330 con 0x7f665810be00 2024-08-02T18:51:39.129 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.108+0000 7f66602f0640 1 -- 172.21.15.103:0/3829066593 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66581a4c20 con 0x7f665810be00 2024-08-02T18:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.110+0000 7f664f7fe640 1 -- 172.21.15.103:0/3829066593 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f6650037020 con 0x7f665810be00 2024-08-02T18:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.110+0000 7f6663040740 1 Processor -- start 2024-08-02T18:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f6663040740 1 -- start start 2024-08-02T18:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f6663040740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3b57b0 0x55a19f3b5b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f6663040740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c0430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.130 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f6663040740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3c0970 0x55a19f3c2d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f6663040740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a19f3199b0 con 0x55a19f3c0970 2024-08-02T18:51:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f6663040740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a19f2c1800 con 0x55a19f3b57b0 2024-08-02T18:51:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f6663040740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a19f315970 con 0x55a19f3b60d0 2024-08-02T18:51:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f664f7fe640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f66440a2e20 0x7f66440a52e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.131 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e08c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c0430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665d88b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3c0970 0x55a19f3c2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e88d640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f66440a2e20 0x7f66440a52e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e08c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c0430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:60010/0 (socket says 172.21.15.103:60010) 2024-08-02T18:51:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e08c640 1 -- 172.21.15.103:0/2039437211 learned_addr learned my addr 172.21.15.103:0/2039437211 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665d88b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3c0970 0x55a19f3c2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45812/0 (socket says 172.21.15.103:45812) 2024-08-02T18:51:39.132 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665d88b640 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3b57b0 0x55a19f3b5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e08c640 1 -- 172.21.15.103:0/2039437211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3b57b0 msgr2=0x55a19f3b5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e08c640 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3b57b0 0x55a19f3b5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f664f7fe640 1 -- 172.21.15.103:0/3829066593 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f66500f0420 con 0x7f665810be00 2024-08-02T18:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e08c640 1 -- 172.21.15.103:0/2039437211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3c0970 msgr2=0x55a19f3c2d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e08c640 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3c0970 0x55a19f3c2d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.133 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665e08c640 1 -- 172.21.15.103:0/2039437211 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a19f02d210 con 0x55a19f3b60d0 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.111+0000 7f665d88b640 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3c0970 0x55a19f3c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f665e08c640 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c0430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f665400bd10 tx=0x7f66540107a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e9a702f900d008c8 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f665e88d640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f66440a2e20 0x7f66440a52e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66500b90e0 tx=0x7f665008e6d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f664cbfe640 1 -- 172.21.15.103:0/2039437211 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654004030 con 0x55a19f3b60d0 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f664cbfe640 1 -- 172.21.15.103:0/2039437211 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f66540041d0 con 0x55a19f3b60d0 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f664cbfe640 1 -- 172.21.15.103:0/2039437211 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6654011820 con 0x55a19f3b60d0 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f6663040740 1 -- 172.21.15.103:0/2039437211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 msgr2=0x55a19f3c0430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f6663040740 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c0430 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f665400bd10 tx=0x7f66540107a0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f6663040740 1 -- 172.21.15.103:0/2039437211 shutdown_connections 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f6663040740 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3c0970 0x55a19f3c2d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.134 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f6663040740 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c0430 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f6663040740 1 --2- 172.21.15.103:0/2039437211 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3b57b0 0x55a19f3b5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.112+0000 7f6663040740 1 -- 172.21.15.103:0/2039437211 >> 172.21.15.103:0/2039437211 conn(0x55a19f3b1d20 msgr2=0x55a19f3b2100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 -- 172.21.15.103:0/2039437211 shutdown_connections 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 -- 172.21.15.103:0/2039437211 wait complete. 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 -- start start 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 Processor -- start 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3bd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3bdd90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3be2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55a19f3c3540 con 0x55a19f3b57b0 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55a19f2d5500 con 0x55a19f3c0970 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55a19f3c36c0 con 0x55a19f3b60d0 2024-08-02T18:51:39.135 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f6663040740 10 client.0 _ll_register_callbacks cb 0x55a19f02ca00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f665d88b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3bd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f665d88b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3bd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45814/0 (socket says 172.21.15.103:45814) 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f665d88b640 1 -- 172.21.15.103:0/3012885896 learned_addr learned my addr 172.21.15.103:0/3012885896 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f665e08c640 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3bdd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.113+0000 7f665d88b640 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3be2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f665d88b640 1 -- 172.21.15.103:0/3012885896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 msgr2=0x55a19f3bdd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f665d88b640 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3bdd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f665d88b640 1 -- 172.21.15.103:0/3012885896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 msgr2=0x55a19f3be2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f665d88b640 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3be2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f665d88b640 1 -- 172.21.15.103:0/3012885896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a19f0f9620 con 0x55a19f3b57b0 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f665d88b640 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3bd850 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6648011fd0 tx=0x7f6648009530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1289fd6ff8bfc0f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6641ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6641ffb640 1 -- 172.21.15.103:0/3012885896 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648004030 con 0x55a19f3b57b0 2024-08-02T18:51:39.136 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6641ffb640 1 -- 172.21.15.103:0/3012885896 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f66480041d0 con 0x55a19f3b57b0 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6663040740 1 -- 172.21.15.103:0/3012885896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f66540041d0 con 0x55a19f3b57b0 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6641ffb640 1 -- 172.21.15.103:0/3012885896 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66480043d0 con 0x55a19f3b57b0 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6663040740 10 client.16101 fetch_fsmap learned FSMap version 29 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6663040740 1 -- 172.21.15.103:0/3012885896 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a19f3cf220 con 0x55a19f3b57b0 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6641ffb640 1 -- 172.21.15.103:0/3012885896 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f66540041d0 con 0x55a19f3b57b0 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.114+0000 7f6641ffb640 1 -- 172.21.15.103:0/3012885896 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f66480035f0 con 0x55a19f3b57b0 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f6663040740 10 client.16101 fetch_fsmap finished waiting for FSMap version 29 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f6663040740 10 client.16101 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f6663040740 20 client.16101 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f6663040740 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a19f3d06e0 0x55a19f3d2ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f6663040740 4 client.16101 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f6663040740 1 -- 172.21.15.103:0/3012885896 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55a19f3270e0 con 0x55a19f3d06e0 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f665e08c640 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a19f3d06e0 0x55a19f3d2ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.137 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f665e08c640 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a19f3d06e0 0x55a19f3d2ad0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=de271ba6ba77e7a3 server_cookie=cac5591419a45c43 in_seq=0 out_seq=0 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.115+0000 7f6641ffb640 10 client.16101 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6641ffb640 1 -- 172.21.15.103:0/3012885896 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55a19f3270e0 con 0x55a19f3d06e0 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6641ffb640 10 client.16101 handle_command_reply: tid=0 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 client.16101 shutdown 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 -- 172.21.15.103:0/3012885896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 msgr2=0x55a19f3bd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3bd850 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f6648011fd0 tx=0x7f6648009530 comp rx=0 tx=0).stop 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 -- 172.21.15.103:0/3012885896 shutdown_connections 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a19f3d06e0 0x55a19f3d2ad0 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3be2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3bdd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 --2- 172.21.15.103:0/3012885896 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3bd850 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.138 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6641ffb640 0 client.16101 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 -- 172.21.15.103:0/3012885896 >> 172.21.15.103:0/3012885896 conn(0x55a19f3b1d20 msgr2=0x55a19f3b7a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 -- 172.21.15.103:0/3012885896 shutdown_connections 2024-08-02T18:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 1 -- 172.21.15.103:0/3012885896 wait complete. 2024-08-02T18:51:39.139 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.116+0000 7f6663040740 20 client.16101 trim_cache size 0 max 16384 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f6663040740 1 Processor -- start 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f6663040740 1 -- start start 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f6663040740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3b8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f6663040740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3d83c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f6663040740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3d8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f6663040740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66581b13e0 con 0x55a19f3b57b0 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f6663040740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f66581aecb0 con 0x55a19f3c0970 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f6663040740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f66581acb00 con 0x55a19f3b60d0 2024-08-02T18:51:39.144 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f665d88b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3b8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f665d88b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3b8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45820/0 (socket says 172.21.15.103:45820) 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f665d88b640 1 -- 172.21.15.103:0/984620452 learned_addr learned my addr 172.21.15.103:0/984620452 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.131+0000 7f665e08c640 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3d83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f665d88b640 1 -- 172.21.15.103:0/984620452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 msgr2=0x55a19f3d83c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f665d88b640 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3d83c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f665d88b640 1 -- 172.21.15.103:0/984620452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 msgr2=0x55a19f3d8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f665d88b640 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3d8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f665d88b640 1 -- 172.21.15.103:0/984620452 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a19f3b9400 con 0x55a19f3b57b0 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f665e08c640 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3d83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f665d88b640 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3b8220 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f664800e490 tx=0x7f6648005db0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c9c0c0b1f6e415 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f6643fff640 1 -- 172.21.15.103:0/984620452 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648004570 con 0x55a19f3b57b0 2024-08-02T18:51:39.145 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f6643fff640 1 -- 172.21.15.103:0/984620452 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6648004130 con 0x55a19f3b57b0 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.132+0000 7f6643fff640 1 -- 172.21.15.103:0/984620452 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648005040 con 0x55a19f3b57b0 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- 172.21.15.103:0/984620452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 msgr2=0x55a19f3b8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3b8220 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f664800e490 tx=0x7f6648005db0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- 172.21.15.103:0/984620452 shutdown_connections 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3d8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3d83c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 --2- 172.21.15.103:0/984620452 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3b8220 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- 172.21.15.103:0/984620452 >> 172.21.15.103:0/984620452 conn(0x55a19f3b1d20 msgr2=0x55a19f3bf7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- 172.21.15.103:0/984620452 shutdown_connections 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- 172.21.15.103:0/984620452 wait complete. 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- start start 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 Processor -- start 2024-08-02T18:51:39.146 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3c8f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c4260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3c47a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f66581ad170 con 0x55a19f3b57b0 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f66581ae5e0 con 0x55a19f3c0970 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f66581ad840 con 0x55a19f3b60d0 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f665d88b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3c8f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f6663040740 10 client.0 _ll_register_callbacks cb 0x7f6648011ed0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f665d88b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3c8f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:45832/0 (socket says 172.21.15.103:45832) 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f665d88b640 1 -- 172.21.15.103:0/3353554937 learned_addr learned my addr 172.21.15.103:0/3353554937 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.133+0000 7f665e08c640 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c4260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f665d88b640 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3c47a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f665d88b640 1 -- 172.21.15.103:0/3353554937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 msgr2=0x55a19f3c4260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:39.147 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f665d88b640 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c4260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f665d88b640 1 -- 172.21.15.103:0/3353554937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 msgr2=0x55a19f3c47a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f665d88b640 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3c47a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f665d88b640 1 -- 172.21.15.103:0/3353554937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a19f3c4e10 con 0x55a19f3b57b0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f665d88b640 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3c8f40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6648006010 tx=0x7f66480111d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=492167edbbd7e4c3 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6641ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6641ffb640 1 -- 172.21.15.103:0/3353554937 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6648005100 con 0x55a19f3b57b0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6641ffb640 1 -- 172.21.15.103:0/3353554937 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f66480052a0 con 0x55a19f3b57b0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6663040740 1 -- 172.21.15.103:0/3353554937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f6648004130 con 0x55a19f3b57b0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6641ffb640 1 -- 172.21.15.103:0/3353554937 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7f66480054a0 con 0x55a19f3b57b0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6663040740 10 client.16107 fetch_fsmap learned FSMap version 29 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6663040740 1 -- 172.21.15.103:0/3353554937 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55a19f43b210 con 0x55a19f3b57b0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6641ffb640 1 -- 172.21.15.103:0/3353554937 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6648004130 con 0x55a19f3b57b0 2024-08-02T18:51:39.148 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6641ffb640 1 -- 172.21.15.103:0/3353554937 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7f6648004690 con 0x55a19f3b57b0 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6663040740 10 client.16107 fetch_fsmap finished waiting for FSMap version 29 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6663040740 10 client.16107 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.134+0000 7f6663040740 20 client.16107 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.135+0000 7f6663040740 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a19f43b860 0x55a19f43dc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.135+0000 7f6663040740 4 client.16107 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.135+0000 7f6663040740 1 -- 172.21.15.103:0/3353554937 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55a19f321430 con 0x55a19f43b860 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.135+0000 7f665e08c640 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a19f43b860 0x55a19f43dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.135+0000 7f6641ffb640 10 client.16107 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:39.149 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.135+0000 7f665e08c640 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a19f43b860 0x55a19f43dc80 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=202c48f976252746 server_cookie=28b8b7474b2efc97 in_seq=0 out_seq=0 2024-08-02T18:51:39.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:38 smithi121 ceph-mon[37236]: pgmap v60: 129 pgs: 129 active+clean; 90 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 812 KiB/s wr, 186 op/s 2024-08-02T18:51:39.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:38 smithi151 ceph-mon[37155]: pgmap v60: 129 pgs: 129 active+clean; 90 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 812 KiB/s wr, 186 op/s 2024-08-02T18:51:39.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:38 smithi103 ceph-mon[32753]: pgmap v60: 129 pgs: 129 active+clean; 90 MiB data, 561 MiB used, 1.0 TiB / 1.0 TiB avail; 822 KiB/s rd, 812 KiB/s wr, 186 op/s 2024-08-02T18:51:39.410 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.407+0000 7f6641ffb640 1 -- 172.21.15.103:0/3353554937 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55a19f321430 con 0x55a19f43b860 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.407+0000 7f6641ffb640 10 client.16107 handle_command_reply: tid=0 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.407+0000 7f6663040740 1 client.16107 shutdown 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 -- 172.21.15.103:0/3353554937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 msgr2=0x55a19f3c8f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3c8f40 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f6648006010 tx=0x7f66480111d0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 -- 172.21.15.103:0/3353554937 shutdown_connections 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55a19f43b860 0x55a19f43dc80 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55a19f3c0970 0x55a19f3c47a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6641ffb640 0 client.16107 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55a19f3b60d0 0x55a19f3c4260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.411 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 --2- 172.21.15.103:0/3353554937 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55a19f3b57b0 0x55a19f3c8f40 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 -- 172.21.15.103:0/3353554937 >> 172.21.15.103:0/3353554937 conn(0x55a19f3b1d20 msgr2=0x55a19f3bed80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 -- 172.21.15.103:0/3353554937 shutdown_connections 2024-08-02T18:51:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 1 -- 172.21.15.103:0/3353554937 wait complete. 2024-08-02T18:51:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f6663040740 20 client.16107 trim_cache size 0 max 16384 2024-08-02T18:51:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:51:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:51:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:51:39.412 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:51:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 -- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f66440a2e20 msgr2=0x7f66440a52e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f66440a2e20 0x7f66440a52e0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f66500b90e0 tx=0x7f665008e6d0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 -- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 msgr2=0x7f665819c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:39.413 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 0x7f665819c970 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f6650009ca0 tx=0x7f665002f640 comp rx=0 tx=0).stop 2024-08-02T18:51:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 -- 172.21.15.103:0/3829066593 shutdown_connections 2024-08-02T18:51:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f66440a2e20 0x7f66440a52e0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f665810be00 0x7f665819c970 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f66581032d0 0x7f66581985f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.408+0000 7f66602f0640 1 --2- 172.21.15.103:0/3829066593 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f66581029b0 0x7f66581980b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.409+0000 7f66602f0640 1 -- 172.21.15.103:0/3829066593 >> 172.21.15.103:0/3829066593 conn(0x7f66580776c0 msgr2=0x7f66580fe3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.409+0000 7f66602f0640 1 -- 172.21.15.103:0/3829066593 shutdown_connections 2024-08-02T18:51:39.414 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:39.409+0000 7f66602f0640 1 -- 172.21.15.103:0/3829066593 wait complete. 2024-08-02T18:51:40.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:39 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:active 2024-08-02T18:51:40.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:39 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:40.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:39 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:active 2024-08-02T18:51:40.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:39 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:40.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:39 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] up:active 2024-08-02T18:51:40.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:39 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:51:41.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:40 smithi121 ceph-mon[37236]: pgmap v61: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-08-02T18:51:41.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:40 smithi151 ceph-mon[37155]: pgmap v61: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-08-02T18:51:41.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:40 smithi103 ceph-mon[32753]: pgmap v61: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.8 MiB/s wr, 454 op/s 2024-08-02T18:51:42.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:41 smithi121 ceph-mon[37236]: scrub summary: idle 2024-08-02T18:51:42.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:41 smithi121 ceph-mon[37236]: scrub summary: idle 2024-08-02T18:51:42.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:41 smithi151 ceph-mon[37155]: scrub summary: idle 2024-08-02T18:51:42.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:41 smithi151 ceph-mon[37155]: scrub summary: idle 2024-08-02T18:51:42.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:41 smithi103 ceph-mon[32753]: scrub summary: idle 2024-08-02T18:51:42.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:41 smithi103 ceph-mon[32753]: scrub summary: idle 2024-08-02T18:51:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:42 smithi121 ceph-mon[37236]: pgmap v62: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-08-02T18:51:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:42 smithi121 ceph-mon[37236]: scrub summary: idle 2024-08-02T18:51:43.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:42 smithi151 ceph-mon[37155]: pgmap v62: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-08-02T18:51:43.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:42 smithi151 ceph-mon[37155]: scrub summary: idle 2024-08-02T18:51:43.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:42 smithi103 ceph-mon[32753]: pgmap v62: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-08-02T18:51:43.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:42 smithi103 ceph-mon[32753]: scrub summary: idle 2024-08-02T18:51:45.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:44 smithi121 ceph-mon[37236]: pgmap v63: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-08-02T18:51:45.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:44 smithi151 ceph-mon[37155]: pgmap v63: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-08-02T18:51:45.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:44 smithi103 ceph-mon[32753]: pgmap v63: 129 pgs: 129 active+clean; 92 MiB data, 596 MiB used, 1.0 TiB / 1.0 TiB avail; 993 KiB/s rd, 1.2 MiB/s wr, 322 op/s 2024-08-02T18:51:45.924 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:45 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T18:51:45.670+0000 7f4e9562d640 -1 log_channel(cluster) log [ERR] : Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-02T18:51:46.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:45 smithi121 ceph-mon[37236]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-02T18:51:46.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:45 smithi151 ceph-mon[37155]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-02T18:51:46.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:45 smithi103 ceph-mon[32753]: Health check update: 2 MDSs report damaged metadata (MDS_DAMAGE) 2024-08-02T18:51:47.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:46 smithi121 ceph-mon[37236]: pgmap v64: 129 pgs: 129 active+clean; 102 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 328 op/s 2024-08-02T18:51:47.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:46 smithi151 ceph-mon[37155]: pgmap v64: 129 pgs: 129 active+clean; 102 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 328 op/s 2024-08-02T18:51:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:46 smithi103 ceph-mon[32753]: pgmap v64: 129 pgs: 129 active+clean; 102 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 2.1 MiB/s wr, 328 op/s 2024-08-02T18:51:48.332 INFO:tasks.workunit.client.0.smithi103.stderr:+ sync 2024-08-02T18:51:49.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:48 smithi121 ceph-mon[37236]: pgmap v65: 129 pgs: 129 active+clean; 102 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 274 op/s 2024-08-02T18:51:49.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:48 smithi151 ceph-mon[37155]: pgmap v65: 129 pgs: 129 active+clean; 102 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 274 op/s 2024-08-02T18:51:49.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:48 smithi103 ceph-mon[32753]: pgmap v65: 129 pgs: 129 active+clean; 102 MiB data, 619 MiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 1.8 MiB/s wr, 274 op/s 2024-08-02T18:51:51.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:50 smithi121 ceph-mon[37236]: pgmap v66: 129 pgs: 129 active+clean; 142 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 656 op/s 2024-08-02T18:51:51.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:50 smithi151 ceph-mon[37155]: pgmap v66: 129 pgs: 129 active+clean; 142 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 656 op/s 2024-08-02T18:51:51.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:50 smithi103 ceph-mon[32753]: pgmap v66: 129 pgs: 129 active+clean; 142 MiB data, 733 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.4 MiB/s wr, 656 op/s 2024-08-02T18:51:52.504 INFO:tasks.workunit.client.0.smithi103.stderr:+ tar c linux-4.0.5 2024-08-02T18:51:52.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.540+0000 7fa2f4155640 1 -- 172.21.15.103:0/2625922845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec103a30 msgr2=0x7fa2ec103e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.540+0000 7fa2f4155640 1 --2- 172.21.15.103:0/2625922845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec103a30 0x7fa2ec103e90 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009930 tx=0x7fa2e002a420 comp rx=0 tx=0).stop 2024-08-02T18:51:52.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.541+0000 7fa2f4155640 1 -- 172.21.15.103:0/2625922845 shutdown_connections 2024-08-02T18:51:52.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.541+0000 7fa2f4155640 1 --2- 172.21.15.103:0/2625922845 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec1043d0 0x7fa2ec110900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.542 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.541+0000 7fa2f4155640 1 --2- 172.21.15.103:0/2625922845 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec103a30 0x7fa2ec103e90 secure :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0009930 tx=0x7fa2e002a420 comp rx=0 tx=0).stop 2024-08-02T18:51:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.541+0000 7fa2f4155640 1 --2- 172.21.15.103:0/2625922845 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec109a40 0x7fa2ec109e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.541+0000 7fa2f4155640 1 -- 172.21.15.103:0/2625922845 >> 172.21.15.103:0/2625922845 conn(0x7fa2ec0ff6b0 msgr2=0x7fa2ec101ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.541+0000 7fa2f4155640 1 -- 172.21.15.103:0/2625922845 shutdown_connections 2024-08-02T18:51:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.541+0000 7fa2f4155640 1 -- 172.21.15.103:0/2625922845 wait complete. 2024-08-02T18:51:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f4155640 1 Processor -- start 2024-08-02T18:51:52.543 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f4155640 1 -- start start 2024-08-02T18:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f4155640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec1043d0 0x7fa2ec110890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.544 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f4155640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec109a40 0x7fa2ec10d930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f4155640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec10dfd0 0x7fa2ec1aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f4155640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec113ff0 con 0x7fa2ec1043d0 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f4155640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec113e70 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f4155640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec114170 con 0x7fa2ec109a40 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.542+0000 7fa2f26f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec10dfd0 0x7fa2ec1aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f26f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec10dfd0 0x7fa2ec1aacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:54122/0 (socket says 172.21.15.103:54122) 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f26f2640 1 -- 172.21.15.103:0/3912481917 learned_addr learned my addr 172.21.15.103:0/3912481917 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec1043d0 0x7fa2ec110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec109a40 0x7fa2ec10d930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f26f2640 1 -- 172.21.15.103:0/3912481917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec109a40 msgr2=0x7fa2ec10d930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec109a40 0x7fa2ec10d930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.545 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f26f2640 1 -- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec1043d0 msgr2=0x7fa2ec110890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec1043d0 0x7fa2ec110890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f26f2640 1 -- 172.21.15.103:0/3912481917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa2ec1ab210 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec1043d0 0x7fa2ec110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:51:52.546 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.543+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec10dfd0 0x7fa2ec1aacd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400eb10 tx=0x7fa2e400c2d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.544+0000 7fa2deffd640 1 -- 172.21.15.103:0/3912481917 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e4004b20 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.544+0000 7fa2f4155640 1 -- 172.21.15.103:0/3912481917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa2ec1ab3e0 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.544+0000 7fa2deffd640 1 -- 172.21.15.103:0/3912481917 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2e4004cc0 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.544+0000 7fa2deffd640 1 -- 172.21.15.103:0/3912481917 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40107f0 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.547 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.544+0000 7fa2f4155640 1 -- 172.21.15.103:0/3912481917 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa2ec1ab7e0 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.549 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.548+0000 7fa2deffd640 1 -- 172.21.15.103:0/3912481917 <== mon.2 v2:172.21.15.121:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fa2e4010a90 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.548+0000 7fa2f6f7c740 1 Processor -- start 2024-08-02T18:51:52.550 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.549+0000 7fa2f6f7c740 1 -- start start 2024-08-02T18:51:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70ee7b0 0x55fba70eeb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70f9430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f16f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70ee7b0 0x55fba70eeb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.551 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f16f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70ee7b0 0x55fba70eeb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:54126/0 (socket says 172.21.15.103:54126) 2024-08-02T18:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f1ef1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70f9430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f1ef1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70f9430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:47502/0 (socket says 172.21.15.103:47502) 2024-08-02T18:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70f9970 0x55fba70fbd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f16f0640 1 -- 172.21.15.103:0/1296825456 learned_addr learned my addr 172.21.15.103:0/1296825456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/1296825456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fba70529b0 con 0x55fba70f9970 2024-08-02T18:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/1296825456 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fba6ffa800 con 0x55fba70ee7b0 2024-08-02T18:51:52.552 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.550+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/1296825456 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fba704e970 con 0x55fba70ef0d0 2024-08-02T18:51:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.551+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/1296825456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70ee7b0 msgr2=0x55fba70eeb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.551+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/1296825456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70ee7b0 0x55fba70eeb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.551+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/1296825456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70f9970 msgr2=0x55fba70fbd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:52.553 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.551+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/1296825456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70f9970 0x55fba70fbd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.551+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/1296825456 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fba6d66210 con 0x55fba70ef0d0 2024-08-02T18:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.551+0000 7fa2deffd640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2d80a2ef0 0x7fa2d80a53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.551+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/1296825456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70f9430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009be0 tx=0x7fa2e8010740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c91f7da9406b2ca4 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.552+0000 7fa2deffd640 1 -- 172.21.15.103:0/3912481917 <== mon.2 v2:172.21.15.121:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa2e40d1020 con 0x7fa2ec10dfd0 2024-08-02T18:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.552+0000 7fa2d7fff640 1 -- 172.21.15.103:0/1296825456 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e801b480 con 0x55fba70ef0d0 2024-08-02T18:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.552+0000 7fa2d7fff640 1 -- 172.21.15.103:0/1296825456 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2e8012950 con 0x55fba70ef0d0 2024-08-02T18:51:52.554 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.552+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2d80a2ef0 0x7fa2d80a53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.553+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/1296825456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 msgr2=0x55fba70f9430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.553+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/1296825456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70f9430 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009be0 tx=0x7fa2e8010740 comp rx=0 tx=0).stop 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.553+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/1296825456 shutdown_connections 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.553+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/1296825456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70f9970 0x55fba70fbd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.553+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/1296825456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70f9430 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.553+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/1296825456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70ee7b0 0x55fba70eeb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.553+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2d80a2ef0 0x7fa2d80a53b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0005ab0 tx=0x7fa2e0005b90 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.553+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/1296825456 >> 172.21.15.103:0/1296825456 conn(0x55fba70ead20 msgr2=0x55fba70eb100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:52.555 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.554+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/1296825456 shutdown_connections 2024-08-02T18:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.554+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/1296825456 wait complete. 2024-08-02T18:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.554+0000 7fa2f6f7c740 1 -- start start 2024-08-02T18:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.555+0000 7fa2f6f7c740 1 Processor -- start 2024-08-02T18:51:52.556 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.555+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70f6870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.555+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba70f6db0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.555+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70f72f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.555+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55fba70fc590 con 0x55fba70ef0d0 2024-08-02T18:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.555+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55fba700e500 con 0x55fba70f9970 2024-08-02T18:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.555+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55fba70fc710 con 0x55fba70ee7b0 2024-08-02T18:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.555+0000 7fa2f6f7c740 10 client.0 _ll_register_callbacks cb 0x55fba6d65a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:52.557 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.556+0000 7fa2f1ef1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.556+0000 7fa2f1ef1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70f6870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:47504/0 (socket says 172.21.15.103:47504) 2024-08-02T18:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.556+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/2673155262 learned_addr learned my addr 172.21.15.103:0/2673155262 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.556+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70f72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.558 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.556+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba70f6db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.557+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/2673155262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 msgr2=0x55fba70f72f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.557+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70f72f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.557+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/2673155262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 msgr2=0x55fba70f6db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.557+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba70f6db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.557+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/2673155262 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fba6e32620 con 0x55fba70ee7b0 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.557+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba70f6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.557+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70f6870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8011f00 tx=0x7fa2e8011f30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=57be04a999517618 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.557+0000 7fa2d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:51:52.559 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.558+0000 7fa2d57fa640 1 -- 172.21.15.103:0/2673155262 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e8005110 con 0x55fba70ee7b0 2024-08-02T18:51:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.558+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/2673155262 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fba70600e0 con 0x55fba70ee7b0 2024-08-02T18:51:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.558+0000 7fa2d57fa640 1 -- 172.21.15.103:0/2673155262 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa2e80052b0 con 0x55fba70ee7b0 2024-08-02T18:51:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.558+0000 7fa2d57fa640 1 -- 172.21.15.103:0/2673155262 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2e802d050 con 0x55fba70ee7b0 2024-08-02T18:51:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.558+0000 7fa2f6f7c740 10 client.25588 fetch_fsmap learned FSMap version 29 2024-08-02T18:51:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.558+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/2673155262 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fba71082e0 con 0x55fba70ee7b0 2024-08-02T18:51:52.560 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.559+0000 7fa2d57fa640 1 -- 172.21.15.103:0/2673155262 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x55fba70600e0 con 0x55fba70ee7b0 2024-08-02T18:51:52.561 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.560+0000 7fa2d57fa640 1 -- 172.21.15.103:0/2673155262 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa2e800f040 con 0x55fba70ee7b0 2024-08-02T18:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.560+0000 7fa2f6f7c740 10 client.25588 fetch_fsmap finished waiting for FSMap version 29 2024-08-02T18:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.560+0000 7fa2f6f7c740 10 client.25588 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.560+0000 7fa2f6f7c740 20 client.25588 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.560+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fba7109bd0 0x55fba710c090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.561+0000 7fa2f6f7c740 4 client.25588 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.561+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/2673155262 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fba705a430 con 0x55fba7109bd0 2024-08-02T18:51:52.562 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.561+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fba7109bd0 0x55fba710c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.563+0000 7fa2d57fa640 10 client.25588 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:52.564 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.563+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fba7109bd0 0x55fba710c090 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=144ae90b32e8964b server_cookie=c2f4b48b1322a9a5 in_seq=0 out_seq=0 2024-08-02T18:51:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.564+0000 7fa2d57fa640 1 -- 172.21.15.103:0/2673155262 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55fba705a430 con 0x55fba7109bd0 2024-08-02T18:51:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.564+0000 7fa2d57fa640 10 client.25588 handle_command_reply: tid=0 2024-08-02T18:51:52.566 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.565+0000 7fa2f6f7c740 1 client.25588 shutdown 2024-08-02T18:51:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/2673155262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 msgr2=0x55fba70f6870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70f6870 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8011f00 tx=0x7fa2e8011f30 comp rx=0 tx=0).stop 2024-08-02T18:51:52.567 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/2673155262 shutdown_connections 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fba7109bd0 0x55fba710c090 crc :-1 s=READY pgs=90 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70f72f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba70f6db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/2673155262 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70f6870 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/2673155262 >> 172.21.15.103:0/2673155262 conn(0x55fba70ead20 msgr2=0x55fba70f0a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2d57fa640 0 client.25588 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/2673155262 shutdown_connections 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/2673155262 wait complete. 2024-08-02T18:51:52.568 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.566+0000 7fa2f6f7c740 20 client.25588 trim_cache size 0 max 16384 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f6f7c740 1 Processor -- start 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f6f7c740 1 -- start start 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70e5900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba71119a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba7111ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec1b7f90 con 0x55fba70ef0d0 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec1b5860 con 0x55fba70f9970 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec1b3760 con 0x55fba70ee7b0 2024-08-02T18:51:52.596 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f16f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba71119a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f1ef1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70e5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f26f2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba7111ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f1ef1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70e5900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:47514/0 (socket says 172.21.15.103:47514) 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.594+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/4291611160 learned_addr learned my addr 172.21.15.103:0/4291611160 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2f26f2640 1 -- 172.21.15.103:0/4291611160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 msgr2=0x55fba70e5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/4291611160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70e5900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2f26f2640 1 -- 172.21.15.103:0/4291611160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 msgr2=0x55fba71119a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/4291611160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba71119a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.597 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2f26f2640 1 -- 172.21.15.103:0/4291611160 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fba70ee530 con 0x55fba70f9970 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/4291611160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba7111ee0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40ce3d0 tx=0x7fa2e409cf70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=717a7bd0fac57a0f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2d77fe640 1 -- 172.21.15.103:0/4291611160 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40152d0 con 0x55fba70f9970 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2d77fe640 1 -- 172.21.15.103:0/4291611160 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2e409d8a0 con 0x55fba70f9970 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.595+0000 7fa2d77fe640 1 -- 172.21.15.103:0/4291611160 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e40a1160 con 0x55fba70f9970 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/4291611160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 msgr2=0x55fba7111ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/4291611160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba7111ee0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fa2e40ce3d0 tx=0x7fa2e409cf70 comp rx=0 tx=0).stop 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/4291611160 shutdown_connections 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/4291611160 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba7111ee0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.600 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/4291611160 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ef0d0 0x55fba71119a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/4291611160 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ee7b0 0x55fba70e5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/4291611160 >> 172.21.15.103:0/4291611160 conn(0x55fba70ead20 msgr2=0x55fba70f5120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/4291611160 shutdown_connections 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.596+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/4291611160 wait complete. 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.597+0000 7fa2f6f7c740 1 -- start start 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.597+0000 7fa2f6f7c740 1 Processor -- start 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.597+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ee7b0 0x55fba71020a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.597+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f6f7c740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec1b3d20 con 0x55fba70ee7b0 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec1b5190 con 0x55fba70f9970 2024-08-02T18:51:52.601 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f6f7c740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fa2ec1b43f0 con 0x55fba70ef0d0 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ee7b0 0x55fba71020a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ee7b0 0x55fba71020a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:55468/0 (socket says 172.21.15.103:55468) 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/473168886 learned_addr learned my addr 172.21.15.103:0/473168886 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f6f7c740 10 client.0 _ll_register_callbacks cb 0x7fa2e8005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/473168886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 msgr2=0x55fba70fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70fc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 msgr2=0x55fba70fcef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70fcef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 -- 172.21.15.103:0/473168886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fba70fd6f0 con 0x55fba70ee7b0 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f26f2640 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:51:52.602 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2f1ef1640 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ee7b0 0x55fba71020a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009a30 tx=0x7fa2e8009a60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20fb93a7c5480a0c server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:51:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.598+0000 7fa2d57fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:51:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2d57fa640 1 -- 172.21.15.103:0/473168886 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa2e801f040 con 0x55fba70ee7b0 2024-08-02T18:51:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2d57fa640 1 -- 172.21.15.103:0/473168886 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fa2e8005110 con 0x55fba70ee7b0 2024-08-02T18:51:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/473168886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa2e409d8a0 con 0x55fba70ee7b0 2024-08-02T18:51:52.603 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2d57fa640 1 -- 172.21.15.103:0/473168886 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=29) ==== 24+0+0 (secure 0 0 0) 0x7fa2e8005ab0 con 0x55fba70ee7b0 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 10 client.16119 fetch_fsmap learned FSMap version 29 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/473168886 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=29,monmap=4+}) -- 0x55fba71738c0 con 0x55fba70ee7b0 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2d57fa640 1 -- 172.21.15.103:0/473168886 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fa2e409d8a0 con 0x55fba70ee7b0 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2d57fa640 1 -- 172.21.15.103:0/473168886 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 29) ==== 8362+0+0 (secure 0 0 0) 0x7fa2e8003af0 con 0x55fba70ee7b0 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 10 client.16119 fetch_fsmap finished waiting for FSMap version 29 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 10 client.16119 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 20 client.16119 populate_metadata read hostname 'smithi103' 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fba7173fb0 0x55fba71763d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:51:52.604 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 4 client.16119 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:51:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.599+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/473168886 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x55fba6fd78e0 con 0x55fba7173fb0 2024-08-02T18:51:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.600+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fba7173fb0 0x55fba71763d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:51:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.600+0000 7fa2d57fa640 10 client.16119 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:52.605 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.600+0000 7fa2f16f0640 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fba7173fb0 0x55fba71763d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5c911469ff638a30 server_cookie=10fd1699ebb9a998 in_seq=0 out_seq=0 2024-08-02T18:51:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.895+0000 7fa2d57fa640 1 -- 172.21.15.103:0/473168886 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x55fba6fd78e0 con 0x55fba7173fb0 2024-08-02T18:51:52.897 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.895+0000 7fa2d57fa640 10 client.16119 handle_command_reply: tid=0 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.895+0000 7fa2f6f7c740 1 client.16119 shutdown 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.895+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/473168886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ee7b0 msgr2=0x55fba71020a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.895+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ee7b0 0x55fba71020a0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fa2e8009a30 tx=0x7fa2e8009a60 comp rx=0 tx=0).stop 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.895+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/473168886 shutdown_connections 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.895+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55fba7173fb0 0x55fba71763d0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.896+0000 7fa2d57fa640 0 client.16119 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.896+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55fba70f9970 0x55fba70fcef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.896+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55fba70ef0d0 0x55fba70fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.896+0000 7fa2f6f7c740 1 --2- 172.21.15.103:0/473168886 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55fba70ee7b0 0x55fba71020a0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.896+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/473168886 >> 172.21.15.103:0/473168886 conn(0x55fba70ead20 msgr2=0x55fba70e9660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.896+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/473168886 shutdown_connections 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.896+0000 7fa2f6f7c740 1 -- 172.21.15.103:0/473168886 wait complete. 2024-08-02T18:51:52.898 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.896+0000 7fa2f6f7c740 20 client.16119 trim_cache size 0 max 16384 2024-08-02T18:51:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:51:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:51:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:51:52.899 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 -- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2d80a2ef0 msgr2=0x7fa2d80a53b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2d80a2ef0 0x7fa2d80a53b0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa2e0005ab0 tx=0x7fa2e0005b90 comp rx=0 tx=0).stop 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 -- 172.21.15.103:0/3912481917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec10dfd0 msgr2=0x7fa2ec1aacd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec10dfd0 0x7fa2ec1aacd0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fa2e400eb10 tx=0x7fa2e400c2d0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 -- 172.21.15.103:0/3912481917 shutdown_connections 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fa2d80a2ef0 0x7fa2d80a53b0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fa2ec10dfd0 0x7fa2ec1aacd0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fa2ec109a40 0x7fa2ec10d930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 --2- 172.21.15.103:0/3912481917 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fa2ec1043d0 0x7fa2ec110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:51:52.900 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 -- 172.21.15.103:0/3912481917 >> 172.21.15.103:0/3912481917 conn(0x7fa2ec0ff6b0 msgr2=0x7fa2ec0ffd80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:51:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 -- 172.21.15.103:0/3912481917 shutdown_connections 2024-08-02T18:51:52.901 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:51:52.898+0000 7fa2f4155640 1 -- 172.21.15.103:0/3912481917 wait complete. 2024-08-02T18:51:53.025 INFO:tasks.workunit.client.0.smithi103.stderr:+ rm -rf linux-4.0.5 2024-08-02T18:51:53.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:52 smithi121 ceph-mon[37236]: pgmap v67: 129 pgs: 129 active+clean; 165 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-08-02T18:51:53.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:52 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:51:53.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:52 smithi151 ceph-mon[37155]: pgmap v67: 129 pgs: 129 active+clean; 165 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-08-02T18:51:53.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:52 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:51:53.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:52 smithi103 ceph-mon[32753]: pgmap v67: 129 pgs: 129 active+clean; 165 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-08-02T18:51:53.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:52 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:51:54.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:51:54.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:51:54.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:54.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:51:54.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:51:54.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:51:55.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:55 smithi121 ceph-mon[37236]: pgmap v68: 129 pgs: 129 active+clean; 165 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-08-02T18:51:55.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:55 smithi151 ceph-mon[37155]: pgmap v68: 129 pgs: 129 active+clean; 165 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-08-02T18:51:55.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:55 smithi103 ceph-mon[32753]: pgmap v68: 129 pgs: 129 active+clean; 165 MiB data, 757 MiB used, 1.0 TiB / 1.0 TiB avail; 2.0 MiB/s rd, 6.4 MiB/s wr, 538 op/s 2024-08-02T18:51:57.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:57 smithi121 ceph-mon[37236]: pgmap v69: 129 pgs: 129 active+clean; 165 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.2 MiB/s wr, 1.24k op/s 2024-08-02T18:51:57.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:57 smithi151 ceph-mon[37155]: pgmap v69: 129 pgs: 129 active+clean; 165 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.2 MiB/s wr, 1.24k op/s 2024-08-02T18:51:57.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:57 smithi103 ceph-mon[32753]: pgmap v69: 129 pgs: 129 active+clean; 165 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.7 MiB/s rd, 9.2 MiB/s wr, 1.24k op/s 2024-08-02T18:51:59.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:51:59 smithi121 ceph-mon[37236]: pgmap v70: 129 pgs: 129 active+clean; 165 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.3 MiB/s wr, 1.24k op/s 2024-08-02T18:51:59.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:51:59 smithi151 ceph-mon[37155]: pgmap v70: 129 pgs: 129 active+clean; 165 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.3 MiB/s wr, 1.24k op/s 2024-08-02T18:51:59.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:51:59 smithi103 ceph-mon[32753]: pgmap v70: 129 pgs: 129 active+clean; 165 MiB data, 811 MiB used, 1.0 TiB / 1.0 TiB avail; 3.1 MiB/s rd, 8.3 MiB/s wr, 1.24k op/s 2024-08-02T18:52:01.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:01 smithi121 ceph-mon[37236]: pgmap v71: 129 pgs: 129 active+clean; 173 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.36k op/s 2024-08-02T18:52:01.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:01 smithi151 ceph-mon[37155]: pgmap v71: 129 pgs: 129 active+clean; 173 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.36k op/s 2024-08-02T18:52:01.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:01 smithi103 ceph-mon[32753]: pgmap v71: 129 pgs: 129 active+clean; 173 MiB data, 837 MiB used, 1.0 TiB / 1.0 TiB avail; 4.0 MiB/s rd, 9.2 MiB/s wr, 1.36k op/s 2024-08-02T18:52:02.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:02 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:02.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:02 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:02.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:02 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:03.755 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:03 smithi121 ceph-mon[37236]: pgmap v72: 129 pgs: 129 active+clean; 172 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 1.02k op/s 2024-08-02T18:52:03.755 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:03 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:03.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:03 smithi151 ceph-mon[37155]: pgmap v72: 129 pgs: 129 active+clean; 172 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 1.02k op/s 2024-08-02T18:52:03.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:03 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:03.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:03 smithi103 ceph-mon[32753]: pgmap v72: 129 pgs: 129 active+clean; 172 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 5.6 MiB/s wr, 1.02k op/s 2024-08-02T18:52:03.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:03 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:03.959 INFO:tasks.workunit.client.0.smithi103.stderr:+ tar xf doc.tar 2024-08-02T18:52:05.172 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 scrub status 2024-08-02T18:52:05.431 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:52:05.552 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:05 smithi103 ceph-mon[32753]: pgmap v73: 129 pgs: 129 active+clean; 172 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 871 op/s 2024-08-02T18:52:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:05 smithi121 ceph-mon[37236]: pgmap v73: 129 pgs: 129 active+clean; 172 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 871 op/s 2024-08-02T18:52:05.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:05 smithi151 ceph-mon[37155]: pgmap v73: 129 pgs: 129 active+clean; 172 MiB data, 833 MiB used, 1.0 TiB / 1.0 TiB avail; 2.7 MiB/s rd, 3.6 MiB/s wr, 871 op/s 2024-08-02T18:52:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 -- 172.21.15.103:0/1656939243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01066f0 msgr2=0x7f5ab0106ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/1656939243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01066f0 0x7f5ab0106ad0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f5aac009930 tx=0x7f5aac02a420 comp rx=0 tx=0).stop 2024-08-02T18:52:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 -- 172.21.15.103:0/1656939243 shutdown_connections 2024-08-02T18:52:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/1656939243 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ab0101080 0x7f5ab010d5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/1656939243 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ab01006e0 0x7f5ab0100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/1656939243 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01066f0 0x7f5ab0106ad0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 -- 172.21.15.103:0/1656939243 >> 172.21.15.103:0/1656939243 conn(0x7f5ab00776c0 msgr2=0x7f5ab00fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:06.000 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 -- 172.21.15.103:0/1656939243 shutdown_connections 2024-08-02T18:52:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 -- 172.21.15.103:0/1656939243 wait complete. 2024-08-02T18:52:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 Processor -- start 2024-08-02T18:52:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.995+0000 7f5ab7f72640 1 -- start start 2024-08-02T18:52:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab7f72640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01006e0 0x7f5ab01970b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab7f72640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ab0101080 0x7f5ab01975f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab7f72640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ab01066f0 0x7f5ab019b970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab7f72640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0110ca0 con 0x7f5ab01006e0 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab7f72640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0110b20 con 0x7f5ab01066f0 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab7f72640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab0110e20 con 0x7f5ab0101080 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01006e0 0x7f5ab01970b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01006e0 0x7f5ab01970b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34032/0 (socket says 172.21.15.103:34032) 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 -- 172.21.15.103:0/66523720 learned_addr learned my addr 172.21.15.103:0/66523720 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab650f640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ab01066f0 0x7f5ab019b970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab550d640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ab0101080 0x7f5ab01975f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 -- 172.21.15.103:0/66523720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ab0101080 msgr2=0x7f5ab01975f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ab0101080 0x7f5ab01975f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 -- 172.21.15.103:0/66523720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ab01066f0 msgr2=0x7f5ab019b970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ab01066f0 0x7f5ab019b970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 -- 172.21.15.103:0/66523720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5ab019c0a0 con 0x7f5ab01006e0 2024-08-02T18:52:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab550d640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ab0101080 0x7f5ab01975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:52:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01006e0 0x7f5ab01970b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5aac02a940 tx=0x7f5aac0329c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5aa6ffd640 1 -- 172.21.15.103:0/66523720 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac03f030 con 0x7f5ab01006e0 2024-08-02T18:52:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5aa6ffd640 1 -- 172.21.15.103:0/66523720 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aac032df0 con 0x7f5ab01006e0 2024-08-02T18:52:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab7f72640 1 -- 172.21.15.103:0/66523720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5ab019c330 con 0x7f5ab01006e0 2024-08-02T18:52:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5aa6ffd640 1 -- 172.21.15.103:0/66523720 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aac035070 con 0x7f5ab01006e0 2024-08-02T18:52:06.003 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.996+0000 7f5ab7f72640 1 -- 172.21.15.103:0/66523720 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5ab01a3c20 con 0x7f5ab01006e0 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.999+0000 7f5aa6ffd640 1 -- 172.21.15.103:0/66523720 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f5aac042030 con 0x7f5ab01006e0 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:05.999+0000 7f5abada6740 1 Processor -- start 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5abada6740 1 -- start start 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5abada6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b4766d0 0x558f3b476ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5abada6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b483640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5abada6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b485f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5abada6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558f3b3da9b0 con 0x558f3b4766d0 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5abada6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558f3b382800 con 0x558f3b483b80 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5abada6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558f3b3d6970 con 0x558f3b476ff0 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b4766d0 0x558f3b476ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.010 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b4766d0 0x558f3b476ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34042/0 (socket says 172.21.15.103:34042) 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 -- 172.21.15.103:0/1401676539 learned_addr learned my addr 172.21.15.103:0/1401676539 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab550d640 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b485f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b483640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5aa6ffd640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5a9c0a2da0 0x7f5a9c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 -- 172.21.15.103:0/1401676539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 msgr2=0x558f3b483640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b483640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 -- 172.21.15.103:0/1401676539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 msgr2=0x558f3b485f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b485f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 -- 172.21.15.103:0/1401676539 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f3b0ee210 con 0x558f3b4766d0 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab550d640 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b485f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b483640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:52:06.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5aa6ffd640 1 -- 172.21.15.103:0/66523720 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f5aac0efb20 con 0x7f5ab01006e0 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.000+0000 7f5ab650f640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5a9c0a2da0 0x7f5a9c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.001+0000 7f5ab650f640 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b4766d0 0x558f3b476ab0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800a5d0 tx=0x7f5aa800aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cfdb3e7146791f0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.001+0000 7f5a9bfff640 1 -- 172.21.15.103:0/1401676539 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa801a040 con 0x558f3b4766d0 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.001+0000 7f5a9bfff640 1 -- 172.21.15.103:0/1401676539 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aa8021ba0 con 0x558f3b4766d0 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.001+0000 7f5a9bfff640 1 -- 172.21.15.103:0/1401676539 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa801f350 con 0x558f3b4766d0 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.001+0000 7f5abada6740 1 -- 172.21.15.103:0/1401676539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b4766d0 msgr2=0x558f3b476ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.001+0000 7f5abada6740 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b4766d0 0x558f3b476ab0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800a5d0 tx=0x7f5aa800aa90 comp rx=0 tx=0).stop 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.001+0000 7f5ab650f640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5a9c0a2da0 0x7f5a9c0a5260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8020000 tx=0x7f5aa8021000 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 -- 172.21.15.103:0/1401676539 shutdown_connections 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b485f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b483640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 --2- 172.21.15.103:0/1401676539 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b4766d0 0x558f3b476ab0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 -- 172.21.15.103:0/1401676539 >> 172.21.15.103:0/1401676539 conn(0x558f3b472d20 msgr2=0x558f3b473100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 -- 172.21.15.103:0/1401676539 shutdown_connections 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 -- 172.21.15.103:0/1401676539 wait complete. 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 -- start start 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 Processor -- start 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b480a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b480fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b481510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x558f3b486750 con 0x558f3b483b80 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x558f3b396500 con 0x558f3b4766d0 2024-08-02T18:52:06.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.002+0000 7f5abada6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x558f3b4868d0 con 0x558f3b476ff0 2024-08-02T18:52:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5abada6740 10 client.0 _ll_register_callbacks cb 0x558f3b0eda00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab5d0e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b480a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b481510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b481510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34044/0 (socket says 172.21.15.103:34044) 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab5d0e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b480a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:54252/0 (socket says 172.21.15.103:54252) 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab550d640 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b480fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 -- 172.21.15.103:0/2761319405 learned_addr learned my addr 172.21.15.103:0/2761319405 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 -- 172.21.15.103:0/2761319405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 msgr2=0x558f3b480fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b480fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 -- 172.21.15.103:0/2761319405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 msgr2=0x558f3b480a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b480a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 -- 172.21.15.103:0/2761319405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f3b1ba620 con 0x558f3b483b80 2024-08-02T18:52:06.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5ab650f640 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b481510 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800af90 tx=0x7f5aa8016570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a14e91b5d8e943 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5a997fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5a997fa640 1 -- 172.21.15.103:0/2761319405 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa802d070 con 0x558f3b483b80 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5a997fa640 1 -- 172.21.15.103:0/2761319405 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f5aa8020d70 con 0x558f3b483b80 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5abada6740 1 -- 172.21.15.103:0/2761319405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aa8021ba0 con 0x558f3b483b80 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5a997fa640 1 -- 172.21.15.103:0/2761319405 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5aa8039050 con 0x558f3b483b80 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5abada6740 10 client.16131 fetch_fsmap learned FSMap version 31 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.003+0000 7f5abada6740 1 -- 172.21.15.103:0/2761319405 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558f3b492400 con 0x558f3b483b80 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5a997fa640 1 -- 172.21.15.103:0/2761319405 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aa8021ba0 con 0x558f3b483b80 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5a997fa640 1 -- 172.21.15.103:0/2761319405 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5aa8028040 con 0x558f3b483b80 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5abada6740 10 client.16131 fetch_fsmap finished waiting for FSMap version 31 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5abada6740 10 client.16131 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:52:06.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5abada6740 20 client.16131 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5abada6740 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x558f3b493810 0x558f3b495c00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5abada6740 4 client.16131 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5abada6740 1 -- 172.21.15.103:0/2761319405 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558f3b3e80e0 con 0x558f3b493810 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x558f3b493810 0x558f3b495c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5a997fa640 10 client.16131 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.004+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x558f3b493810 0x558f3b495c00 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ab6f56c58798e2a1 server_cookie=96ffa8acf939af70 in_seq=0 out_seq=0 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5a997fa640 1 -- 172.21.15.103:0/2761319405 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x558f3b3e80e0 con 0x558f3b493810 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5a997fa640 10 client.16131 handle_command_reply: tid=0 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 client.16131 shutdown 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 -- 172.21.15.103:0/2761319405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 msgr2=0x558f3b481510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b481510 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f5aa800af90 tx=0x7f5aa8016570 comp rx=0 tx=0).stop 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 -- 172.21.15.103:0/2761319405 shutdown_connections 2024-08-02T18:52:06.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x558f3b493810 0x558f3b495c00 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b481510 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b480fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5a997fa640 0 client.16131 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 --2- 172.21.15.103:0/2761319405 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b480a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 -- 172.21.15.103:0/2761319405 >> 172.21.15.103:0/2761319405 conn(0x558f3b472d20 msgr2=0x558f3b4789e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 -- 172.21.15.103:0/2761319405 shutdown_connections 2024-08-02T18:52:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 1 -- 172.21.15.103:0/2761319405 wait complete. 2024-08-02T18:52:06.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.006+0000 7f5abada6740 20 client.16131 trim_cache size 0 max 16384 2024-08-02T18:52:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.021+0000 7f5abada6740 1 Processor -- start 2024-08-02T18:52:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.021+0000 7f5abada6740 1 -- start start 2024-08-02T18:52:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5abada6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b4766d0 0x558f3b46d900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.027 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5abada6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b476ff0 0x558f3b481340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5abada6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b49b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5abada6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01af310 con 0x558f3b476ff0 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5abada6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01acb80 con 0x558f3b483b80 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5abada6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01aa9d0 con 0x558f3b4766d0 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b476ff0 0x558f3b481340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b476ff0 0x558f3b481340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34052/0 (socket says 172.21.15.103:34052) 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 -- 172.21.15.103:0/878718516 learned_addr learned my addr 172.21.15.103:0/878718516 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab650f640 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b49b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b4766d0 0x558f3b46d900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 -- 172.21.15.103:0/878718516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b4766d0 msgr2=0x558f3b46d900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b4766d0 0x558f3b46d900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 -- 172.21.15.103:0/878718516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 msgr2=0x558f3b49b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:06.028 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b49b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 -- 172.21.15.103:0/878718516 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558f3b47fa20 con 0x558f3b476ff0 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5ab550d640 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b476ff0 0x558f3b481340 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009c30 tx=0x7f5aa0013830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=768415e05961f635 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5a9b7fe640 1 -- 172.21.15.103:0/878718516 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa0009d20 con 0x558f3b476ff0 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5a9b7fe640 1 -- 172.21.15.103:0/878718516 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aa00035f0 con 0x558f3b476ff0 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.022+0000 7f5a9b7fe640 1 -- 172.21.15.103:0/878718516 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa001c640 con 0x558f3b476ff0 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 -- 172.21.15.103:0/878718516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b476ff0 msgr2=0x558f3b481340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b476ff0 0x558f3b481340 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f5aa0009c30 tx=0x7f5aa0013830 comp rx=0 tx=0).stop 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 -- 172.21.15.103:0/878718516 shutdown_connections 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b483b80 0x558f3b49b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b476ff0 0x558f3b481340 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 --2- 172.21.15.103:0/878718516 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b4766d0 0x558f3b46d900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 -- 172.21.15.103:0/878718516 >> 172.21.15.103:0/878718516 conn(0x558f3b472d20 msgr2=0x558f3b482a00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:06.029 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 -- 172.21.15.103:0/878718516 shutdown_connections 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 -- 172.21.15.103:0/878718516 wait complete. 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 -- start start 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.023+0000 7f5abada6740 1 Processor -- start 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5abada6740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b48c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5abada6740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b487670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5abada6740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b487bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5abada6740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01ab040 con 0x558f3b483b80 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5abada6740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01ac4b0 con 0x558f3b4766d0 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5abada6740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f5ab01ab710 con 0x558f3b476ff0 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5abada6740 10 client.0 _ll_register_callbacks cb 0x7f5aa00095f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b487bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.030 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab5d0e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b48c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b487bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:34054/0 (socket says 172.21.15.103:34054) 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 -- 172.21.15.103:0/3388841450 learned_addr learned my addr 172.21.15.103:0/3388841450 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab550d640 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b487670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 -- 172.21.15.103:0/3388841450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 msgr2=0x558f3b487670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b487670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 -- 172.21.15.103:0/3388841450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 msgr2=0x558f3b48c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b48c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 -- 172.21.15.103:0/3388841450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558f3b488400 con 0x558f3b483b80 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b48c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5ab650f640 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b487bd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009690 tx=0x7f5aa800a470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9a4d6b163859f03 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5a997fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:06.031 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.024+0000 7f5a997fa640 1 -- 172.21.15.103:0/3388841450 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5aa802d040 con 0x558f3b483b80 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5a997fa640 1 -- 172.21.15.103:0/3388841450 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f5aa8021a20 con 0x558f3b483b80 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 1 -- 172.21.15.103:0/3388841450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5aa00035f0 con 0x558f3b483b80 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5a997fa640 1 -- 172.21.15.103:0/3388841450 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=31) ==== 24+0+0 (secure 0 0 0) 0x7f5aa801a050 con 0x558f3b483b80 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 10 client.16137 fetch_fsmap learned FSMap version 31 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 1 -- 172.21.15.103:0/3388841450 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=31,monmap=4+}) -- 0x558f3b4fe500 con 0x558f3b483b80 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5a997fa640 1 -- 172.21.15.103:0/3388841450 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f5aa00035f0 con 0x558f3b483b80 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5a997fa640 1 -- 172.21.15.103:0/3388841450 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 31) ==== 8370+0+0 (secure 0 0 0) 0x7f5aa8028040 con 0x558f3b483b80 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 10 client.16137 fetch_fsmap finished waiting for FSMap version 31 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 10 client.16137 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 20 client.16137 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x558f3b4febe0 0x558f3b501000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 4 client.16137 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5abada6740 1 -- 172.21.15.103:0/3388841450 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x558f3b3e2430 con 0x558f3b4febe0 2024-08-02T18:52:06.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.025+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x558f3b4febe0 0x558f3b501000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.026+0000 7f5a997fa640 10 client.16137 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:06.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.026+0000 7f5ab5d0e640 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x558f3b4febe0 0x558f3b501000 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b725eda059929af3 server_cookie=fc507f84a089c065 in_seq=0 out_seq=0 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.889+0000 7f5a997fa640 1 -- 172.21.15.103:0/3388841450 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x558f3b3e2430 con 0x558f3b4febe0 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.889+0000 7f5a997fa640 10 client.16137 handle_command_reply: tid=0 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.889+0000 7f5abada6740 1 client.16137 shutdown 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 -- 172.21.15.103:0/3388841450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 msgr2=0x558f3b487bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b487bd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8009690 tx=0x7f5aa800a470 comp rx=0 tx=0).stop 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 -- 172.21.15.103:0/3388841450 shutdown_connections 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x558f3b4febe0 0x558f3b501000 crc :-1 s=READY pgs=93 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x558f3b483b80 0x558f3b487bd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5a997fa640 0 client.16137 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:06.892 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x558f3b476ff0 0x558f3b487670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 --2- 172.21.15.103:0/3388841450 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x558f3b4766d0 0x558f3b48c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 -- 172.21.15.103:0/3388841450 >> 172.21.15.103:0/3388841450 conn(0x558f3b472d20 msgr2=0x558f3b48ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 -- 172.21.15.103:0/3388841450 shutdown_connections 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 1 -- 172.21.15.103:0/3388841450 wait complete. 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.890+0000 7f5abada6740 20 client.16137 trim_cache size 0 max 16384 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:52:06.893 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:52:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 -- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5a9c0a2da0 msgr2=0x7f5a9c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5a9c0a2da0 0x7f5a9c0a5260 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5aa8020000 tx=0x7f5aa8021000 comp rx=0 tx=0).stop 2024-08-02T18:52:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 -- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01006e0 msgr2=0x7f5ab01970b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01006e0 0x7f5ab01970b0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f5aac02a940 tx=0x7f5aac0329c0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 -- 172.21.15.103:0/66523720 shutdown_connections 2024-08-02T18:52:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f5a9c0a2da0 0x7f5a9c0a5260 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.894 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f5ab01066f0 0x7f5ab019b970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f5ab0101080 0x7f5ab01975f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 --2- 172.21.15.103:0/66523720 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f5ab01006e0 0x7f5ab01970b0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 -- 172.21.15.103:0/66523720 >> 172.21.15.103:0/66523720 conn(0x7f5ab00776c0 msgr2=0x7f5ab00febf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 -- 172.21.15.103:0/66523720 shutdown_connections 2024-08-02T18:52:06.895 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:06.891+0000 7f5ab7f72640 1 -- 172.21.15.103:0/66523720 wait complete. 2024-08-02T18:52:07.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:07 smithi103 ceph-mon[32753]: pgmap v74: 129 pgs: 129 active+clean; 174 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 1.11k op/s 2024-08-02T18:52:07.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:07 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:07.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:07 smithi121 ceph-mon[37236]: pgmap v74: 129 pgs: 129 active+clean; 174 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 1.11k op/s 2024-08-02T18:52:07.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:07 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:07.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:07 smithi151 ceph-mon[37155]: pgmap v74: 129 pgs: 129 active+clean; 174 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 3.5 MiB/s rd, 4.5 MiB/s wr, 1.11k op/s 2024-08-02T18:52:07.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:07 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:08.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:08 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:08.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:08 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:08.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:08 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:52:09.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.464+0000 7fdd14bf6640 1 -- 172.21.15.103:0/1525413202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 msgr2=0x7fdd1006e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.466 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.464+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/1525413202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 0x7fdd1006e220 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fdcf8009900 tx=0x7fdcf802a400 comp rx=0 tx=0).stop 2024-08-02T18:52:09.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.467+0000 7fdd14bf6640 1 -- 172.21.15.103:0/1525413202 shutdown_connections 2024-08-02T18:52:09.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.467+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/1525413202 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1011ae70 0x7fdd1011d260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.467+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/1525413202 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd1006e760 0x7fdd1006ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.467+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/1525413202 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 0x7fdd1006e220 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.469 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.467+0000 7fdd14bf6640 1 -- 172.21.15.103:0/1525413202 >> 172.21.15.103:0/1525413202 conn(0x7fdd10072f40 msgr2=0x7fdd10073350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:09.474 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.472+0000 7fdd14bf6640 1 -- 172.21.15.103:0/1525413202 shutdown_connections 2024-08-02T18:52:09.475 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.473+0000 7fdd14bf6640 1 -- 172.21.15.103:0/1525413202 wait complete. 2024-08-02T18:52:09.476 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.474+0000 7fdd14bf6640 1 Processor -- start 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.476+0000 7fdd14bf6640 1 -- start start 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.476+0000 7fdd14bf6640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd1006e760 0x7fdd101a6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.477+0000 7fdd14bf6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 0x7fdd101a7480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.477+0000 7fdd14bf6640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1011ae70 0x7fdd101ab810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.477+0000 7fdd0e59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd1006e760 0x7fdd101a6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.477+0000 7fdd0e59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd1006e760 0x7fdd101a6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:53716/0 (socket says 172.21.15.103:53716) 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.477+0000 7fdd0e59c640 1 -- 172.21.15.103:0/2624572872 learned_addr learned my addr 172.21.15.103:0/2624572872 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.477+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd10120bb0 con 0x7fdd1010ff50 2024-08-02T18:52:09.479 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.477+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd10120a30 con 0x7fdd1011ae70 2024-08-02T18:52:09.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.477+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdd10120d30 con 0x7fdd1006e760 2024-08-02T18:52:09.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.478+0000 7fdd0ed9d640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1011ae70 0x7fdd101ab810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.480 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.478+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 0x7fdd101a7480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.479+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2624572872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd1006e760 msgr2=0x7fdd101a6f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.479+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd1006e760 0x7fdd101a6f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.479+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2624572872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1011ae70 msgr2=0x7fdd101ab810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.479+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1011ae70 0x7fdd101ab810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.481 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.479+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2624572872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdd101abef0 con 0x7fdd1010ff50 2024-08-02T18:52:09.483 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.481+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 0x7fdd101a7480 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000bd70 tx=0x7fdd0000be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.482+0000 7fdd077fe640 1 -- 172.21.15.103:0/2624572872 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd00019070 con 0x7fdd1010ff50 2024-08-02T18:52:09.484 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.482+0000 7fdd077fe640 1 -- 172.21.15.103:0/2624572872 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd00014940 con 0x7fdd1010ff50 2024-08-02T18:52:09.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.483+0000 7fdd077fe640 1 -- 172.21.15.103:0/2624572872 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd000129e0 con 0x7fdd1010ff50 2024-08-02T18:52:09.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.485+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdd101ac1e0 con 0x7fdd1010ff50 2024-08-02T18:52:09.486 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.485+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdd101b3ac0 con 0x7fdd1010ff50 2024-08-02T18:52:09.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.489+0000 7fdd077fe640 1 -- 172.21.15.103:0/2624572872 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fdd00012b80 con 0x7fdd1010ff50 2024-08-02T18:52:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.497+0000 7fdd077fe640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdcfc0a2c20 0x7fdcfc0a50e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.498+0000 7fdd077fe640 1 -- 172.21.15.103:0/2624572872 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fdd000cee10 con 0x7fdd1010ff50 2024-08-02T18:52:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.499+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdcfc0a2c20 0x7fdcfc0a50e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.500 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.499+0000 7fdd16ff4740 1 Processor -- start 2024-08-02T18:52:09.501 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd16ff4740 1 -- start start 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 0x555f7d28d750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28dc90 0x555f7d298010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d298550 0x555f7d29a940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555f7d1f2980 con 0x555f7d298550 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555f7d18aa70 con 0x555f7d28dc90 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555f7d1ee940 con 0x555f7d28d370 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd0dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28dc90 0x555f7d298010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd0dd9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28dc90 0x555f7d298010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:44032/0 (socket says 172.21.15.103:44032) 2024-08-02T18:52:09.502 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.500+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/3673312117 learned_addr learned my addr 172.21.15.103:0/3673312117 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:09.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.501+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 0x555f7d28d750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.501+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdcfc0a2c20 0x7fdcfc0a50e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80096c0 tx=0x7fdcf802a900 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:09.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.501+0000 7fdd0ed9d640 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d298550 0x555f7d29a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.501+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/3673312117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 msgr2=0x555f7d28d750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:09.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.501+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 0x555f7d28d750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.501+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/3673312117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d298550 msgr2=0x555f7d29a940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:09.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.502+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d298550 0x555f7d29a940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.503 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.502+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/3673312117 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f7d1ed6e0 con 0x555f7d28dc90 2024-08-02T18:52:09.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.503+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28dc90 0x555f7d298010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd00097610 tx=0x7fdd00004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=78e5c15184585a50 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:09.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.508+0000 7fdd04ff9640 1 -- 172.21.15.103:0/3673312117 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0009f4b0 con 0x555f7d28dc90 2024-08-02T18:52:09.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.508+0000 7fdd04ff9640 1 -- 172.21.15.103:0/3673312117 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd000a3d70 con 0x555f7d28dc90 2024-08-02T18:52:09.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.509+0000 7fdd16ff4740 1 -- 172.21.15.103:0/3673312117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28dc90 msgr2=0x555f7d298010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.509+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28dc90 0x555f7d298010 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7fdd00097610 tx=0x7fdd00004a40 comp rx=0 tx=0).stop 2024-08-02T18:52:09.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.510+0000 7fdd16ff4740 1 -- 172.21.15.103:0/3673312117 shutdown_connections 2024-08-02T18:52:09.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.510+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d298550 0x555f7d29a940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.510+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28dc90 0x555f7d298010 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.510+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/3673312117 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 0x555f7d28d750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.510+0000 7fdd16ff4740 1 -- 172.21.15.103:0/3673312117 >> 172.21.15.103:0/3673312117 conn(0x555f7d289900 msgr2=0x555f7d289ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:09.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.512+0000 7fdd16ff4740 1 -- 172.21.15.103:0/3673312117 shutdown_connections 2024-08-02T18:52:09.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.512+0000 7fdd16ff4740 1 -- 172.21.15.103:0/3673312117 wait complete. 2024-08-02T18:52:09.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.513+0000 7fdd16ff4740 1 -- start start 2024-08-02T18:52:09.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.513+0000 7fdd16ff4740 1 Processor -- start 2024-08-02T18:52:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.513+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 0x555f7d2954b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d2959f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.515 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 0x555f7d295f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555f7d29b170 con 0x555f7d28dc90 2024-08-02T18:52:09.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x555f7d1adaa0 con 0x555f7d298550 2024-08-02T18:52:09.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555f7d29b2f0 con 0x555f7d28d370 2024-08-02T18:52:09.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 0x555f7d295f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd0e59c640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 0x555f7d2954b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd16ff4740 10 client.0 _ll_register_callbacks cb 0x555f7d19ce60 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:09.517 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd0dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d2959f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd0ed9d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 0x555f7d295f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:44042/0 (socket says 172.21.15.103:44042) 2024-08-02T18:52:09.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.514+0000 7fdd0ed9d640 1 -- 172.21.15.103:0/2909034525 learned_addr learned my addr 172.21.15.103:0/2909034525 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:09.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.515+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2909034525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 msgr2=0x555f7d2954b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:09.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.515+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 0x555f7d2954b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.515+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2909034525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 msgr2=0x555f7d295f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:09.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.515+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 0x555f7d295f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.518 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.515+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2909034525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f7d191650 con 0x555f7d28dc90 2024-08-02T18:52:09.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.516+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d2959f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdd00097610 tx=0x7fdd00012340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8af0fa6bf9d00148 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:09.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.517+0000 7fdcf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:09.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.517+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2909034525 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0009f4b0 con 0x555f7d28dc90 2024-08-02T18:52:09.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.517+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2909034525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fdd000a3d70 con 0x555f7d28dc90 2024-08-02T18:52:09.519 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.517+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2909034525 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fdd000994b0 con 0x555f7d28dc90 2024-08-02T18:52:09.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.518+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2909034525 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdd00097990 con 0x555f7d28dc90 2024-08-02T18:52:09.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.518+0000 7fdd16ff4740 10 client.16149 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:09.520 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.518+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2909034525 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555f7cf643c0 con 0x555f7d28dc90 2024-08-02T18:52:09.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.519+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2909034525 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd000a3d70 con 0x555f7d28dc90 2024-08-02T18:52:09.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.519+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2909034525 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fdd00096f00 con 0x555f7d28dc90 2024-08-02T18:52:09.521 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.519+0000 7fdd16ff4740 10 client.16149 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:09.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.519+0000 7fdd16ff4740 10 client.16149 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:52:09.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.519+0000 7fdd16ff4740 20 client.16149 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:09.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.520+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x555f7d2a7fc0 0x555f7d2aa3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.520+0000 7fdd16ff4740 4 client.16149 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:52:09.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.520+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2909034525 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555f7d1ffef0 con 0x555f7d2a7fc0 2024-08-02T18:52:09.522 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.520+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x555f7d2a7fc0 0x555f7d2aa3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.522+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x555f7d2a7fc0 0x555f7d2aa3b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6432cd12f5a1af84 server_cookie=d09519d79756253c in_seq=0 out_seq=0 2024-08-02T18:52:09.524 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.523+0000 7fdcf5ffb640 10 client.16149 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:09.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.529+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2909034525 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555f7d1ffef0 con 0x555f7d2a7fc0 2024-08-02T18:52:09.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.529+0000 7fdcf5ffb640 10 client.16149 handle_command_reply: tid=0 2024-08-02T18:52:09.530 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.529+0000 7fdd16ff4740 1 client.16149 shutdown 2024-08-02T18:52:09.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.530+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2909034525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 msgr2=0x555f7d2959f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.532 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.530+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d2959f0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fdd00097610 tx=0x7fdd00012340 comp rx=0 tx=0).stop 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2909034525 shutdown_connections 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x555f7d2a7fc0 0x555f7d2aa3b0 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 0x555f7d295f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d2959f0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2909034525 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28d370 0x555f7d2954b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2909034525 >> 172.21.15.103:0/2909034525 conn(0x555f7d289900 msgr2=0x555f7d28f5e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdcf5ffb640 0 client.16149 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2909034525 shutdown_connections 2024-08-02T18:52:09.534 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.532+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2909034525 wait complete. 2024-08-02T18:52:09.535 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.533+0000 7fdd16ff4740 20 client.16149 trim_cache size 0 max 16384 2024-08-02T18:52:09.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.568+0000 7fdd16ff4740 1 Processor -- start 2024-08-02T18:52:09.570 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:09 smithi103 ceph-mon[32753]: pgmap v75: 129 pgs: 129 active+clean; 174 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 403 op/s 2024-08-02T18:52:09.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.569+0000 7fdd16ff4740 1 -- start start 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.569+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28d370 0x555f7d2af950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28dc90 0x555f7d2afe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 0x555f7d292710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd0dd9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28dc90 0x555f7d2afe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd0dd9b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28dc90 0x555f7d2afe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:53742/0 (socket says 172.21.15.103:53742) 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2111077842 learned_addr learned my addr 172.21.15.103:0/2111077842 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/2111077842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28d370 0x555f7d2af950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2111077842 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd101c01b0 con 0x555f7d28d370 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2111077842 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd101bd9c0 con 0x555f7d298550 2024-08-02T18:52:09.572 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.570+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2111077842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdd101bb810 con 0x555f7d28dc90 2024-08-02T18:52:09.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.571+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2111077842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 msgr2=0x555f7d292710 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-02T18:52:09.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.571+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2111077842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 0x555f7d292710 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.571+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2111077842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28d370 msgr2=0x555f7d2af950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:09.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.571+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2111077842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28d370 0x555f7d2af950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.571+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2111077842 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555f7d28dac0 con 0x555f7d28dc90 2024-08-02T18:52:09.573 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.572+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2111077842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28dc90 0x555f7d2afe90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000cf60 tx=0x7fdd00004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f08fc1a499a8eff1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:09.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.576+0000 7fdcf7fff640 1 -- 172.21.15.103:0/2111077842 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd000a3d70 con 0x555f7d28dc90 2024-08-02T18:52:09.577 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.576+0000 7fdcf7fff640 1 -- 172.21.15.103:0/2111077842 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdd0009f4b0 con 0x555f7d28dc90 2024-08-02T18:52:09.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.577+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2111077842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28dc90 msgr2=0x555f7d2afe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.577+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2111077842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28dc90 0x555f7d2afe90 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000cf60 tx=0x7fdd00004a40 comp rx=0 tx=0).stop 2024-08-02T18:52:09.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.577+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2111077842 shutdown_connections 2024-08-02T18:52:09.578 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.577+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2111077842 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d298550 0x555f7d292710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.577+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2111077842 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d28dc90 0x555f7d2afe90 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.577+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2111077842 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28d370 0x555f7d2af950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.577+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2111077842 >> 172.21.15.103:0/2111077842 conn(0x555f7d289900 msgr2=0x555f7d293d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.577+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2111077842 shutdown_connections 2024-08-02T18:52:09.579 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.578+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2111077842 wait complete. 2024-08-02T18:52:09.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.578+0000 7fdd16ff4740 1 -- start start 2024-08-02T18:52:09.580 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.578+0000 7fdd16ff4740 1 Processor -- start 2024-08-02T18:52:09.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28d370 0x555f7d29b550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d29ba90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd16ff4740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d298550 0x555f7d29bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdd101bbe80 con 0x555f7d28dc90 2024-08-02T18:52:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdd101bd2f0 con 0x555f7d28d370 2024-08-02T18:52:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd16ff4740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdd101bc550 con 0x555f7d298550 2024-08-02T18:52:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd16ff4740 10 client.0 _ll_register_callbacks cb 0x7fdcf8040070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd0dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d29ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd0dd9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d29ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56688/0 (socket says 172.21.15.103:56688) 2024-08-02T18:52:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.579+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2613854727 learned_addr learned my addr 172.21.15.103:0/2613854727 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.580+0000 7fdd0ed9d640 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d298550 0x555f7d29bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.582 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.580+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28d370 0x555f7d29b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.580+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2613854727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d298550 msgr2=0x555f7d29bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.580+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d298550 0x555f7d29bfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.580+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2613854727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28d370 msgr2=0x555f7d29b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.580+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28d370 0x555f7d29b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.580+0000 7fdd0dd9b640 1 -- 172.21.15.103:0/2613854727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555f7d3219d0 con 0x555f7d28dc90 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.581+0000 7fdd0dd9b640 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d29ba90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdd0009aeb0 tx=0x7fdd00004b50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1e26511c52c30dc server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.581+0000 7fdcf5ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.582+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2613854727 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdd0009a930 con 0x555f7d28dc90 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.582+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2613854727 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fdd000994b0 con 0x555f7d28dc90 2024-08-02T18:52:09.584 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.582+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2613854727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555f7d1fa400 con 0x555f7d28dc90 2024-08-02T18:52:09.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.583+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2613854727 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fdd000a3d70 con 0x555f7d28dc90 2024-08-02T18:52:09.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.584+0000 7fdd16ff4740 10 client.16155 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:09.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.584+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2613854727 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555f7d3219d0 con 0x555f7d28dc90 2024-08-02T18:52:09.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.585+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2613854727 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x555f7d1fa400 con 0x555f7d28dc90 2024-08-02T18:52:09.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.585+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2613854727 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fdd000840f0 con 0x555f7d28dc90 2024-08-02T18:52:09.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.585+0000 7fdd16ff4740 10 client.16155 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:09.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.585+0000 7fdd16ff4740 10 client.16155 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:52:09.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.585+0000 7fdd16ff4740 20 client.16155 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:09.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.585+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x555f7d322fb0 0x555f7d3253d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:09.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.585+0000 7fdd16ff4740 4 client.16155 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "scrub status"}] 2024-08-02T18:52:09.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.585+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2613854727 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "scrub status"}) -- 0x555f7d177210 con 0x555f7d322fb0 2024-08-02T18:52:09.587 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.586+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x555f7d322fb0 0x555f7d3253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:09.592 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.591+0000 7fdcf5ffb640 10 client.16155 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:09.593 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.591+0000 7fdd0e59c640 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x555f7d322fb0 0x555f7d3253d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=88c602495c6a5bf0 server_cookie=85fdb41f8e848497 in_seq=0 out_seq=0 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.593+0000 7fdcf5ffb640 1 -- 172.21.15.103:0/2613854727 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+63 (crc 0 0 0) 0x555f7d177210 con 0x555f7d322fb0 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.593+0000 7fdcf5ffb640 10 client.16155 handle_command_reply: tid=0 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.593+0000 7fdd16ff4740 1 client.16155 shutdown 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.593+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2613854727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 msgr2=0x555f7d29ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.593+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d29ba90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fdd0009aeb0 tx=0x7fdd00004b50 comp rx=0 tx=0).stop 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2613854727 shutdown_connections 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x555f7d322fb0 0x555f7d3253d0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555f7d298550 0x555f7d29bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555f7d28dc90 0x555f7d29ba90 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.596 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 1 --2- 172.21.15.103:0/2613854727 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555f7d28d370 0x555f7d29b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2613854727 >> 172.21.15.103:0/2613854727 conn(0x555f7d289900 msgr2=0x555f7d28edc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdcf5ffb640 0 client.16155 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2613854727 shutdown_connections 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 1 -- 172.21.15.103:0/2613854727 wait complete. 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.594+0000 7fdd16ff4740 20 client.16155 trim_cache size 0 max 16384 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stdout: "status": "no active scrubs running", 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stdout: "scrubs": {} 2024-08-02T18:52:09.597 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:52:09.598 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.595+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdcfc0a2c20 msgr2=0x7fdcfc0a50e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.595+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdcfc0a2c20 0x7fdcfc0a50e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdcf80096c0 tx=0x7fdcf802a900 comp rx=0 tx=0).stop 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.595+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 msgr2=0x7fdd101a7480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.595+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 0x7fdd101a7480 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7fdd0000bd70 tx=0x7fdd0000be60 comp rx=0 tx=0).stop 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.596+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 shutdown_connections 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.596+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fdcfc0a2c20 0x7fdcfc0a50e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.596+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdd1011ae70 0x7fdd101ab810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.596+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdd1010ff50 0x7fdd101a7480 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.596+0000 7fdd14bf6640 1 --2- 172.21.15.103:0/2624572872 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdd1006e760 0x7fdd101a6f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.596+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 >> 172.21.15.103:0/2624572872 conn(0x7fdd10072f40 msgr2=0x7fdd10118e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.596+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 shutdown_connections 2024-08-02T18:52:09.599 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:09.596+0000 7fdd14bf6640 1 -- 172.21.15.103:0/2624572872 wait complete. 2024-08-02T18:52:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:09 smithi121 ceph-mon[37236]: pgmap v75: 129 pgs: 129 active+clean; 174 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 403 op/s 2024-08-02T18:52:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:09 smithi151 ceph-mon[37155]: pgmap v75: 129 pgs: 129 active+clean; 174 MiB data, 949 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 403 op/s 2024-08-02T18:52:10.411 INFO:tasks.cephfs.filesystem:all active scrubs completed 2024-08-02T18:52:10.411 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:52:10.709 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 -- 172.21.15.103:0/3208548584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8100b50 msgr2=0x7f85c8100f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/3208548584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8100b50 0x7f85c8100f30 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f85b8009900 tx=0x7f85b802a480 comp rx=0 tx=0).stop 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 -- 172.21.15.103:0/3208548584 shutdown_connections 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/3208548584 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85c8102c20 0x7f85c810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/3208548584 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85c81022a0 0x7f85c81026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/3208548584 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c8100b50 0x7f85c8100f30 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 -- 172.21.15.103:0/3208548584 >> 172.21.15.103:0/3208548584 conn(0x7f85c80fc500 msgr2=0x7f85c80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 -- 172.21.15.103:0/3208548584 shutdown_connections 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.183+0000 7f85cdbd4640 1 -- 172.21.15.103:0/3208548584 wait complete. 2024-08-02T18:52:11.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85cdbd4640 1 Processor -- start 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85cdbd4640 1 -- start start 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85cdbd4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85c8100b50 0x7f85c8197270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85cdbd4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c81022a0 0x7f85c81977b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85cdbd4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85c8102c20 0x7f85c819bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85cdbd4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8110e10 con 0x7f85c81022a0 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85cdbd4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8110c90 con 0x7f85c8102c20 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85cdbd4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f85c8110f90 con 0x7f85c8100b50 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c81022a0 0x7f85c81977b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c6ffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c81022a0 0x7f85c81977b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56712/0 (socket says 172.21.15.103:56712) 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c6ffd640 1 -- 172.21.15.103:0/448606800 learned_addr learned my addr 172.21.15.103:0/448606800 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:11.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c7fff640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85c8102c20 0x7f85c819bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c77fe640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85c8100b50 0x7f85c8197270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c6ffd640 1 -- 172.21.15.103:0/448606800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85c8100b50 msgr2=0x7f85c8197270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c6ffd640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85c8100b50 0x7f85c8197270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c6ffd640 1 -- 172.21.15.103:0/448606800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85c8102c20 msgr2=0x7f85c819bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c6ffd640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85c8102c20 0x7f85c819bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c6ffd640 1 -- 172.21.15.103:0/448606800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f85c819c220 con 0x7f85c81022a0 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c77fe640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85c8100b50 0x7f85c8197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.184+0000 7f85c7fff640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85c8102c20 0x7f85c819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.185+0000 7f85c6ffd640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c81022a0 0x7f85c81977b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00b4a0 tx=0x7f85bc00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.185+0000 7f85c4ff9640 1 -- 172.21.15.103:0/448606800 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc014070 con 0x7f85c81022a0 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.185+0000 7f85c4ff9640 1 -- 172.21.15.103:0/448606800 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85bc010b10 con 0x7f85c81022a0 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.185+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f85c819c510 con 0x7f85c81022a0 2024-08-02T18:52:11.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.185+0000 7f85c4ff9640 1 -- 172.21.15.103:0/448606800 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85bc017d60 con 0x7f85c81022a0 2024-08-02T18:52:11.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.185+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85c81a3df0 con 0x7f85c81022a0 2024-08-02T18:52:11.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.186+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f85c8100f30 con 0x7f85c81022a0 2024-08-02T18:52:11.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.187+0000 7f85c4ff9640 1 -- 172.21.15.103:0/448606800 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f85bc017070 con 0x7f85c81022a0 2024-08-02T18:52:11.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.188+0000 7f85c4ff9640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f85b00a2cf0 0x7f85b00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:11.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.188+0000 7f85c77fe640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f85b00a2cf0 0x7f85b00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:11.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.188+0000 7f85c4ff9640 1 -- 172.21.15.103:0/448606800 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f85bc0cea20 con 0x7f85c81022a0 2024-08-02T18:52:11.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.188+0000 7f85c77fe640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f85b00a2cf0 0x7f85b00a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f85b8005ab0 tx=0x7f85b8005a20 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:11.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.192+0000 7f85c4ff9640 1 -- 172.21.15.103:0/448606800 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f85bc09b410 con 0x7f85c81022a0 2024-08-02T18:52:11.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.401+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f85c81a3ff0 con 0x7f85c81022a0 2024-08-02T18:52:11.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.402+0000 7f85c4ff9640 1 -- 172.21.15.103:0/448606800 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11942 (secure 0 0 0) 0x7f85bc09ad10 con 0x7f85c81022a0 2024-08-02T18:52:11.404 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:52:11.404 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"btime":"2024-08-02T18:52:07:446419+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:52:06.765772+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":72,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":70,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T18:52:11.404 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 33 2024-08-02T18:52:11.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f85b00a2cf0 msgr2=0x7f85b00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:11.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f85b00a2cf0 0x7f85b00a51b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f85b8005ab0 tx=0x7f85b8005a20 comp rx=0 tx=0).stop 2024-08-02T18:52:11.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c81022a0 msgr2=0x7f85c81977b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:11.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c81022a0 0x7f85c81977b0 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f85bc00b4a0 tx=0x7f85bc00b960 comp rx=0 tx=0).stop 2024-08-02T18:52:11.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 shutdown_connections 2024-08-02T18:52:11.406 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f85b00a2cf0 0x7f85b00a51b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85c8102c20 0x7f85c819bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85c81022a0 0x7f85c81977b0 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 --2- 172.21.15.103:0/448606800 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f85c8100b50 0x7f85c8197270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:11.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 >> 172.21.15.103:0/448606800 conn(0x7f85c80fc500 msgr2=0x7f85c80fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:11.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 shutdown_connections 2024-08-02T18:52:11.407 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:11.405+0000 7f85cdbd4640 1 -- 172.21.15.103:0/448606800 wait complete. 2024-08-02T18:52:11.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:11 smithi121 ceph-mon[37236]: pgmap v76: 129 pgs: 129 active+clean; 175 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 491 op/s 2024-08-02T18:52:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:11 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/448606800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:52:11.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:11 smithi151 ceph-mon[37155]: pgmap v76: 129 pgs: 129 active+clean; 175 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 491 op/s 2024-08-02T18:52:11.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:11 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/448606800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:52:11.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:11 smithi103 ceph-mon[32753]: pgmap v76: 129 pgs: 129 active+clean; 175 MiB data, 978 MiB used, 1.0 TiB / 1.0 TiB avail; 1.8 MiB/s rd, 1.8 MiB/s wr, 491 op/s 2024-08-02T18:52:11.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:11 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/448606800' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:52:12.067 INFO:tasks.workunit.client.0.smithi103.stderr:+ sync 2024-08-02T18:52:12.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:2 damage ls 2024-08-02T18:52:12.557 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:52:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:13 smithi121 ceph-mon[37236]: pgmap v77: 129 pgs: 129 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 872 op/s 2024-08-02T18:52:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:13 smithi151 ceph-mon[37155]: pgmap v77: 129 pgs: 129 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 872 op/s 2024-08-02T18:52:13.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:13 smithi103 ceph-mon[32753]: pgmap v77: 129 pgs: 129 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 872 op/s 2024-08-02T18:52:14.184 INFO:tasks.workunit.client.0.smithi103.stderr:+ tar c linux-4.0.5 2024-08-02T18:52:14.441 INFO:tasks.workunit.client.0.smithi103.stdout:Ok 2024-08-02T18:52:14.442 INFO:tasks.workunit.client.0.smithi103.stderr:+ echo Ok 2024-08-02T18:52:14.442 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-08-02T18:52:14.442 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.471+0000 7f85478c2640 1 -- 172.21.15.103:0/4254564989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85401022a0 msgr2=0x7f85401026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.471+0000 7f85478c2640 1 --2- 172.21.15.103:0/4254564989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85401022a0 0x7f85401026e0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f8530009900 tx=0x7f853002a480 comp rx=0 tx=0).stop 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 -- 172.21.15.103:0/4254564989 shutdown_connections 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 --2- 172.21.15.103:0/4254564989 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540102c20 0x7f854010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 --2- 172.21.15.103:0/4254564989 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f85401022a0 0x7f85401026e0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 --2- 172.21.15.103:0/4254564989 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f8540100b50 0x7f8540100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 -- 172.21.15.103:0/4254564989 >> 172.21.15.103:0/4254564989 conn(0x7f85400fc500 msgr2=0x7f85400fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 -- 172.21.15.103:0/4254564989 shutdown_connections 2024-08-02T18:52:14.489 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 -- 172.21.15.103:0/4254564989 wait complete. 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 Processor -- start 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.472+0000 7f85478c2640 1 -- start start 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85478c2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540100b50 0x7f854019a510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85478c2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85401022a0 0x7f854019aa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85478c2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8540102c20 0x7f854019ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85478c2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f854010fcd0 con 0x7f8540102c20 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85478c2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f854010fb50 con 0x7f85401022a0 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85478c2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f854010fe50 con 0x7f8540100b50 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8540102c20 0x7f854019ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8540102c20 0x7f854019ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56720/0 (socket says 172.21.15.103:56720) 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8544e5d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85401022a0 0x7f854019aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.490 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 -- 172.21.15.103:0/527828151 learned_addr learned my addr 172.21.15.103:0/527828151 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f854565e640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540100b50 0x7f854019a510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 -- 172.21.15.103:0/527828151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540100b50 msgr2=0x7f854019a510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540100b50 0x7f854019a510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 -- 172.21.15.103:0/527828151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85401022a0 msgr2=0x7f854019aa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85401022a0 0x7f854019aa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 -- 172.21.15.103:0/527828151 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f854019f4c0 con 0x7f8540102c20 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f8545e5f640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8540102c20 0x7f854019ede0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8538009e20 tx=0x7f853800e490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85367fc640 1 -- 172.21.15.103:0/527828151 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8538004b20 con 0x7f8540102c20 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85367fc640 1 -- 172.21.15.103:0/527828151 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f8538004cc0 con 0x7f8540102c20 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85478c2640 1 -- 172.21.15.103:0/527828151 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f854019f7b0 con 0x7f8540102c20 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.473+0000 7f85367fc640 1 -- 172.21.15.103:0/527828151 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f85380059e0 con 0x7f8540102c20 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.474+0000 7f85478c2640 1 -- 172.21.15.103:0/527828151 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f85401a7090 con 0x7f8540102c20 2024-08-02T18:52:14.491 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f85367fc640 1 -- 172.21.15.103:0/527828151 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f853801b020 con 0x7f8540102c20 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8549cc0740 1 Processor -- start 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8549cc0740 1 -- start start 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636ab93d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac3c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636ac65c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8549cc0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555636a1ea40 con 0x555636ab8ff0 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8549cc0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5556369b69d0 con 0x555636ab9910 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8549cc0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555636a1aa00 con 0x555636ac41d0 2024-08-02T18:52:14.492 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.476+0000 7f8544e5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636ab93d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f85367fc640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f852c0a2cf0 0x7f852c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f854565e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636ab93d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56732/0 (socket says 172.21.15.103:56732) 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 -- 172.21.15.103:0/1733496549 learned_addr learned my addr 172.21.15.103:0/1733496549 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8545e5f640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f852c0a2cf0 0x7f852c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1733496549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636ac65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f85367fc640 1 -- 172.21.15.103:0/527828151 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f85380cf190 con 0x7f8540102c20 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 -- 172.21.15.103:0/1733496549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 msgr2=0x555636ac65c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1733496549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636ac65c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 -- 172.21.15.103:0/1733496549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 msgr2=0x555636ac3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1733496549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.493 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 -- 172.21.15.103:0/1733496549 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5556369bd650 con 0x555636ab8ff0 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1733496549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636ab93d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x555636ab6900 tx=0x7f8530000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96af3eb6bbc22c02 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f8545e5f640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f852c0a2cf0 0x7f852c0a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f853809b300 tx=0x7f853808d040 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f852b7fe640 1 -- 172.21.15.103:0/1733496549 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530044030 con 0x555636ab8ff0 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f852b7fe640 1 -- 172.21.15.103:0/1733496549 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85300318c0 con 0x555636ab8ff0 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.477+0000 7f852b7fe640 1 -- 172.21.15.103:0/1733496549 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8530035040 con 0x555636ab8ff0 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 -- 172.21.15.103:0/1733496549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 msgr2=0x555636ab93d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1733496549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636ab93d0 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x555636ab6900 tx=0x7f8530000bc0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 -- 172.21.15.103:0/1733496549 shutdown_connections 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1733496549 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636ac65c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1733496549 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1733496549 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636ab93d0 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.494 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 -- 172.21.15.103:0/1733496549 >> 172.21.15.103:0/1733496549 conn(0x555636ab5580 msgr2=0x555636ab5960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 -- 172.21.15.103:0/1733496549 shutdown_connections 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.478+0000 7f8549cc0740 1 -- 172.21.15.103:0/1733496549 wait complete. 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 1 -- start start 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 1 Processor -- start 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 0x555636ac1110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ac41d0 0x555636ac1b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x555636ac6da0 con 0x555636ac41d0 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5556369d9b20 con 0x555636ab9910 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x555636ac6f20 con 0x555636ab8ff0 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8549cc0740 10 client.0 _ll_register_callbacks cb 0x5556369d7bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8544e5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ac41d0 0x555636ac1b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.495 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8544e5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ac41d0 0x555636ac1b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56738/0 (socket says 172.21.15.103:56738) 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f8544e5d640 1 -- 172.21.15.103:0/1831049133 learned_addr learned my addr 172.21.15.103:0/1831049133 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.479+0000 7f854565e640 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 0x555636ac1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f854565e640 1 -- 172.21.15.103:0/1831049133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 msgr2=0x555636ac1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f854565e640 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 0x555636ac1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f854565e640 1 -- 172.21.15.103:0/1831049133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ac41d0 msgr2=0x555636ac1b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f854565e640 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ac41d0 0x555636ac1b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f854565e640 1 -- 172.21.15.103:0/1831049133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5556367903c0 con 0x555636ab9910 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ac41d0 0x555636ac1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f854565e640 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac1650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f853c012700 tx=0x7f853c012bc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=af354c26eb62b92f server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f8528ff9640 10 client.0 ms_handle_connect on v2:172.21.15.121:3300/0 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f8528ff9640 1 -- 172.21.15.103:0/1831049133 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c004320 con 0x555636ab9910 2024-08-02T18:52:14.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f8528ff9640 1 -- 172.21.15.103:0/1831049133 <== mon.2 v2:172.21.15.121:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f853c0119a0 con 0x555636ab9910 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.480+0000 7f8549cc0740 1 -- 172.21.15.103:0/1831049133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f85300318c0 con 0x555636ab9910 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8528ff9640 1 -- 172.21.15.103:0/1831049133 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f853c025050 con 0x555636ab9910 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8549cc0740 10 client.25634 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8549cc0740 1 -- 172.21.15.103:0/1831049133 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555636ad2ab0 con 0x555636ab9910 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8528ff9640 1 -- 172.21.15.103:0/1831049133 <== mon.2 v2:172.21.15.121:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f85300318c0 con 0x555636ab9910 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8528ff9640 1 -- 172.21.15.103:0/1831049133 <== mon.2 v2:172.21.15.121:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f853c00f440 con 0x555636ab9910 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8549cc0740 10 client.25634 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8549cc0740 10 client.25634 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8549cc0740 20 client.25634 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x555636ad4010 0x555636ad6430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8549cc0740 4 client.25634 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:52:14.497 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8549cc0740 1 -- 172.21.15.103:0/1831049133 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555636a2bfb0 con 0x555636ad4010 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.481+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x555636ad4010 0x555636ad6430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.482+0000 7f8528ff9640 10 client.25634 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.482+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x555636ad4010 0x555636ad6430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=607e270d72749bfa server_cookie=17a53cf9e3f7e82c in_seq=0 out_seq=0 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.482+0000 7f8528ff9640 1 -- 172.21.15.103:0/1831049133 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x555636a2bfb0 con 0x555636ad4010 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.482+0000 7f8528ff9640 10 client.25634 handle_command_reply: tid=0 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.482+0000 7f8549cc0740 1 client.25634 shutdown 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 -- 172.21.15.103:0/1831049133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 msgr2=0x555636ac1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac1650 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f853c012700 tx=0x7f853c012bc0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 -- 172.21.15.103:0/1831049133 shutdown_connections 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x555636ad4010 0x555636ad6430 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ac41d0 0x555636ac1b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8528ff9640 0 client.25634 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:52:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636ac1650 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1831049133 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 0x555636ac1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 -- 172.21.15.103:0/1831049133 >> 172.21.15.103:0/1831049133 conn(0x555636ab5580 msgr2=0x555636abb2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 -- 172.21.15.103:0/1831049133 shutdown_connections 2024-08-02T18:52:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 1 -- 172.21.15.103:0/1831049133 wait complete. 2024-08-02T18:52:14.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.483+0000 7f8549cc0740 20 client.25634 trim_cache size 0 max 16384 2024-08-02T18:52:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8549cc0740 1 Processor -- start 2024-08-02T18:52:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8549cc0740 1 -- start start 2024-08-02T18:52:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636adbd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636adc260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636abaa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.504 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8549cc0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85401b3770 con 0x555636ab8ff0 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8549cc0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85401b0f80 con 0x555636ab9910 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8549cc0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f85401aedd0 con 0x555636ac41d0 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8544e5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636adbd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8544e5d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636adbd20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56744/0 (socket says 172.21.15.103:56744) 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f8544e5d640 1 -- 172.21.15.103:0/1731223992 learned_addr learned my addr 172.21.15.103:0/1731223992 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.502+0000 7f854565e640 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636adc260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636abaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f854565e640 1 -- 172.21.15.103:0/1731223992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 msgr2=0x555636abaa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f854565e640 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636abaa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f854565e640 1 -- 172.21.15.103:0/1731223992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 msgr2=0x555636adbd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f854565e640 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636adbd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f854565e640 1 -- 172.21.15.103:0/1731223992 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555636ac6930 con 0x555636ab9910 2024-08-02T18:52:14.505 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f8544e5d640 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636abaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:52:14.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f854565e640 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636adc260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f853c00f860 tx=0x7f853c011890 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1f767d92bab672d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:14.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f852affd640 1 -- 172.21.15.103:0/1731223992 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c02d070 con 0x555636ab9910 2024-08-02T18:52:14.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f852affd640 1 -- 172.21.15.103:0/1731223992 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f853c00f440 con 0x555636ab9910 2024-08-02T18:52:14.506 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.503+0000 7f852affd640 1 -- 172.21.15.103:0/1731223992 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c022040 con 0x555636ab9910 2024-08-02T18:52:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 -- 172.21.15.103:0/1731223992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 msgr2=0x555636adc260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636adc260 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f853c00f860 tx=0x7f853c011890 comp rx=0 tx=0).stop 2024-08-02T18:52:14.508 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 -- 172.21.15.103:0/1731223992 shutdown_connections 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ac41d0 0x555636abaa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ab9910 0x555636adc260 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 --2- 172.21.15.103:0/1731223992 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab8ff0 0x555636adbd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 -- 172.21.15.103:0/1731223992 >> 172.21.15.103:0/1731223992 conn(0x555636ab5580 msgr2=0x555636abfa60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 -- 172.21.15.103:0/1731223992 shutdown_connections 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 -- 172.21.15.103:0/1731223992 wait complete. 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 -- start start 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.504+0000 7f8549cc0740 1 Processor -- start 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 0x555636acc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab9910 0x555636acc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8549cc0740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ac41d0 0x555636abd7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8549cc0740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f85401af440 con 0x555636ab9910 2024-08-02T18:52:14.509 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8549cc0740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f85401b08b0 con 0x555636ac41d0 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8549cc0740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f85401afb10 con 0x555636ab8ff0 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8549cc0740 10 client.0 _ll_register_callbacks cb 0x7f853c0097a0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab9910 0x555636acc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab9910 0x555636acc6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56758/0 (socket says 172.21.15.103:56758) 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 -- 172.21.15.103:0/3208282316 learned_addr learned my addr 172.21.15.103:0/3208282316 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8544e5d640 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ac41d0 0x555636abd7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8544e5d640 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 0x555636acc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 -- 172.21.15.103:0/3208282316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 msgr2=0x555636acc170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 0x555636acc170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 -- 172.21.15.103:0/3208282316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ac41d0 msgr2=0x555636abd7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ac41d0 0x555636abd7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.510 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 -- 172.21.15.103:0/3208282316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555636abdd00 con 0x555636ab9910 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f854565e640 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab9910 0x555636acc6b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f853c0126d0 tx=0x7f853c00fc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e76329cb2110b529 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.505+0000 7f8528ff9640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8528ff9640 1 -- 172.21.15.103:0/3208282316 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f853c02d070 con 0x555636ab9910 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8528ff9640 1 -- 172.21.15.103:0/3208282316 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f853c018070 con 0x555636ab9910 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 1 -- 172.21.15.103:0/3208282316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f853c00f440 con 0x555636ab9910 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8528ff9640 1 -- 172.21.15.103:0/3208282316 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f853c041050 con 0x555636ab9910 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 10 client.16179 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 1 -- 172.21.15.103:0/3208282316 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x555636b3e460 con 0x555636ab9910 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8528ff9640 1 -- 172.21.15.103:0/3208282316 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f853c00f440 con 0x555636ab9910 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8528ff9640 1 -- 172.21.15.103:0/3208282316 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f853c003b90 con 0x555636ab9910 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 10 client.16179 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 10 client.16179 resolve_mds: resolved 1:2 to role '1:2' aka daemon mds.c 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 20 client.16179 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:14.511 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x555636ad4010 0x555636b40bc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:14.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 4 client.16179 mds_command: new command op to 24454 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:52:14.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.506+0000 7f8549cc0740 1 -- 172.21.15.103:0/3208282316 --> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] -- command(tid 0: {"prefix": "damage ls"}) -- 0x555636a264c0 con 0x555636ad4010 2024-08-02T18:52:14.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.507+0000 7f8544e5d640 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x555636ad4010 0x555636b40bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:14.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.507+0000 7f8544e5d640 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x555636ad4010 0x555636b40bc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=69eeb8dc479bb87f server_cookie=68f85a3a6df7b854 in_seq=0 out_seq=0 2024-08-02T18:52:14.512 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.507+0000 7f8528ff9640 10 client.16179 ms_handle_connect on v2:172.21.15.151:6836/1434322363 2024-08-02T18:52:14.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8528ff9640 1 -- 172.21.15.103:0/3208282316 <== mds.2 v2:172.21.15.151:6836/1434322363 1 ==== command_reply(tid 0: 0 ) ==== 8+0+36621 (crc 0 0 0) 0x555636a264c0 con 0x555636ad4010 2024-08-02T18:52:14.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8528ff9640 10 client.16179 handle_command_reply: tid=0 2024-08-02T18:52:14.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 client.16179 shutdown 2024-08-02T18:52:14.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 -- 172.21.15.103:0/3208282316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab9910 msgr2=0x555636acc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab9910 0x555636acc6b0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f853c0126d0 tx=0x7f853c00fc00 comp rx=0 tx=0).stop 2024-08-02T18:52:14.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 -- 172.21.15.103:0/3208282316 shutdown_connections 2024-08-02T18:52:14.513 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x555636ac41d0 0x555636abd7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.151:6836/1434322363,v1:172.21.15.151:6837/1434322363] conn(0x555636ad4010 0x555636b40bc0 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x555636ab9910 0x555636acc6b0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 --2- 172.21.15.103:0/3208282316 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x555636ab8ff0 0x555636acc170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8528ff9640 0 client.16179 ms_handle_reset on v2:172.21.15.151:6836/1434322363 2024-08-02T18:52:14.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.508+0000 7f8549cc0740 1 -- 172.21.15.103:0/3208282316 >> 172.21.15.103:0/3208282316 conn(0x555636ab5580 msgr2=0x555636ac10d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:14.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.509+0000 7f8549cc0740 1 -- 172.21.15.103:0/3208282316 shutdown_connections 2024-08-02T18:52:14.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.509+0000 7f8549cc0740 1 -- 172.21.15.103:0/3208282316 wait complete. 2024-08-02T18:52:14.514 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.509+0000 7f8549cc0740 20 client.16179 trim_cache size 0 max 16384 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 22818349, 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628368, 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore" 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 41421271, 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628436, 2024-08-02T18:52:14.515 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan" 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 94957110, 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628391, 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533" 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 151965859, 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628485, 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus" 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 207659465, 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628500, 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse" 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 224044757, 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628498, 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop" 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.517 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 233715833, 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628452, 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac" 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 260041209, 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628549, 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp" 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.518 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 304536679, 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628341, 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm" 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 455501916, 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628327, 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx" 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.519 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 551003006, 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628377, 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma" 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 583879077, 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628508, 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map" 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.520 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 584187234, 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628318, 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight" 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 611891350, 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628455, 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory" 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.521 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 613108955, 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628313, 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls" 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 613244598, 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628370, 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block" 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.522 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 620029308, 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628407, 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform" 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 633680279, 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628494, 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek" 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 643693001, 2024-08-02T18:52:14.523 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628323, 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node" 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 689045614, 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628547, 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps" 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 750222510, 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628495, 2024-08-02T18:52:14.524 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start" 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 750341782, 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628532, 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline" 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 783246141, 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628503, 2024-08-02T18:52:14.525 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback" 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 818626864, 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628426, 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd" 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 853410550, 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628484, 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone" 2024-08-02T18:52:14.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 873144101, 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628400, 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs" 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 896724116, 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628446, 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration" 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 917046685, 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628460, 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb" 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 971187887, 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628526, 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm" 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 974559888, 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628329, 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04" 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 982536603, 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628385, 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7" 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.529 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1035615379, 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628415, 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency" 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1041198418, 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628542, 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim" 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.530 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1072533159, 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628335, 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification" 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1075795813, 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628510, 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log" 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.531 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1112942633, 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628477, 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo" 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1161348433, 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628347, 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi" 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.532 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1187232606, 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628312, 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb" 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1193510674, 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628338, 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget" 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.533 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1238240406, 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628336, 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso" 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1265882774, 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628322, 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc" 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.534 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1275912379, 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628474, 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu" 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1283084927, 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628492, 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1" 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1311892308, 2024-08-02T18:52:14.535 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628331, 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump" 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1331428199, 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628315, 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire" 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1349327776, 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628374, 2024-08-02T18:52:14.536 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram" 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1353632141, 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628369, 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata" 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1355096400, 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628402, 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media" 2024-08-02T18:52:14.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1366184819, 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628442, 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap" 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1371934752, 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628314, 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile" 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.538 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1378880746, 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628487, 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus" 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1415322075, 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628486, 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure" 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.539 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1427987691, 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628546, 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power" 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1458641151, 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628466, 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup" 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1458971814, 2024-08-02T18:52:14.540 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628540, 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop" 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1504227889, 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628361, 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc" 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1521891042, 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628425, 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu" 2024-08-02T18:52:14.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1563747212, 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628457, 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online" 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1617854202, 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628317, 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend" 2024-08-02T18:52:14.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1791777038, 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628536, 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi" 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1813831331, 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628431, 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt" 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.543 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1843390104, 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628397, 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als" 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1871682575, 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628384, 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format" 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.509+0000 7f85478c2640 1 -- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f852c0a2cf0 msgr2=0x7f852c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.509+0000 7f85478c2640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f852c0a2cf0 0x7f852c0a51b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f853809b300 tx=0x7f853808d040 comp rx=0 tx=0).stop 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.509+0000 7f85478c2640 1 -- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8540102c20 msgr2=0x7f854019ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.509+0000 7f85478c2640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8540102c20 0x7f854019ede0 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f8538009e20 tx=0x7f853800e490 comp rx=0 tx=0).stop 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.509+0000 7f85478c2640 1 -- 172.21.15.103:0/527828151 shutdown_connections 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.510+0000 7f85478c2640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f852c0a2cf0 0x7f852c0a51b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.510+0000 7f85478c2640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f8540102c20 0x7f854019ede0 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.510+0000 7f85478c2640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f85401022a0 0x7f854019aa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.510+0000 7f85478c2640 1 --2- 172.21.15.103:0/527828151 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f8540100b50 0x7f854019a510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.510+0000 7f85478c2640 1 -- 172.21.15.103:0/527828151 >> 172.21.15.103:0/527828151 conn(0x7f85400fc500 msgr2=0x7f85401065e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.510+0000 7f85478c2640 1 -- 172.21.15.103:0/527828151 shutdown_connections 2024-08-02T18:52:14.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:14.510+0000 7f85478c2640 1 -- 172.21.15.103:0/527828151 wait complete. 2024-08-02T18:52:14.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.546 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.546 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1903445982, 2024-08-02T18:52:14.546 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628320, 2024-08-02T18:52:14.546 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm" 2024-08-02T18:52:14.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.546 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.546 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1910785945, 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628311, 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev" 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1944383500, 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628550, 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty" 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1948473117, 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628332, 2024-08-02T18:52:14.547 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog" 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1971768638, 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628340, 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm" 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1986022550, 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628505, 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi" 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.548 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1992375677, 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628387, 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe" 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2033529384, 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628440, 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd" 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2047960859, 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628433, 2024-08-02T18:52:14.549 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net" 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2086935595, 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628401, 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio" 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2143635583, 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628529, 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab" 2024-08-02T18:52:14.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2162232236, 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628479, 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch" 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2177107133, 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628513, 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi" 2024-08-02T18:52:14.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2188490468, 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628439, 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics" 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2198176859, 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628551, 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf" 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.552 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2204925369, 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628483, 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku" 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2229878745, 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628403, 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei" 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.553 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2266128878, 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628358, 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe" 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2269883283, 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628356, 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2" 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.554 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2357237094, 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628458, 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget" 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2455009610, 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628472, 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu" 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2466004302, 2024-08-02T18:52:14.555 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628516, 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs" 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2476357127, 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628520, 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085" 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.556 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2558580225, 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628428, 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533" 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2572982959, 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628325, 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory" 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.557 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2588793762, 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628507, 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi" 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2599255891, 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628319, 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill" 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.558 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2635505713, 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628326, 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp" 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2720250741, 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628541, 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop" 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2766123470, 2024-08-02T18:52:14.559 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628419, 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi" 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2771349899, 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628511, 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap" 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.560 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2782415558, 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628363, 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd" 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2809563693, 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628360, 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad" 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.561 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2817958763, 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628490, 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos" 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2839167142, 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628471, 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun" 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.562 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2860745504, 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628316, 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb" 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2869750483, 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628456, 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc" 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2906390924, 2024-08-02T18:52:14.563 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628461, 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power" 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2913776019, 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628432, 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd" 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2984516656, 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628328, 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc" 2024-08-02T18:52:14.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3051879771, 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628379, 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x" 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3054461010, 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628362, 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto" 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.565 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3125208813, 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628357, 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc" 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3142179253, 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628352, 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial" 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3193779806, 2024-08-02T18:52:14.566 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628386, 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci" 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3195492518, 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628365, 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm" 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3213042332, 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628539, 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg" 2024-08-02T18:52:14.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3239094105, 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628481, 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys" 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3250993832, 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628450, 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev" 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.568 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3269652505, 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628423, 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu" 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3352197433, 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628409, 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg" 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.569 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3372583682, 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628523, 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps" 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3379230467, 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628475, 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe" 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.570 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3464021379, 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628417, 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870" 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3676818861, 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628514, 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv" 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3729879358, 2024-08-02T18:52:14.571 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628396, 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160" 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3768003269, 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628321, 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi" 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3795759762, 2024-08-02T18:52:14.572 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628534, 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2" 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3852096129, 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628533, 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module" 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3867647136, 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628537, 2024-08-02T18:52:14.573 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91" 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3894369830, 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628464, 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2" 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3914188621, 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628378, 2024-08-02T18:52:14.574 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10" 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3917806074, 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628333, 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module" 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3918548604, 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628544, 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb" 2024-08-02T18:52:14.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3936070372, 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628506, 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi" 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3965157167, 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628345, 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback" 2024-08-02T18:52:14.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3974492404, 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628468, 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state" 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3982841669, 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628448, 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc" 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.577 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3992102547, 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628522, 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params" 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4009861084, 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628346, 2024-08-02T18:52:14.578 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage" 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4010072298, 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628504, 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront" 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4025965557, 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628330, 2024-08-02T18:52:14.579 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars" 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4048884468, 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628515, 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4" 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4058305485, 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628470, 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc" 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.580 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4095962422, 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628512, 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw" 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4106828290, 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628528, 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm" 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.581 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4191646467, 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628324, 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu" 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4215522924, 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628334, 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp" 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:52:14.582 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-08-02T18:52:15.451 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:1 damage ls 2024-08-02T18:52:15.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:15 smithi121 ceph-mon[37236]: pgmap v78: 129 pgs: 129 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 825 op/s 2024-08-02T18:52:15.801 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:52:15.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:15 smithi151 ceph-mon[37155]: pgmap v78: 129 pgs: 129 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 825 op/s 2024-08-02T18:52:15.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:15 smithi103 ceph-mon[32753]: pgmap v78: 129 pgs: 129 active+clean; 179 MiB data, 1.0 GiB used, 1.0 TiB / 1.0 TiB avail; 1.3 MiB/s rd, 1.8 MiB/s wr, 825 op/s 2024-08-02T18:52:16.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 -- 172.21.15.103:0/3498227176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf01022a0 msgr2=0x7fbcf01026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 --2- 172.21.15.103:0/3498227176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf01022a0 0x7fbcf01026e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009900 tx=0x7fbce002a480 comp rx=0 tx=0).stop 2024-08-02T18:52:16.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 -- 172.21.15.103:0/3498227176 shutdown_connections 2024-08-02T18:52:16.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 --2- 172.21.15.103:0/3498227176 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcf0102c20 0x7fbcf010d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 --2- 172.21.15.103:0/3498227176 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf01022a0 0x7fbcf01026e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 --2- 172.21.15.103:0/3498227176 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf0100b50 0x7fbcf0100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.303 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 -- 172.21.15.103:0/3498227176 >> 172.21.15.103:0/3498227176 conn(0x7fbcf00fc500 msgr2=0x7fbcf00fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 -- 172.21.15.103:0/3498227176 shutdown_connections 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 -- 172.21.15.103:0/3498227176 wait complete. 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 Processor -- start 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.276+0000 7fbcf855b640 1 -- start start 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf855b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf0100b50 0x7fbcf01971e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf855b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcf01022a0 0x7fbcf0197720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf855b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf0102c20 0x7fbcf019bab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf855b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0110da0 con 0x7fbcf0100b50 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf855b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0110c20 con 0x7fbcf0102c20 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf855b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf0110f20 con 0x7fbcf01022a0 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf0100b50 0x7fbcf01971e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf0100b50 0x7fbcf01971e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56776/0 (socket says 172.21.15.103:56776) 2024-08-02T18:52:16.304 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 -- 172.21.15.103:0/1931166076 learned_addr learned my addr 172.21.15.103:0/1931166076 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf0102c20 0x7fbcf019bab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcf01022a0 0x7fbcf0197720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 -- 172.21.15.103:0/1931166076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcf01022a0 msgr2=0x7fbcf0197720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcf01022a0 0x7fbcf0197720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 -- 172.21.15.103:0/1931166076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf0102c20 msgr2=0x7fbcf019bab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf0102c20 0x7fbcf019bab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 -- 172.21.15.103:0/1931166076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbcf019c190 con 0x7fbcf0100b50 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf0102c20 0x7fbcf019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf0100b50 0x7fbcf01971e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009f50 tx=0x7fbcec00b690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbce77fe640 1 -- 172.21.15.103:0/1931166076 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec00be10 con 0x7fbcf0100b50 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbce77fe640 1 -- 172.21.15.103:0/1931166076 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbcec004020 con 0x7fbcf0100b50 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbce77fe640 1 -- 172.21.15.103:0/1931166076 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec015780 con 0x7fbcf0100b50 2024-08-02T18:52:16.305 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.277+0000 7fbcf855b640 1 -- 172.21.15.103:0/1931166076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbcf019c480 con 0x7fbcf0100b50 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.278+0000 7fbcf855b640 1 -- 172.21.15.103:0/1931166076 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbcf0069ca0 con 0x7fbcf0100b50 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.280+0000 7fbce77fe640 1 -- 172.21.15.103:0/1931166076 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fbcec0041d0 con 0x7fbcf0100b50 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.280+0000 7fbcfa959740 1 Processor -- start 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.280+0000 7fbcfa959740 1 -- start start 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d6fff0 0x564f39d703d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7ac90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d7d5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbce77fe640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fbcdc0a2cf0 0x7fbcdc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcfa959740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564f39cd5a40 con 0x564f39d7b1d0 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcfa959740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564f39c6d9d0 con 0x564f39d70910 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcfa959740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f39cd1a00 con 0x564f39d6fff0 2024-08-02T18:52:16.306 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d7d5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf62f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7ac90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fbcdc0a2cf0 0x7fbcdc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf62f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7ac90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:44182/0 (socket says 172.21.15.103:44182) 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d7d5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56792/0 (socket says 172.21.15.103:56792) 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf62f7640 1 -- 172.21.15.103:0/1419906627 learned_addr learned my addr 172.21.15.103:0/1419906627 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbce77fe640 1 -- 172.21.15.103:0/1931166076 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fbcec0d12c0 con 0x7fbcf0100b50 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1419906627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d6fff0 0x564f39d703d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 -- 172.21.15.103:0/1419906627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d6fff0 msgr2=0x564f39d703d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1419906627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d6fff0 0x564f39d703d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 -- 172.21.15.103:0/1419906627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 msgr2=0x564f39d7ac90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1419906627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7ac90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 -- 172.21.15.103:0/1419906627 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f39c74650 con 0x564f39d7b1d0 2024-08-02T18:52:16.307 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fbcdc0a2cf0 0x7fbcdc0a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00fe940 tx=0x7fbce0005a20 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.281+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1419906627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d7d5c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbce8011a60 tx=0x7fbce800a9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24cdca2971f0558c server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbce4ff9640 1 -- 172.21.15.103:0/1419906627 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8011320 con 0x564f39d7b1d0 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbce4ff9640 1 -- 172.21.15.103:0/1419906627 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbce8005020 con 0x564f39d7b1d0 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbce4ff9640 1 -- 172.21.15.103:0/1419906627 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8004c30 con 0x564f39d7b1d0 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbcfa959740 1 -- 172.21.15.103:0/1419906627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 msgr2=0x564f39d7d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1419906627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d7d5c0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fbce8011a60 tx=0x7fbce800a9f0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbcfa959740 1 -- 172.21.15.103:0/1419906627 shutdown_connections 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1419906627 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d7d5c0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1419906627 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7ac90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1419906627 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d6fff0 0x564f39d703d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.282+0000 7fbcfa959740 1 -- 172.21.15.103:0/1419906627 >> 172.21.15.103:0/1419906627 conn(0x564f39d6c580 msgr2=0x564f39d6c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 -- 172.21.15.103:0/1419906627 shutdown_connections 2024-08-02T18:52:16.308 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 -- 172.21.15.103:0/1419906627 wait complete. 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 -- start start 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 Processor -- start 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d780a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d70910 0x564f39d785e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d78b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x564f39d7dda0 con 0x564f39d7b1d0 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x564f39c90b20 con 0x564f39d6fff0 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x564f39d7df20 con 0x564f39d70910 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcfa959740 10 client.0 _ll_register_callbacks cb 0x564f39c8ebb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcf6af8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d78b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcf6af8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d78b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56796/0 (socket says 172.21.15.103:56796) 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcf6af8640 1 -- 172.21.15.103:0/1868283337 learned_addr learned my addr 172.21.15.103:0/1868283337 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:16.309 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcf62f7640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d780a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.283+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d70910 0x564f39d785e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcf6af8640 1 -- 172.21.15.103:0/1868283337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d70910 msgr2=0x564f39d785e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d70910 0x564f39d785e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcf6af8640 1 -- 172.21.15.103:0/1868283337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 msgr2=0x564f39d780a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d780a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcf6af8640 1 -- 172.21.15.103:0/1868283337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f39a473c0 con 0x564f39d7b1d0 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d780a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d78b20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbce8004be0 tx=0x7fbce8004c10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9fc1ef5a6bb4f04 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/1868283337 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce8022070 con 0x564f39d7b1d0 2024-08-02T18:52:16.310 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/1868283337 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fbce800f9a0 con 0x564f39d7b1d0 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcfa959740 1 -- 172.21.15.103:0/1868283337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbce8005020 con 0x564f39d7b1d0 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/1868283337 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbce802e050 con 0x564f39d7b1d0 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcfa959740 10 client.16191 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcfa959740 1 -- 172.21.15.103:0/1868283337 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564f39d899a0 con 0x564f39d7b1d0 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.284+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/1868283337 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbce8005020 con 0x564f39d7b1d0 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/1868283337 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fbce801e960 con 0x564f39d7b1d0 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcfa959740 10 client.16191 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcfa959740 10 client.16191 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcfa959740 20 client.16191 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x564f39d8ad50 0x564f39d8d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcfa959740 4 client.16191 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:52:16.311 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcfa959740 1 -- 172.21.15.103:0/1868283337 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564f39ce2fb0 con 0x564f39d8ad50 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x564f39d8ad50 0x564f39d8d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcd9ffb640 10 client.16191 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.285+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x564f39d8ad50 0x564f39d8d140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8543100b569a986a server_cookie=29d3dd88019b4f84 in_seq=0 out_seq=0 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.286+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/1868283337 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x564f39ce2fb0 con 0x564f39d8ad50 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.286+0000 7fbcd9ffb640 10 client.16191 handle_command_reply: tid=0 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.286+0000 7fbcfa959740 1 client.16191 shutdown 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 -- 172.21.15.103:0/1868283337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 msgr2=0x564f39d78b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d78b20 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fbce8004be0 tx=0x7fbce8004c10 comp rx=0 tx=0).stop 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 -- 172.21.15.103:0/1868283337 shutdown_connections 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d7b1d0 0x564f39d78b20 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d70910 0x564f39d785e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.312 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x564f39d8ad50 0x564f39d8d140 crc :-1 s=READY pgs=42 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcd9ffb640 0 client.16191 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 --2- 172.21.15.103:0/1868283337 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d780a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 -- 172.21.15.103:0/1868283337 >> 172.21.15.103:0/1868283337 conn(0x564f39d6c580 msgr2=0x564f39d72260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 -- 172.21.15.103:0/1868283337 shutdown_connections 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 1 -- 172.21.15.103:0/1868283337 wait complete. 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.287+0000 7fbcfa959740 20 client.16191 trim_cache size 0 max 16384 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcfa959740 1 Processor -- start 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcfa959740 1 -- start start 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d92880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d70910 0x564f39d92dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 0x564f39d71a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcfa959740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf01af3f0 con 0x564f39d70910 2024-08-02T18:52:16.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcfa959740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf01acc00 con 0x564f39d6fff0 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcfa959740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf01aaa50 con 0x564f39d7b1d0 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcf5af6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d70910 0x564f39d92dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcf5af6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d70910 0x564f39d92dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56802/0 (socket says 172.21.15.103:56802) 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcf5af6640 1 -- 172.21.15.103:0/583825460 learned_addr learned my addr 172.21.15.103:0/583825460 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.300+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d92880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcf6af8640 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 0x564f39d71a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcf5af6640 1 -- 172.21.15.103:0/583825460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 msgr2=0x564f39d71a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 0x564f39d71a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcf5af6640 1 -- 172.21.15.103:0/583825460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 msgr2=0x564f39d92880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d92880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcf5af6640 1 -- 172.21.15.103:0/583825460 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564f39d70740 con 0x564f39d70910 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d92880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:16.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d70910 0x564f39d92dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009900 tx=0x7fbce003c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d44e0a79cdeedf87 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcdbfff640 1 -- 172.21.15.103:0/583825460 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0035050 con 0x564f39d70910 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcdbfff640 1 -- 172.21.15.103:0/583825460 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbce0005540 con 0x564f39d70910 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.301+0000 7fbcdbfff640 1 -- 172.21.15.103:0/583825460 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbce0004ce0 con 0x564f39d70910 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 -- 172.21.15.103:0/583825460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d70910 msgr2=0x564f39d92dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d70910 0x564f39d92dc0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009900 tx=0x7fbce003c000 comp rx=0 tx=0).stop 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 -- 172.21.15.103:0/583825460 shutdown_connections 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 0x564f39d71a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d70910 0x564f39d92dc0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 --2- 172.21.15.103:0/583825460 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d6fff0 0x564f39d92880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 -- 172.21.15.103:0/583825460 >> 172.21.15.103:0/583825460 conn(0x564f39d6c580 msgr2=0x564f39d76970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 -- 172.21.15.103:0/583825460 shutdown_connections 2024-08-02T18:52:16.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 -- 172.21.15.103:0/583825460 wait complete. 2024-08-02T18:52:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 -- start start 2024-08-02T18:52:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 Processor -- start 2024-08-02T18:52:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.302+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d6fff0 0x564f39d83a60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7e130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcfa959740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 0x564f39d7e870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcfa959740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf01ab0c0 con 0x564f39d6fff0 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcfa959740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf01ac530 con 0x564f39d70910 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcfa959740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fbcf01ab790 con 0x564f39d7b1d0 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d6fff0 0x564f39d83a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d6fff0 0x564f39d83a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56818/0 (socket says 172.21.15.103:56818) 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 -- 172.21.15.103:0/4265105027 learned_addr learned my addr 172.21.15.103:0/4265105027 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcfa959740 10 client.0 _ll_register_callbacks cb 0x7fbcec021e70 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 -- 172.21.15.103:0/4265105027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 msgr2=0x564f39d7e870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 0x564f39d7e870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 -- 172.21.15.103:0/4265105027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 msgr2=0x564f39d7e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.319 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 -- 172.21.15.103:0/4265105027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564f39df3840 con 0x564f39d6fff0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcf62f7640 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d6fff0 0x564f39d83a60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbcec09d1a0 tx=0x7fbcec004520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7c99a93aa63e907 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcd9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/4265105027 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbcec084040 con 0x564f39d6fff0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/4265105027 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fbcec099b10 con 0x564f39d6fff0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.303+0000 7fbcfa959740 1 -- 172.21.15.103:0/4265105027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbce0005540 con 0x564f39d6fff0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/4265105027 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fbcec0a1850 con 0x564f39d6fff0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcfa959740 10 client.16197 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcfa959740 1 -- 172.21.15.103:0/4265105027 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x564f39df4aa0 con 0x564f39d6fff0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/4265105027 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fbce0005540 con 0x564f39d6fff0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/4265105027 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fbcec09d700 con 0x564f39d6fff0 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcfa959740 10 client.16197 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcfa959740 10 client.16197 resolve_mds: resolved 1:1 to role '1:1' aka daemon mds.i 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcfa959740 20 client.16197 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:16.320 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcfa959740 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x564f39d8ad50 0x564f39df7280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcfa959740 4 client.16197 mds_command: new command op to 24469 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcfa959740 1 -- 172.21.15.103:0/4265105027 --> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] -- command(tid 0: {"prefix": "damage ls"}) -- 0x564f39cdd4c0 con 0x564f39d8ad50 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.304+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x564f39d8ad50 0x564f39df7280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.305+0000 7fbcf5af6640 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x564f39d8ad50 0x564f39df7280 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=235eca0c3acb330c server_cookie=e9f8c0a2ec7eda40 in_seq=0 out_seq=0 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.305+0000 7fbcd9ffb640 10 client.16197 ms_handle_connect on v2:172.21.15.151:6838/3705298051 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcd9ffb640 1 -- 172.21.15.103:0/4265105027 <== mds.1 v2:172.21.15.151:6838/3705298051 1 ==== command_reply(tid 0: 0 ) ==== 8+0+51268 (crc 0 0 0) 0x564f39cdd4c0 con 0x564f39d8ad50 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcd9ffb640 10 client.16197 handle_command_reply: tid=0 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 client.16197 shutdown 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 -- 172.21.15.103:0/4265105027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d6fff0 msgr2=0x564f39d83a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d6fff0 0x564f39d83a60 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fbcec09d1a0 tx=0x7fbcec004520 comp rx=0 tx=0).stop 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 -- 172.21.15.103:0/4265105027 shutdown_connections 2024-08-02T18:52:16.321 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x564f39d7b1d0 0x564f39d7e870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.151:6838/3705298051,v1:172.21.15.151:6839/3705298051] conn(0x564f39d8ad50 0x564f39df7280 crc :-1 s=READY pgs=43 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x564f39d70910 0x564f39d7e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 --2- 172.21.15.103:0/4265105027 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x564f39d6fff0 0x564f39d83a60 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 -- 172.21.15.103:0/4265105027 >> 172.21.15.103:0/4265105027 conn(0x564f39d6c580 msgr2=0x564f39d719b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcd9ffb640 0 client.16197 ms_handle_reset on v2:172.21.15.151:6838/3705298051 2024-08-02T18:52:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 -- 172.21.15.103:0/4265105027 shutdown_connections 2024-08-02T18:52:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 1 -- 172.21.15.103:0/4265105027 wait complete. 2024-08-02T18:52:16.322 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.306+0000 7fbcfa959740 20 client.16197 trim_cache size 0 max 16384 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout:[ 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 7600673, 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628737, 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml" 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 10769178, 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628708, 2024-08-02T18:52:16.323 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml" 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 57050196, 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628586, 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore" 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 78310113, 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628667, 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml" 2024-08-02T18:52:16.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 82010960, 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628609, 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml" 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 104122925, 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628607, 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore" 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.325 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 186798076, 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628757, 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml" 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 204790957, 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628703, 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg" 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.326 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 231306699, 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628630, 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf" 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 291582813, 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628687, 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml" 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 313245547, 2024-08-02T18:52:16.327 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628730, 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml" 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 342825710, 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628616, 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml" 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 400477906, 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628722, 2024-08-02T18:52:16.328 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml" 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 435227699, 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628569, 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl" 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 462636314, 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628598, 2024-08-02T18:52:16.329 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml" 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 500782744, 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628668, 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml" 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 515597086, 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628670, 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml" 2024-08-02T18:52:16.330 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 583526484, 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628754, 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml" 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 610416105, 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628715, 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml" 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.331 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 623940100, 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628644, 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml" 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 637646101, 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628574, 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl" 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.332 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 644090340, 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628602, 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64" 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 657376288, 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628724, 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml" 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 658559666, 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628578, 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl" 2024-08-02T18:52:16.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 661277245, 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628692, 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml" 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 667817525, 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628712, 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf" 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.334 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 716721936, 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628575, 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl" 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 723656774, 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628720, 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml" 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.335 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 733647630, 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628581, 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile" 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 779745054, 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628672, 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml" 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 791424560, 2024-08-02T18:52:16.336 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628736, 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml" 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 798937272, 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628746, 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml" 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 806246085, 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628721, 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml" 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.337 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 810141857, 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628652, 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml" 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 812490858, 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628700, 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml" 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.338 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 817397250, 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628624, 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml" 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 821546916, 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628728, 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml" 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.339 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 830399384, 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628689, 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml" 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 847364988, 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628633, 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml" 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 852474917, 2024-08-02T18:52:16.340 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628748, 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml" 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 852636162, 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628729, 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml" 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 881296237, 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628693, 2024-08-02T18:52:16.341 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml" 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 884575317, 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628577, 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl" 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 889316459, 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628697, 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml" 2024-08-02T18:52:16.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 925231476, 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628725, 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml" 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 985098707, 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628583, 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64" 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.343 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1040208895, 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628706, 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia" 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1062066776, 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628741, 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml" 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1066047875, 2024-08-02T18:52:16.344 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628564, 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl" 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1078115789, 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628614, 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml" 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1092667144, 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628563, 2024-08-02T18:52:16.345 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile" 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1104347423, 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628654, 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf" 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1104560851, 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628713, 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml" 2024-08-02T18:52:16.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1115603384, 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628645, 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml" 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1161072099, 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628716, 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml" 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.347 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1175334347, 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628683, 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml" 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1188610533, 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628628, 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml" 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1195145658, 2024-08-02T18:52:16.348 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628622, 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml" 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1293067792, 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628710, 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf" 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1326206966, 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628704, 2024-08-02T18:52:16.349 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia" 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1352738828, 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628678, 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml" 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1363653650, 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628756, 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml" 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.350 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1365757234, 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628719, 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 -- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fbcdc0a2cf0 msgr2=0x7fbcdc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fbcdc0a2cf0 0x7fbcdc0a51b0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fbcf00fe940 tx=0x7fbce0005a20 comp rx=0 tx=0).stop 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 -- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf0100b50 msgr2=0x7fbcf01971e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf0100b50 0x7fbcf01971e0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fbcec009f50 tx=0x7fbcec00b690 comp rx=0 tx=0).stop 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 -- 172.21.15.103:0/1931166076 shutdown_connections 2024-08-02T18:52:16.351 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fbcdc0a2cf0 0x7fbcdc0a51b0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fbcf0102c20 0x7fbcf019bab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fbcf01022a0 0x7fbcf0197720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 --2- 172.21.15.103:0/1931166076 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fbcf0100b50 0x7fbcf01971e0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:16.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 -- 172.21.15.103:0/1931166076 >> 172.21.15.103:0/1931166076 conn(0x7fbcf00fc500 msgr2=0x7fbcf0106560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:16.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 -- 172.21.15.103:0/1931166076 shutdown_connections 2024-08-02T18:52:16.352 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:16.307+0000 7fbcf855b640 1 -- 172.21.15.103:0/1931166076 wait complete. 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml" 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1415399251, 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628657, 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml" 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.353 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1415618006, 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628572, 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl" 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1425414510, 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628571, 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl" 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.354 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1432256988, 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628618, 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml" 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1439277452, 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628619, 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml" 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.355 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1457048167, 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628709, 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml" 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1464065356, 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628599, 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64" 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.356 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1485951112, 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628702, 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia" 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1504730862, 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628636, 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml" 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1512894896, 2024-08-02T18:52:16.357 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628612, 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml" 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1518102114, 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628739, 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml" 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1519755342, 2024-08-02T18:52:16.358 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628663, 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml" 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1520266217, 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628656, 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml" 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1545891438, 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628726, 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml" 2024-08-02T18:52:16.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1596757893, 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628701, 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml" 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1602356836, 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628638, 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml" 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.360 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1625247946, 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628582, 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64" 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1665927421, 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628562, 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl" 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1713997679, 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628661, 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml" 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1756682843, 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628685, 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml" 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.362 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1759570248, 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628659, 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml" 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1798810262, 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628664, 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml" 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1809684461, 2024-08-02T18:52:16.363 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628673, 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml" 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1813046801, 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628743, 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml" 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1835780443, 2024-08-02T18:52:16.364 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628647, 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml" 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1890492047, 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628591, 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml" 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1926942395, 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628611, 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml" 2024-08-02T18:52:16.365 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1964159766, 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628641, 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml" 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1984619879, 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628651, 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml" 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.366 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1995105235, 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628627, 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml" 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 1996988505, 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628587, 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml" 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2056172875, 2024-08-02T18:52:16.367 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628561, 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore" 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2087131108, 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628658, 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml" 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2116941779, 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628694, 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml" 2024-08-02T18:52:16.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2140262763, 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628576, 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl" 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2164997083, 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628738, 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml" 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.369 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2167339921, 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628707, 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg" 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2194168671, 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628567, 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl" 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.370 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2197778269, 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628580, 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media" 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2200505801, 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628750, 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml" 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.371 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2229103727, 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628594, 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml" 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2246038449, 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628735, 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml" 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2251439719, 2024-08-02T18:52:16.372 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628597, 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml" 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2269480371, 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628751, 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml" 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2274694271, 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628680, 2024-08-02T18:52:16.373 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml" 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2275143404, 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628568, 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl" 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2323188297, 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628666, 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml" 2024-08-02T18:52:16.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2323792345, 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628749, 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml" 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2326830891, 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628593, 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml" 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.375 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2358422588, 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628589, 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml" 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2376008431, 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628695, 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml" 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.376 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2380696763, 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628755, 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml" 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2387471357, 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628744, 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml" 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2396323801, 2024-08-02T18:52:16.377 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628753, 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml" 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2405696348, 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628690, 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml" 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.378 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2437653941, 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628740, 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml" 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2465869751, 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628684, 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml" 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.379 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2467486265, 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628566, 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl" 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2480472380, 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628733, 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml" 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.380 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2583949666, 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628679, 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml" 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2630026451, 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628635, 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml" 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2655948706, 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628698, 2024-08-02T18:52:16.381 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml" 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2677220652, 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628623, 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml" 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2691401339, 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628742, 2024-08-02T18:52:16.382 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml" 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2766483837, 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628671, 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml" 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2781550589, 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628613, 2024-08-02T18:52:16.383 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf" 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2791439076, 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628605, 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64" 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2813435370, 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628734, 2024-08-02T18:52:16.384 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml" 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2835013442, 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628649, 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml" 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2836928670, 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628711, 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf" 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.385 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2867515741, 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628584, 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64" 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2882797551, 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628631, 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf" 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.386 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2895789040, 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628682, 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml" 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2900862934, 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628610, 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml" 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2913041417, 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628660, 2024-08-02T18:52:16.387 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml" 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2947093931, 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628723, 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml" 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2956876134, 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628595, 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml" 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.388 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2967434665, 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628603, 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64" 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2975632728, 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628696, 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml" 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.389 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 2975663254, 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628681, 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml" 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3070919457, 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628565, 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl" 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3071340791, 2024-08-02T18:52:16.390 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628620, 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml" 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3101961342, 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628642, 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml" 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3145226937, 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628674, 2024-08-02T18:52:16.391 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml" 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3156323589, 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628662, 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml" 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3161139091, 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628625, 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml" 2024-08-02T18:52:16.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3165667695, 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628686, 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml" 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3171127201, 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628691, 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml" 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.393 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3193904201, 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628665, 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml" 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3207839784, 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628643, 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml" 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.394 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3224525257, 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628669, 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml" 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3251071908, 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628626, 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml" 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3284821075, 2024-08-02T18:52:16.395 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628655, 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml" 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3318073124, 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628675, 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml" 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3346460103, 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628634, 2024-08-02T18:52:16.396 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml" 2024-08-02T18:52:16.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.397 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.397 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.397 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3428355000, 2024-08-02T18:52:16.397 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628604, 2024-08-02T18:52:16.397 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64" 2024-08-02T18:52:16.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3448918211, 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628640, 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml" 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.398 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3491379419, 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628731, 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml" 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3501711306, 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628717, 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml" 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.399 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3501884064, 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628637, 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml" 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3527571763, 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628699, 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml" 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3564846084, 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628752, 2024-08-02T18:52:16.400 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml" 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3593164320, 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628745, 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml" 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3634754420, 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628676, 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml" 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3635466648, 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628718, 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml" 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3665034402, 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628653, 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml" 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.402 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3671592404, 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628629, 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml" 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3696765188, 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628727, 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml" 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.403 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3742531447, 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628592, 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf" 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3744086289, 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628601, 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64" 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3798483576, 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628688, 2024-08-02T18:52:16.404 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml" 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3871425965, 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628570, 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl" 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3890183413, 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628588, 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml" 2024-08-02T18:52:16.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3900254364, 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628590, 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml" 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3917516323, 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628714, 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml" 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.406 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3940241933, 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628573, 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl" 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3962995128, 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628617, 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml" 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.407 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3965022046, 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628621, 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml" 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3973427807, 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628732, 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml" 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.408 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3986351746, 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628648, 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml" 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 3989378170, 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628596, 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml" 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4016373030, 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628600, 2024-08-02T18:52:16.409 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64" 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4026943664, 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628579, 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl" 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4050863691, 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628650, 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml" 2024-08-02T18:52:16.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4061581666, 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628677, 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml" 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4139139721, 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628615, 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml" 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4150313392, 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628606, 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l" 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4182378951, 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628747, 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml" 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.412 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4194319575, 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628608, 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml" 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4218296883, 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628632, 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml" 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4233875181, 2024-08-02T18:52:16.413 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628639, 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml" 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4249736571, 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628705, 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg" 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4267355485, 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628585, 2024-08-02T18:52:16.414 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb" 2024-08-02T18:52:16.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:52:16.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:52:16.415 INFO:teuthology.orchestra.run.smithi103.stdout: "damage_type": "backtrace", 2024-08-02T18:52:16.415 INFO:teuthology.orchestra.run.smithi103.stdout: "id": 4278135646, 2024-08-02T18:52:16.415 INFO:teuthology.orchestra.run.smithi103.stdout: "ino": 1099511628646, 2024-08-02T18:52:16.415 INFO:teuthology.orchestra.run.smithi103.stdout: "path": "/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml" 2024-08-02T18:52:16.415 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:52:16.415 INFO:teuthology.orchestra.run.smithi103.stdout:] 2024-08-02T18:52:17.228 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph tell mds.1:0 damage ls 2024-08-02T18:52:17.490 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:52:17.741 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:17 smithi103 ceph-mon[32753]: pgmap v79: 129 pgs: 129 active+clean; 205 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 1.02k op/s 2024-08-02T18:52:17.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:17 smithi121 ceph-mon[37236]: pgmap v79: 129 pgs: 129 active+clean; 205 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 1.02k op/s 2024-08-02T18:52:17.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:17 smithi151 ceph-mon[37155]: pgmap v79: 129 pgs: 129 active+clean; 205 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.1 MiB/s wr, 1.02k op/s 2024-08-02T18:52:17.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 -- 172.21.15.103:0/2953803394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 msgr2=0x7f279c101d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:17.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/2953803394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 0x7f279c101d20 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f2790009930 tx=0x7f279002a420 comp rx=0 tx=0).stop 2024-08-02T18:52:17.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 -- 172.21.15.103:0/2953803394 shutdown_connections 2024-08-02T18:52:17.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/2953803394 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f279c102260 0x7f279c10e790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:17.993 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/2953803394 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 0x7f279c101d20 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/2953803394 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f279c1078c0 0x7f279c107ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 -- 172.21.15.103:0/2953803394 >> 172.21.15.103:0/2953803394 conn(0x7f279c0fd620 msgr2=0x7f279c0ffa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 -- 172.21.15.103:0/2953803394 shutdown_connections 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 -- 172.21.15.103:0/2953803394 wait complete. 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.991+0000 7f27a3ba9640 1 Processor -- start 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a3ba9640 1 -- start start 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a3ba9640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 0x7f279c198270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a3ba9640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f279c102260 0x7f279c1987b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a3ba9640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f279c1078c0 0x7f279c19cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a3ba9640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f279c111de0 con 0x7f279c1018c0 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a3ba9640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f279c111c60 con 0x7f279c102260 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a3ba9640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f279c111f60 con 0x7f279c1078c0 2024-08-02T18:52:17.994 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a1945640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 0x7f279c198270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:17.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a2146640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f279c1078c0 0x7f279c19cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:17.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a2146640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f279c1078c0 0x7f279c19cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.151:3300/0 says I am v2:172.21.15.103:53884/0 (socket says 172.21.15.103:53884) 2024-08-02T18:52:17.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a1945640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 0x7f279c198270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56832/0 (socket says 172.21.15.103:56832) 2024-08-02T18:52:17.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a2146640 1 -- 172.21.15.103:0/336916167 learned_addr learned my addr 172.21.15.103:0/336916167 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:17.995 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a1144640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f279c102260 0x7f279c1987b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a2146640 1 -- 172.21.15.103:0/336916167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f279c102260 msgr2=0x7f279c1987b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a2146640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f279c102260 0x7f279c1987b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a2146640 1 -- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 msgr2=0x7f279c198270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a2146640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 0x7f279c198270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a2146640 1 -- 172.21.15.103:0/336916167 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f279c19d220 con 0x7f279c1078c0 2024-08-02T18:52:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a1144640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f279c102260 0x7f279c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:17.996 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.992+0000 7f27a1945640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 0x7f279c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:17.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.993+0000 7f27a2146640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f279c1078c0 0x7f279c19cb40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f279400e970 tx=0x7f279400ed70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:17.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.993+0000 7f279affd640 1 -- 172.21.15.103:0/336916167 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279400ccc0 con 0x7f279c1078c0 2024-08-02T18:52:17.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.993+0000 7f27a3ba9640 1 -- 172.21.15.103:0/336916167 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f279c19d510 con 0x7f279c1078c0 2024-08-02T18:52:17.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.993+0000 7f279affd640 1 -- 172.21.15.103:0/336916167 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f279400ce60 con 0x7f279c1078c0 2024-08-02T18:52:17.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.993+0000 7f279affd640 1 -- 172.21.15.103:0/336916167 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2794010690 con 0x7f279c1078c0 2024-08-02T18:52:17.997 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.993+0000 7f27a3ba9640 1 -- 172.21.15.103:0/336916167 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f279c1a4df0 con 0x7f279c1078c0 2024-08-02T18:52:17.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.995+0000 7f279affd640 1 -- 172.21.15.103:0/336916167 <== mon.1 v2:172.21.15.151:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f27940046c0 con 0x7f279c1078c0 2024-08-02T18:52:17.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f27a5fa7740 1 Processor -- start 2024-08-02T18:52:17.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f27a5fa7740 1 -- start start 2024-08-02T18:52:17.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f279affd640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f27840a2d70 0x7f27840a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:17.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df7a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:17.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df7a7b0 0x55f80df890a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:17.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80df8b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:17.999 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f80dedfa40 con 0x55f80df79e90 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f80de779d0 con 0x55f80df7a7b0 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.996+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f80dedba00 con 0x55f80df895e0 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f279affd640 1 -- 172.21.15.103:0/336916167 <== mon.1 v2:172.21.15.151:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f27940cfba0 con 0x7f279c1078c0 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a1945640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df7a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a1144640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f27840a2d70 0x7f27840a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a1945640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df7a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56840/0 (socket says 172.21.15.103:56840) 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a1945640 1 -- 172.21.15.103:0/4009807796 learned_addr learned my addr 172.21.15.103:0/4009807796 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a2146640 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80df8b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a1144640 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df7a7b0 0x55f80df890a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a2146640 1 -- 172.21.15.103:0/4009807796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df7a7b0 msgr2=0x55f80df890a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a2146640 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df7a7b0 0x55f80df890a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a2146640 1 -- 172.21.15.103:0/4009807796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 msgr2=0x55f80df7a270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:18.000 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a2146640 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df7a270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a2146640 1 -- 172.21.15.103:0/4009807796 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80de7e650 con 0x55f80df895e0 2024-08-02T18:52:18.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a2146640 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80df8b9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27940ccf50 tx=0x7f279409b740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6e3ab47be78d823 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:18.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f2783fff640 1 -- 172.21.15.103:0/4009807796 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279409c420 con 0x55f80df895e0 2024-08-02T18:52:18.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f27a1144640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f27840a2d70 0x7f27840a5230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2790009900 tx=0x7f2790000bc0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:18.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f2783fff640 1 -- 172.21.15.103:0/4009807796 <== mon.1 v2:172.21.15.151:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2794078f30 con 0x55f80df895e0 2024-08-02T18:52:18.001 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.997+0000 7f2783fff640 1 -- 172.21.15.103:0/4009807796 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f279407ab40 con 0x55f80df895e0 2024-08-02T18:52:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 -- 172.21.15.103:0/4009807796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 msgr2=0x55f80df8b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:18.006 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80df8b9d0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f27940ccf50 tx=0x7f279409b740 comp rx=0 tx=0).stop 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 -- 172.21.15.103:0/4009807796 shutdown_connections 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80df8b9d0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df7a7b0 0x55f80df890a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/4009807796 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df7a270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 -- 172.21.15.103:0/4009807796 >> 172.21.15.103:0/4009807796 conn(0x55f80df76580 msgr2=0x55f80df76960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 -- 172.21.15.103:0/4009807796 shutdown_connections 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.998+0000 7f27a5fa7740 1 -- 172.21.15.103:0/4009807796 wait complete. 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 1 -- start start 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 1 Processor -- start 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df86570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df86ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df895e0 0x55f80df86ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x55f80df8c1b0 con 0x55f80df79e90 2024-08-02T18:52:18.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x55f80de9ab20 con 0x55f80df895e0 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x55f80df8c330 con 0x55f80df7a7b0 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a5fa7740 10 client.0 _ll_register_callbacks cb 0x55f80de98bb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a1945640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df86570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a1945640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df86570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56856/0 (socket says 172.21.15.103:56856) 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a1945640 1 -- 172.21.15.103:0/1083240599 learned_addr learned my addr 172.21.15.103:0/1083240599 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:17.999+0000 7f27a1144640 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df86ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a2146640 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df895e0 0x55f80df86ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a1144640 1 -- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df895e0 msgr2=0x55f80df86ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a1144640 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df895e0 0x55f80df86ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a1144640 1 -- 172.21.15.103:0/1083240599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 msgr2=0x55f80df86570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a1144640 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df86570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a1144640 1 -- 172.21.15.103:0/1083240599 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f80dc513c0 con 0x55f80df7a7b0 2024-08-02T18:52:18.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a2146640 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df895e0 0x55f80df86ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a1144640 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df86ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2790005940 tx=0x7f2790009260 comp rx=0 tx=0).ready entity=mon.1 client_cookie=438259d337a63bd6 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27817fa640 10 client.0 ms_handle_connect on v2:172.21.15.151:3300/0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27817fa640 1 -- 172.21.15.103:0/1083240599 <== mon.1 v2:172.21.15.151:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790050060 con 0x55f80df7a7b0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a5fa7740 1 -- 172.21.15.103:0/1083240599 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f2794078f30 con 0x55f80df7a7b0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27817fa640 1 -- 172.21.15.103:0/1083240599 <== mon.1 v2:172.21.15.151:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f279004b460 con 0x55f80df7a7b0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27817fa640 1 -- 172.21.15.103:0/1083240599 <== mon.1 v2:172.21.15.151:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2790057050 con 0x55f80df7a7b0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a5fa7740 10 client.25663 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27a5fa7740 1 -- 172.21.15.103:0/1083240599 --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f80df97ea0 con 0x55f80df7a7b0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.000+0000 7f27817fa640 1 -- 172.21.15.103:0/1083240599 <== mon.1 v2:172.21.15.151:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f2794078f30 con 0x55f80df7a7b0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27817fa640 1 -- 172.21.15.103:0/1083240599 <== mon.1 v2:172.21.15.151:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f279003d740 con 0x55f80df7a7b0 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27a5fa7740 10 client.25663 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27a5fa7740 10 client.25663 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27a5fa7740 20 client.25663 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:18.009 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f80df99800 0x55f80df9bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27a5fa7740 4 client.25663 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27a5fa7740 1 -- 172.21.15.103:0/1083240599 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f80deecfb0 con 0x55f80df99800 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27a1945640 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f80df99800 0x55f80df9bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27a1945640 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f80df99800 0x55f80df9bc60 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d8e824467dadfedc server_cookie=f4b051a974c5249f in_seq=0 out_seq=0 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.001+0000 7f27817fa640 10 client.25663 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27817fa640 1 -- 172.21.15.103:0/1083240599 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x55f80deecfb0 con 0x55f80df99800 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27817fa640 10 client.25663 handle_command_reply: tid=0 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 client.25663 shutdown 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 -- 172.21.15.103:0/1083240599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 msgr2=0x55f80df86ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df86ab0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f2790005940 tx=0x7f2790009260 comp rx=0 tx=0).stop 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 -- 172.21.15.103:0/1083240599 shutdown_connections 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f80df99800 0x55f80df9bc60 crc :-1 s=READY pgs=96 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df895e0 0x55f80df86ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df86ab0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/1083240599 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df79e90 0x55f80df86570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 -- 172.21.15.103:0/1083240599 >> 172.21.15.103:0/1083240599 conn(0x55f80df76580 msgr2=0x55f80df7c2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27817fa640 0 client.25663 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 -- 172.21.15.103:0/1083240599 shutdown_connections 2024-08-02T18:52:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 1 -- 172.21.15.103:0/1083240599 wait complete. 2024-08-02T18:52:18.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.002+0000 7f27a5fa7740 20 client.25663 trim_cache size 0 max 16384 2024-08-02T18:52:18.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a5fa7740 1 Processor -- start 2024-08-02T18:52:18.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a5fa7740 1 -- start start 2024-08-02T18:52:18.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df818c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df7a7b0 0x55f80df81e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80dfa1530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.019 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1af4d0 con 0x55f80df7a7b0 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1acce0 con 0x55f80df79e90 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1aab30 con 0x55f80df895e0 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1144640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df7a7b0 0x55f80df81e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1144640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df7a7b0 0x55f80df81e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:56862/0 (socket says 172.21.15.103:56862) 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1144640 1 -- 172.21.15.103:0/2718891621 learned_addr learned my addr 172.21.15.103:0/2718891621 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1945640 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df818c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a2146640 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80dfa1530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1144640 1 -- 172.21.15.103:0/2718891621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 msgr2=0x55f80dfa1530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1144640 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80dfa1530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1144640 1 -- 172.21.15.103:0/2718891621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 msgr2=0x55f80df818c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1144640 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df818c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1144640 1 -- 172.21.15.103:0/2718891621 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f80df813b0 con 0x55f80df7a7b0 2024-08-02T18:52:18.020 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.016+0000 7f27a1945640 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df818c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.017+0000 7f27a1144640 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df7a7b0 0x55f80df81e00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f279003db60 tx=0x7f27900058d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b41bb188bbdd328a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.017+0000 7f27837fe640 1 -- 172.21.15.103:0/2718891621 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790050040 con 0x55f80df7a7b0 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.017+0000 7f27837fe640 1 -- 172.21.15.103:0/2718891621 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f279004b460 con 0x55f80df7a7b0 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.017+0000 7f27837fe640 1 -- 172.21.15.103:0/2718891621 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2790035040 con 0x55f80df7a7b0 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.017+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2718891621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df7a7b0 msgr2=0x55f80df81e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.017+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df7a7b0 0x55f80df81e00 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f279003db60 tx=0x7f27900058d0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2718891621 shutdown_connections 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df895e0 0x55f80dfa1530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df7a7b0 0x55f80df81e00 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2718891621 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df818c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2718891621 >> 172.21.15.103:0/2718891621 conn(0x55f80df76580 msgr2=0x55f80df84e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2718891621 shutdown_connections 2024-08-02T18:52:18.021 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2718891621 wait complete. 2024-08-02T18:52:18.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 -- start start 2024-08-02T18:52:18.022 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.018+0000 7f27a5fa7740 1 Processor -- start 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df84010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df915c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a5fa7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df895e0 0x55f80df91b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ab1a0 con 0x55f80df895e0 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ac610 con 0x55f80df79e90 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a5fa7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f279c1ab870 con 0x55f80df7a7b0 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a1945640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df84010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a2146640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df895e0 0x55f80df91b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a1945640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df84010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:44244/0 (socket says 172.21.15.103:44244) 2024-08-02T18:52:18.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a1144640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df915c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a1945640 1 -- 172.21.15.103:0/2072324591 learned_addr learned my addr 172.21.15.103:0/2072324591 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a5fa7740 10 client.0 _ll_register_callbacks cb 0x7f2794005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a2146640 1 -- 172.21.15.103:0/2072324591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 msgr2=0x55f80df915c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a2146640 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df915c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a2146640 1 -- 172.21.15.103:0/2072324591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 msgr2=0x55f80df84010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a2146640 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df84010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a2146640 1 -- 172.21.15.103:0/2072324591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f80df827e0 con 0x55f80df895e0 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a1144640 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df915c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a1945640 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df84010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:18.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27a2146640 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df895e0 0x55f80df91b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f279409bee0 tx=0x7f2794005740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930d57a955b975e1 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.019+0000 7f27817fa640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27817fa640 1 -- 172.21.15.103:0/2072324591 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f27940b8070 con 0x55f80df895e0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27817fa640 1 -- 172.21.15.103:0/2072324591 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7f27940a4500 con 0x55f80df895e0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2072324591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f279004b460 con 0x55f80df895e0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27817fa640 1 -- 172.21.15.103:0/2072324591 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7f2794083050 con 0x55f80df895e0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 10 client.16215 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2072324591 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x55f80e003650 con 0x55f80df895e0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27817fa640 1 -- 172.21.15.103:0/2072324591 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f279004b460 con 0x55f80df895e0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27817fa640 1 -- 172.21.15.103:0/2072324591 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7f27940a4be0 con 0x55f80df895e0 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 10 client.16215 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 10 client.16215 resolve_mds: resolved 1:0 to role '1:0' aka daemon mds.b 2024-08-02T18:52:18.028 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 20 client.16215 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f80e003930 0x55f80e005d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 4 client.16215 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "damage ls"}] 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2072324591 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "damage ls"}) -- 0x55f80dee74c0 con 0x55f80e003930 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.020+0000 7f27a1945640 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f80e003930 0x55f80e005d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27817fa640 10 client.16215 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a1945640 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f80e003930 0x55f80e005d50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=48e8934c169cd00 server_cookie=9d532d178a207c36 in_seq=0 out_seq=0 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27817fa640 1 -- 172.21.15.103:0/2072324591 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+3 (crc 0 0 0) 0x55f80dee74c0 con 0x55f80e003930 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27817fa640 10 client.16215 handle_command_reply: tid=0 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 client.16215 shutdown 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2072324591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df895e0 msgr2=0x55f80df91b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df895e0 0x55f80df91b00 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f279409bee0 tx=0x7f2794005740 comp rx=0 tx=0).stop 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2072324591 shutdown_connections 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x55f80e003930 0x55f80e005d50 crc :-1 s=READY pgs=97 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x55f80df895e0 0x55f80df91b00 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.029 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x55f80df7a7b0 0x55f80df915c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 --2- 172.21.15.103:0/2072324591 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x55f80df79e90 0x55f80df84010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2072324591 >> 172.21.15.103:0/2072324591 conn(0x55f80df76580 msgr2=0x55f80df818c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:18.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27817fa640 0 client.16215 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:18.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2072324591 shutdown_connections 2024-08-02T18:52:18.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.021+0000 7f27a5fa7740 1 -- 172.21.15.103:0/2072324591 wait complete. 2024-08-02T18:52:18.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a5fa7740 20 client.16215 trim_cache size 0 max 16384 2024-08-02T18:52:18.030 INFO:teuthology.orchestra.run.smithi103.stdout:[] 2024-08-02T18:52:18.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 -- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f27840a2d70 msgr2=0x7f27840a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:18.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f27840a2d70 0x7f27840a5230 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f2790009900 tx=0x7f2790000bc0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 -- 172.21.15.103:0/336916167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f279c1078c0 msgr2=0x7f279c19cb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:18.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f279c1078c0 0x7f279c19cb40 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f279400e970 tx=0x7f279400ed70 comp rx=0 tx=0).stop 2024-08-02T18:52:18.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 -- 172.21.15.103:0/336916167 shutdown_connections 2024-08-02T18:52:18.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f27840a2d70 0x7f27840a5230 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.031 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f279c1078c0 0x7f279c19cb40 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f279c102260 0x7f279c1987b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 --2- 172.21.15.103:0/336916167 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f279c1018c0 0x7f279c198270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:18.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 -- 172.21.15.103:0/336916167 >> 172.21.15.103:0/336916167 conn(0x7f279c0fd620 msgr2=0x7f279c0fdd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:18.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 -- 172.21.15.103:0/336916167 shutdown_connections 2024-08-02T18:52:18.032 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:18.022+0000 7f27a3ba9640 1 -- 172.21.15.103:0/336916167 wait complete. 2024-08-02T18:52:18.890 ERROR:tasks.fwd_scrub:rank 2 damaged: [{'damage_type': 'backtrace', 'id': 22818349, 'ino': 1099511628368, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/pstore'}, {'damage_type': 'backtrace', 'id': 41421271, 'ino': 1099511628436, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-grcan'}, {'damage_type': 'backtrace', 'id': 94957110, 'ino': 1099511628391, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-i2c-devices-lm3533'}, {'damage_type': 'backtrace', 'id': 151965859, 'ino': 1099511628485, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-koneplus'}, {'damage_type': 'backtrace', 'id': 207659465, 'ino': 1099511628500, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-tegra-fuse'}, {'damage_type': 'backtrace', 'id': 224044757, 'ino': 1099511628498, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-samsung-laptop'}, {'damage_type': 'backtrace', 'id': 233715833, 'ino': 1099511628452, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-edac'}, {'damage_type': 'backtrace', 'id': 260041209, 'ino': 1099511628549, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ptp'}, {'damage_type': 'backtrace', 'id': 304536679, 'ino': 1099511628341, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-ecm'}, {'damage_type': 'backtrace', 'id': 455501916, 'ino': 1099511628327, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-qla2xxx'}, {'damage_type': 'backtrace', 'id': 551003006, 'ino': 1099511628377, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-bcma'}, {'damage_type': 'backtrace', 'id': 583879077, 'ino': 1099511628508, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi-runtime-map'}, {'damage_type': 'backtrace', 'id': 584187234, 'ino': 1099511628318, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-backlight'}, {'damage_type': 'backtrace', 'id': 611891350, 'ino': 1099511628455, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-memory'}, {'damage_type': 'backtrace', 'id': 613108955, 'ino': 1099511628313, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/syscalls'}, {'damage_type': 'backtrace', 'id': 613244598, 'ino': 1099511628370, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block'}, {'damage_type': 'backtrace', 'id': 620029308, 'ino': 1099511628407, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-platform'}, {'damage_type': 'backtrace', 'id': 633680279, 'ino': 1099511628494, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-input-axp-pek'}, {'damage_type': 'backtrace', 'id': 643693001, 'ino': 1099511628323, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-node'}, {'damage_type': 'backtrace', 'id': 689045614, 'ino': 1099511628547, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-pps'}, {'damage_type': 'backtrace', 'id': 750222510, 'ino': 1099511628495, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-intel-rapid-start'}, {'damage_type': 'backtrace', 'id': 750341782, 'ino': 1099511628532, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-memory-page-offline'}, {'damage_type': 'backtrace', 'id': 783246141, 'ino': 1099511628503, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkback'}, {'damage_type': 'backtrace', 'id': 818626864, 'ino': 1099511628426, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-lcd'}, {'damage_type': 'backtrace', 'id': 853410550, 'ino': 1099511628484, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kone'}, {'damage_type': 'backtrace', 'id': 873144101, 'ino': 1099511628400, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-trigger-sysfs'}, {'damage_type': 'backtrace', 'id': 896724116, 'ino': 1099511628446, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-rtc-rtc0-device-rtc_calibration'}, {'damage_type': 'backtrace', 'id': 917046685, 'ino': 1099511628460, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-sh_mobile_lcdc_fb'}, {'damage_type': 'backtrace', 'id': 971187887, 'ino': 1099511628526, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm'}, {'damage_type': 'backtrace', 'id': 974559888, 'ino': 1099511628329, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-w1_ds28e04'}, {'damage_type': 'backtrace', 'id': 982536603, 'ino': 1099511628385, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_24x7'}, {'damage_type': 'backtrace', 'id': 1035615379, 'ino': 1099511628415, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-cfq-target-latency'}, {'damage_type': 'backtrace', 'id': 1041198418, 'ino': 1099511628542, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-kim'}, {'damage_type': 'backtrace', 'id': 1072533159, 'ino': 1099511628335, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/thermal-notification'}, {'damage_type': 'backtrace', 'id': 1075795813, 'ino': 1099511628510, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-log'}, {'damage_type': 'backtrace', 'id': 1112942633, 'ino': 1099511628477, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-lenovo'}, {'damage_type': 'backtrace', 'id': 1161348433, 'ino': 1099511628347, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-midi'}, {'damage_type': 'backtrace', 'id': 1187232606, 'ino': 1099511628312, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/o2cb'}, {'damage_type': 'backtrace', 'id': 1193510674, 'ino': 1099511628338, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-spear-pcie-gadget'}, {'damage_type': 'backtrace', 'id': 1238240406, 'ino': 1099511628336, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/vdso'}, {'damage_type': 'backtrace', 'id': 1265882774, 'ino': 1099511628322, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-udc'}, {'damage_type': 'backtrace', 'id': 1275912379, 'ino': 1099511628474, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-xen_cpu'}, {'damage_type': 'backtrace', 'id': 1283084927, 'ino': 1099511628492, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-srws1'}, {'damage_type': 'backtrace', 'id': 1311892308, 'ino': 1099511628331, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-dump'}, {'damage_type': 'backtrace', 'id': 1331428199, 'ino': 1099511628315, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-firewire'}, {'damage_type': 'backtrace', 'id': 1349327776, 'ino': 1099511628374, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-block-zram'}, {'damage_type': 'backtrace', 'id': 1353632141, 'ino': 1099511628369, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ata'}, {'damage_type': 'backtrace', 'id': 1355096400, 'ino': 1099511628402, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-media'}, {'damage_type': 'backtrace', 'id': 1366184819, 'ino': 1099511628442, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-powercap'}, {'damage_type': 'backtrace', 'id': 1371934752, 'ino': 1099511628314, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-acpi-pmprofile'}, {'damage_type': 'backtrace', 'id': 1378880746, 'ino': 1099511628487, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-kovaplus'}, {'damage_type': 'backtrace', 'id': 1415322075, 'ino': 1099511628486, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-konepure'}, {'damage_type': 'backtrace', 'id': 1427987691, 'ino': 1099511628546, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-power'}, {'damage_type': 'backtrace', 'id': 1458641151, 'ino': 1099511628466, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_wakeup'}, {'damage_type': 'backtrace', 'id': 1458971814, 'ino': 1099511628540, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-eeepc-laptop'}, {'damage_type': 'backtrace', 'id': 1504227889, 'ino': 1099511628361, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-olpc'}, {'damage_type': 'backtrace', 'id': 1521891042, 'ino': 1099511628425, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu-intel-iommu'}, {'damage_type': 'backtrace', 'id': 1563747212, 'ino': 1099511628457, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-online'}, {'damage_type': 'backtrace', 'id': 1617854202, 'ino': 1099511628317, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-xen-backend'}, {'damage_type': 'backtrace', 'id': 1791777038, 'ino': 1099511628536, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-asus-wmi'}, {'damage_type': 'backtrace', 'id': 1813831331, 'ino': 1099511628431, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mic.txt'}, {'damage_type': 'backtrace', 'id': 1843390104, 'ino': 1099511628397, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-light-lm3533-als'}, {'damage_type': 'backtrace', 'id': 1871682575, 'ino': 1099511628384, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-format'}, {'damage_type': 'backtrace', 'id': 1903445982, 'ino': 1099511628320, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-tpm'}, {'damage_type': 'backtrace', 'id': 1910785945, 'ino': 1099511628311, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/firewire-cdev'}, {'damage_type': 'backtrace', 'id': 1944383500, 'ino': 1099511628550, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-tty'}, {'damage_type': 'backtrace', 'id': 1948473117, 'ino': 1099511628332, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-opal-elog'}, {'damage_type': 'backtrace', 'id': 1971768638, 'ino': 1099511628340, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-acm'}, {'damage_type': 'backtrace', 'id': 1986022550, 'ino': 1099511628505, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-acpi'}, {'damage_type': 'backtrace', 'id': 1992375677, 'ino': 1099511628387, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-fcoe'}, {'damage_type': 'backtrace', 'id': 2033529384, 'ino': 1099511628440, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-pktcdvd'}, {'damage_type': 'backtrace', 'id': 2047960859, 'ino': 1099511628433, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net'}, {'damage_type': 'backtrace', 'id': 2086935595, 'ino': 1099511628401, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mdio'}, {'damage_type': 'backtrace', 'id': 2143635583, 'ino': 1099511628529, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-slab'}, {'damage_type': 'backtrace', 'id': 2162232236, 'ino': 1099511628479, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-multitouch'}, {'damage_type': 'backtrace', 'id': 2177107133, 'ino': 1099511628513, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sfi'}, {'damage_type': 'backtrace', 'id': 2188490468, 'ino': 1099511628439, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-net-statistics'}, {'damage_type': 'backtrace', 'id': 2198176859, 'ino': 1099511628551, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-wusb_cbaf'}, {'damage_type': 'backtrace', 'id': 2204925369, 'ino': 1099511628483, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-isku'}, {'damage_type': 'backtrace', 'id': 2229878745, 'ino': 1099511628403, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-mei'}, {'damage_type': 'backtrace', 'id': 2266128878, 'ino': 1099511628358, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-driver-genwqe'}, {'damage_type': 'backtrace', 'id': 2269883283, 'ino': 1099511628356, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uac2'}, {'damage_type': 'backtrace', 'id': 2357237094, 'ino': 1099511628458, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-platform-_UDC_-gadget'}, {'damage_type': 'backtrace', 'id': 2455009610, 'ino': 1099511628472, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-system-cpu'}, {'damage_type': 'backtrace', 'id': 2466004302, 'ino': 1099511628516, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-f2fs'}, {'damage_type': 'backtrace', 'id': 2476357127, 'ino': 1099511628520, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-i2c-bmp085'}, {'damage_type': 'backtrace', 'id': 2558580225, 'ino': 1099511628428, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-led-driver-lm3533'}, {'damage_type': 'backtrace', 'id': 2572982959, 'ino': 1099511628325, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-xen_memory'}, {'damage_type': 'backtrace', 'id': 2588793762, 'ino': 1099511628507, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-efi'}, {'damage_type': 'backtrace', 'id': 2599255891, 'ino': 1099511628319, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-rfkill'}, {'damage_type': 'backtrace', 'id': 2635505713, 'ino': 1099511628326, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-ib_srp'}, {'damage_type': 'backtrace', 'id': 2720250741, 'ino': 1099511628541, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-ideapad-laptop'}, {'damage_type': 'backtrace', 'id': 2766123470, 'ino': 1099511628419, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-bdi'}, {'damage_type': 'backtrace', 'id': 2771349899, 'ino': 1099511628511, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-memmap'}, {'damage_type': 'backtrace', 'id': 2782415558, 'ino': 1099511628363, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pktcdvd'}, {'damage_type': 'backtrace', 'id': 2809563693, 'ino': 1099511628360, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-ideapad'}, {'damage_type': 'backtrace', 'id': 2817958763, 'ino': 1099511628490, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-roccat-ryos'}, {'damage_type': 'backtrace', 'id': 2839167142, 'ino': 1099511628471, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-sun'}, {'damage_type': 'backtrace', 'id': 2860745504, 'ino': 1099511628316, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-bus-usb'}, {'damage_type': 'backtrace', 'id': 2869750483, 'ino': 1099511628456, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-mmc'}, {'damage_type': 'backtrace', 'id': 2906390924, 'ino': 1099511628461, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power'}, {'damage_type': 'backtrace', 'id': 2913776019, 'ino': 1099511628432, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-mtd'}, {'damage_type': 'backtrace', 'id': 2984516656, 'ino': 1099511628328, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-driver-usb-usbtmc'}, {'damage_type': 'backtrace', 'id': 3051879771, 'ino': 1099511628379, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etm3x'}, {'damage_type': 'backtrace', 'id': 3054461010, 'ino': 1099511628362, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/debugfs-pfo-nx-crypto'}, {'damage_type': 'backtrace', 'id': 3125208813, 'ino': 1099511628357, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-uvc'}, {'damage_type': 'backtrace', 'id': 3142179253, 'ino': 1099511628352, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-serial'}, {'damage_type': 'backtrace', 'id': 3193779806, 'ino': 1099511628386, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-event_source-devices-hv_gpci'}, {'damage_type': 'backtrace', 'id': 3195492518, 'ino': 1099511628365, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/evm'}, {'damage_type': 'backtrace', 'id': 3213042332, 'ino': 1099511628539, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-chipidea-usb-otg'}, {'damage_type': 'backtrace', 'id': 3239094105, 'ino': 1099511628481, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-hid-prodikeys'}, {'damage_type': 'backtrace', 'id': 3250993832, 'ino': 1099511628450, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-dev'}, {'damage_type': 'backtrace', 'id': 3269652505, 'ino': 1099511628423, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-iommu'}, {'damage_type': 'backtrace', 'id': 3352197433, 'ino': 1099511628409, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-rpmsg'}, {'damage_type': 'backtrace', 'id': 3372583682, 'ino': 1099511628523, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-fscaps'}, {'damage_type': 'backtrace', 'id': 3379230467, 'ino': 1099511628475, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-genwqe'}, {'damage_type': 'backtrace', 'id': 3464021379, 'ino': 1099511628417, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-backlight-driver-adp8870'}, {'damage_type': 'backtrace', 'id': 3676818861, 'ino': 1099511628514, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-sgi_uv'}, {'damage_type': 'backtrace', 'id': 3729879358, 'ino': 1099511628396, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-iio-gyro-bmg160'}, {'damage_type': 'backtrace', 'id': 3768003269, 'ino': 1099511628321, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-class-ubi'}, {'damage_type': 'backtrace', 'id': 3795759762, 'ino': 1099511628534, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-ocfs2'}, {'damage_type': 'backtrace', 'id': 3852096129, 'ino': 1099511628533, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-module'}, {'damage_type': 'backtrace', 'id': 3867647136, 'ino': 1099511628537, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-at91'}, {'damage_type': 'backtrace', 'id': 3894369830, 'ino': 1099511628464, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-power_resources_D2'}, {'damage_type': 'backtrace', 'id': 3914188621, 'ino': 1099511628378, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-bus-coresight-devices-etb10'}, {'damage_type': 'backtrace', 'id': 3917806074, 'ino': 1099511628333, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-module'}, {'damage_type': 'backtrace', 'id': 3918548604, 'ino': 1099511628544, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-platform-tahvo-usb'}, {'damage_type': 'backtrace', 'id': 3936070372, 'ino': 1099511628506, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-dmi'}, {'damage_type': 'backtrace', 'id': 3965157167, 'ino': 1099511628345, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-loopback'}, {'damage_type': 'backtrace', 'id': 3974492404, 'ino': 1099511628468, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-real_power_state'}, {'damage_type': 'backtrace', 'id': 3982841669, 'ino': 1099511628448, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-class-uwb_rc'}, {'damage_type': 'backtrace', 'id': 3992102547, 'ino': 1099511628522, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-boot_params'}, {'damage_type': 'backtrace', 'id': 4009861084, 'ino': 1099511628346, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/configfs-usb-gadget-mass-storage'}, {'damage_type': 'backtrace', 'id': 4010072298, 'ino': 1099511628504, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-driver-xen-blkfront'}, {'damage_type': 'backtrace', 'id': 4025965557, 'ino': 1099511628330, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-firmware-efi-vars'}, {'damage_type': 'backtrace', 'id': 4048884468, 'ino': 1099511628515, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-fs-ext4'}, {'damage_type': 'backtrace', 'id': 4058305485, 'ino': 1099511628470, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-devices-soc'}, {'damage_type': 'backtrace', 'id': 4095962422, 'ino': 1099511628512, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-firmware-ofw'}, {'damage_type': 'backtrace', 'id': 4106828290, 'ino': 1099511628528, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/testing/sysfs-kernel-mm-ksm'}, {'damage_type': 'backtrace', 'id': 4191646467, 'ino': 1099511628324, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-devices-system-cpu'}, {'damage_type': 'backtrace', 'id': 4215522924, 'ino': 1099511628334, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/ABI/stable/sysfs-transport-srp'}] 2024-08-02T18:52:18.891 ERROR:tasks.fwd_scrub:rank 1 damaged: [{'damage_type': 'backtrace', 'id': 7600673, 'ino': 1099511628737, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-edid.xml'}, {'damage_type': 'backtrace', 'id': 10769178, 'ino': 1099511628708, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2.xml'}, {'damage_type': 'backtrace', 'id': 57050196, 'ino': 1099511628586, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/.gitignore'}, {'damage_type': 'backtrace', 'id': 78310113, 'ino': 1099511628667, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs08.xml'}, {'damage_type': 'backtrace', 'id': 82010960, 'ino': 1099511628609, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/capture.c.xml'}, {'damage_type': 'backtrace', 'id': 104122925, 'ino': 1099511628607, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/.gitignore'}, {'damage_type': 'backtrace', 'id': 186798076, 'ino': 1099511628757, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-query-dv-timings.xml'}, {'damage_type': 'backtrace', 'id': 204790957, 'ino': 1099511628703, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.svg'}, {'damage_type': 'backtrace', 'id': 231306699, 'ino': 1099511628630, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_bt.pdf'}, {'damage_type': 'backtrace', 'id': 291582813, 'ino': 1099511628687, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y41p.xml'}, {'damage_type': 'backtrace', 'id': 313245547, 'ino': 1099511628730, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumstd.xml'}, {'damage_type': 'backtrace', 'id': 342825710, 'ino': 1099511628616, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-effect.xml'}, {'damage_type': 'backtrace', 'id': 400477906, 'ino': 1099511628722, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-fmt.xml'}, {'damage_type': 'backtrace', 'id': 435227699, 'ino': 1099511628569, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/drm.tmpl'}, {'damage_type': 'backtrace', 'id': 462636314, 'ino': 1099511628598, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/video.xml'}, {'damage_type': 'backtrace', 'id': 500782744, 'ino': 1099511628668, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cs14le.xml'}, {'damage_type': 'backtrace', 'id': 515597086, 'ino': 1099511628670, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu16le.xml'}, {'damage_type': 'backtrace', 'id': 583526484, 'ino': 1099511628754, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-overlay.xml'}, {'damage_type': 'backtrace', 'id': 610416105, 'ino': 1099511628715, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-chip-info.xml'}, {'damage_type': 'backtrace', 'id': 623940100, 'ino': 1099511628644, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/libv4l.xml'}, {'damage_type': 'backtrace', 'id': 637646101, 'ino': 1099511628574, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-hacking.tmpl'}, {'damage_type': 'backtrace', 'id': 644090340, 'ino': 1099511628602, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt.gif.b64'}, {'damage_type': 'backtrace', 'id': 657376288, 'ino': 1099511628724, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-framesizes.xml'}, {'damage_type': 'backtrace', 'id': 658559666, 'ino': 1099511628578, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/librs.tmpl'}, {'damage_type': 'backtrace', 'id': 661277245, 'ino': 1099511628692, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv422p.xml'}, {'damage_type': 'backtrace', 'id': 667817525, 'ino': 1099511628712, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_hsync.pdf'}, {'damage_type': 'backtrace', 'id': 716721936, 'ino': 1099511628575, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-locking.tmpl'}, {'damage_type': 'backtrace', 'id': 723656774, 'ino': 1099511628720, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-encoder-cmd.xml'}, {'damage_type': 'backtrace', 'id': 733647630, 'ino': 1099511628581, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/Makefile'}, {'damage_type': 'backtrace', 'id': 779745054, 'ino': 1099511628672, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgbrg8.xml'}, {'damage_type': 'backtrace', 'id': 791424560, 'ino': 1099511628736, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-dv-timings.xml'}, {'damage_type': 'backtrace', 'id': 798937272, 'ino': 1099511628746, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-output.xml'}, {'damage_type': 'backtrace', 'id': 806246085, 'ino': 1099511628721, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-dv-timings.xml'}, {'damage_type': 'backtrace', 'id': 810141857, 'ino': 1099511628652, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-links.xml'}, {'damage_type': 'backtrace', 'id': 812490858, 'ino': 1099511628700, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selections-common.xml'}, {'damage_type': 'backtrace', 'id': 817397250, 'ino': 1099511628624, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sdr.xml'}, {'damage_type': 'backtrace', 'id': 821546916, 'ino': 1099511628728, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enuminput.xml'}, {'damage_type': 'backtrace', 'id': 830399384, 'ino': 1099511628689, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv411p.xml'}, {'damage_type': 'backtrace', 'id': 847364988, 'ino': 1099511628633, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-ioctl.xml'}, {'damage_type': 'backtrace', 'id': 852474917, 'ino': 1099511628748, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-priority.xml'}, {'damage_type': 'backtrace', 'id': 852636162, 'ino': 1099511628729, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumoutput.xml'}, {'damage_type': 'backtrace', 'id': 881296237, 'ino': 1099511628693, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuyv.xml'}, {'damage_type': 'backtrace', 'id': 884575317, 'ino': 1099511628577, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl'}, {'damage_type': 'backtrace', 'id': 889316459, 'ino': 1099511628697, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/planar-apis.xml'}, {'damage_type': 'backtrace', 'id': 925231476, 'ino': 1099511628725, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-freq-bands.xml'}, {'damage_type': 'backtrace', 'id': 985098707, 'ino': 1099511628583, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/constraints.png.b64'}, {'damage_type': 'backtrace', 'id': 1040208895, 'ino': 1099511628706, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.dia'}, {'damage_type': 'backtrace', 'id': 1062066776, 'ino': 1099511628741, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fmt.xml'}, {'damage_type': 'backtrace', 'id': 1066047875, 'ino': 1099511628564, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/alsa-driver-api.tmpl'}, {'damage_type': 'backtrace', 'id': 1078115789, 'ino': 1099511628614, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-capture.xml'}, {'damage_type': 'backtrace', 'id': 1092667144, 'ino': 1099511628563, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/Makefile'}, {'damage_type': 'backtrace', 'id': 1104347423, 'ino': 1099511628654, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pipeline.pdf'}, {'damage_type': 'backtrace', 'id': 1104560851, 'ino': 1099511628713, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-create-bufs.xml'}, {'damage_type': 'backtrace', 'id': 1115603384, 'ino': 1099511628645, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/lirc_device_interface.xml'}, {'damage_type': 'backtrace', 'id': 1161072099, 'ino': 1099511628716, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dbg-g-register.xml'}, {'damage_type': 'backtrace', 'id': 1175334347, 'ino': 1099511628683, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10.xml'}, {'damage_type': 'backtrace', 'id': 1188610533, 'ino': 1099511628628, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/driver.xml'}, {'damage_type': 'backtrace', 'id': 1195145658, 'ino': 1099511628622, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-raw-vbi.xml'}, {'damage_type': 'backtrace', 'id': 1293067792, 'ino': 1099511628710, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_525.pdf'}, {'damage_type': 'backtrace', 'id': 1326206966, 'ino': 1099511628704, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.dia'}, {'damage_type': 'backtrace', 'id': 1352738828, 'ino': 1099511628678, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb12.xml'}, {'damage_type': 'backtrace', 'id': 1363653650, 'ino': 1099511628756, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-qbuf.xml'}, {'damage_type': 'backtrace', 'id': 1365757234, 'ino': 1099511628719, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dv-timings-cap.xml'}, {'damage_type': 'backtrace', 'id': 1415399251, 'ino': 1099511628657, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12.xml'}, {'damage_type': 'backtrace', 'id': 1415618006, 'ino': 1099511628572, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/genericirq.tmpl'}, {'damage_type': 'backtrace', 'id': 1425414510, 'ino': 1099511628571, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/gadget.tmpl'}, {'damage_type': 'backtrace', 'id': 1432256988, 'ino': 1099511628618, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-osd.xml'}, {'damage_type': 'backtrace', 'id': 1439277452, 'ino': 1099511628619, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-output.xml'}, {'damage_type': 'backtrace', 'id': 1457048167, 'ino': 1099511628709, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/v4l2grab.c.xml'}, {'damage_type': 'backtrace', 'id': 1464065356, 'ino': 1099511628599, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvbstb.png.b64'}, {'damage_type': 'backtrace', 'id': 1485951112, 'ino': 1099511628702, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-crop.dia'}, {'damage_type': 'backtrace', 'id': 1504730862, 'ino': 1099511628636, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-open.xml'}, {'damage_type': 'backtrace', 'id': 1512894896, 'ino': 1099511628612, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/controls.xml'}, {'damage_type': 'backtrace', 'id': 1518102114, 'ino': 1099511628739, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ext-ctrls.xml'}, {'damage_type': 'backtrace', 'id': 1519755342, 'ino': 1099511628663, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-rgb.xml'}, {'damage_type': 'backtrace', 'id': 1520266217, 'ino': 1099511628656, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-m420.xml'}, {'damage_type': 'backtrace', 'id': 1545891438, 'ino': 1099511628726, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudio.xml'}, {'damage_type': 'backtrace', 'id': 1596757893, 'ino': 1099511628701, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-formats.xml'}, {'damage_type': 'backtrace', 'id': 1602356836, 'ino': 1099511628638, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-read.xml'}, {'damage_type': 'backtrace', 'id': 1625247946, 'ino': 1099511628582, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/bayer.png.b64'}, {'damage_type': 'backtrace', 'id': 1665927421, 'ino': 1099511628562, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/80211.tmpl'}, {'damage_type': 'backtrace', 'id': 1713997679, 'ino': 1099511628661, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16m.xml'}, {'damage_type': 'backtrace', 'id': 1756682843, 'ino': 1099511628685, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y12.xml'}, {'damage_type': 'backtrace', 'id': 1759570248, 'ino': 1099511628659, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12mt.xml'}, {'damage_type': 'backtrace', 'id': 1798810262, 'ino': 1099511628664, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-packed-yuv.xml'}, {'damage_type': 'backtrace', 'id': 1809684461, 'ino': 1099511628673, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sgrbg8.xml'}, {'damage_type': 'backtrace', 'id': 1813046801, 'ino': 1099511628743, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-input.xml'}, {'damage_type': 'backtrace', 'id': 1835780443, 'ino': 1099511628647, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-close.xml'}, {'damage_type': 'backtrace', 'id': 1890492047, 'ino': 1099511628591, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbproperty.xml'}, {'damage_type': 'backtrace', 'id': 1926942395, 'ino': 1099511628611, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/compat.xml'}, {'damage_type': 'backtrace', 'id': 1964159766, 'ino': 1099511628641, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/gen-errors.xml'}, {'damage_type': 'backtrace', 'id': 1984619879, 'ino': 1099511628651, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-enum-entities.xml'}, {'damage_type': 'backtrace', 'id': 1995105235, 'ino': 1099511628627, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-teletext.xml'}, {'damage_type': 'backtrace', 'id': 1996988505, 'ino': 1099511628587, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/audio.xml'}, {'damage_type': 'backtrace', 'id': 2056172875, 'ino': 1099511628561, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/.gitignore'}, {'damage_type': 'backtrace', 'id': 2087131108, 'ino': 1099511628658, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv12m.xml'}, {'damage_type': 'backtrace', 'id': 2116941779, 'ino': 1099511628694, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvu420m.xml'}, {'damage_type': 'backtrace', 'id': 2140262763, 'ino': 1099511628576, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kgdb.tmpl'}, {'damage_type': 'backtrace', 'id': 2164997083, 'ino': 1099511628738, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-enc-index.xml'}, {'damage_type': 'backtrace', 'id': 2167339921, 'ino': 1099511628707, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-scaling-multi-source.svg'}, {'damage_type': 'backtrace', 'id': 2194168671, 'ino': 1099511628567, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/device-drivers.tmpl'}, {'damage_type': 'backtrace', 'id': 2197778269, 'ino': 1099511628580, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media'}, {'damage_type': 'backtrace', 'id': 2200505801, 'ino': 1099511628750, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-sliced-vbi-cap.xml'}, {'damage_type': 'backtrace', 'id': 2229103727, 'ino': 1099511628594, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/frontend.xml'}, {'damage_type': 'backtrace', 'id': 2246038449, 'ino': 1099511628735, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-ctrl.xml'}, {'damage_type': 'backtrace', 'id': 2251439719, 'ino': 1099511628597, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/net.xml'}, {'damage_type': 'backtrace', 'id': 2269480371, 'ino': 1099511628751, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-std.xml'}, {'damage_type': 'backtrace', 'id': 2274694271, 'ino': 1099511628680, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uv8.xml'}, {'damage_type': 'backtrace', 'id': 2275143404, 'ino': 1099511628568, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/deviceiobook.tmpl'}, {'damage_type': 'backtrace', 'id': 2323188297, 'ino': 1099511628666, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr8.xml'}, {'damage_type': 'backtrace', 'id': 2323792345, 'ino': 1099511628749, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-selection.xml'}, {'damage_type': 'backtrace', 'id': 2326830891, 'ino': 1099511628593, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/examples.xml'}, {'damage_type': 'backtrace', 'id': 2358422588, 'ino': 1099511628589, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/demux.xml'}, {'damage_type': 'backtrace', 'id': 2376008431, 'ino': 1099511628695, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yvyu.xml'}, {'damage_type': 'backtrace', 'id': 2380696763, 'ino': 1099511628755, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-prepare-buf.xml'}, {'damage_type': 'backtrace', 'id': 2387471357, 'ino': 1099511628744, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-jpegcomp.xml'}, {'damage_type': 'backtrace', 'id': 2396323801, 'ino': 1099511628753, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-log-status.xml'}, {'damage_type': 'backtrace', 'id': 2405696348, 'ino': 1099511628690, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420.xml'}, {'damage_type': 'backtrace', 'id': 2437653941, 'ino': 1099511628740, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-fbuf.xml'}, {'damage_type': 'backtrace', 'id': 2465869751, 'ino': 1099511628684, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y10b.xml'}, {'damage_type': 'backtrace', 'id': 2467486265, 'ino': 1099511628566, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/debugobjects.tmpl'}, {'damage_type': 'backtrace', 'id': 2480472380, 'ino': 1099511628733, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audioout.xml'}, {'damage_type': 'backtrace', 'id': 2583949666, 'ino': 1099511628679, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb8.xml'}, {'damage_type': 'backtrace', 'id': 2630026451, 'ino': 1099511628635, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-munmap.xml'}, {'damage_type': 'backtrace', 'id': 2655948706, 'ino': 1099511628698, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/remote_controllers.xml'}, {'damage_type': 'backtrace', 'id': 2677220652, 'ino': 1099511628623, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-rds.xml'}, {'damage_type': 'backtrace', 'id': 2691401339, 'ino': 1099511628742, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-frequency.xml'}, {'damage_type': 'backtrace', 'id': 2766483837, 'ino': 1099511628671, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-ru12le.xml'}, {'damage_type': 'backtrace', 'id': 2781550589, 'ino': 1099511628613, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/crop.pdf'}, {'damage_type': 'backtrace', 'id': 2791439076, 'ino': 1099511628605, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/selection.png.b64'}, {'damage_type': 'backtrace', 'id': 2813435370, 'ino': 1099511628734, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-crop.xml'}, {'damage_type': 'backtrace', 'id': 2835013442, 'ino': 1099511628649, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-open.xml'}, {'damage_type': 'backtrace', 'id': 2836928670, 'ino': 1099511628711, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vbi_625.pdf'}, {'damage_type': 'backtrace', 'id': 2867515741, 'ino': 1099511628584, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/crop.gif.b64'}, {'damage_type': 'backtrace', 'id': 2882797551, 'ino': 1099511628631, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fieldseq_tb.pdf'}, {'damage_type': 'backtrace', 'id': 2895789040, 'ino': 1099511628682, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-vyuy.xml'}, {'damage_type': 'backtrace', 'id': 2900862934, 'ino': 1099511628610, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/common.xml'}, {'damage_type': 'backtrace', 'id': 2913041417, 'ino': 1099511628660, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv16.xml'}, {'damage_type': 'backtrace', 'id': 2947093931, 'ino': 1099511628723, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enum-frameintervals.xml'}, {'damage_type': 'backtrace', 'id': 2956876134, 'ino': 1099511628595, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/intro.xml'}, {'damage_type': 'backtrace', 'id': 2967434665, 'ino': 1099511628603, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/nv12mt_example.gif.b64'}, {'damage_type': 'backtrace', 'id': 2975632728, 'ino': 1099511628696, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt.xml'}, {'damage_type': 'backtrace', 'id': 2975663254, 'ino': 1099511628681, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-uyvy.xml'}, {'damage_type': 'backtrace', 'id': 3070919457, 'ino': 1099511628565, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/crypto-API.tmpl'}, {'damage_type': 'backtrace', 'id': 3071340791, 'ino': 1099511628620, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-overlay.xml'}, {'damage_type': 'backtrace', 'id': 3101961342, 'ino': 1099511628642, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/io.xml'}, {'damage_type': 'backtrace', 'id': 3145226937, 'ino': 1099511628674, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10.xml'}, {'damage_type': 'backtrace', 'id': 3156323589, 'ino': 1099511628662, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-nv24.xml'}, {'damage_type': 'backtrace', 'id': 3161139091, 'ino': 1099511628625, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-sliced-vbi.xml'}, {'damage_type': 'backtrace', 'id': 3165667695, 'ino': 1099511628686, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-y16.xml'}, {'damage_type': 'backtrace', 'id': 3171127201, 'ino': 1099511628691, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv420m.xml'}, {'damage_type': 'backtrace', 'id': 3193904201, 'ino': 1099511628665, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sbggr16.xml'}, {'damage_type': 'backtrace', 'id': 3207839784, 'ino': 1099511628643, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/keytable.c.xml'}, {'damage_type': 'backtrace', 'id': 3224525257, 'ino': 1099511628669, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-sdr-cu08.xml'}, {'damage_type': 'backtrace', 'id': 3251071908, 'ino': 1099511628626, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-subdev.xml'}, {'damage_type': 'backtrace', 'id': 3284821075, 'ino': 1099511628655, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-grey.xml'}, {'damage_type': 'backtrace', 'id': 3318073124, 'ino': 1099511628675, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10alaw8.xml'}, {'damage_type': 'backtrace', 'id': 3346460103, 'ino': 1099511628634, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-mmap.xml'}, {'damage_type': 'backtrace', 'id': 3428355000, 'ino': 1099511628604, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/pipeline.png.b64'}, {'damage_type': 'backtrace', 'id': 3448918211, 'ino': 1099511628640, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-write.xml'}, {'damage_type': 'backtrace', 'id': 3491379419, 'ino': 1099511628731, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-expbuf.xml'}, {'damage_type': 'backtrace', 'id': 3501711306, 'ino': 1099511628717, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-decoder-cmd.xml'}, {'damage_type': 'backtrace', 'id': 3501884064, 'ino': 1099511628637, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-poll.xml'}, {'damage_type': 'backtrace', 'id': 3527571763, 'ino': 1099511628699, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/selection-api.xml'}, {'damage_type': 'backtrace', 'id': 3564846084, 'ino': 1099511628752, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-tuner.xml'}, {'damage_type': 'backtrace', 'id': 3593164320, 'ino': 1099511628745, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-modulator.xml'}, {'damage_type': 'backtrace', 'id': 3634754420, 'ino': 1099511628676, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10dpcm8.xml'}, {'damage_type': 'backtrace', 'id': 3635466648, 'ino': 1099511628718, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-dqevent.xml'}, {'damage_type': 'backtrace', 'id': 3665034402, 'ino': 1099511628653, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-setup-link.xml'}, {'damage_type': 'backtrace', 'id': 3671592404, 'ino': 1099511628629, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/fdl-appendix.xml'}, {'damage_type': 'backtrace', 'id': 3696765188, 'ino': 1099511628727, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-enumaudioout.xml'}, {'damage_type': 'backtrace', 'id': 3742531447, 'ino': 1099511628592, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbstb.pdf'}, {'damage_type': 'backtrace', 'id': 3744086289, 'ino': 1099511628601, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_tb.gif.b64'}, {'damage_type': 'backtrace', 'id': 3798483576, 'ino': 1099511628688, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-yuv410.xml'}, {'damage_type': 'backtrace', 'id': 3871425965, 'ino': 1099511628570, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/filesystems.tmpl'}, {'damage_type': 'backtrace', 'id': 3890183413, 'ino': 1099511628588, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/ca.xml'}, {'damage_type': 'backtrace', 'id': 3900254364, 'ino': 1099511628590, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/dvbapi.xml'}, {'damage_type': 'backtrace', 'id': 3917516323, 'ino': 1099511628714, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-cropcap.xml'}, {'damage_type': 'backtrace', 'id': 3940241933, 'ino': 1099511628573, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/kernel-api.tmpl'}, {'damage_type': 'backtrace', 'id': 3962995128, 'ino': 1099511628617, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-event.xml'}, {'damage_type': 'backtrace', 'id': 3965022046, 'ino': 1099511628621, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-radio.xml'}, {'damage_type': 'backtrace', 'id': 3973427807, 'ino': 1099511628732, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-audio.xml'}, {'damage_type': 'backtrace', 'id': 3986351746, 'ino': 1099511628648, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-func-ioctl.xml'}, {'damage_type': 'backtrace', 'id': 3989378170, 'ino': 1099511628596, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb/kdapi.xml'}, {'damage_type': 'backtrace', 'id': 4016373030, 'ino': 1099511628600, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/fieldseq_bt.gif.b64'}, {'damage_type': 'backtrace', 'id': 4026943664, 'ino': 1099511628579, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/lsm.tmpl'}, {'damage_type': 'backtrace', 'id': 4050863691, 'ino': 1099511628650, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-ioc-device-info.xml'}, {'damage_type': 'backtrace', 'id': 4061581666, 'ino': 1099511628677, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/pixfmt-srggb10p.xml'}, {'damage_type': 'backtrace', 'id': 4139139721, 'ino': 1099511628615, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/dev-codec.xml'}, {'damage_type': 'backtrace', 'id': 4150313392, 'ino': 1099511628606, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l'}, {'damage_type': 'backtrace', 'id': 4182378951, 'ino': 1099511628747, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/vidioc-g-parm.xml'}, {'damage_type': 'backtrace', 'id': 4194319575, 'ino': 1099511628608, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/biblio.xml'}, {'damage_type': 'backtrace', 'id': 4218296883, 'ino': 1099511628632, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-close.xml'}, {'damage_type': 'backtrace', 'id': 4233875181, 'ino': 1099511628639, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/func-select.xml'}, {'damage_type': 'backtrace', 'id': 4249736571, 'ino': 1099511628705, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/subdev-image-processing-full.svg'}, {'damage_type': 'backtrace', 'id': 4267355485, 'ino': 1099511628585, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/dvb'}, {'damage_type': 'backtrace', 'id': 4278135646, 'ino': 1099511628646, 'path': '/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/media/v4l/media-controller.xml'}] 2024-08-02T18:52:18.891 ERROR:tasks.fwd_scrub.fs.[cephfs]:exception: Traceback (most recent call last): File "/home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa/tasks/fwd_scrub.py", line 35, in _run self.do_scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa/tasks/fwd_scrub.py", line 48, in do_scrub self._scrub() File "/home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa/tasks/fwd_scrub.py", line 70, in _scrub self._check_damage() File "/home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa/tasks/fwd_scrub.py", line 81, in _check_damage raise RuntimeError(f"rank damage found: {types}") RuntimeError: rank damage found: {'backtrace'} 2024-08-02T18:52:19.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:19 smithi121 ceph-mon[37236]: pgmap v80: 129 pgs: 129 active+clean; 205 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 787 op/s 2024-08-02T18:52:19.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:19 smithi151 ceph-mon[37155]: pgmap v80: 129 pgs: 129 active+clean; 205 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 787 op/s 2024-08-02T18:52:19.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:19 smithi103 ceph-mon[32753]: pgmap v80: 129 pgs: 129 active+clean; 205 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.4 MiB/s rd, 3.3 MiB/s wr, 787 op/s 2024-08-02T18:52:20.001 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 -- 172.21.15.103:0/3623318297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd944101080 msgr2=0x7fd94410d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 --2- 172.21.15.103:0/3623318297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd944101080 0x7fd94410d5b0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009cd0 tx=0x7fd93c02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 -- 172.21.15.103:0/3623318297 shutdown_connections 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 --2- 172.21.15.103:0/3623318297 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd944101080 0x7fd94410d5b0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 --2- 172.21.15.103:0/3623318297 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9441006e0 0x7fd944100b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 --2- 172.21.15.103:0/3623318297 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd9441066f0 0x7fd944106ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 -- 172.21.15.103:0/3623318297 >> 172.21.15.103:0/3623318297 conn(0x7fd9440776c0 msgr2=0x7fd9440fea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 -- 172.21.15.103:0/3623318297 shutdown_connections 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.000+0000 7fd948c5f640 1 -- 172.21.15.103:0/3623318297 wait complete. 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd948c5f640 1 Processor -- start 2024-08-02T18:52:20.002 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd948c5f640 1 -- start start 2024-08-02T18:52:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd948c5f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9441006e0 0x7fd944198130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd948c5f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd944101080 0x7fd944198670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd948c5f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9441066f0 0x7fd94419c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.004 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd948c5f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111d40 con 0x7fd9441006e0 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd948c5f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111bc0 con 0x7fd944101080 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd948c5f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd944111ec0 con 0x7fd9441066f0 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9441006e0 0x7fd944198130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9441006e0 0x7fd944198130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37604/0 (socket says 172.21.15.103:37604) 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 -- 172.21.15.103:0/4194095978 learned_addr learned my addr 172.21.15.103:0/4194095978 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd941d9b640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd944101080 0x7fd944198670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 -- 172.21.15.103:0/4194095978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9441066f0 msgr2=0x7fd94419c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd942d9d640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9441066f0 0x7fd94419c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9441066f0 0x7fd94419c9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 -- 172.21.15.103:0/4194095978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd944101080 msgr2=0x7fd944198670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd944101080 0x7fd944198670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.005 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 -- 172.21.15.103:0/4194095978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd94419d120 con 0x7fd9441006e0 2024-08-02T18:52:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd94259c640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9441006e0 0x7fd944198130 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00e9f0 tx=0x7fd92c00eeb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.001+0000 7fd93b7fe640 1 -- 172.21.15.103:0/4194095978 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c00cd80 con 0x7fd9441006e0 2024-08-02T18:52:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.002+0000 7fd93b7fe640 1 -- 172.21.15.103:0/4194095978 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd92c010930 con 0x7fd9441006e0 2024-08-02T18:52:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.002+0000 7fd948c5f640 1 -- 172.21.15.103:0/4194095978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd94419d410 con 0x7fd9441006e0 2024-08-02T18:52:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.002+0000 7fd93b7fe640 1 -- 172.21.15.103:0/4194095978 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c018b00 con 0x7fd9441006e0 2024-08-02T18:52:20.006 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.002+0000 7fd948c5f640 1 -- 172.21.15.103:0/4194095978 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd9441a4ca0 con 0x7fd9441006e0 2024-08-02T18:52:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.004+0000 7fd93b7fe640 1 -- 172.21.15.103:0/4194095978 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fd92c018ca0 con 0x7fd9441006e0 2024-08-02T18:52:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.004+0000 7fd94b9b7740 1 Processor -- start 2024-08-02T18:52:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.004+0000 7fd93b7fe640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9300a2da0 0x7fd9300a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd942d9d640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9300a2da0 0x7fd9300a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd94b9b7740 1 -- start start 2024-08-02T18:52:20.011 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd93b7fe640 1 -- 172.21.15.103:0/4194095978 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fd92c0cfb70 con 0x7fd9441006e0 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 0x5599c8911b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c891c430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891ed60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5599c88759b0 con 0x5599c891c970 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5599c881d800 con 0x5599c89120d0 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5599c8871970 con 0x5599c89117b0 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c891c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c891c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:52460/0 (socket says 172.21.15.103:52460) 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 -- 172.21.15.103:0/533251358 learned_addr learned my addr 172.21.15.103:0/533251358 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd942d9d640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9300a2da0 0x7fd9300a5260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd93c006010 tx=0x7fd93c031000 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd942d9d640 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd94259c640 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 0x5599c8911b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.012 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 -- 172.21.15.103:0/533251358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 msgr2=0x5599c8911b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 0x5599c8911b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 -- 172.21.15.103:0/533251358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 msgr2=0x5599c891ed60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891ed60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 -- 172.21.15.103:0/533251358 --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c8589210 con 0x5599c89120d0 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.005+0000 7fd941d9b640 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c891c430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd934009ca0 tx=0x7fd934011810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=2520e9bf9321393d server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd938ff9640 1 -- 172.21.15.103:0/533251358 <== mon.2 v2:172.21.15.121:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93401e070 con 0x5599c89120d0 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd938ff9640 1 -- 172.21.15.103:0/533251358 <== mon.2 v2:172.21.15.121:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd934019b30 con 0x5599c89120d0 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd938ff9640 1 -- 172.21.15.103:0/533251358 <== mon.2 v2:172.21.15.121:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93400eb30 con 0x5599c89120d0 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd94b9b7740 1 -- 172.21.15.103:0/533251358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 msgr2=0x5599c891c430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c891c430 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fd934009ca0 tx=0x7fd934011810 comp rx=0 tx=0).stop 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd94b9b7740 1 -- 172.21.15.103:0/533251358 shutdown_connections 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891ed60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.013 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c891c430 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/533251358 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 0x5599c8911b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.006+0000 7fd94b9b7740 1 -- 172.21.15.103:0/533251358 >> 172.21.15.103:0/533251358 conn(0x5599c890dd20 msgr2=0x5599c890e100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 -- 172.21.15.103:0/533251358 shutdown_connections 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 -- 172.21.15.103:0/533251358 wait complete. 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 -- start start 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 Processor -- start 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 0x5599c8919820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c8919d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891a2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.014 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x5599c891f540 con 0x5599c891c970 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x5599c8831500 con 0x5599c89120d0 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x5599c891f6c0 con 0x5599c89117b0 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd94b9b7740 10 client.0 _ll_register_callbacks cb 0x5599c8588a00 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd942d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891a2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd941d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c8919d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd942d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891a2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37626/0 (socket says 172.21.15.103:37626) 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd941d9b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c8919d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:52466/0 (socket says 172.21.15.103:52466) 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.007+0000 7fd942d9d640 1 -- 172.21.15.103:0/1323871673 learned_addr learned my addr 172.21.15.103:0/1323871673 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:20.015 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd942d9d640 1 -- 172.21.15.103:0/1323871673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 msgr2=0x5599c8919820 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-08-02T18:52:20.016 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd942d9d640 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 0x5599c8919820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd942d9d640 1 -- 172.21.15.103:0/1323871673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 msgr2=0x5599c8919d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd942d9d640 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c8919d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd942d9d640 1 -- 172.21.15.103:0/1323871673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c8655620 con 0x5599c891c970 2024-08-02T18:52:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd941d9b640 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c8919d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd942d9d640 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891a2a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009cd0 tx=0x7fd93c0095c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42b9db0864cfb35a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd929ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd929ffb640 1 -- 172.21.15.103:0/1323871673 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c004450 con 0x5599c891c970 2024-08-02T18:52:20.017 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd929ffb640 1 -- 172.21.15.103:0/1323871673 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fd93c0045f0 con 0x5599c891c970 2024-08-02T18:52:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 1 -- 172.21.15.103:0/1323871673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd934019b30 con 0x5599c891c970 2024-08-02T18:52:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd929ffb640 1 -- 172.21.15.103:0/1323871673 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd93c0047f0 con 0x5599c891c970 2024-08-02T18:52:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 10 client.16227 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 1 -- 172.21.15.103:0/1323871673 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5599c892b1c0 con 0x5599c891c970 2024-08-02T18:52:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd929ffb640 1 -- 172.21.15.103:0/1323871673 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd934019b30 con 0x5599c891c970 2024-08-02T18:52:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd929ffb640 1 -- 172.21.15.103:0/1323871673 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fd93c04f070 con 0x5599c891c970 2024-08-02T18:52:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 10 client.16227 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:20.018 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 10 client.16227 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:52:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 20 client.16227 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5599c892c680 0x5599c892eb10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 4 client.16227 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:52:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.008+0000 7fd94b9b7740 1 -- 172.21.15.103:0/1323871673 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5599c88830e0 con 0x5599c892c680 2024-08-02T18:52:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.009+0000 7fd94259c640 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5599c892c680 0x5599c892eb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.009+0000 7fd929ffb640 10 client.16227 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:20.019 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.009+0000 7fd94259c640 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5599c892c680 0x5599c892eb10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3a7d7d741f79a079 server_cookie=d2fc830e3411b69a in_seq=0 out_seq=0 2024-08-02T18:52:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd929ffb640 1 -- 172.21.15.103:0/1323871673 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x5599c88830e0 con 0x5599c892c680 2024-08-02T18:52:20.021 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd929ffb640 10 client.16227 handle_command_reply: tid=0 2024-08-02T18:52:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 client.16227 shutdown 2024-08-02T18:52:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 -- 172.21.15.103:0/1323871673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 msgr2=0x5599c891a2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891a2a0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009cd0 tx=0x7fd93c0095c0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 -- 172.21.15.103:0/1323871673 shutdown_connections 2024-08-02T18:52:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5599c892c680 0x5599c892eb10 crc :-1 s=READY pgs=98 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c891a2a0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.022 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89120d0 0x5599c8919d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd929ffb640 0 client.16227 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/1323871673 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89117b0 0x5599c8919820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 -- 172.21.15.103:0/1323871673 >> 172.21.15.103:0/1323871673 conn(0x5599c890dd20 msgr2=0x5599c8913a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 -- 172.21.15.103:0/1323871673 shutdown_connections 2024-08-02T18:52:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 1 -- 172.21.15.103:0/1323871673 wait complete. 2024-08-02T18:52:20.023 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.011+0000 7fd94b9b7740 20 client.16227 trim_cache size 0 max 16384 2024-08-02T18:52:20.032 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94b9b7740 1 Processor -- start 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94b9b7740 1 -- start start 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8934420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89120d0 0x5599c8934960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c890c660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9441b15e0 con 0x5599c891c970 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9441aedf0 con 0x5599c89117b0 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd9441acc40 con 0x5599c89120d0 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd942d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c890c660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd942d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c890c660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37642/0 (socket says 172.21.15.103:37642) 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd942d9d640 1 -- 172.21.15.103:0/572169859 learned_addr learned my addr 172.21.15.103:0/572169859 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:20.033 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd94259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8934420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd942d9d640 1 -- 172.21.15.103:0/572169859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89120d0 msgr2=0x5599c8934960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd942d9d640 1 --2- 172.21.15.103:0/572169859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89120d0 0x5599c8934960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd942d9d640 1 -- 172.21.15.103:0/572169859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 msgr2=0x5599c8934420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd942d9d640 1 --2- 172.21.15.103:0/572169859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8934420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.027+0000 7fd942d9d640 1 -- 172.21.15.103:0/572169859 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5599c8911530 con 0x5599c891c970 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd942d9d640 1 --2- 172.21.15.103:0/572169859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c890c660 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009430 tx=0x7fd93c051640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f658f2c6b9f5d15a server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd92bfff640 1 -- 172.21.15.103:0/572169859 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c051a60 con 0x5599c891c970 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd92bfff640 1 -- 172.21.15.103:0/572169859 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd93c036040 con 0x5599c891c970 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd92bfff640 1 -- 172.21.15.103:0/572169859 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93c030aa0 con 0x5599c891c970 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 -- 172.21.15.103:0/572169859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 msgr2=0x5599c890c660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/572169859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c890c660 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fd93c009430 tx=0x7fd93c051640 comp rx=0 tx=0).stop 2024-08-02T18:52:20.034 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 -- 172.21.15.103:0/572169859 shutdown_connections 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/572169859 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c891c970 0x5599c890c660 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/572169859 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c89120d0 0x5599c8934960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/572169859 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8934420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 -- 172.21.15.103:0/572169859 >> 172.21.15.103:0/572169859 conn(0x5599c890dd20 msgr2=0x5599c89188f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 -- 172.21.15.103:0/572169859 shutdown_connections 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.028+0000 7fd94b9b7740 1 -- 172.21.15.103:0/572169859 wait complete. 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 1 -- start start 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 1 Processor -- start 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8925070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c89120d0 0x5599c8920390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c891c970 0x5599c89208d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fd9441ad2b0 con 0x5599c89120d0 2024-08-02T18:52:20.035 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fd9441ae720 con 0x5599c89117b0 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fd9441ad980 con 0x5599c891c970 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94b9b7740 10 client.0 _ll_register_callbacks cb 0x7fd92c005e30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd941d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c89120d0 0x5599c8920390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8925070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8925070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.121:3300/0 says I am v2:172.21.15.103:52494/0 (socket says 172.21.15.103:52494) 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd941d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c89120d0 0x5599c8920390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37646/0 (socket says 172.21.15.103:37646) 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94259c640 1 -- 172.21.15.103:0/2370668433 learned_addr learned my addr 172.21.15.103:0/2370668433 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd942d9d640 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c891c970 0x5599c89208d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd941d9b640 1 -- 172.21.15.103:0/2370668433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c891c970 msgr2=0x5599c89208d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd941d9b640 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c891c970 0x5599c89208d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd941d9b640 1 -- 172.21.15.103:0/2370668433 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 msgr2=0x5599c8925070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd941d9b640 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8925070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.036 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd941d9b640 1 -- 172.21.15.103:0/2370668433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5599c89210e0 con 0x5599c89120d0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.029+0000 7fd94259c640 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8925070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd941d9b640 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c89120d0 0x5599c8920390 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd93401c040 tx=0x7fd934009620 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a879ac1af6404acf server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd929ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd929ffb640 1 -- 172.21.15.103:0/2370668433 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd93402a020 con 0x5599c89120d0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd929ffb640 1 -- 172.21.15.103:0/2370668433 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fd934005220 con 0x5599c89120d0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 1 -- 172.21.15.103:0/2370668433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd93c036040 con 0x5599c89120d0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd929ffb640 1 -- 172.21.15.103:0/2370668433 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7fd934032050 con 0x5599c89120d0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 10 client.16233 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 1 -- 172.21.15.103:0/2370668433 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5599c89973d0 con 0x5599c89120d0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd929ffb640 1 -- 172.21.15.103:0/2370668433 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fd93c036040 con 0x5599c89120d0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd929ffb640 1 -- 172.21.15.103:0/2370668433 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7fd934019ce0 con 0x5599c89120d0 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 10 client.16233 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:20.037 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 10 client.16233 resolve_mds: resolved cephfs:0 to role '1:0' aka daemon mds.b 2024-08-02T18:52:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 20 client.16233 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5599c8997a10 0x5599c8999e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 4 client.16233 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "flush journal"}] 2024-08-02T18:52:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.030+0000 7fd94b9b7740 1 -- 172.21.15.103:0/2370668433 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "flush journal"}) -- 0x5599c887d430 con 0x5599c8997a10 2024-08-02T18:52:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.031+0000 7fd94259c640 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5599c8997a10 0x5599c8999e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.031+0000 7fd929ffb640 10 client.16233 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:20.038 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.031+0000 7fd94259c640 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5599c8997a10 0x5599c8999e00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=19079f16229cdb55 server_cookie=db11192912d4b20c in_seq=0 out_seq=0 2024-08-02T18:52:20.318 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd929ffb640 1 -- 172.21.15.103:0/2370668433 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+44 (crc 0 0 0) 0x5599c887d430 con 0x5599c8997a10 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd929ffb640 10 client.16233 handle_command_reply: tid=0 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 client.16233 shutdown 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 -- 172.21.15.103:0/2370668433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c89120d0 msgr2=0x5599c8920390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c89120d0 0x5599c8920390 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fd93401c040 tx=0x7fd934009620 comp rx=0 tx=0).stop 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 -- 172.21.15.103:0/2370668433 shutdown_connections 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x5599c8997a10 0x5599c8999e00 crc :-1 s=READY pgs=99 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd929ffb640 0 client.16233 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x5599c891c970 0x5599c89208d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x5599c89120d0 0x5599c8920390 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 --2- 172.21.15.103:0/2370668433 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x5599c89117b0 0x5599c8925070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.319 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.316+0000 7fd94b9b7740 1 -- 172.21.15.103:0/2370668433 >> 172.21.15.103:0/2370668433 conn(0x5599c890dd20 msgr2=0x5599c890c660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd94b9b7740 1 -- 172.21.15.103:0/2370668433 shutdown_connections 2024-08-02T18:52:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd94b9b7740 1 -- 172.21.15.103:0/2370668433 wait complete. 2024-08-02T18:52:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd94b9b7740 20 client.16233 trim_cache size 0 max 16384 2024-08-02T18:52:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:{ 2024-08-02T18:52:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "message": "", 2024-08-02T18:52:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout: "return_code": 0 2024-08-02T18:52:20.320 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stdout:} 2024-08-02T18:52:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 -- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9300a2da0 msgr2=0x7fd9300a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9300a2da0 0x7fd9300a5260 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7fd93c006010 tx=0x7fd93c031000 comp rx=0 tx=0).stop 2024-08-02T18:52:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 -- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9441006e0 msgr2=0x7fd944198130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9441006e0 0x7fd944198130 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fd92c00e9f0 tx=0x7fd92c00eeb0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 -- 172.21.15.103:0/4194095978 shutdown_connections 2024-08-02T18:52:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fd9300a2da0 0x7fd9300a5260 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fd9441066f0 0x7fd94419c9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.321 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fd944101080 0x7fd944198670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 --2- 172.21.15.103:0/4194095978 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fd9441006e0 0x7fd944198130 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.317+0000 7fd948c5f640 1 -- 172.21.15.103:0/4194095978 >> 172.21.15.103:0/4194095978 conn(0x7fd9440776c0 msgr2=0x7fd944103410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.318+0000 7fd948c5f640 1 -- 172.21.15.103:0/4194095978 shutdown_connections 2024-08-02T18:52:20.322 INFO:teuthology.task.background_exec.ubuntu@smithi103.front.sepia.ceph.com.smithi103.stderr:2024-08-02T18:52:20.318+0000 7fd948c5f640 1 -- 172.21.15.103:0/4194095978 wait complete. 2024-08-02T18:52:21.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:21 smithi121 ceph-mon[37236]: pgmap v81: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 834 op/s 2024-08-02T18:52:21.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:21 smithi151 ceph-mon[37155]: pgmap v81: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 834 op/s 2024-08-02T18:52:21.826 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:21 smithi103 ceph-mon[32753]: pgmap v81: 129 pgs: 129 active+clean; 208 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 3.5 MiB/s wr, 834 op/s 2024-08-02T18:52:23.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:23 smithi121 ceph-mon[37236]: pgmap v82: 129 pgs: 129 active+clean; 213 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 987 op/s 2024-08-02T18:52:23.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:23 smithi151 ceph-mon[37155]: pgmap v82: 129 pgs: 129 active+clean; 213 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 987 op/s 2024-08-02T18:52:23.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:23 smithi103 ceph-mon[32753]: pgmap v82: 129 pgs: 129 active+clean; 213 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.2 MiB/s rd, 4.0 MiB/s wr, 987 op/s 2024-08-02T18:52:25.636 INFO:tasks.workunit:Stopping ['fs/norstats'] on client.0... 2024-08-02T18:52:25.636 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-08-02T18:52:25.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:25 smithi121 ceph-mon[37236]: pgmap v83: 129 pgs: 129 active+clean; 213 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 487 op/s 2024-08-02T18:52:25.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:25 smithi151 ceph-mon[37155]: pgmap v83: 129 pgs: 129 active+clean; 213 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 487 op/s 2024-08-02T18:52:25.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:25 smithi103 ceph-mon[32753]: pgmap v83: 129 pgs: 129 active+clean; 213 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.7 MiB/s rd, 3.2 MiB/s wr, 487 op/s 2024-08-02T18:52:26.010 DEBUG:teuthology.parallel:result is None 2024-08-02T18:52:26.011 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-08-02T18:52:26.054 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-08-02T18:52:26.055 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-08-02T18:52:26.065 INFO:tasks.quiescer:joining Quiescers 2024-08-02T18:52:26.065 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-08-02T18:52:26.066 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T18:52:26.347 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:52:26.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 -- 172.21.15.103:0/580804962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881068b0 msgr2=0x7fec88106c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:26.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/580804962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881068b0 0x7fec88106c90 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7fec78009900 tx=0x7fec7802a410 comp rx=0 tx=0).stop 2024-08-02T18:52:26.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 -- 172.21.15.103:0/580804962 shutdown_connections 2024-08-02T18:52:26.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/580804962 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec881007d0 0x7fec8810e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:26.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/580804962 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec880ffe30 0x7fec88100290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:26.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/580804962 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881068b0 0x7fec88106c90 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:26.864 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 -- 172.21.15.103:0/580804962 >> 172.21.15.103:0/580804962 conn(0x7fec88076f60 msgr2=0x7fec880fe370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 -- 172.21.15.103:0/580804962 shutdown_connections 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 -- 172.21.15.103:0/580804962 wait complete. 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 Processor -- start 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 -- start start 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec880ffe30 0x7fec88198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881007d0 0x7fec88198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec881068b0 0x7fec8819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fec88111ea0 con 0x7fec881007d0 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.850+0000 7fec8e0a4640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fec88111d20 con 0x7fec881068b0 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec8e0a4640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fec88112020 con 0x7fec880ffe30 2024-08-02T18:52:26.865 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881007d0 0x7fec88198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881007d0 0x7fec88198860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37666/0 (socket says 172.21.15.103:37666) 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 -- 172.21.15.103:0/1907890646 learned_addr learned my addr 172.21.15.103:0/1907890646 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec87fff640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec881068b0 0x7fec8819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec877fe640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec880ffe30 0x7fec88198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 -- 172.21.15.103:0/1907890646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec880ffe30 msgr2=0x7fec88198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec880ffe30 0x7fec88198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 -- 172.21.15.103:0/1907890646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec881068b0 msgr2=0x7fec8819cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec881068b0 0x7fec8819cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 -- 172.21.15.103:0/1907890646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fec8819d2d0 con 0x7fec881007d0 2024-08-02T18:52:26.866 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec877fe640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec880ffe30 0x7fec88198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec7ffff640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881007d0 0x7fec88198860 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fec7000d950 tx=0x7fec7000de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec857fa640 1 -- 172.21.15.103:0/1907890646 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec70017070 con 0x7fec881007d0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec857fa640 1 -- 172.21.15.103:0/1907890646 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fec70009c30 con 0x7fec881007d0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fec8819d5c0 con 0x7fec881007d0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec857fa640 1 -- 172.21.15.103:0/1907890646 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fec7000f740 con 0x7fec881007d0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.851+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fec881a4ea0 con 0x7fec881007d0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.852+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fec88100290 con 0x7fec881007d0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.854+0000 7fec857fa640 1 -- 172.21.15.103:0/1907890646 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fec70010a80 con 0x7fec881007d0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.854+0000 7fec857fa640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fec740a2d70 0x7fec740a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.854+0000 7fec877fe640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fec740a2d70 0x7fec740a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.854+0000 7fec857fa640 1 -- 172.21.15.103:0/1907890646 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7fec700cf2f0 con 0x7fec881007d0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.855+0000 7fec877fe640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fec740a2d70 0x7fec740a5230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec78005ab0 tx=0x7fec78005a20 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:26.867 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:26.858+0000 7fec857fa640 1 -- 172.21.15.103:0/1907890646 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fec70009de0 con 0x7fec881007d0 2024-08-02T18:52:27.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.059+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fec881a5070 con 0x7fec881007d0 2024-08-02T18:52:27.061 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.059+0000 7fec857fa640 1 -- 172.21.15.103:0/1907890646 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) ==== 94+0+11942 (secure 0 0 0) 0x7fec7009bc50 con 0x7fec881007d0 2024-08-02T18:52:27.062 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:52:27.062 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":33,"btime":"2024-08-02T18:52:07:446419+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":33,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:52:06.765772+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":72,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[0,1],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":70,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[0,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[1,2],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T18:52:27.062 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 33 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.061+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fec740a2d70 msgr2=0x7fec740a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.061+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fec740a2d70 0x7fec740a5230 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fec78005ab0 tx=0x7fec78005a20 comp rx=0 tx=0).stop 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.061+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881007d0 msgr2=0x7fec88198860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.061+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881007d0 0x7fec88198860 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fec7000d950 tx=0x7fec7000de10 comp rx=0 tx=0).stop 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.062+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 shutdown_connections 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.062+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fec740a2d70 0x7fec740a5230 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.062+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fec881068b0 0x7fec8819cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.062+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fec881007d0 0x7fec88198860 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:27.064 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.062+0000 7fec8e0a4640 1 --2- 172.21.15.103:0/1907890646 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fec880ffe30 0x7fec88198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.062+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 >> 172.21.15.103:0/1907890646 conn(0x7fec88076f60 msgr2=0x7fec881047b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.062+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 shutdown_connections 2024-08-02T18:52:27.065 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:27.062+0000 7fec8e0a4640 1 -- 172.21.15.103:0/1907890646 wait complete. 2024-08-02T18:52:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:27 smithi121 ceph-mon[37236]: pgmap v84: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 848 op/s 2024-08-02T18:52:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:27 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1907890646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:52:27.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:27 smithi151 ceph-mon[37155]: pgmap v84: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 848 op/s 2024-08-02T18:52:27.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:27 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1907890646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:52:27.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:27 smithi103 ceph-mon[32753]: pgmap v84: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 MiB/s rd, 4.0 MiB/s wr, 848 op/s 2024-08-02T18:52:27.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:27 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1907890646' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T18:52:27.893 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.24473 quiesce db --cancel --all' 2024-08-02T18:52:27.893 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- timeout 105 ceph tell mds.24473 quiesce db --cancel --all 2024-08-02T18:52:28.148 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:52:28.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 -- 172.21.15.103:0/3647832930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141007b0 msgr2=0x7ff614100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 --2- 172.21.15.103:0/3647832930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141007b0 0x7ff614100c10 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7ff608009930 tx=0x7ff60802a440 comp rx=0 tx=0).stop 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 -- 172.21.15.103:0/3647832930 shutdown_connections 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 --2- 172.21.15.103:0/3647832930 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614101150 0x7ff61410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 --2- 172.21.15.103:0/3647832930 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141007b0 0x7ff614100c10 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 --2- 172.21.15.103:0/3647832930 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6141067b0 0x7ff614106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 -- 172.21.15.103:0/3647832930 >> 172.21.15.103:0/3647832930 conn(0x7ff6140fc4d0 msgr2=0x7ff6140fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 -- 172.21.15.103:0/3647832930 shutdown_connections 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.590+0000 7ff618d63640 1 -- 172.21.15.103:0/3647832930 wait complete. 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff618d63640 1 Processor -- start 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff618d63640 1 -- start start 2024-08-02T18:52:28.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff618d63640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6141007b0 0x7ff6140fca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff618d63640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614101150 0x7ff6140fcfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff618d63640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141067b0 0x7ff6140fd500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff618d63640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff614110d30 con 0x7ff6141067b0 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff618d63640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff614110bb0 con 0x7ff6141007b0 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff618d63640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff614110eb0 con 0x7ff614101150 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff612d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141067b0 0x7ff6140fd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff612d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141067b0 0x7ff6140fd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37690/0 (socket says 172.21.15.103:37690) 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff61259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6141007b0 0x7ff6140fca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.591+0000 7ff612d9d640 1 -- 172.21.15.103:0/2355928799 learned_addr learned my addr 172.21.15.103:0/2355928799 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:28.620 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff612d9d640 1 -- 172.21.15.103:0/2355928799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614101150 msgr2=0x7ff6140fcfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff611d9b640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614101150 0x7ff6140fcfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff612d9d640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614101150 0x7ff6140fcfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff612d9d640 1 -- 172.21.15.103:0/2355928799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6141007b0 msgr2=0x7ff6140fca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff612d9d640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6141007b0 0x7ff6140fca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff612d9d640 1 -- 172.21.15.103:0/2355928799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6141a6820 con 0x7ff6141067b0 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff611d9b640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614101150 0x7ff6140fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff612d9d640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141067b0 0x7ff6140fd500 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00b990 tx=0x7ff60c00be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff6037fe640 1 -- 172.21.15.103:0/2355928799 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c019070 con 0x7ff6141067b0 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff618d63640 1 -- 172.21.15.103:0/2355928799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6141a6b10 con 0x7ff6141067b0 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff6037fe640 1 -- 172.21.15.103:0/2355928799 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff60c00cba0 con 0x7ff6141067b0 2024-08-02T18:52:28.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff6037fe640 1 -- 172.21.15.103:0/2355928799 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c007770 con 0x7ff6141067b0 2024-08-02T18:52:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.592+0000 7ff618d63640 1 -- 172.21.15.103:0/2355928799 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6141a70a0 con 0x7ff6141067b0 2024-08-02T18:52:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.594+0000 7ff6037fe640 1 -- 172.21.15.103:0/2355928799 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7ff60c01c070 con 0x7ff6141067b0 2024-08-02T18:52:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61b161740 1 Processor -- start 2024-08-02T18:52:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61b161740 1 -- start start 2024-08-02T18:52:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61b161740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 0x563454fb0a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61b161740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 0x563454fbb340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61b161740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fbdc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.622 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff6037fe640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5fc0a2cf0 0x7ff5fc0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61b161740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563454f118c0 con 0x563454fbb880 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61b161740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563454ec39e0 con 0x563454fb0fc0 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61b161740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563454f1f540 con 0x563454fb06a0 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff612d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fbdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff611d9b640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5fc0a2cf0 0x7ff5fc0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff612d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fbdc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37696/0 (socket says 172.21.15.103:37696) 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff612d9d640 1 -- 172.21.15.103:0/2439246701 learned_addr learned my addr 172.21.15.103:0/2439246701 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff611d9b640 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 0x563454fb0a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.595+0000 7ff61259c640 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 0x563454fbb340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff6037fe640 1 -- 172.21.15.103:0/2355928799 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff60c0ced60 con 0x7ff6141067b0 2024-08-02T18:52:28.623 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff612d9d640 1 -- 172.21.15.103:0/2439246701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 msgr2=0x563454fb0a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff612d9d640 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 0x563454fb0a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff612d9d640 1 -- 172.21.15.103:0/2439246701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 msgr2=0x563454fbb340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff612d9d640 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 0x563454fbb340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff612d9d640 1 -- 172.21.15.103:0/2439246701 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563454ead640 con 0x563454fbb880 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff611d9b640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5fc0a2cf0 0x7ff5fc0a51b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff60802a960 tx=0x7ff608031480 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff612d9d640 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fbdc70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0974b0 tx=0x7ff60c066120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad09a0bdf20c6f9b server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff600ff9640 1 -- 172.21.15.103:0/2439246701 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c064240 con 0x563454fbb880 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff600ff9640 1 -- 172.21.15.103:0/2439246701 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff60c09b750 con 0x563454fbb880 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.596+0000 7ff600ff9640 1 -- 172.21.15.103:0/2439246701 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c018850 con 0x563454fbb880 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 -- 172.21.15.103:0/2439246701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 msgr2=0x563454fbdc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fbdc70 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0974b0 tx=0x7ff60c066120 comp rx=0 tx=0).stop 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 -- 172.21.15.103:0/2439246701 shutdown_connections 2024-08-02T18:52:28.624 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fbdc70 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 0x563454fbb340 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 --2- 172.21.15.103:0/2439246701 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 0x563454fb0a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 -- 172.21.15.103:0/2439246701 >> 172.21.15.103:0/2439246701 conn(0x563454facc30 msgr2=0x563454fad010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 -- 172.21.15.103:0/2439246701 shutdown_connections 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 -- 172.21.15.103:0/2439246701 wait complete. 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 -- start start 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.597+0000 7ff61b161740 1 Processor -- start 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61b161740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb06a0 0x563454fbb170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61b161740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 0x563454fb8420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61b161740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fb8960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61b161740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x563454f14c10 con 0x563454fbb880 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61b161740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x563454ed3f00 con 0x563454fb06a0 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61b161740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x563454f19f30 con 0x563454fb0fc0 2024-08-02T18:52:28.625 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61b161740 10 client.0 _ll_register_callbacks cb 0x563454c24b20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fb8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61259c640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb06a0 0x563454fbb170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fb8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37702/0 (socket says 172.21.15.103:37702) 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 -- 172.21.15.103:0/810534001 learned_addr learned my addr 172.21.15.103:0/810534001 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff611d9b640 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 0x563454fb8420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 -- 172.21.15.103:0/810534001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 msgr2=0x563454fb8420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 0x563454fb8420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 -- 172.21.15.103:0/810534001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb06a0 msgr2=0x563454fbb170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb06a0 0x563454fbb170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 -- 172.21.15.103:0/810534001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563454c87620 con 0x563454fbb880 2024-08-02T18:52:28.626 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff612d9d640 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fb8960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0cc770 tx=0x7ff60c018e50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4da2aea8b09c1b2 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff5f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/810534001 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60c00f160 con 0x563454fbb880 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/810534001 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff60c09f0d0 con 0x563454fbb880 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.598+0000 7ff61b161740 1 -- 172.21.15.103:0/810534001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff60c09b750 con 0x563454fbb880 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/810534001 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff60c064240 con 0x563454fbb880 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61b161740 10 client.16251 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61b161740 1 -- 172.21.15.103:0/810534001 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x563454fc9e50 con 0x563454fbb880 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/810534001 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff60c09b750 con 0x563454fbb880 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/810534001 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7ff60c09b340 con 0x563454fbb880 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61b161740 10 client.16251 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61b161740 10 client.16251 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61b161740 20 client.16251 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:28.627 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61b161740 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563454fcb1a0 0x563454fcd590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61b161740 4 client.16251 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61b161740 1 -- 172.21.15.103:0/810534001 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x563454f22e70 con 0x563454fcb1a0 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.599+0000 7ff61259c640 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563454fcb1a0 0x563454fcd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.600+0000 7ff5f9ffb640 10 client.16251 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.600+0000 7ff61259c640 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563454fcb1a0 0x563454fcd590 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=752c92b12df4fc3f server_cookie=93d26d2168ae135b in_seq=0 out_seq=0 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.600+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/810534001 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+24173 (crc 0 0 0) 0x563454f22e70 con 0x563454fcb1a0 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.600+0000 7ff5f9ffb640 10 client.16251 handle_command_reply: tid=0 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 client.16251 shutdown 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 -- 172.21.15.103:0/810534001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 msgr2=0x563454fb8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fb8960 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7ff60c0cc770 tx=0x7ff60c018e50 comp rx=0 tx=0).stop 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 -- 172.21.15.103:0/810534001 shutdown_connections 2024-08-02T18:52:28.628 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563454fcb1a0 0x563454fcd590 crc :-1 s=READY pgs=100 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fbb880 0x563454fb8960 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 0x563454fb8420 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff5f9ffb640 0 client.16251 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:28.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 --2- 172.21.15.103:0/810534001 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb06a0 0x563454fbb170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 -- 172.21.15.103:0/810534001 >> 172.21.15.103:0/810534001 conn(0x563454facc30 msgr2=0x563454fb2960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:28.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 -- 172.21.15.103:0/810534001 shutdown_connections 2024-08-02T18:52:28.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 1 -- 172.21.15.103:0/810534001 wait complete. 2024-08-02T18:52:28.629 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.601+0000 7ff61b161740 20 client.16251 trim_cache size 0 max 16384 2024-08-02T18:52:28.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.617+0000 7ff61b161740 1 Processor -- start 2024-08-02T18:52:28.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff61b161740 1 -- start start 2024-08-02T18:52:28.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff61b161740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454facc30 0x563454fb3b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff61b161740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fb06a0 0x563454fba390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff61b161740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 0x563454fb5680 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff61b161740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141b1120 con 0x563454fb06a0 2024-08-02T18:52:28.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff61b161740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141aef70 con 0x563454facc30 2024-08-02T18:52:28.634 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff61b161740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141b0a50 con 0x563454fb0fc0 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fb06a0 0x563454fba390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fb06a0 0x563454fba390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37704/0 (socket says 172.21.15.103:37704) 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 -- 172.21.15.103:0/328060772 learned_addr learned my addr 172.21.15.103:0/328060772 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff612d9d640 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 0x563454fb5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff61259c640 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454facc30 0x563454fb3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 -- 172.21.15.103:0/328060772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 msgr2=0x563454fb5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 0x563454fb5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 -- 172.21.15.103:0/328060772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454facc30 msgr2=0x563454fb3b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454facc30 0x563454fb3b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 -- 172.21.15.103:0/328060772 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563454fb6970 con 0x563454fb06a0 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.618+0000 7ff611d9b640 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fb06a0 0x563454fba390 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff608009930 tx=0x7ff60802a440 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7f6a161a1e33a58 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:28.635 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff5fbfff640 1 -- 172.21.15.103:0/328060772 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff60804e020 con 0x563454fb06a0 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff5fbfff640 1 -- 172.21.15.103:0/328060772 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff608005570 con 0x563454fb06a0 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff5fbfff640 1 -- 172.21.15.103:0/328060772 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff608035040 con 0x563454fb06a0 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 -- 172.21.15.103:0/328060772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fb06a0 msgr2=0x563454fba390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fb06a0 0x563454fba390 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7ff608009930 tx=0x7ff60802a440 comp rx=0 tx=0).stop 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 -- 172.21.15.103:0/328060772 shutdown_connections 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb0fc0 0x563454fb5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454fb06a0 0x563454fba390 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 --2- 172.21.15.103:0/328060772 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454facc30 0x563454fb3b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 -- 172.21.15.103:0/328060772 >> 172.21.15.103:0/328060772 conn(0x563454fb8ac0 msgr2=0x563454fb9c80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 -- 172.21.15.103:0/328060772 shutdown_connections 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.619+0000 7ff61b161740 1 -- 172.21.15.103:0/328060772 wait complete. 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 1 -- start start 2024-08-02T18:52:28.636 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 1 Processor -- start 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454facc30 0x563454fd0b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 0x563454fcef40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 0x563454fcf480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141afcb0 con 0x563454facc30 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141af5e0 con 0x563454fb0fc0 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff6141b0380 con 0x563454fb06a0 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61b161740 10 client.0 _ll_register_callbacks cb 0x7ff60400b770 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454facc30 0x563454fd0b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454facc30 0x563454fd0b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:37718/0 (socket says 172.21.15.103:37718) 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61259c640 1 -- 172.21.15.103:0/1081778035 learned_addr learned my addr 172.21.15.103:0/1081778035 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff611d9b640 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 0x563454fcef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff612d9d640 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 0x563454fcf480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.637 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61259c640 1 -- 172.21.15.103:0/1081778035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 msgr2=0x563454fcef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61259c640 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 0x563454fcef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61259c640 1 -- 172.21.15.103:0/1081778035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 msgr2=0x563454fcf480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61259c640 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 0x563454fcf480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.620+0000 7ff61259c640 1 -- 172.21.15.103:0/1081778035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563454fcfac0 con 0x563454facc30 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61259c640 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454facc30 0x563454fd0b40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x563454f19fc0 tx=0x7ff6040035f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=399feb13fd85ee30 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff5f9ffb640 10 client.0 ms_handle_connect on v2:172.21.15.103:3300/0 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/1081778035 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff604005220 con 0x563454facc30 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/1081778035 <== mon.0 v2:172.21.15.103:3300/0 2 ==== osd_map(90..90 src has 1..90) ==== 9350+0+0 (secure 0 0 0) 0x7ff6040053c0 con 0x563454facc30 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 1 -- 172.21.15.103:0/1081778035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff608005570 con 0x563454facc30 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/1081778035 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_get_version_reply(handle=1 version=33) ==== 24+0+0 (secure 0 0 0) 0x7ff6040055c0 con 0x563454facc30 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 10 client.16257 fetch_fsmap learned FSMap version 33 2024-08-02T18:52:28.638 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 1 -- 172.21.15.103:0/1081778035 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,fsmap=33,monmap=4+}) -- 0x5634550369c0 con 0x563454facc30 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/1081778035 <== mon.0 v2:172.21.15.103:3300/0 4 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff608005570 con 0x563454facc30 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/1081778035 <== mon.0 v2:172.21.15.103:3300/0 5 ==== fsmap(e 33) ==== 8378+0+0 (secure 0 0 0) 0x7ff60401d9f0 con 0x563454facc30 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 10 client.16257 fetch_fsmap finished waiting for FSMap version 33 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 10 client.16257 resolve_mds: validated gid 24473 aka daemon mds.b 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 20 client.16257 populate_metadata read hostname 'smithi103' 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563454fbb880 0x563455039210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 4 client.16257 mds_command: new command op to 24473 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.621+0000 7ff61b161740 1 -- 172.21.15.103:0/1081778035 --> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x563454f1d380 con 0x563454fbb880 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff611d9b640 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563454fbb880 0x563455039210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff5f9ffb640 10 client.16257 ms_handle_connect on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff611d9b640 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563454fbb880 0x563455039210 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e84fe392888f8047 server_cookie=c3b7143ac24921a7 in_seq=0 out_seq=0 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff5f9ffb640 1 -- 172.21.15.103:0/1081778035 <== mds.0 v2:172.21.15.121:6838/3512573309 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x563454f1d380 con 0x563454fbb880 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff5f9ffb640 10 client.16257 handle_command_reply: tid=0 2024-08-02T18:52:28.639 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 client.16257 shutdown 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 -- 172.21.15.103:0/1081778035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454facc30 msgr2=0x563454fd0b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454facc30 0x563454fd0b40 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x563454f19fc0 tx=0x7ff6040035f0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 -- 172.21.15.103:0/1081778035 shutdown_connections 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.121:6838/3512573309,v1:172.21.15.121:6839/3512573309] conn(0x563454fbb880 0x563455039210 crc :-1 s=READY pgs=101 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x563454fb0fc0 0x563454fcf480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x563454fb06a0 0x563454fcef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff5f9ffb640 0 client.16257 ms_handle_reset on v2:172.21.15.121:6838/3512573309 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 --2- 172.21.15.103:0/1081778035 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x563454facc30 0x563454fd0b40 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.622+0000 7ff61b161740 1 -- 172.21.15.103:0/1081778035 >> 172.21.15.103:0/1081778035 conn(0x563454fb8ac0 msgr2=0x563454fb20f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff61b161740 1 -- 172.21.15.103:0/1081778035 shutdown_connections 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff61b161740 1 -- 172.21.15.103:0/1081778035 wait complete. 2024-08-02T18:52:28.640 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff61b161740 20 client.16257 trim_cache size 0 max 16384 2024-08-02T18:52:28.641 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:52:28.641 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 33, 2024-08-02T18:52:28.641 INFO:teuthology.orchestra.run.smithi103.stdout: "leader": 24473, 2024-08-02T18:52:28.641 INFO:teuthology.orchestra.run.smithi103.stdout: "set_version": 8, 2024-08-02T18:52:28.641 INFO:teuthology.orchestra.run.smithi103.stdout: "sets": {} 2024-08-02T18:52:28.641 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:52:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 -- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5fc0a2cf0 msgr2=0x7ff5fc0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5fc0a2cf0 0x7ff5fc0a51b0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7ff60802a960 tx=0x7ff608031480 comp rx=0 tx=0).stop 2024-08-02T18:52:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 -- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141067b0 msgr2=0x7ff6140fd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:52:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141067b0 0x7ff6140fd500 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7ff60c00b990 tx=0x7ff60c00be50 comp rx=0 tx=0).stop 2024-08-02T18:52:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 -- 172.21.15.103:0/2355928799 shutdown_connections 2024-08-02T18:52:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff5fc0a2cf0 0x7ff5fc0a51b0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.642 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff6141067b0 0x7ff6140fd500 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff614101150 0x7ff6140fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 --2- 172.21.15.103:0/2355928799 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff6141007b0 0x7ff6140fca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:52:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 -- 172.21.15.103:0/2355928799 >> 172.21.15.103:0/2355928799 conn(0x7ff6140fc4d0 msgr2=0x7ff61406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:52:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 -- 172.21.15.103:0/2355928799 shutdown_connections 2024-08-02T18:52:28.643 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:52:28.623+0000 7ff618d63640 1 -- 172.21.15.103:0/2355928799 wait complete. 2024-08-02T18:52:29.420 INFO:tasks.quiescer:done joining Quiescers 2024-08-02T18:52:29.420 DEBUG:teuthology.run_tasks:Unwinding manager background_exec 2024-08-02T18:52:29.430 INFO:teuthology.task.background_exec:Stopping background command on ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:52:29.439 DEBUG:teuthology.run_tasks:Unwinding manager full_sequential_finally 2024-08-02T18:52:29.449 INFO:teuthology.task.full_sequential_finally:In full_sequential_finally, running task exec... 2024-08-02T18:52:29.450 INFO:teuthology.task.exec:Executing custom commands... 2024-08-02T18:52:29.450 INFO:teuthology.task.exec:Running commands on role mon.a host ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T18:52:29.450 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'date +%s > END_TIME' 2024-08-02T18:52:29.508 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'START_TIME=$(cat START_TIME); END_TIME=$(cat END_TIME); DIFF_TIME=$((600-(END_TIME-START_TIME))); if [ "$DIFF_TIME" -gt 0 ]; then sleep "$DIFF_TIME"; fi' 2024-08-02T18:52:29.570 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:29 smithi103 ceph-mon[32753]: pgmap v85: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 650 op/s 2024-08-02T18:52:29.750 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:29 smithi121 ceph-mon[37236]: pgmap v85: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 650 op/s 2024-08-02T18:52:29.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:29 smithi151 ceph-mon[37155]: pgmap v85: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 650 op/s 2024-08-02T18:52:31.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:31 smithi121 ceph-mon[37236]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 660 op/s 2024-08-02T18:52:31.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:31 smithi151 ceph-mon[37155]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 660 op/s 2024-08-02T18:52:31.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:31 smithi103 ceph-mon[32753]: pgmap v86: 129 pgs: 129 active+clean; 189 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.5 MiB/s rd, 1.6 MiB/s wr, 660 op/s 2024-08-02T18:52:33.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:33 smithi121 ceph-mon[37236]: pgmap v87: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 686 op/s 2024-08-02T18:52:33.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:33 smithi151 ceph-mon[37155]: pgmap v87: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 686 op/s 2024-08-02T18:52:33.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:33 smithi103 ceph-mon[32753]: pgmap v87: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 1.6 MiB/s rd, 1.5 MiB/s wr, 686 op/s 2024-08-02T18:52:35.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:35 smithi121 ceph-mon[37236]: pgmap v88: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 943 KiB/s wr, 444 op/s 2024-08-02T18:52:35.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:35 smithi151 ceph-mon[37155]: pgmap v88: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 943 KiB/s wr, 444 op/s 2024-08-02T18:52:35.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:35 smithi103 ceph-mon[32753]: pgmap v88: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 971 KiB/s rd, 943 KiB/s wr, 444 op/s 2024-08-02T18:52:37.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:37 smithi121 ceph-mon[37236]: pgmap v89: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 946 KiB/s wr, 449 op/s 2024-08-02T18:52:37.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:37 smithi151 ceph-mon[37155]: pgmap v89: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 946 KiB/s wr, 449 op/s 2024-08-02T18:52:37.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:37 smithi103 ceph-mon[32753]: pgmap v89: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 974 KiB/s rd, 946 KiB/s wr, 449 op/s 2024-08-02T18:52:39.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:39 smithi151 ceph-mon[37155]: pgmap v90: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 160 KiB/s wr, 87 op/s 2024-08-02T18:52:39.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:39 smithi103 ceph-mon[32753]: pgmap v90: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 160 KiB/s wr, 87 op/s 2024-08-02T18:52:40.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:39 smithi121 ceph-mon[37236]: pgmap v90: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 160 KiB/s wr, 87 op/s 2024-08-02T18:52:41.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:41 smithi151 ceph-mon[37155]: pgmap v91: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 160 KiB/s wr, 88 op/s 2024-08-02T18:52:41.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:41 smithi103 ceph-mon[32753]: pgmap v91: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 160 KiB/s wr, 88 op/s 2024-08-02T18:52:42.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:41 smithi121 ceph-mon[37236]: pgmap v91: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 258 KiB/s rd, 160 KiB/s wr, 88 op/s 2024-08-02T18:52:43.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:43 smithi151 ceph-mon[37155]: pgmap v92: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 160 KiB/s wr, 80 op/s 2024-08-02T18:52:43.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:43 smithi103 ceph-mon[32753]: pgmap v92: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 160 KiB/s wr, 80 op/s 2024-08-02T18:52:44.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:43 smithi121 ceph-mon[37236]: pgmap v92: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 257 KiB/s rd, 160 KiB/s wr, 80 op/s 2024-08-02T18:52:45.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:45 smithi151 ceph-mon[37155]: pgmap v93: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-02T18:52:45.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:45 smithi103 ceph-mon[32753]: pgmap v93: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-02T18:52:46.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:45 smithi121 ceph-mon[37236]: pgmap v93: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 3.2 KiB/s wr, 7 op/s 2024-08-02T18:52:47.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:47 smithi151 ceph-mon[37155]: pgmap v94: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-08-02T18:52:47.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:47 smithi103 ceph-mon[32753]: pgmap v94: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-08-02T18:52:48.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:47 smithi121 ceph-mon[37236]: pgmap v94: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 6.9 KiB/s rd, 3.4 KiB/s wr, 11 op/s 2024-08-02T18:52:49.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:49 smithi151 ceph-mon[37155]: pgmap v95: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-08-02T18:52:49.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:49 smithi103 ceph-mon[32753]: pgmap v95: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-08-02T18:52:50.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:49 smithi121 ceph-mon[37236]: pgmap v95: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 7 op/s 2024-08-02T18:52:51.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:51 smithi151 ceph-mon[37155]: pgmap v96: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 8 op/s 2024-08-02T18:52:51.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:51 smithi103 ceph-mon[32753]: pgmap v96: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 8 op/s 2024-08-02T18:52:52.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:51 smithi121 ceph-mon[37236]: pgmap v96: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 1023 B/s wr, 8 op/s 2024-08-02T18:52:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:53 smithi151 ceph-mon[37155]: pgmap v97: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-08-02T18:52:53.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:53 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:52:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:53 smithi103 ceph-mon[32753]: pgmap v97: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-08-02T18:52:53.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:53 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:52:54.000 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:53 smithi121 ceph-mon[37236]: pgmap v97: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.4 KiB/s rd, 1.5 KiB/s wr, 9 op/s 2024-08-02T18:52:54.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:53 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:52:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:54 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:52:54.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:54 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:52:54.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:54 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:52:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:54 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:52:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:54 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:52:54.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:54 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:52:55.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:54 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:52:55.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:54 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:52:55.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:54 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:52:55.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:55 smithi151 ceph-mon[37155]: pgmap v98: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 6 op/s 2024-08-02T18:52:55.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:55 smithi103 ceph-mon[32753]: pgmap v98: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 6 op/s 2024-08-02T18:52:56.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:55 smithi121 ceph-mon[37236]: pgmap v98: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 853 B/s wr, 6 op/s 2024-08-02T18:52:57.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:57 smithi151 ceph-mon[37155]: pgmap v99: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-02T18:52:57.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:57 smithi103 ceph-mon[32753]: pgmap v99: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-02T18:52:58.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:57 smithi121 ceph-mon[37236]: pgmap v99: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.6 KiB/s rd, 853 B/s wr, 10 op/s 2024-08-02T18:52:59.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:52:59 smithi151 ceph-mon[37155]: pgmap v100: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-02T18:52:59.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:52:59 smithi103 ceph-mon[32753]: pgmap v100: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-02T18:53:00.000 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:52:59 smithi121 ceph-mon[37236]: pgmap v100: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 597 B/s wr, 6 op/s 2024-08-02T18:53:01.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:01 smithi151 ceph-mon[37155]: pgmap v101: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-02T18:53:01.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:01 smithi103 ceph-mon[32753]: pgmap v101: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-02T18:53:02.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:01 smithi121 ceph-mon[37236]: pgmap v101: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.9 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-02T18:53:03.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:03 smithi151 ceph-mon[37155]: pgmap v102: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-02T18:53:03.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:03 smithi103 ceph-mon[32753]: pgmap v102: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-02T18:53:04.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:03 smithi121 ceph-mon[37236]: pgmap v102: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 597 B/s wr, 8 op/s 2024-08-02T18:53:05.803 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:05 smithi121 ceph-mon[37236]: pgmap v103: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-08-02T18:53:05.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:05 smithi151 ceph-mon[37155]: pgmap v103: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-08-02T18:53:05.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:05 smithi103 ceph-mon[32753]: pgmap v103: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-08-02T18:53:07.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:07 smithi151 ceph-mon[37155]: pgmap v104: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-02T18:53:07.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:07 smithi103 ceph-mon[32753]: pgmap v104: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-02T18:53:08.003 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:07 smithi121 ceph-mon[37236]: pgmap v104: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 24 op/s 2024-08-02T18:53:09.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:09 smithi151 ceph-mon[37155]: pgmap v105: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:53:09.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:09 smithi103 ceph-mon[32753]: pgmap v105: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:53:10.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:09 smithi121 ceph-mon[37236]: pgmap v105: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:53:11.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:11 smithi151 ceph-mon[37155]: pgmap v106: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:53:11.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:11 smithi103 ceph-mon[32753]: pgmap v106: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:53:12.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:11 smithi121 ceph-mon[37236]: pgmap v106: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:53:13.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:13 smithi151 ceph-mon[37155]: pgmap v107: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:53:13.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:13 smithi103 ceph-mon[32753]: pgmap v107: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:53:14.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:13 smithi121 ceph-mon[37236]: pgmap v107: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:53:15.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:15 smithi151 ceph-mon[37155]: pgmap v108: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:53:15.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:15 smithi103 ceph-mon[32753]: pgmap v108: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:53:16.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:15 smithi121 ceph-mon[37236]: pgmap v108: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:53:17.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:16 smithi121 ceph-mon[37236]: pgmap v109: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:53:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:16 smithi151 ceph-mon[37155]: pgmap v109: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:53:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:16 smithi103 ceph-mon[32753]: pgmap v109: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:53:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:18 smithi121 ceph-mon[37236]: pgmap v110: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:53:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:18 smithi151 ceph-mon[37155]: pgmap v110: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:53:19.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:18 smithi103 ceph-mon[32753]: pgmap v110: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:53:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:20 smithi121 ceph-mon[37236]: pgmap v111: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:53:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:20 smithi151 ceph-mon[37155]: pgmap v111: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:53:21.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:20 smithi103 ceph-mon[32753]: pgmap v111: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:53:23.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:22 smithi121 ceph-mon[37236]: pgmap v112: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:53:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:22 smithi151 ceph-mon[37155]: pgmap v112: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:53:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:22 smithi103 ceph-mon[32753]: pgmap v112: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:53:25.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:24 smithi121 ceph-mon[37236]: pgmap v113: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:24 smithi151 ceph-mon[37155]: pgmap v113: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:24 smithi103 ceph-mon[32753]: pgmap v113: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:27.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:26 smithi121 ceph-mon[37236]: pgmap v114: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:26 smithi151 ceph-mon[37155]: pgmap v114: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:26 smithi103 ceph-mon[32753]: pgmap v114: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:29.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:28 smithi121 ceph-mon[37236]: pgmap v115: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:29.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:28 smithi151 ceph-mon[37155]: pgmap v115: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:29.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:28 smithi103 ceph-mon[32753]: pgmap v115: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:31.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:30 smithi121 ceph-mon[37236]: pgmap v116: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:31.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:30 smithi151 ceph-mon[37155]: pgmap v116: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:31.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:30 smithi103 ceph-mon[32753]: pgmap v116: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:33.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:32 smithi121 ceph-mon[37236]: pgmap v117: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:33.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:32 smithi151 ceph-mon[37155]: pgmap v117: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:33.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:32 smithi103 ceph-mon[32753]: pgmap v117: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:35.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:34 smithi121 ceph-mon[37236]: pgmap v118: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:35.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:34 smithi151 ceph-mon[37155]: pgmap v118: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:35.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:34 smithi103 ceph-mon[32753]: pgmap v118: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:37.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:36 smithi121 ceph-mon[37236]: pgmap v119: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:37.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:36 smithi151 ceph-mon[37155]: pgmap v119: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:37.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:36 smithi103 ceph-mon[32753]: pgmap v119: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:39.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:38 smithi121 ceph-mon[37236]: pgmap v120: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:39.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:38 smithi151 ceph-mon[37155]: pgmap v120: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:39.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:38 smithi103 ceph-mon[32753]: pgmap v120: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:41.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:40 smithi121 ceph-mon[37236]: pgmap v121: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:41.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:40 smithi151 ceph-mon[37155]: pgmap v121: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:41.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:40 smithi103 ceph-mon[32753]: pgmap v121: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:43.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:42 smithi121 ceph-mon[37236]: pgmap v122: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:43.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:42 smithi151 ceph-mon[37155]: pgmap v122: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:43.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:42 smithi103 ceph-mon[32753]: pgmap v122: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:45.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:44 smithi121 ceph-mon[37236]: pgmap v123: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:45.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:44 smithi151 ceph-mon[37155]: pgmap v123: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:45.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:44 smithi103 ceph-mon[32753]: pgmap v123: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:47.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:46 smithi121 ceph-mon[37236]: pgmap v124: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:47.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:46 smithi151 ceph-mon[37155]: pgmap v124: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:47.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:46 smithi103 ceph-mon[32753]: pgmap v124: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:49.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:48 smithi121 ceph-mon[37236]: pgmap v125: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:49.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:48 smithi151 ceph-mon[37155]: pgmap v125: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:49.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:48 smithi103 ceph-mon[32753]: pgmap v125: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:51.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:50 smithi121 ceph-mon[37236]: pgmap v126: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:51.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:50 smithi151 ceph-mon[37155]: pgmap v126: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:51.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:50 smithi103 ceph-mon[32753]: pgmap v126: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:53:53.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:52 smithi121 ceph-mon[37236]: pgmap v127: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:53.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:52 smithi151 ceph-mon[37155]: pgmap v127: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:53.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:52 smithi103 ceph-mon[32753]: pgmap v127: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:53:55.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:54 smithi151 ceph-mon[37155]: pgmap v128: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:55.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:54 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:53:55.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:54 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:53:55.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:54 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:53:55.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:54 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:53:55.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:54 smithi103 ceph-mon[32753]: pgmap v128: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:55.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:54 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:53:55.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:54 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:53:55.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:54 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:53:55.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:54 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:53:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:54 smithi121 ceph-mon[37236]: pgmap v128: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:54 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:53:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:54 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:53:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:54 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:53:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:54 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:53:57.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:56 smithi151 ceph-mon[37155]: pgmap v129: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:56 smithi103 ceph-mon[32753]: pgmap v129: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:56 smithi121 ceph-mon[37236]: pgmap v129: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:53:58.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:57 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:53:58.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:57 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:53:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:57 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:53:59.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:53:58 smithi151 ceph-mon[37155]: pgmap v130: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:53:58 smithi103 ceph-mon[32753]: pgmap v130: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:53:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:53:58 smithi121 ceph-mon[37236]: pgmap v130: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:01.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:00 smithi151 ceph-mon[37155]: pgmap v131: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:01.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:00 smithi103 ceph-mon[32753]: pgmap v131: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:01.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:00 smithi121 ceph-mon[37236]: pgmap v131: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:03.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:02 smithi151 ceph-mon[37155]: pgmap v132: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:03.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:02 smithi103 ceph-mon[32753]: pgmap v132: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:03.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:02 smithi121 ceph-mon[37236]: pgmap v132: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:05.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:04 smithi151 ceph-mon[37155]: pgmap v133: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:05.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:04 smithi103 ceph-mon[32753]: pgmap v133: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:05.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:04 smithi121 ceph-mon[37236]: pgmap v133: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:07.053 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:06 smithi121 ceph-mon[37236]: pgmap v134: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:54:07.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:06 smithi151 ceph-mon[37155]: pgmap v134: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:54:07.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:06 smithi103 ceph-mon[32753]: pgmap v134: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:54:09.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:08 smithi151 ceph-mon[37155]: pgmap v135: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:54:09.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:08 smithi103 ceph-mon[32753]: pgmap v135: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:54:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:08 smithi121 ceph-mon[37236]: pgmap v135: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:54:11.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:10 smithi151 ceph-mon[37155]: pgmap v136: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:54:11.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:10 smithi103 ceph-mon[32753]: pgmap v136: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:54:11.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:10 smithi121 ceph-mon[37236]: pgmap v136: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:54:13.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:12 smithi151 ceph-mon[37155]: pgmap v137: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:54:13.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:12 smithi103 ceph-mon[32753]: pgmap v137: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:54:13.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:12 smithi121 ceph-mon[37236]: pgmap v137: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:54:15.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:14 smithi151 ceph-mon[37155]: pgmap v138: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:54:15.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:14 smithi103 ceph-mon[32753]: pgmap v138: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:54:15.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:14 smithi121 ceph-mon[37236]: pgmap v138: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:54:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:16 smithi151 ceph-mon[37155]: pgmap v139: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:54:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:16 smithi103 ceph-mon[32753]: pgmap v139: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:54:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:16 smithi121 ceph-mon[37236]: pgmap v139: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:54:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:18 smithi151 ceph-mon[37155]: pgmap v140: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:54:19.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:18 smithi103 ceph-mon[32753]: pgmap v140: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:54:19.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:18 smithi121 ceph-mon[37236]: pgmap v140: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.6 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:54:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:20 smithi151 ceph-mon[37155]: pgmap v141: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:54:21.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:20 smithi103 ceph-mon[32753]: pgmap v141: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:54:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:20 smithi121 ceph-mon[37236]: pgmap v141: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:54:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:22 smithi151 ceph-mon[37155]: pgmap v142: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:54:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:22 smithi103 ceph-mon[32753]: pgmap v142: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:54:23.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:22 smithi121 ceph-mon[37236]: pgmap v142: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:54:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:24 smithi151 ceph-mon[37155]: pgmap v143: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:24 smithi103 ceph-mon[32753]: pgmap v143: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:25.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:24 smithi121 ceph-mon[37236]: pgmap v143: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:26 smithi151 ceph-mon[37155]: pgmap v144: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:26 smithi103 ceph-mon[32753]: pgmap v144: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:27.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:26 smithi121 ceph-mon[37236]: pgmap v144: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:28.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:27 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:28.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:27 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:28.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:27 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:29.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:28 smithi103 ceph-mon[32753]: pgmap v145: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:29.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:28 smithi121 ceph-mon[37236]: pgmap v145: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:29.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:28 smithi151 ceph-mon[37155]: pgmap v145: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:30 smithi121 ceph-mon[37236]: pgmap v146: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:31.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:30 smithi151 ceph-mon[37155]: pgmap v146: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:31.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:30 smithi103 ceph-mon[32753]: pgmap v146: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:33.254 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:32 smithi121 ceph-mon[37236]: pgmap v147: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:33.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:32 smithi151 ceph-mon[37155]: pgmap v147: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:33.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:32 smithi103 ceph-mon[32753]: pgmap v147: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:35.128 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:34 smithi103 ceph-mon[32753]: pgmap v148: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:35.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:34 smithi121 ceph-mon[37236]: pgmap v148: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:35.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:34 smithi151 ceph-mon[37155]: pgmap v148: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:37.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:36 smithi121 ceph-mon[37236]: pgmap v149: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:37.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:36 smithi151 ceph-mon[37155]: pgmap v149: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:37.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:36 smithi103 ceph-mon[32753]: pgmap v149: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:39.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:38 smithi121 ceph-mon[37236]: pgmap v150: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:39.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:38 smithi151 ceph-mon[37155]: pgmap v150: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:39.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:38 smithi103 ceph-mon[32753]: pgmap v150: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:41.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:40 smithi121 ceph-mon[37236]: pgmap v151: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:41.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:40 smithi151 ceph-mon[37155]: pgmap v151: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:41.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:40 smithi103 ceph-mon[32753]: pgmap v151: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:42 smithi121 ceph-mon[37236]: pgmap v152: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:42 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:43.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:42 smithi151 ceph-mon[37155]: pgmap v152: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:43.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:42 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:43.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:42 smithi103 ceph-mon[32753]: pgmap v152: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:43.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:42 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:45.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:44 smithi121 ceph-mon[37236]: pgmap v153: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:45.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:44 smithi151 ceph-mon[37155]: pgmap v153: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:45.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:44 smithi103 ceph-mon[32753]: pgmap v153: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:47.122 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:46 smithi151 ceph-mon[37155]: pgmap v154: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:47.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:46 smithi121 ceph-mon[37236]: pgmap v154: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:46 smithi103 ceph-mon[32753]: pgmap v154: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:48.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:47 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:48.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:47 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:48.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:47 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:54:49.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:48 smithi121 ceph-mon[37236]: pgmap v155: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:49.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:48 smithi151 ceph-mon[37155]: pgmap v155: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:49.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:48 smithi103 ceph-mon[32753]: pgmap v155: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:51.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:50 smithi121 ceph-mon[37236]: pgmap v156: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:51.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:50 smithi151 ceph-mon[37155]: pgmap v156: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:51.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:50 smithi103 ceph-mon[32753]: pgmap v156: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:54:53.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:52 smithi121 ceph-mon[37236]: pgmap v157: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:53.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:52 smithi151 ceph-mon[37155]: pgmap v157: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:53.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:52 smithi103 ceph-mon[32753]: pgmap v157: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:54:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:54 smithi121 ceph-mon[37236]: pgmap v158: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:54 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:54:55.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:54 smithi151 ceph-mon[37155]: pgmap v158: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:55.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:54 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:54:55.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:54 smithi103 ceph-mon[32753]: pgmap v158: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:55.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:54 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:54:56.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:55 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:54:56.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:55 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:54:56.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:55 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:54:56.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:55 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:54:56.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:55 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:54:56.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:55 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:54:56.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:55 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:54:56.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:55 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:54:56.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:55 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:54:57.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:57 smithi103 ceph-mon[32753]: pgmap v159: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:57.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:57 smithi121 ceph-mon[37236]: pgmap v159: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:57.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:57 smithi151 ceph-mon[37155]: pgmap v159: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:54:59.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:54:59 smithi103 ceph-mon[32753]: pgmap v160: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:59.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:54:59 smithi121 ceph-mon[37236]: pgmap v160: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:54:59.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:54:59 smithi151 ceph-mon[37155]: pgmap v160: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:01 smithi121 ceph-mon[37236]: pgmap v161: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:01.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:01 smithi151 ceph-mon[37155]: pgmap v161: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:01 smithi103 ceph-mon[32753]: pgmap v161: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:03.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:03 smithi121 ceph-mon[37236]: pgmap v162: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:03.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:03 smithi151 ceph-mon[37155]: pgmap v162: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:03.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:03 smithi103 ceph-mon[32753]: pgmap v162: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:05.378 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:05 smithi103 ceph-mon[32753]: pgmap v163: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:05.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:05 smithi121 ceph-mon[37236]: pgmap v163: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:05.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:05 smithi151 ceph-mon[37155]: pgmap v163: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:07.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:07 smithi121 ceph-mon[37236]: pgmap v164: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:55:07.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:07 smithi151 ceph-mon[37155]: pgmap v164: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:55:07.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:07 smithi103 ceph-mon[32753]: pgmap v164: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:55:08.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:08 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:55:08.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:08 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:55:08.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:08 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:55:09.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:09 smithi121 ceph-mon[37236]: pgmap v165: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:55:09.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:09 smithi151 ceph-mon[37155]: pgmap v165: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:55:09.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:09 smithi103 ceph-mon[32753]: pgmap v165: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:55:11.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:11 smithi121 ceph-mon[37236]: pgmap v166: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:55:11.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:11 smithi151 ceph-mon[37155]: pgmap v166: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:55:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:11 smithi103 ceph-mon[32753]: pgmap v166: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 22 op/s 2024-08-02T18:55:13.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:13 smithi121 ceph-mon[37236]: pgmap v167: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:55:13.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:13 smithi151 ceph-mon[37155]: pgmap v167: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:55:13.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:13 smithi103 ceph-mon[32753]: pgmap v167: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 23 op/s 2024-08-02T18:55:15.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:15 smithi121 ceph-mon[37236]: pgmap v168: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:55:15.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:15 smithi151 ceph-mon[37155]: pgmap v168: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:55:15.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:15 smithi103 ceph-mon[32753]: pgmap v168: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 12 KiB/s rd, 22 KiB/s wr, 21 op/s 2024-08-02T18:55:17.373 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:17 smithi151 ceph-mon[37155]: pgmap v169: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:55:17.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:17 smithi121 ceph-mon[37236]: pgmap v169: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:55:17.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:17 smithi103 ceph-mon[32753]: pgmap v169: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 13 KiB/s rd, 22 KiB/s wr, 25 op/s 2024-08-02T18:55:18.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:18 smithi121 ceph-mon[37236]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:55:18.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:18 smithi151 ceph-mon[37155]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:55:18.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:18 smithi103 ceph-mon[32753]: fsmap cephfs:3 {0=b=up:active,1=i=up:active,2=c=up:active} 3 up:standby-replay 6 up:standby 2024-08-02T18:55:19.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:19 smithi121 ceph-mon[37236]: pgmap v170: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:55:19.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:19 smithi151 ceph-mon[37155]: pgmap v170: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:55:19.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:19 smithi103 ceph-mon[32753]: pgmap v170: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 85 B/s wr, 6 op/s 2024-08-02T18:55:21.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:21 smithi121 ceph-mon[37236]: pgmap v171: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:55:21.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:21 smithi151 ceph-mon[37155]: pgmap v171: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:55:21.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:21 smithi103 ceph-mon[32753]: pgmap v171: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 85 B/s wr, 7 op/s 2024-08-02T18:55:23.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:23 smithi121 ceph-mon[37236]: pgmap v172: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:55:23.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:23 smithi151 ceph-mon[37155]: pgmap v172: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:55:23.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:23 smithi103 ceph-mon[32753]: pgmap v172: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 85 B/s wr, 8 op/s 2024-08-02T18:55:25.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:25 smithi121 ceph-mon[37236]: pgmap v173: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-08-02T18:55:25.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:25 smithi151 ceph-mon[37155]: pgmap v173: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-08-02T18:55:25.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:25 smithi103 ceph-mon[32753]: pgmap v173: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.4 KiB/s rd, 6 op/s 2024-08-02T18:55:27.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:27 smithi121 ceph-mon[37236]: pgmap v174: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:27.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:27 smithi151 ceph-mon[37155]: pgmap v174: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:27.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:27 smithi103 ceph-mon[32753]: pgmap v174: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:29.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:29 smithi121 ceph-mon[37236]: pgmap v175: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:29.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:29 smithi151 ceph-mon[37155]: pgmap v175: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:29.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:29 smithi103 ceph-mon[32753]: pgmap v175: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:31.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:31 smithi121 ceph-mon[37236]: pgmap v176: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:31.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:31 smithi151 ceph-mon[37155]: pgmap v176: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:31.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:31 smithi103 ceph-mon[32753]: pgmap v176: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:33.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:33 smithi121 ceph-mon[37236]: pgmap v177: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:33.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:33 smithi151 ceph-mon[37155]: pgmap v177: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:33.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:33 smithi103 ceph-mon[32753]: pgmap v177: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:35.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:35 smithi121 ceph-mon[37236]: pgmap v178: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:35.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:35 smithi151 ceph-mon[37155]: pgmap v178: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:35.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:35 smithi103 ceph-mon[32753]: pgmap v178: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:37.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:37 smithi121 ceph-mon[37236]: pgmap v179: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:37.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:37 smithi151 ceph-mon[37155]: pgmap v179: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:37.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:37 smithi103 ceph-mon[32753]: pgmap v179: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:39.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:39 smithi121 ceph-mon[37236]: pgmap v180: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:39.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:39 smithi151 ceph-mon[37155]: pgmap v180: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:39.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:39 smithi103 ceph-mon[32753]: pgmap v180: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:41.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:41 smithi121 ceph-mon[37236]: pgmap v181: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:41.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:41 smithi151 ceph-mon[37155]: pgmap v181: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:41.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:41 smithi103 ceph-mon[32753]: pgmap v181: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:43.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:43 smithi121 ceph-mon[37236]: pgmap v182: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:43.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:43 smithi151 ceph-mon[37155]: pgmap v182: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:43.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:43 smithi103 ceph-mon[32753]: pgmap v182: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:45.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:45 smithi121 ceph-mon[37236]: pgmap v183: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:45.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:45 smithi151 ceph-mon[37155]: pgmap v183: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:45.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:45 smithi103 ceph-mon[32753]: pgmap v183: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:47.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:47 smithi121 ceph-mon[37236]: pgmap v184: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:47.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:47 smithi151 ceph-mon[37155]: pgmap v184: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:47.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:47 smithi103 ceph-mon[32753]: pgmap v184: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:49.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:49 smithi121 ceph-mon[37236]: pgmap v185: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:49.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:49 smithi151 ceph-mon[37155]: pgmap v185: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:49.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:49 smithi103 ceph-mon[32753]: pgmap v185: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:51.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:51 smithi121 ceph-mon[37236]: pgmap v186: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:51.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:51 smithi151 ceph-mon[37155]: pgmap v186: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:51.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:51 smithi103 ceph-mon[32753]: pgmap v186: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:55:53.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:53 smithi121 ceph-mon[37236]: pgmap v187: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:53.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:53 smithi151 ceph-mon[37155]: pgmap v187: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:53.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:53 smithi103 ceph-mon[32753]: pgmap v187: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:55:55.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:55 smithi121 ceph-mon[37236]: pgmap v188: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:55.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:55 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:55:55.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:55 smithi151 ceph-mon[37155]: pgmap v188: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:55.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:55 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:55:55.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:55 smithi103 ceph-mon[32753]: pgmap v188: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:55.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:55 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:55:56.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:55:56.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:55:56.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:55:56.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:55:56.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:55:56.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:55:56.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:55:56.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:55:56.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:55:57.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:57 smithi121 ceph-mon[37236]: pgmap v189: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:57.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:57 smithi151 ceph-mon[37155]: pgmap v189: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:57.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:57 smithi103 ceph-mon[32753]: pgmap v189: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:55:59.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:55:59 smithi121 ceph-mon[37236]: pgmap v190: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:59.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:55:59 smithi151 ceph-mon[37155]: pgmap v190: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:55:59.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:55:59 smithi103 ceph-mon[32753]: pgmap v190: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:01 smithi121 ceph-mon[37236]: pgmap v191: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:01.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:01 smithi151 ceph-mon[37155]: pgmap v191: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:01 smithi103 ceph-mon[32753]: pgmap v191: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:03.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:03 smithi121 ceph-mon[37236]: pgmap v192: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:03.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:03 smithi151 ceph-mon[37155]: pgmap v192: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:03.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:03 smithi103 ceph-mon[32753]: pgmap v192: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:05.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:05 smithi121 ceph-mon[37236]: pgmap v193: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:05.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:05 smithi151 ceph-mon[37155]: pgmap v193: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:05.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:05 smithi103 ceph-mon[32753]: pgmap v193: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:07.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:07 smithi121 ceph-mon[37236]: pgmap v194: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:56:07.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:07 smithi151 ceph-mon[37155]: pgmap v194: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:56:07.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:07 smithi103 ceph-mon[32753]: pgmap v194: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:56:08.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:08 smithi121 ceph-mon[37236]: osdmap e91: 12 total, 12 up, 12 in 2024-08-02T18:56:08.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:08 smithi151 ceph-mon[37155]: osdmap e91: 12 total, 12 up, 12 in 2024-08-02T18:56:08.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:08 smithi103 ceph-mon[32753]: osdmap e91: 12 total, 12 up, 12 in 2024-08-02T18:56:09.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:09 smithi121 ceph-mon[37236]: pgmap v196: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:09.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:09 smithi151 ceph-mon[37155]: pgmap v196: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:09.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:09 smithi103 ceph-mon[32753]: pgmap v196: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:11.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:11 smithi121 ceph-mon[37236]: pgmap v197: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:11.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:11 smithi151 ceph-mon[37155]: pgmap v197: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:11 smithi103 ceph-mon[32753]: pgmap v197: 129 pgs: 129 active+clean; 186 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:13.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:13 smithi121 ceph-mon[37236]: pgmap v198: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:13.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:13 smithi151 ceph-mon[37155]: pgmap v198: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:13.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:13 smithi103 ceph-mon[32753]: pgmap v198: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:15.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:15 smithi121 ceph-mon[37236]: pgmap v199: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:15.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:15 smithi151 ceph-mon[37155]: pgmap v199: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:15.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:15 smithi103 ceph-mon[32753]: pgmap v199: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:56:17.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:16 smithi121 ceph-mon[37236]: pgmap v200: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:17.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:16 smithi121 ceph-mon[37236]: osdmap e92: 12 total, 12 up, 12 in 2024-08-02T18:56:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:16 smithi151 ceph-mon[37155]: pgmap v200: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:16 smithi151 ceph-mon[37155]: osdmap e92: 12 total, 12 up, 12 in 2024-08-02T18:56:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:16 smithi103 ceph-mon[32753]: pgmap v200: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:16 smithi103 ceph-mon[32753]: osdmap e92: 12 total, 12 up, 12 in 2024-08-02T18:56:19.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:18 smithi121 ceph-mon[37236]: pgmap v202: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:18 smithi151 ceph-mon[37155]: pgmap v202: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:19.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:18 smithi103 ceph-mon[32753]: pgmap v202: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:21.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:20 smithi121 ceph-mon[37236]: pgmap v203: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:20 smithi151 ceph-mon[37155]: pgmap v203: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:21.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:20 smithi103 ceph-mon[32753]: pgmap v203: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:56:23.001 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:22 smithi121 ceph-mon[37236]: pgmap v204: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:56:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:22 smithi151 ceph-mon[37155]: pgmap v204: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:56:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:22 smithi103 ceph-mon[32753]: pgmap v204: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:56:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:24 smithi151 ceph-mon[37155]: pgmap v205: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:56:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:24 smithi103 ceph-mon[32753]: pgmap v205: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:56:25.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:24 smithi121 ceph-mon[37236]: pgmap v205: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:56:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:26 smithi151 ceph-mon[37155]: pgmap v206: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:56:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:26 smithi103 ceph-mon[32753]: pgmap v206: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:56:27.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:26 smithi121 ceph-mon[37236]: pgmap v206: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:56:29.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:28 smithi151 ceph-mon[37155]: pgmap v207: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:29.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:28 smithi103 ceph-mon[32753]: pgmap v207: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:29.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:28 smithi121 ceph-mon[37236]: pgmap v207: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:31.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:30 smithi151 ceph-mon[37155]: pgmap v208: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:31.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:30 smithi103 ceph-mon[32753]: pgmap v208: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:30 smithi121 ceph-mon[37236]: pgmap v208: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:33.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:32 smithi151 ceph-mon[37155]: pgmap v209: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:33.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:32 smithi103 ceph-mon[32753]: pgmap v209: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:33.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:32 smithi121 ceph-mon[37236]: pgmap v209: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:35.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:34 smithi151 ceph-mon[37155]: pgmap v210: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:35.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:34 smithi103 ceph-mon[32753]: pgmap v210: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:35.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:34 smithi121 ceph-mon[37236]: pgmap v210: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:37.052 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:36 smithi121 ceph-mon[37236]: pgmap v211: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:37.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:36 smithi151 ceph-mon[37155]: pgmap v211: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:37.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:36 smithi103 ceph-mon[32753]: pgmap v211: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:39.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:38 smithi151 ceph-mon[37155]: pgmap v212: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:39.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:38 smithi103 ceph-mon[32753]: pgmap v212: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:39.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:38 smithi121 ceph-mon[37236]: pgmap v212: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:41.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:40 smithi151 ceph-mon[37155]: pgmap v213: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:41.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:40 smithi103 ceph-mon[32753]: pgmap v213: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:41.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:40 smithi121 ceph-mon[37236]: pgmap v213: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:43.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:42 smithi151 ceph-mon[37155]: pgmap v214: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:43.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:42 smithi103 ceph-mon[32753]: pgmap v214: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:42 smithi121 ceph-mon[37236]: pgmap v214: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:45.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:44 smithi151 ceph-mon[37155]: pgmap v215: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:45.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:44 smithi103 ceph-mon[32753]: pgmap v215: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:45.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:44 smithi121 ceph-mon[37236]: pgmap v215: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:47.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:46 smithi151 ceph-mon[37155]: pgmap v216: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:47.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:46 smithi103 ceph-mon[32753]: pgmap v216: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:47.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:46 smithi121 ceph-mon[37236]: pgmap v216: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:49.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:48 smithi151 ceph-mon[37155]: pgmap v217: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:49.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:48 smithi103 ceph-mon[32753]: pgmap v217: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:49.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:48 smithi121 ceph-mon[37236]: pgmap v217: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:51.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:50 smithi151 ceph-mon[37155]: pgmap v218: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:51.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:50 smithi103 ceph-mon[32753]: pgmap v218: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:51.255 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:50 smithi121 ceph-mon[37236]: pgmap v218: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:56:53.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:52 smithi151 ceph-mon[37155]: pgmap v219: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:53.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:52 smithi103 ceph-mon[32753]: pgmap v219: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:53.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:52 smithi121 ceph-mon[37236]: pgmap v219: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:56:55.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:54 smithi151 ceph-mon[37155]: pgmap v220: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:55.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:54 smithi103 ceph-mon[32753]: pgmap v220: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:54 smithi121 ceph-mon[37236]: pgmap v220: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:56.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:55 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:56:56.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:55 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:56:56.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:55 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:56:57.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:56 smithi151 ceph-mon[37155]: pgmap v221: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:56:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:56:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:56:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:56 smithi103 ceph-mon[32753]: pgmap v221: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:56:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:56:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:56:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:56 smithi121 ceph-mon[37236]: pgmap v221: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:56:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:56:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:56:57.252 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:56:59.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:56:58 smithi151 ceph-mon[37155]: pgmap v222: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:56:58 smithi103 ceph-mon[32753]: pgmap v222: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:56:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:56:58 smithi121 ceph-mon[37236]: pgmap v222: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:01.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:00 smithi151 ceph-mon[37155]: pgmap v223: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:01.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:00 smithi103 ceph-mon[32753]: pgmap v223: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:01.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:00 smithi121 ceph-mon[37236]: pgmap v223: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:03.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:02 smithi151 ceph-mon[37155]: pgmap v224: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:03.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:02 smithi103 ceph-mon[32753]: pgmap v224: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:03.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:02 smithi121 ceph-mon[37236]: pgmap v224: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:05.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:04 smithi151 ceph-mon[37155]: pgmap v225: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:05.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:04 smithi103 ceph-mon[32753]: pgmap v225: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:05.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:04 smithi121 ceph-mon[37236]: pgmap v225: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:07.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:06 smithi121 ceph-mon[37236]: pgmap v226: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:57:07.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:06 smithi151 ceph-mon[37155]: pgmap v226: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:57:07.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:06 smithi103 ceph-mon[32753]: pgmap v226: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:57:08.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:07 smithi121 ceph-mon[37236]: osdmap e93: 12 total, 12 up, 12 in 2024-08-02T18:57:08.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:07 smithi151 ceph-mon[37155]: osdmap e93: 12 total, 12 up, 12 in 2024-08-02T18:57:08.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:07 smithi103 ceph-mon[32753]: osdmap e93: 12 total, 12 up, 12 in 2024-08-02T18:57:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:08 smithi121 ceph-mon[37236]: pgmap v228: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:09.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:08 smithi151 ceph-mon[37155]: pgmap v228: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:09.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:08 smithi103 ceph-mon[32753]: pgmap v228: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:11.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:10 smithi121 ceph-mon[37236]: pgmap v229: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:11.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:10 smithi151 ceph-mon[37155]: pgmap v229: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:11.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:10 smithi103 ceph-mon[32753]: pgmap v229: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:13.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:12 smithi121 ceph-mon[37236]: pgmap v230: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:13.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:12 smithi151 ceph-mon[37155]: pgmap v230: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:13.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:12 smithi103 ceph-mon[32753]: pgmap v230: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:15.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:14 smithi121 ceph-mon[37236]: pgmap v231: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:15.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:14 smithi151 ceph-mon[37155]: pgmap v231: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:15.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:14 smithi103 ceph-mon[32753]: pgmap v231: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:57:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:16 smithi151 ceph-mon[37155]: pgmap v232: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:17.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:16 smithi151 ceph-mon[37155]: osdmap e94: 12 total, 12 up, 12 in 2024-08-02T18:57:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:16 smithi103 ceph-mon[32753]: pgmap v232: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:16 smithi103 ceph-mon[32753]: osdmap e94: 12 total, 12 up, 12 in 2024-08-02T18:57:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:16 smithi121 ceph-mon[37236]: pgmap v232: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:16 smithi121 ceph-mon[37236]: osdmap e94: 12 total, 12 up, 12 in 2024-08-02T18:57:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:18 smithi151 ceph-mon[37155]: pgmap v234: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:19.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:18 smithi103 ceph-mon[32753]: pgmap v234: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:19.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:18 smithi121 ceph-mon[37236]: pgmap v234: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:20 smithi151 ceph-mon[37155]: pgmap v235: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:21.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:20 smithi103 ceph-mon[32753]: pgmap v235: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:20 smithi121 ceph-mon[37236]: pgmap v235: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:57:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:22 smithi151 ceph-mon[37155]: pgmap v236: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:57:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:22 smithi103 ceph-mon[32753]: pgmap v236: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:57:23.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:22 smithi121 ceph-mon[37236]: pgmap v236: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:57:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:24 smithi151 ceph-mon[37155]: pgmap v237: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:57:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:24 smithi103 ceph-mon[32753]: pgmap v237: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:57:25.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:24 smithi121 ceph-mon[37236]: pgmap v237: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:57:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:26 smithi151 ceph-mon[37155]: pgmap v238: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:57:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:26 smithi103 ceph-mon[32753]: pgmap v238: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:57:27.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:26 smithi121 ceph-mon[37236]: pgmap v238: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:57:29.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:28 smithi151 ceph-mon[37155]: pgmap v239: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:29.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:28 smithi103 ceph-mon[32753]: pgmap v239: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:29.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:28 smithi121 ceph-mon[37236]: pgmap v239: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:31.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:30 smithi151 ceph-mon[37155]: pgmap v240: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:31.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:30 smithi103 ceph-mon[32753]: pgmap v240: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:30 smithi121 ceph-mon[37236]: pgmap v240: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:33.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:32 smithi151 ceph-mon[37155]: pgmap v241: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:33.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:32 smithi103 ceph-mon[32753]: pgmap v241: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:33.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:32 smithi121 ceph-mon[37236]: pgmap v241: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:35.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:34 smithi151 ceph-mon[37155]: pgmap v242: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:35.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:34 smithi103 ceph-mon[32753]: pgmap v242: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:35.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:34 smithi121 ceph-mon[37236]: pgmap v242: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:37.052 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:36 smithi121 ceph-mon[37236]: pgmap v243: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:37.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:36 smithi151 ceph-mon[37155]: pgmap v243: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:37.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:36 smithi103 ceph-mon[32753]: pgmap v243: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:39.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:38 smithi151 ceph-mon[37155]: pgmap v244: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:39.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:38 smithi103 ceph-mon[32753]: pgmap v244: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:39.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:38 smithi121 ceph-mon[37236]: pgmap v244: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:41.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:40 smithi151 ceph-mon[37155]: pgmap v245: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:41.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:40 smithi103 ceph-mon[32753]: pgmap v245: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:41.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:40 smithi121 ceph-mon[37236]: pgmap v245: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:43.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:42 smithi151 ceph-mon[37155]: pgmap v246: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:43.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:42 smithi103 ceph-mon[32753]: pgmap v246: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:42 smithi121 ceph-mon[37236]: pgmap v246: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:45.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:44 smithi151 ceph-mon[37155]: pgmap v247: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:45.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:44 smithi103 ceph-mon[32753]: pgmap v247: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:45.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:44 smithi121 ceph-mon[37236]: pgmap v247: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:47.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:46 smithi151 ceph-mon[37155]: pgmap v248: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:47.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:46 smithi103 ceph-mon[32753]: pgmap v248: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:47.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:46 smithi121 ceph-mon[37236]: pgmap v248: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:49.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:48 smithi151 ceph-mon[37155]: pgmap v249: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:49.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:48 smithi103 ceph-mon[32753]: pgmap v249: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:49.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:48 smithi121 ceph-mon[37236]: pgmap v249: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:51.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:50 smithi151 ceph-mon[37155]: pgmap v250: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:51.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:50 smithi103 ceph-mon[32753]: pgmap v250: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:51.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:50 smithi121 ceph-mon[37236]: pgmap v250: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:57:53.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:52 smithi151 ceph-mon[37155]: pgmap v251: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:53.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:52 smithi103 ceph-mon[32753]: pgmap v251: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:53.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:52 smithi121 ceph-mon[37236]: pgmap v251: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:57:55.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:54 smithi151 ceph-mon[37155]: pgmap v252: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:55.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:54 smithi103 ceph-mon[32753]: pgmap v252: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:54 smithi121 ceph-mon[37236]: pgmap v252: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:57.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:56 smithi151 ceph-mon[37155]: pgmap v253: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:57.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:57:57.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:57:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:57:57.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:57:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:56 smithi103 ceph-mon[32753]: pgmap v253: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:57:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:57:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:57:57.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:57:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:56 smithi121 ceph-mon[37236]: pgmap v253: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:57:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:57:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:57:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:57:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:57:59.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:57:58 smithi151 ceph-mon[37155]: pgmap v254: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:59.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:57:58 smithi103 ceph-mon[32753]: pgmap v254: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:57:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:57:58 smithi121 ceph-mon[37236]: pgmap v254: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:01.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:00 smithi103 ceph-mon[32753]: pgmap v255: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:01.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:00 smithi121 ceph-mon[37236]: pgmap v255: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:01.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:00 smithi151 ceph-mon[37155]: pgmap v255: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:03.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:02 smithi103 ceph-mon[32753]: pgmap v256: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:03.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:02 smithi121 ceph-mon[37236]: pgmap v256: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:03.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:02 smithi151 ceph-mon[37155]: pgmap v256: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:05.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:04 smithi121 ceph-mon[37236]: pgmap v257: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:05.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:04 smithi151 ceph-mon[37155]: pgmap v257: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:05.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:04 smithi103 ceph-mon[32753]: pgmap v257: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:07.127 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:06 smithi103 ceph-mon[32753]: pgmap v258: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:58:07.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:06 smithi121 ceph-mon[37236]: pgmap v258: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:58:07.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:06 smithi151 ceph-mon[37155]: pgmap v258: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:58:08.250 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:07 smithi121 ceph-mon[37236]: osdmap e95: 12 total, 12 up, 12 in 2024-08-02T18:58:08.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:07 smithi151 ceph-mon[37155]: osdmap e95: 12 total, 12 up, 12 in 2024-08-02T18:58:08.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:07 smithi103 ceph-mon[32753]: osdmap e95: 12 total, 12 up, 12 in 2024-08-02T18:58:09.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:08 smithi121 ceph-mon[37236]: pgmap v260: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:09.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:08 smithi151 ceph-mon[37155]: pgmap v260: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:09.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:08 smithi103 ceph-mon[32753]: pgmap v260: 129 pgs: 129 active+clean; 186 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:11.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:10 smithi121 ceph-mon[37236]: pgmap v261: 129 pgs: 129 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:11.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:10 smithi151 ceph-mon[37155]: pgmap v261: 129 pgs: 129 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:11.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:10 smithi103 ceph-mon[32753]: pgmap v261: 129 pgs: 129 active+clean; 140 MiB data, 1.2 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:13.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:12 smithi121 ceph-mon[37236]: pgmap v262: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:13.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:12 smithi151 ceph-mon[37155]: pgmap v262: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:13.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:12 smithi103 ceph-mon[32753]: pgmap v262: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:15.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:14 smithi121 ceph-mon[37236]: pgmap v263: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:15.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:14 smithi151 ceph-mon[37155]: pgmap v263: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:15.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:14 smithi103 ceph-mon[32753]: pgmap v263: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:58:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:16 smithi151 ceph-mon[37155]: pgmap v264: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:16 smithi151 ceph-mon[37155]: osdmap e96: 12 total, 12 up, 12 in 2024-08-02T18:58:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:16 smithi103 ceph-mon[32753]: pgmap v264: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:16 smithi103 ceph-mon[32753]: osdmap e96: 12 total, 12 up, 12 in 2024-08-02T18:58:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:16 smithi121 ceph-mon[37236]: pgmap v264: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:16 smithi121 ceph-mon[37236]: osdmap e96: 12 total, 12 up, 12 in 2024-08-02T18:58:19.075 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:18 smithi151 ceph-mon[37155]: pgmap v266: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:19.077 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:18 smithi103 ceph-mon[32753]: pgmap v266: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:19.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:18 smithi121 ceph-mon[37236]: pgmap v266: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:20 smithi151 ceph-mon[37155]: pgmap v267: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:21.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:20 smithi103 ceph-mon[32753]: pgmap v267: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:20 smithi121 ceph-mon[37236]: pgmap v267: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:58:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:22 smithi151 ceph-mon[37155]: pgmap v268: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:58:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:22 smithi103 ceph-mon[32753]: pgmap v268: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:58:23.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:22 smithi121 ceph-mon[37236]: pgmap v268: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:58:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:24 smithi151 ceph-mon[37155]: pgmap v269: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:58:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:24 smithi103 ceph-mon[32753]: pgmap v269: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:58:25.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:24 smithi121 ceph-mon[37236]: pgmap v269: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:58:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:26 smithi151 ceph-mon[37155]: pgmap v270: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:58:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:26 smithi103 ceph-mon[32753]: pgmap v270: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:58:27.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:26 smithi121 ceph-mon[37236]: pgmap v270: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:58:29.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:28 smithi151 ceph-mon[37155]: pgmap v271: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:29.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:28 smithi103 ceph-mon[32753]: pgmap v271: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:29.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:28 smithi121 ceph-mon[37236]: pgmap v271: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:31.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:30 smithi151 ceph-mon[37155]: pgmap v272: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:31.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:30 smithi103 ceph-mon[32753]: pgmap v272: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:30 smithi121 ceph-mon[37236]: pgmap v272: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:33.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:32 smithi151 ceph-mon[37155]: pgmap v273: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:33.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:32 smithi103 ceph-mon[32753]: pgmap v273: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:33.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:32 smithi121 ceph-mon[37236]: pgmap v273: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:35.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:34 smithi151 ceph-mon[37155]: pgmap v274: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:35.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:34 smithi103 ceph-mon[32753]: pgmap v274: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:35.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:34 smithi121 ceph-mon[37236]: pgmap v274: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:37.053 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:36 smithi121 ceph-mon[37236]: pgmap v275: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:37.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:36 smithi151 ceph-mon[37155]: pgmap v275: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:37.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:36 smithi103 ceph-mon[32753]: pgmap v275: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:39.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:38 smithi151 ceph-mon[37155]: pgmap v276: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:39.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:38 smithi103 ceph-mon[32753]: pgmap v276: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:39.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:38 smithi121 ceph-mon[37236]: pgmap v276: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:41.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:40 smithi151 ceph-mon[37155]: pgmap v277: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:41.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:40 smithi103 ceph-mon[32753]: pgmap v277: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:41.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:40 smithi121 ceph-mon[37236]: pgmap v277: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:43.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:42 smithi151 ceph-mon[37155]: pgmap v278: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:43.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:42 smithi103 ceph-mon[32753]: pgmap v278: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:42 smithi121 ceph-mon[37236]: pgmap v278: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:45.072 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:44 smithi151 ceph-mon[37155]: pgmap v279: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:45.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:44 smithi103 ceph-mon[32753]: pgmap v279: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:45.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:44 smithi121 ceph-mon[37236]: pgmap v279: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:47.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:46 smithi151 ceph-mon[37155]: pgmap v280: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:47.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:46 smithi103 ceph-mon[32753]: pgmap v280: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:47.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:46 smithi121 ceph-mon[37236]: pgmap v280: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:49.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:48 smithi103 ceph-mon[32753]: pgmap v281: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:49.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:48 smithi121 ceph-mon[37236]: pgmap v281: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:49.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:48 smithi151 ceph-mon[37155]: pgmap v281: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:51.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:50 smithi103 ceph-mon[32753]: pgmap v282: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:51.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:50 smithi121 ceph-mon[37236]: pgmap v282: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:51.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:50 smithi151 ceph-mon[37155]: pgmap v282: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:58:53.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:52 smithi121 ceph-mon[37236]: pgmap v283: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:53.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:52 smithi151 ceph-mon[37155]: pgmap v283: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:53.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:52 smithi103 ceph-mon[32753]: pgmap v283: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:58:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:54 smithi121 ceph-mon[37236]: pgmap v284: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:55.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:54 smithi151 ceph-mon[37155]: pgmap v284: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:55.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:54 smithi103 ceph-mon[32753]: pgmap v284: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:56 smithi121 ceph-mon[37236]: pgmap v285: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:57.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:56 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:58:57.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:56 smithi151 ceph-mon[37155]: pgmap v285: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:57.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:56 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:58:57.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:56 smithi103 ceph-mon[32753]: pgmap v285: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:58:57.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:56 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:58:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:57 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:58:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:57 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:58:58.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:57 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:58:58.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:57 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:58:58.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:57 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:58:58.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:57 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:58:58.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:57 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T18:58:58.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:57 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T18:58:58.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:57 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:58:59.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:58:59 smithi151 ceph-mon[37155]: pgmap v286: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:59.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:58:59 smithi103 ceph-mon[32753]: pgmap v286: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:58:59.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:58:59 smithi121 ceph-mon[37236]: pgmap v286: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:01.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:01 smithi151 ceph-mon[37155]: pgmap v287: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:59:01.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:01 smithi103 ceph-mon[32753]: pgmap v287: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:59:01.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:01 smithi121 ceph-mon[37236]: pgmap v287: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:59:03.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:03 smithi151 ceph-mon[37155]: pgmap v288: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:03.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:03 smithi103 ceph-mon[32753]: pgmap v288: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:03.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:03 smithi121 ceph-mon[37236]: pgmap v288: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:05.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:05 smithi151 ceph-mon[37155]: pgmap v289: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:05.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:05 smithi103 ceph-mon[32753]: pgmap v289: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:05.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:05 smithi121 ceph-mon[37236]: pgmap v289: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:07.553 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:07 smithi121 ceph-mon[37236]: pgmap v290: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:59:07.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:07 smithi151 ceph-mon[37155]: pgmap v290: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:59:07.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:07 smithi103 ceph-mon[32753]: pgmap v290: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 14 KiB/s rd, 44 KiB/s wr, 27 op/s 2024-08-02T18:59:08.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:08 smithi151 ceph-mon[37155]: osdmap e97: 12 total, 12 up, 12 in 2024-08-02T18:59:08.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:08 smithi103 ceph-mon[32753]: osdmap e97: 12 total, 12 up, 12 in 2024-08-02T18:59:08.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:08 smithi121 ceph-mon[37236]: osdmap e97: 12 total, 12 up, 12 in 2024-08-02T18:59:09.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:09 smithi151 ceph-mon[37155]: pgmap v292: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:09.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:09 smithi103 ceph-mon[32753]: pgmap v292: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:09.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:09 smithi121 ceph-mon[37236]: pgmap v292: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:11.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:11 smithi151 ceph-mon[37155]: pgmap v293: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:11.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:11 smithi103 ceph-mon[32753]: pgmap v293: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:11 smithi121 ceph-mon[37236]: pgmap v293: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:13.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:13 smithi151 ceph-mon[37155]: pgmap v294: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:13.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:13 smithi103 ceph-mon[32753]: pgmap v294: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:13 smithi121 ceph-mon[37236]: pgmap v294: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:15.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:15 smithi151 ceph-mon[37155]: pgmap v295: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:15.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:15 smithi103 ceph-mon[32753]: pgmap v295: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:15.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:15 smithi121 ceph-mon[37236]: pgmap v295: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T18:59:17.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:16 smithi151 ceph-mon[37155]: pgmap v296: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:17.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:16 smithi151 ceph-mon[37155]: osdmap e98: 12 total, 12 up, 12 in 2024-08-02T18:59:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:16 smithi103 ceph-mon[32753]: pgmap v296: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:16 smithi103 ceph-mon[32753]: osdmap e98: 12 total, 12 up, 12 in 2024-08-02T18:59:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:16 smithi121 ceph-mon[37236]: pgmap v296: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:16 smithi121 ceph-mon[37236]: osdmap e98: 12 total, 12 up, 12 in 2024-08-02T18:59:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:18 smithi151 ceph-mon[37155]: pgmap v298: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:19.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:18 smithi103 ceph-mon[32753]: pgmap v298: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:19.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:18 smithi121 ceph-mon[37236]: pgmap v298: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:20 smithi151 ceph-mon[37155]: pgmap v299: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:21.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:20 smithi103 ceph-mon[32753]: pgmap v299: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:20 smithi121 ceph-mon[37236]: pgmap v299: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T18:59:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:22 smithi151 ceph-mon[37155]: pgmap v300: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:59:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:22 smithi103 ceph-mon[32753]: pgmap v300: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:59:23.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:22 smithi121 ceph-mon[37236]: pgmap v300: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:59:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:24 smithi151 ceph-mon[37155]: pgmap v301: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:59:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:24 smithi103 ceph-mon[32753]: pgmap v301: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:59:25.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:24 smithi121 ceph-mon[37236]: pgmap v301: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.1 KiB/s rd, 102 B/s wr, 8 op/s 2024-08-02T18:59:27.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:26 smithi151 ceph-mon[37155]: pgmap v302: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:59:27.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:26 smithi103 ceph-mon[32753]: pgmap v302: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:59:27.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:26 smithi121 ceph-mon[37236]: pgmap v302: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.0 KiB/s rd, 7 op/s 2024-08-02T18:59:29.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:28 smithi151 ceph-mon[37155]: pgmap v303: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:29.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:28 smithi103 ceph-mon[32753]: pgmap v303: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:29.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:28 smithi121 ceph-mon[37236]: pgmap v303: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:31.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:30 smithi151 ceph-mon[37155]: pgmap v304: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:59:31.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:30 smithi103 ceph-mon[32753]: pgmap v304: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:59:31.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:30 smithi121 ceph-mon[37236]: pgmap v304: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 7 op/s 2024-08-02T18:59:33.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:32 smithi151 ceph-mon[37155]: pgmap v305: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:33.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:32 smithi103 ceph-mon[32753]: pgmap v305: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:33.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:32 smithi121 ceph-mon[37236]: pgmap v305: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:35.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:34 smithi151 ceph-mon[37155]: pgmap v306: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:35.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:34 smithi103 ceph-mon[32753]: pgmap v306: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:35.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:34 smithi121 ceph-mon[37236]: pgmap v306: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:37.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:36 smithi151 ceph-mon[37155]: pgmap v307: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:59:37.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:36 smithi103 ceph-mon[32753]: pgmap v307: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:59:37.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:36 smithi121 ceph-mon[37236]: pgmap v307: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:59:39.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:38 smithi151 ceph-mon[37155]: pgmap v308: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:39.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:38 smithi103 ceph-mon[32753]: pgmap v308: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:39.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:38 smithi121 ceph-mon[37236]: pgmap v308: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:41.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:40 smithi151 ceph-mon[37155]: pgmap v309: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-02T18:59:41.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:40 smithi103 ceph-mon[32753]: pgmap v309: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-02T18:59:41.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:40 smithi121 ceph-mon[37236]: pgmap v309: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-02T18:59:43.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:42 smithi103 ceph-mon[32753]: pgmap v310: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:43.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:42 smithi121 ceph-mon[37236]: pgmap v310: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:43.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:42 smithi151 ceph-mon[37155]: pgmap v310: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.9 KiB/s rd, 8 op/s 2024-08-02T18:59:45.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:44 smithi121 ceph-mon[37236]: pgmap v311: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:45.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:44 smithi151 ceph-mon[37155]: pgmap v311: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:45.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:44 smithi103 ceph-mon[32753]: pgmap v311: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:47.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:46 smithi121 ceph-mon[37236]: pgmap v312: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:59:47.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:46 smithi151 ceph-mon[37155]: pgmap v312: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:59:47.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:46 smithi103 ceph-mon[32753]: pgmap v312: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 9 op/s 2024-08-02T18:59:49.123 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:48 smithi151 ceph-mon[37155]: pgmap v313: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:49.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:48 smithi121 ceph-mon[37236]: pgmap v313: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:49.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:48 smithi103 ceph-mon[32753]: pgmap v313: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:51.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:50 smithi121 ceph-mon[37236]: pgmap v314: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-02T18:59:51.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:50 smithi151 ceph-mon[37155]: pgmap v314: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-02T18:59:51.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:50 smithi103 ceph-mon[32753]: pgmap v314: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.7 KiB/s rd, 8 op/s 2024-08-02T18:59:53.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:52 smithi121 ceph-mon[37236]: pgmap v315: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 8 op/s 2024-08-02T18:59:53.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:52 smithi151 ceph-mon[37155]: pgmap v315: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 8 op/s 2024-08-02T18:59:53.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:52 smithi103 ceph-mon[32753]: pgmap v315: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 8 op/s 2024-08-02T18:59:53.579 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule status --fs=cephfs --path=/' 2024-08-02T18:59:53.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.691+0000 7f9858638640 1 -- 172.21.15.103:0/3734913833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850102190 msgr2=0x7f985010e6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:53.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.691+0000 7f9858638640 1 --2- 172.21.15.103:0/3734913833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850102190 0x7f985010e6c0 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f9848009cd0 tx=0x7f984802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.695 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 -- 172.21.15.103:0/3734913833 shutdown_connections 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 --2- 172.21.15.103:0/3734913833 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850102190 0x7f985010e6c0 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 --2- 172.21.15.103:0/3734913833 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98501017f0 0x7f9850101c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 --2- 172.21.15.103:0/3734913833 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9850107800 0x7f9850107be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 -- 172.21.15.103:0/3734913833 >> 172.21.15.103:0/3734913833 conn(0x7f98500fd510 msgr2=0x7f98500ff930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 -- 172.21.15.103:0/3734913833 shutdown_connections 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 -- 172.21.15.103:0/3734913833 wait complete. 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 Processor -- start 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 -- start start 2024-08-02T18:59:53.696 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98501017f0 0x7f98501980d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9850102190 0x7f9850198610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850107800 0x7f985019c990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9850111d60 con 0x7f9850107800 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9850111be0 con 0x7f9850102190 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.692+0000 7f9858638640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9850111ee0 con 0x7f98501017f0 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850107800 0x7f985019c990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850107800 0x7f985019c990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33280/0 (socket says 172.21.15.103:33280) 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 -- 172.21.15.103:0/283962269 learned_addr learned my addr 172.21.15.103:0/283962269 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f98563d4640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98501017f0 0x7f98501980d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9855bd3640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9850102190 0x7f9850198610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 -- 172.21.15.103:0/283962269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98501017f0 msgr2=0x7f98501980d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98501017f0 0x7f98501980d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.697 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 -- 172.21.15.103:0/283962269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9850102190 msgr2=0x7f9850198610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9850102190 0x7f9850198610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 -- 172.21.15.103:0/283962269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f985019d0c0 con 0x7f9850107800 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9856bd5640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850107800 0x7f985019c990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9848006010 tx=0x7f9848003f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f98477fe640 1 -- 172.21.15.103:0/283962269 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848004040 con 0x7f9850107800 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f98477fe640 1 -- 172.21.15.103:0/283962269 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f98480046e0 con 0x7f9850107800 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f985019d350 con 0x7f9850107800 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f98477fe640 1 -- 172.21.15.103:0/283962269 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9848046480 con 0x7f9850107800 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.693+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98501a4c40 con 0x7f9850107800 2024-08-02T18:59:53.698 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.694+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9850102f30 con 0x7f9850107800 2024-08-02T18:59:53.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.695+0000 7f98477fe640 1 -- 172.21.15.103:0/283962269 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f9848030630 con 0x7f9850107800 2024-08-02T18:59:53.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.696+0000 7f98477fe640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f983c0a2da0 0x7f983c0a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:53.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.696+0000 7f98563d4640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f983c0a2da0 0x7f983c0a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:53.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.696+0000 7f98477fe640 1 -- 172.21.15.103:0/283962269 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9438+0+0 (secure 0 0 0) 0x7f984802e030 con 0x7f9850107800 2024-08-02T18:59:53.699 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.697+0000 7f98563d4640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f983c0a2da0 0x7f983c0a5260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f984000cac0 tx=0x7f984000c4a0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:53.701 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.700+0000 7f98477fe640 1 -- 172.21.15.103:0/283962269 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f984804b060 con 0x7f9850107800 2024-08-02T18:59:53.896 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.895+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}) -- 0x7f98500fe020 con 0x7f983c0a2da0 2024-08-02T18:59:53.904 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.903+0000 7f98477fe640 1 -- 172.21.15.103:0/283962269 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+350 (secure 0 0 0) 0x7f98500fe020 con 0x7f983c0a2da0 2024-08-02T18:59:53.904 INFO:teuthology.orchestra.run.smithi103.stdout:{"fs": "cephfs", "subvol": null, "group": null, "path": "/", "rel_path": "/", "schedule": "1m", "retention": {"m": 6, "h": 3}, "start": "2024-08-02T00:00:00", "created": "2024-08-02T18:49:52", "first": "2024-08-02T18:50:00", "last": "2024-08-02T18:59:00", "last_pruned": "2024-08-02T18:59:00", "created_count": 10, "pruned_count": 4, "active": true} 2024-08-02T18:59:53.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f983c0a2da0 msgr2=0x7f983c0a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:53.906 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f983c0a2da0 0x7f983c0a5260 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f984000cac0 tx=0x7f984000c4a0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850107800 msgr2=0x7f985019c990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850107800 0x7f985019c990 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7f9848006010 tx=0x7f9848003f10 comp rx=0 tx=0).stop 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 shutdown_connections 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f983c0a2da0 0x7f983c0a5260 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9850107800 0x7f985019c990 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9850102190 0x7f9850198610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 --2- 172.21.15.103:0/283962269 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f98501017f0 0x7f98501980d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 >> 172.21.15.103:0/283962269 conn(0x7f98500fd510 msgr2=0x7f98500fd910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 shutdown_connections 2024-08-02T18:59:53.907 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:53.905+0000 7f9858638640 1 -- 172.21.15.103:0/283962269 wait complete. 2024-08-02T18:59:53.917 DEBUG:teuthology.orchestra.run.smithi103:> sudo TESTDIR=/home/ubuntu/cephtest bash -c 'ceph fs snap-schedule list --fs=cephfs --path=/ --recursive=true' 2024-08-02T18:59:54.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2244733513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 msgr2=0x7fe2f010d5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.023 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2244733513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 0x7fe2f010d5e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7fe2e8009cd0 tx=0x7fe2e802a8e0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2244733513 shutdown_connections 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2244733513 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 0x7fe2f010d5e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2244733513 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0100710 0x7fe2f0100b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2244733513 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f0106720 0x7fe2f0106b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2244733513 >> 172.21.15.103:0/2244733513 conn(0x7fe2f00fc3f0 msgr2=0x7fe2f00fe810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2244733513 shutdown_connections 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2244733513 wait complete. 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.020+0000 7fe2f53f0640 1 Processor -- start 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2f53f0640 1 -- start start 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2f53f0640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f0100710 0x7fe2f0198f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2f53f0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 0x7fe2f01994d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2f53f0640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0106720 0x7fe2f01a4010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.024 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2f53f0640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0110c80 con 0x7fe2f01010b0 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2f53f0640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0110b00 con 0x7fe2f0106720 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2f53f0640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fe2f0110e00 con 0x7fe2f0100710 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 0x7fe2f01994d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 0x7fe2f01994d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33292/0 (socket says 172.21.15.103:33292) 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 -- 172.21.15.103:0/2716759964 learned_addr learned my addr 172.21.15.103:0/2716759964 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2eeffd640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f0100710 0x7fe2f0198f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ef7fe640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0106720 0x7fe2f01a4010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 -- 172.21.15.103:0/2716759964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f0100710 msgr2=0x7fe2f0198f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f0100710 0x7fe2f0198f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 -- 172.21.15.103:0/2716759964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0106720 msgr2=0x7fe2f01a4010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0106720 0x7fe2f01a4010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 -- 172.21.15.103:0/2716759964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2f01a4550 con 0x7fe2f01010b0 2024-08-02T18:59:54.025 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2eeffd640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f0100710 0x7fe2f0198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T18:59:54.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.021+0000 7fe2ee7fc640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 0x7fe2f01994d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400d950 tx=0x7fe2e400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:54.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.022+0000 7fe2d7fff640 1 -- 172.21.15.103:0/2716759964 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e4017070 con 0x7fe2f01010b0 2024-08-02T18:59:54.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.022+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2f01a4720 con 0x7fe2f01010b0 2024-08-02T18:59:54.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.022+0000 7fe2d7fff640 1 -- 172.21.15.103:0/2716759964 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fe2e4009c30 con 0x7fe2f01010b0 2024-08-02T18:59:54.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.022+0000 7fe2d7fff640 1 -- 172.21.15.103:0/2716759964 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2e400f740 con 0x7fe2f01010b0 2024-08-02T18:59:54.026 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.022+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2f01a4c40 con 0x7fe2f01010b0 2024-08-02T18:59:54.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.023+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2f0100b70 con 0x7fe2f01010b0 2024-08-02T18:59:54.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.024+0000 7fe2d7fff640 1 -- 172.21.15.103:0/2716759964 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fe2e4010a80 con 0x7fe2f01010b0 2024-08-02T18:59:54.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.025+0000 7fe2d7fff640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe2d80a2da0 0x7fe2d80a5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.025+0000 7fe2eeffd640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe2d80a2da0 0x7fe2d80a5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.025+0000 7fe2d7fff640 1 -- 172.21.15.103:0/2716759964 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9438+0+0 (secure 0 0 0) 0x7fe2e40cf480 con 0x7fe2f01010b0 2024-08-02T18:59:54.027 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.025+0000 7fe2eeffd640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe2d80a2da0 0x7fe2d80a5260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0005e00 tx=0x7fe2e0005c70 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:54.030 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.029+0000 7fe2d7fff640 1 -- 172.21.15.103:0/2716759964 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fe2e4009de0 con 0x7fe2f01010b0 2024-08-02T18:59:54.226 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.225+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 --> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] -- mgr_command(tid 0: {"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}) -- 0x7fe2f00fd080 con 0x7fe2d80a2da0 2024-08-02T18:59:54.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.232+0000 7fe2d7fff640 1 -- 172.21.15.103:0/2716759964 <== mgr.15252 v2:172.21.15.103:6800/1161044409 1 ==== mgr_command_reply(tid 0: 0 ) ==== 8+0+10 (secure 0 0 0) 0x7fe2f00fd080 con 0x7fe2d80a2da0 2024-08-02T18:59:54.233 INFO:teuthology.orchestra.run.smithi103.stdout:/ 1m 6m3h 2024-08-02T18:59:54.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe2d80a2da0 msgr2=0x7fe2d80a5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe2d80a2da0 0x7fe2d80a5260 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0005e00 tx=0x7fe2e0005c70 comp rx=0 tx=0).stop 2024-08-02T18:59:54.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 msgr2=0x7fe2f01994d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 0x7fe2f01994d0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fe2e400d950 tx=0x7fe2e400de10 comp rx=0 tx=0).stop 2024-08-02T18:59:54.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 shutdown_connections 2024-08-02T18:59:54.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fe2d80a2da0 0x7fe2d80a5260 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.236 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fe2f0106720 0x7fe2f01a4010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fe2f01010b0 0x7fe2f01994d0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 --2- 172.21.15.103:0/2716759964 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fe2f0100710 0x7fe2f0198f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 >> 172.21.15.103:0/2716759964 conn(0x7fe2f00fc3f0 msgr2=0x7fe2f00fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:54.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 shutdown_connections 2024-08-02T18:59:54.237 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.234+0000 7fe2f53f0640 1 -- 172.21.15.103:0/2716759964 wait complete. 2024-08-02T18:59:54.246 DEBUG:teuthology.run_tasks:Unwinding manager fwd_scrub 2024-08-02T18:59:54.262 INFO:tasks.fwd_scrub:joining ForwardScrubbers 2024-08-02T18:59:54.262 ERROR:teuthology.run_tasks:Manager failed: fwd_scrub Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_53ce1462e129f6eb4071986336534c740fdebd31/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.10/contextlib.py", line 142, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa/tasks/fwd_scrub.py", line 155, in task stop_all_fwd_scrubbers(ctx.ceph[config['cluster']].thrashers) File "/home/teuthworker/src/github.com_ceph_ceph-c_26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea/qa/tasks/fwd_scrub.py", line 90, in stop_all_fwd_scrubbers raise RuntimeError(f"error during scrub thrashing: {thrasher.exception}") RuntimeError: error during scrub thrashing: rank damage found: {'backtrace'} 2024-08-02T18:59:54.263 DEBUG:teuthology.run_tasks:Unwinding manager check-counter 2024-08-02T18:59:54.294 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-08-02T18:59:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 -- 172.21.15.103:0/2988366165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4101090 msgr2=0x7f4de410d5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 --2- 172.21.15.103:0/2988366165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4101090 0x7f4de410d5c0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009cd0 tx=0x7f4ddc02a8e0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 -- 172.21.15.103:0/2988366165 shutdown_connections 2024-08-02T18:59:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 --2- 172.21.15.103:0/2988366165 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4101090 0x7f4de410d5c0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 --2- 172.21.15.103:0/2988366165 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de41006f0 0x7f4de4100b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 --2- 172.21.15.103:0/2988366165 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de4106700 0x7f4de4106ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 -- 172.21.15.103:0/2988366165 >> 172.21.15.103:0/2988366165 conn(0x7f4de40fc3d0 msgr2=0x7f4de40fe7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 -- 172.21.15.103:0/2988366165 shutdown_connections 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.394+0000 7f4deae9e640 1 -- 172.21.15.103:0/2988366165 wait complete. 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4deae9e640 1 Processor -- start 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4deae9e640 1 -- start start 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4deae9e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de41006f0 0x7f4de4198200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4deae9e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4101090 0x7f4de4198740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4deae9e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4106700 0x7f4de419cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4deae9e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f4de4111d50 con 0x7f4de4106700 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4deae9e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f4de4111bd0 con 0x7f4de41006f0 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4deae9e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f4de4111ed0 con 0x7f4de4101090 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de943b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4106700 0x7f4de419cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de943b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4106700 0x7f4de419cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33308/0 (socket says 172.21.15.103:33308) 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de943b640 1 -- 172.21.15.103:0/3500188511 learned_addr learned my addr 172.21.15.103:0/3500188511 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de8c3a640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de41006f0 0x7f4de4198200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de3fff640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4101090 0x7f4de4198740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de943b640 1 -- 172.21.15.103:0/3500188511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4101090 msgr2=0x7f4de4198740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de943b640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4101090 0x7f4de4198740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de943b640 1 -- 172.21.15.103:0/3500188511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de41006f0 msgr2=0x7f4de4198200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de943b640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de41006f0 0x7f4de4198200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.395+0000 7f4de943b640 1 -- 172.21.15.103:0/3500188511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4de419d1f0 con 0x7f4de4106700 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.396+0000 7f4de943b640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4106700 0x7f4de419cac0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009ca0 tx=0x7f4ddc003f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.396+0000 7f4de1ffb640 1 -- 172.21.15.103:0/3500188511 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc004040 con 0x7f4de4106700 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.396+0000 7f4de1ffb640 1 -- 172.21.15.103:0/3500188511 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f4ddc0046e0 con 0x7f4de4106700 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.396+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4de419d480 con 0x7f4de4106700 2024-08-02T18:59:54.400 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.396+0000 7f4de1ffb640 1 -- 172.21.15.103:0/3500188511 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4ddc046480 con 0x7f4de4106700 2024-08-02T18:59:54.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.396+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4de41a4d70 con 0x7f4de4106700 2024-08-02T18:59:54.401 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.397+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4de4100b50 con 0x7f4de4106700 2024-08-02T18:59:54.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.398+0000 7f4de1ffb640 1 -- 172.21.15.103:0/3500188511 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f4ddc0305a0 con 0x7f4de4106700 2024-08-02T18:59:54.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.399+0000 7f4de1ffb640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4dd40a2d00 0x7f4dd40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.399+0000 7f4de8c3a640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4dd40a2d00 0x7f4dd40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.399+0000 7f4de1ffb640 1 -- 172.21.15.103:0/3500188511 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9438+0+0 (secure 0 0 0) 0x7f4ddc02e030 con 0x7f4de4106700 2024-08-02T18:59:54.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.399+0000 7f4de8c3a640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4dd40a2d00 0x7f4dd40a51c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8005d00 tx=0x7f4dd800b410 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:54.403 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.402+0000 7f4de1ffb640 1 -- 172.21.15.103:0/3500188511 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f4ddc04b060 con 0x7f4de4106700 2024-08-02T18:59:54.581 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.580+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f4de41a4fa0 con 0x7f4de4106700 2024-08-02T18:59:54.583 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.582+0000 7f4de1ffb640 1 -- 172.21.15.103:0/3500188511 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v98) ==== 74+0+25264 (secure 0 0 0) 0x7f4ddc0bd9f0 con 0x7f4de4106700 2024-08-02T18:59:54.583 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:59:54.583 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":98,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T18:59:15.778720+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"97","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":15,"snap_epoch":97,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/3303960029":"2024-08-03T18:49:43.556859+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/433411047":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/2738010911":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/15319849":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/3303960029":"2024-08-03T18:49:43.556859+0000","172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/592081832":"2024-08-03T18:49:43.556859+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]},{"pool":4,"snaps":[{"begin":5,"length":1},{"begin":15,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T18:59:54.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4dd40a2d00 msgr2=0x7f4dd40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4dd40a2d00 0x7f4dd40a51c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f4dd8005d00 tx=0x7f4dd800b410 comp rx=0 tx=0).stop 2024-08-02T18:59:54.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4106700 msgr2=0x7f4de419cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4106700 0x7f4de419cac0 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f4ddc009ca0 tx=0x7f4ddc003f80 comp rx=0 tx=0).stop 2024-08-02T18:59:54.585 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 shutdown_connections 2024-08-02T18:59:54.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f4dd40a2d00 0x7f4dd40a51c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f4de4106700 0x7f4de419cac0 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f4de4101090 0x7f4de4198740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 --2- 172.21.15.103:0/3500188511 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f4de41006f0 0x7f4de4198200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 >> 172.21.15.103:0/3500188511 conn(0x7f4de40fc3d0 msgr2=0x7f4de40fcb10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:54.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 shutdown_connections 2024-08-02T18:59:54.586 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.584+0000 7f4deae9e640 1 -- 172.21.15.103:0/3500188511 wait complete. 2024-08-02T18:59:54.596 INFO:tasks.check_counter.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-08-02T18:43:05.562258+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '21', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 12, 'score_stable': 12, 'optimal_score': 0.25, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-08-02T18:47:18.244339+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '81', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.8799999952316284, 'score_stable': 1.8799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.8799999952316284, 'raw_score_stable': 1.8799999952316284, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-08-02T18:47:20.250497+0000', 'flags': 8193, 'flags_names': 'hashpspool,selfmanaged_snaps', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 0.9999998807907104, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-08-02T18:47:26.589938+0000', 'flags': 8197, 'flags_names': 'hashpspool,ec_overwrites,selfmanaged_snaps', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '97', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 15, 'snap_epoch': 97, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-08-02T18:59:54.597 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-08-02T18:59:54.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 -- 172.21.15.103:0/635992574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec101060 msgr2=0x7fdeec10d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.706 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 --2- 172.21.15.103:0/635992574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec101060 0x7fdeec10d590 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fdee4009cd0 tx=0x7fdee402a8e0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 -- 172.21.15.103:0/635992574 shutdown_connections 2024-08-02T18:59:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 --2- 172.21.15.103:0/635992574 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec101060 0x7fdeec10d590 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 --2- 172.21.15.103:0/635992574 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeec1006c0 0x7fdeec100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 --2- 172.21.15.103:0/635992574 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1066d0 0x7fdeec106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 -- 172.21.15.103:0/635992574 >> 172.21.15.103:0/635992574 conn(0x7fdeec0fc380 msgr2=0x7fdeec0fe7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 -- 172.21.15.103:0/635992574 shutdown_connections 2024-08-02T18:59:54.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 -- 172.21.15.103:0/635992574 wait complete. 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 Processor -- start 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.701+0000 7fdef1314640 1 -- start start 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdef1314640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec1006c0 0x7fdeec198fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdef1314640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeec101060 0x7fdeec199510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdef1314640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1066d0 0x7fdeec1a4050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdef1314640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec110c30 con 0x7fdeec1006c0 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdef1314640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec110ab0 con 0x7fdeec1066d0 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdef1314640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fdeec110db0 con 0x7fdeec101060 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec1006c0 0x7fdeec198fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec1006c0 0x7fdeec198fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33322/0 (socket says 172.21.15.103:33322) 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 -- 172.21.15.103:0/2748151734 learned_addr learned my addr 172.21.15.103:0/2748151734 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:59:54.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeb7fe640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1066d0 0x7fdeec1a4050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeea7fc640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeec101060 0x7fdeec199510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 -- 172.21.15.103:0/2748151734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeec101060 msgr2=0x7fdeec199510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeec101060 0x7fdeec199510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 -- 172.21.15.103:0/2748151734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1066d0 msgr2=0x7fdeec1a4050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1066d0 0x7fdeec1a4050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 -- 172.21.15.103:0/2748151734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdeec1a4590 con 0x7fdeec1006c0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdeeaffd640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec1006c0 0x7fdeec198fd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00d950 tx=0x7fdedc00de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fded3fff640 1 -- 172.21.15.103:0/2748151734 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc017030 con 0x7fdeec1006c0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fded3fff640 1 -- 172.21.15.103:0/2748151734 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fdedc004020 con 0x7fdeec1006c0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdeec1a4760 con 0x7fdeec1006c0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.702+0000 7fded3fff640 1 -- 172.21.15.103:0/2748151734 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdedc004a00 con 0x7fdeec1006c0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.703+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdeec1a4c80 con 0x7fdeec1006c0 2024-08-02T18:59:54.709 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.703+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdeec100b20 con 0x7fdeec1006c0 2024-08-02T18:59:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.704+0000 7fded3fff640 1 -- 172.21.15.103:0/2748151734 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fdedc0041d0 con 0x7fdeec1006c0 2024-08-02T18:59:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.705+0000 7fded3fff640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fded40a2d00 0x7fded40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.705+0000 7fdeea7fc640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fded40a2d00 0x7fded40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.705+0000 7fded3fff640 1 -- 172.21.15.103:0/2748151734 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9438+0+0 (secure 0 0 0) 0x7fdedc0cf0c0 con 0x7fdeec1006c0 2024-08-02T18:59:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.706+0000 7fdeea7fc640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fded40a2d00 0x7fded40a51c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdeec06ac40 tx=0x7fdee000b390 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:54.710 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.709+0000 7fded3fff640 1 -- 172.21.15.103:0/2748151734 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fdedc09b950 con 0x7fdeec1006c0 2024-08-02T18:59:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.889+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fdeec1a4f40 con 0x7fdeec1006c0 2024-08-02T18:59:54.890 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.889+0000 7fded3fff640 1 -- 172.21.15.103:0/2748151734 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v98) ==== 93+0+10 (secure 0 0 0) 0x7fdedc09b250 con 0x7fdeec1006c0 2024-08-02T18:59:54.890 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 1 2024-08-02T18:59:54.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fded40a2d00 msgr2=0x7fded40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fded40a2d00 0x7fded40a51c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fdeec06ac40 tx=0x7fdee000b390 comp rx=0 tx=0).stop 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec1006c0 msgr2=0x7fdeec198fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec1006c0 0x7fdeec198fd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fdedc00d950 tx=0x7fdedc00de10 comp rx=0 tx=0).stop 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 shutdown_connections 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fded40a2d00 0x7fded40a51c0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fdeec1066d0 0x7fdeec1a4050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fdeec101060 0x7fdeec199510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 --2- 172.21.15.103:0/2748151734 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fdeec1006c0 0x7fdeec198fd0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 >> 172.21.15.103:0/2748151734 conn(0x7fdeec0fc380 msgr2=0x7fdeec0fca00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 shutdown_connections 2024-08-02T18:59:54.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:54.891+0000 7fdef1314640 1 -- 172.21.15.103:0/2748151734 wait complete. 2024-08-02T18:59:54.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:54 smithi103 ceph-mon[32753]: pgmap v316: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:54.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:54 smithi103 ceph-mon[32753]: from='client.16263 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:59:54.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:54 smithi103 ceph-mon[32753]: from='client.16269 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:59:54.902 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:54 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3500188511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:59:54.903 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-08-02T18:59:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 -- 172.21.15.103:0/983827446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1288101050 msgr2=0x7f128810d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 --2- 172.21.15.103:0/983827446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1288101050 0x7f128810d580 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f1280009cd0 tx=0x7f128002a8e0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.007 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 -- 172.21.15.103:0/983827446 shutdown_connections 2024-08-02T18:59:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 --2- 172.21.15.103:0/983827446 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1288101050 0x7f128810d580 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 --2- 172.21.15.103:0/983827446 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f12881006b0 0x7f1288100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 --2- 172.21.15.103:0/983827446 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12881066c0 0x7f1288106aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 -- 172.21.15.103:0/983827446 >> 172.21.15.103:0/983827446 conn(0x7f1288077770 msgr2=0x7f12880feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 -- 172.21.15.103:0/983827446 shutdown_connections 2024-08-02T18:59:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 -- 172.21.15.103:0/983827446 wait complete. 2024-08-02T18:59:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 Processor -- start 2024-08-02T18:59:55.008 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.006+0000 7f128e76d640 1 -- start start 2024-08-02T18:59:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f128e76d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12881006b0 0x7f1288199050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f128e76d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1288101050 0x7f1288199590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f128e76d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12881066c0 0x7f12881a40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f128e76d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1288110c20 con 0x7f12881006b0 2024-08-02T18:59:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f128e76d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1288110aa0 con 0x7f1288101050 2024-08-02T18:59:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f128e76d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1288110da0 con 0x7f12881066c0 2024-08-02T18:59:55.010 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12881006b0 0x7f1288199050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12881006b0 0x7f1288199050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33344/0 (socket says 172.21.15.103:33344) 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 -- 172.21.15.103:0/3261380751 learned_addr learned my addr 172.21.15.103:0/3261380751 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f12877fe640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1288101050 0x7f1288199590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f128cd0a640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12881066c0 0x7f12881a40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 -- 172.21.15.103:0/3261380751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12881066c0 msgr2=0x7f12881a40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12881066c0 0x7f12881a40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 -- 172.21.15.103:0/3261380751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1288101050 msgr2=0x7f1288199590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1288101050 0x7f1288199590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 -- 172.21.15.103:0/3261380751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f12881a4610 con 0x7f12881006b0 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f1287fff640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12881006b0 0x7f1288199050 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f127800d770 tx=0x7f127800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f12857fa640 1 -- 172.21.15.103:0/3261380751 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278017070 con 0x7f12881006b0 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f12857fa640 1 -- 172.21.15.103:0/3261380751 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1278005520 con 0x7f12881006b0 2024-08-02T18:59:55.011 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f12881a47e0 con 0x7f12881006b0 2024-08-02T18:59:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.007+0000 7f12857fa640 1 -- 172.21.15.103:0/3261380751 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1278010460 con 0x7f12881006b0 2024-08-02T18:59:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.008+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f12881a4cb0 con 0x7f12881006b0 2024-08-02T18:59:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.008+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1288100b10 con 0x7f12881006b0 2024-08-02T18:59:55.012 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.010+0000 7f12857fa640 1 -- 172.21.15.103:0/3261380751 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f1278004ea0 con 0x7f12881006b0 2024-08-02T18:59:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.010+0000 7f12857fa640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f12740a2d00 0x7f12740a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.011+0000 7f12877fe640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f12740a2d00 0x7f12740a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.011+0000 7f12857fa640 1 -- 172.21.15.103:0/3261380751 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9438+0+0 (secure 0 0 0) 0x7f12780cf180 con 0x7f12881006b0 2024-08-02T18:59:55.013 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.011+0000 7f12877fe640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f12740a2d00 0x7f12740a51c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1288069c00 tx=0x7f127000b390 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:55.016 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.015+0000 7f12857fa640 1 -- 172.21.15.103:0/3261380751 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f127809b3c0 con 0x7f12881006b0 2024-08-02T18:59:55.193 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.192+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1288108c40 con 0x7f12881006b0 2024-08-02T18:59:55.194 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.192+0000 7f12857fa640 1 -- 172.21.15.103:0/3261380751 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v98) ==== 104+0+11 (secure 0 0 0) 0x7f127809f6c0 con 0x7f12881006b0 2024-08-02T18:59:55.194 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-08-02T18:59:55.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.194+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f12740a2d00 msgr2=0x7f12740a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.194+0000 7f128e76d640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f12740a2d00 0x7f12740a51c0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f1288069c00 tx=0x7f127000b390 comp rx=0 tx=0).stop 2024-08-02T18:59:55.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.194+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12881006b0 msgr2=0x7f1288199050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.194+0000 7f128e76d640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12881006b0 0x7f1288199050 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f127800d770 tx=0x7f127800dc30 comp rx=0 tx=0).stop 2024-08-02T18:59:55.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.195+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 shutdown_connections 2024-08-02T18:59:55.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.195+0000 7f128e76d640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f12740a2d00 0x7f12740a51c0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.195+0000 7f128e76d640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f12881066c0 0x7f12881a40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.196 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.195+0000 7f128e76d640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1288101050 0x7f1288199590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.195+0000 7f128e76d640 1 --2- 172.21.15.103:0/3261380751 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f12881006b0 0x7f1288199050 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.195+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 >> 172.21.15.103:0/3261380751 conn(0x7f1288077770 msgr2=0x7f12881034f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:55.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.195+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 shutdown_connections 2024-08-02T18:59:55.197 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.195+0000 7f128e76d640 1 -- 172.21.15.103:0/3261380751 wait complete. 2024-08-02T18:59:55.207 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-08-02T18:59:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:54 smithi121 ceph-mon[37236]: pgmap v316: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:54 smithi121 ceph-mon[37236]: from='client.16263 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:59:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:54 smithi121 ceph-mon[37236]: from='client.16269 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:59:55.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:54 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3500188511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:59:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 -- 172.21.15.103:0/3677357171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 msgr2=0x7ff30810d590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 --2- 172.21.15.103:0/3677357171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 0x7ff30810d590 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7ff300009cd0 tx=0x7ff30002a8e0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 -- 172.21.15.103:0/3677357171 shutdown_connections 2024-08-02T18:59:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 --2- 172.21.15.103:0/3677357171 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 0x7ff30810d590 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.313 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 --2- 172.21.15.103:0/3677357171 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3081006c0 0x7ff308100b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 --2- 172.21.15.103:0/3677357171 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081066d0 0x7ff308106ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 -- 172.21.15.103:0/3677357171 >> 172.21.15.103:0/3677357171 conn(0x7ff3080fc3e0 msgr2=0x7ff3080fe800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 -- 172.21.15.103:0/3677357171 shutdown_connections 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 -- 172.21.15.103:0/3677357171 wait complete. 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 Processor -- start 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 -- start start 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3081006c0 0x7ff3081981b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 0x7ff3081986f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081066d0 0x7ff30819ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7ff308110c30 con 0x7ff308101060 2024-08-02T18:59:55.314 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.310+0000 7ff30f61b640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7ff308110ab0 con 0x7ff3081066d0 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30f61b640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7ff308110db0 con 0x7ff3081006c0 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 0x7ff3081986f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 0x7ff3081986f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33354/0 (socket says 172.21.15.103:33354) 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 -- 172.21.15.103:0/4192762189 learned_addr learned my addr 172.21.15.103:0/4192762189 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 -- 172.21.15.103:0/4192762189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3081006c0 msgr2=0x7ff3081981b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30d3b7640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3081006c0 0x7ff3081981b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30dbb8640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081066d0 0x7ff30819ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3081006c0 0x7ff3081981b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 -- 172.21.15.103:0/4192762189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081066d0 msgr2=0x7ff30819ca70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081066d0 0x7ff30819ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.315 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 -- 172.21.15.103:0/4192762189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff30819d1a0 con 0x7ff308101060 2024-08-02T18:59:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30cbb6640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 0x7ff3081986f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800d770 tx=0x7ff2f800dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff2fe7fc640 1 -- 172.21.15.103:0/4192762189 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8017070 con 0x7ff308101060 2024-08-02T18:59:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff2fe7fc640 1 -- 172.21.15.103:0/4192762189 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7ff2f8005520 con 0x7ff308101060 2024-08-02T18:59:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff2fe7fc640 1 -- 172.21.15.103:0/4192762189 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff2f8010460 con 0x7ff308101060 2024-08-02T18:59:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff30819d490 con 0x7ff308101060 2024-08-02T18:59:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.311+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff3081a4d20 con 0x7ff308101060 2024-08-02T18:59:55.316 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.312+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff308100b20 con 0x7ff308101060 2024-08-02T18:59:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.313+0000 7ff2fe7fc640 1 -- 172.21.15.103:0/4192762189 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7ff2f8004ea0 con 0x7ff308101060 2024-08-02T18:59:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.314+0000 7ff2fe7fc640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2f40a2d00 0x7ff2f40a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.314+0000 7ff2fe7fc640 1 -- 172.21.15.103:0/4192762189 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9438+0+0 (secure 0 0 0) 0x7ff2f80cf7d0 con 0x7ff308101060 2024-08-02T18:59:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.314+0000 7ff30d3b7640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2f40a2d00 0x7ff2f40a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.317 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.314+0000 7ff30d3b7640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2f40a2d00 0x7ff2f40a51c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3040099e0 tx=0x7ff304005ed0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:55.318 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.317+0000 7ff2fe7fc640 1 -- 172.21.15.103:0/4192762189 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7ff2f809c060 con 0x7ff308101060 2024-08-02T18:59:55.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:54 smithi151 ceph-mon[37155]: pgmap v316: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 2.5 KiB/s rd, 6 op/s 2024-08-02T18:59:55.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:54 smithi151 ceph-mon[37155]: from='client.16263 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule status", "fs": "cephfs", "path": "/", "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:59:55.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:54 smithi151 ceph-mon[37155]: from='client.16269 -' entity='client.admin' cmd=[{"prefix": "fs snap-schedule list", "fs": "cephfs", "path": "/", "recursive": true, "target": ["mon-mgr", ""]}]: dispatch 2024-08-02T18:59:55.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:54 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3500188511' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T18:59:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.494+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7ff3081096d0 con 0x7ff308101060 2024-08-02T18:59:55.496 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.495+0000 7ff2fe7fc640 1 -- 172.21.15.103:0/4192762189 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v98) ==== 100+0+11 (secure 0 0 0) 0x7ff2f809b960 con 0x7ff308101060 2024-08-02T18:59:55.496 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 64 2024-08-02T18:59:55.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2f40a2d00 msgr2=0x7ff2f40a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.498 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2f40a2d00 0x7ff2f40a51c0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff3040099e0 tx=0x7ff304005ed0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 msgr2=0x7ff3081986f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 0x7ff3081986f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7ff2f800d770 tx=0x7ff2f800dc30 comp rx=0 tx=0).stop 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 shutdown_connections 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7ff2f40a2d00 0x7ff2f40a51c0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7ff3081066d0 0x7ff30819ca70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7ff308101060 0x7ff3081986f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 --2- 172.21.15.103:0/4192762189 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7ff3081006c0 0x7ff3081981b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 >> 172.21.15.103:0/4192762189 conn(0x7ff3080fc3e0 msgr2=0x7ff30806a2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 shutdown_connections 2024-08-02T18:59:55.499 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.497+0000 7ff30f61b640 1 -- 172.21.15.103:0/4192762189 wait complete. 2024-08-02T18:59:55.509 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-08-02T18:59:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.611+0000 7f1a5c66d640 1 -- 172.21.15.103:0/2688409850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54102a20 msgr2=0x7f1a54102e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.611+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/2688409850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54102a20 0x7f1a54102e00 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009900 tx=0x7f1a5002a480 comp rx=0 tx=0).stop 2024-08-02T18:59:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 -- 172.21.15.103:0/2688409850 shutdown_connections 2024-08-02T18:59:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/2688409850 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a5410bdf0 0x7f1a5410e270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/2688409850 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a54103340 0x7f1a5410b820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.615 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/2688409850 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54102a20 0x7f1a54102e00 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 -- 172.21.15.103:0/2688409850 >> 172.21.15.103:0/2688409850 conn(0x7f1a540fc410 msgr2=0x7f1a540fe830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 -- 172.21.15.103:0/2688409850 shutdown_connections 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 -- 172.21.15.103:0/2688409850 wait complete. 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 Processor -- start 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 -- start start 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a54102a20 0x7f1a5419a370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54103340 0x7f1a5419a8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a5410bdf0 0x7f1a5419ec30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f1a54111cf0 con 0x7f1a54103340 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f1a54111b70 con 0x7f1a54102a20 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.612+0000 7f1a5c66d640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f1a54111e70 con 0x7f1a5410bdf0 2024-08-02T18:59:55.616 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54103340 0x7f1a5419a8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54103340 0x7f1a5419a8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33360/0 (socket says 172.21.15.103:33360) 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 -- 172.21.15.103:0/1743468530 learned_addr learned my addr 172.21.15.103:0/1743468530 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a5a409640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a54102a20 0x7f1a5419a370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a5ac0a640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a5410bdf0 0x7f1a5419ec30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 -- 172.21.15.103:0/1743468530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a5410bdf0 msgr2=0x7f1a5419ec30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a5410bdf0 0x7f1a5419ec30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 -- 172.21.15.103:0/1743468530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a54102a20 msgr2=0x7f1a5419a370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a54102a20 0x7f1a5419a370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 -- 172.21.15.103:0/1743468530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a5419f360 con 0x7f1a54103340 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a59c08640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54103340 0x7f1a5419a8b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400d950 tx=0x7f1a4400de10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a4b7fe640 1 -- 172.21.15.103:0/1743468530 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a44017070 con 0x7f1a54103340 2024-08-02T18:59:55.617 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a4b7fe640 1 -- 172.21.15.103:0/1743468530 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f1a44009c30 con 0x7f1a54103340 2024-08-02T18:59:55.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a5419f650 con 0x7f1a54103340 2024-08-02T18:59:55.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a4b7fe640 1 -- 172.21.15.103:0/1743468530 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a4400f740 con 0x7f1a54103340 2024-08-02T18:59:55.618 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.613+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a541a6ee0 con 0x7f1a54103340 2024-08-02T18:59:55.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.614+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1a54102e00 con 0x7f1a54103340 2024-08-02T18:59:55.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.616+0000 7f1a4b7fe640 1 -- 172.21.15.103:0/1743468530 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f1a44010a80 con 0x7f1a54103340 2024-08-02T18:59:55.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.616+0000 7f1a4b7fe640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a400a2d00 0x7f1a400a51c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.617+0000 7f1a5a409640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a400a2d00 0x7f1a400a51c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.617+0000 7f1a4b7fe640 1 -- 172.21.15.103:0/1743468530 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9438+0+0 (secure 0 0 0) 0x7f1a440cf430 con 0x7f1a54103340 2024-08-02T18:59:55.619 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.617+0000 7f1a5a409640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a400a2d00 0x7f1a400a51c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009230 tx=0x7f1a500058d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:55.621 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.620+0000 7f1a4b7fe640 1 -- 172.21.15.103:0/1743468530 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f1a44009de0 con 0x7f1a54103340 2024-08-02T18:59:55.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.795+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f1a541a7180 con 0x7f1a54103340 2024-08-02T18:59:55.797 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.796+0000 7f1a4b7fe640 1 -- 172.21.15.103:0/1743468530 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v98) ==== 103+0+11 (secure 0 0 0) 0x7f1a4409bcc0 con 0x7f1a54103340 2024-08-02T18:59:55.797 INFO:teuthology.orchestra.run.smithi103.stdout:pg_num: 32 2024-08-02T18:59:55.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a400a2d00 msgr2=0x7f1a400a51c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a400a2d00 0x7f1a400a51c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f1a50009230 tx=0x7f1a500058d0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54103340 msgr2=0x7f1a5419a8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54103340 0x7f1a5419a8b0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f1a4400d950 tx=0x7f1a4400de10 comp rx=0 tx=0).stop 2024-08-02T18:59:55.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 shutdown_connections 2024-08-02T18:59:55.799 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f1a400a2d00 0x7f1a400a51c0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f1a5410bdf0 0x7f1a5419ec30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f1a54103340 0x7f1a5419a8b0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 --2- 172.21.15.103:0/1743468530 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f1a54102a20 0x7f1a5419a370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 >> 172.21.15.103:0/1743468530 conn(0x7f1a540fc410 msgr2=0x7f1a540fc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:55.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 shutdown_connections 2024-08-02T18:59:55.800 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.798+0000 7f1a5c66d640 1 -- 172.21.15.103:0/1743468530 wait complete. 2024-08-02T18:59:55.810 DEBUG:teuthology.orchestra.run.smithi103:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json-pretty 2024-08-02T18:59:55.913 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 -- 172.21.15.103:0/21774848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05181066c0 msgr2=0x7f0518106aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 --2- 172.21.15.103:0/21774848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05181066c0 0x7f0518106aa0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f0508009930 tx=0x7f050802a420 comp rx=0 tx=0).stop 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 -- 172.21.15.103:0/21774848 shutdown_connections 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 --2- 172.21.15.103:0/21774848 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0518101050 0x7f051810d580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 --2- 172.21.15.103:0/21774848 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05181006b0 0x7f0518100b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 --2- 172.21.15.103:0/21774848 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f05181066c0 0x7f0518106aa0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 -- 172.21.15.103:0/21774848 >> 172.21.15.103:0/21774848 conn(0x7f0518077740 msgr2=0x7f05180feac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 -- 172.21.15.103:0/21774848 shutdown_connections 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 -- 172.21.15.103:0/21774848 wait complete. 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 Processor -- start 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.910+0000 7f051ea7f640 1 -- start start 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051ea7f640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05181006b0 0x7f0518197170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.914 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051ea7f640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0518101050 0x7f05181976b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051ea7f640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05181066c0 0x7f051819ba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051ea7f640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0518110c20 con 0x7f0518101050 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051ea7f640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0518110aa0 con 0x7f05181006b0 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051ea7f640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0518110da0 con 0x7f05181066c0 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0518101050 0x7f05181976b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0518101050 0x7f05181976b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:33374/0 (socket says 172.21.15.103:33374) 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 -- 172.21.15.103:0/3280447125 learned_addr learned my addr 172.21.15.103:0/3280447125 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051c81b640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05181006b0 0x7f0518197170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051d01c640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05181066c0 0x7f051819ba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 -- 172.21.15.103:0/3280447125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05181066c0 msgr2=0x7f051819ba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05181066c0 0x7f051819ba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 -- 172.21.15.103:0/3280447125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05181006b0 msgr2=0x7f0518197170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05181006b0 0x7f0518197170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:55.915 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 -- 172.21.15.103:0/3280447125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f051819c160 con 0x7f0518101050 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051c81b640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05181006b0 0x7f0518197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051d01c640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05181066c0 0x7f051819ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0517fff640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0518101050 0x7f05181976b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f050000c890 tx=0x7f050000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0515ffb640 1 -- 172.21.15.103:0/3280447125 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500004220 con 0x7f0518101050 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0515ffb640 1 -- 172.21.15.103:0/3280447125 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f05000043c0 con 0x7f0518101050 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f051819c450 con 0x7f0518101050 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.911+0000 7f0515ffb640 1 -- 172.21.15.103:0/3280447125 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0500004b10 con 0x7f0518101050 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.912+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f05181a3ce0 con 0x7f0518101050 2024-08-02T18:59:55.916 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.913+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0518100b10 con 0x7f0518101050 2024-08-02T18:59:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.914+0000 7f0515ffb640 1 -- 172.21.15.103:0/3280447125 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f05000051b0 con 0x7f0518101050 2024-08-02T18:59:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.914+0000 7f0515ffb640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f05040a2d80 0x7f05040a5240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T18:59:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.914+0000 7f051c81b640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f05040a2d80 0x7f05040a5240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T18:59:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.914+0000 7f0515ffb640 1 -- 172.21.15.103:0/3280447125 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(98..98 src has 1..98) ==== 9438+0+0 (secure 0 0 0) 0x7f05000cf880 con 0x7f0518101050 2024-08-02T18:59:55.917 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.915+0000 7f051c81b640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f05040a2d80 0x7f05040a5240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0508000c00 tx=0x7f0508032c80 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T18:59:55.919 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:55.918+0000 7f0515ffb640 1 -- 172.21.15.103:0/3280447125 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0500014030 con 0x7f0518101050 2024-08-02T18:59:56.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:55 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2748151734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:59:56.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:55 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3261380751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-02T18:59:56.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:55 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4192762189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-02T18:59:56.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:55 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1743468530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-02T18:59:56.147 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.146+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json-pretty"} v 0) -- 0x7f0518108c80 con 0x7f0518101050 2024-08-02T18:59:56.154 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.154+0000 7f0515ffb640 1 -- 172.21.15.103:0/3280447125 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json-pretty"}]=0 v26) ==== 81+0+740911 (secure 0 0 0) 0x7f050009c110 con 0x7f0518101050 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: "epoch": 26, 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: "active_gid": 15252, 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: "active_name": "x", 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: "active_addrs": { 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6800", 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1161044409 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v1", 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:6801", 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1161044409 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.168 INFO:teuthology.orchestra.run.smithi103.stdout: "active_addr": "172.21.15.103:6801/1161044409", 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: "active_change": "2024-08-02T18:49:43.557072+0000", 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: "active_mgr_features": 4540701547738038271, 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: "available": true, 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: "standbys": [ 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: "gid": 24856, 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "z", 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_features": 4540701547738038271, 2024-08-02T18:59:56.169 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.170 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.172 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.173 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.174 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.175 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.176 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.177 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to", 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-08-02T18:59:56.178 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-08-02T18:59:56.180 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.181 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.182 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.183 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.184 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.185 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.185 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.185 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.185 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.185 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-08-02T18:59:56.185 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.185 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.185 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.186 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-08-02T18:59:56.186 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-08-02T18:59:56.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.186 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-08-02T18:59:56.187 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.188 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-08-02T18:59:56.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.190 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.190 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.190 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.190 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.190 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.190 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.190 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.191 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-08-02T18:59:56.192 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.192 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.192 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.192 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-08-02T18:59:56.192 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-02T18:59:56.192 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.192 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.193 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-08-02T18:59:56.193 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-08-02T18:59:56.193 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.193 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.193 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.193 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.193 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-08-02T18:59:56.193 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-08-02T18:59:56.194 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.194 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-02T18:59:56.194 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-02T18:59:56.194 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.194 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.194 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-08-02T18:59:56.194 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-08-02T18:59:56.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.195 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.195 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.195 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-08-02T18:59:56.195 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:56.195 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-08-02T18:59:56.195 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.195 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.196 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.197 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.198 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-08-02T18:59:56.199 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.200 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.201 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.202 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.203 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.206 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-08-02T18:59:56.207 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-08-02T18:59:56.208 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.209 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.210 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.211 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.213 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-02T18:59:56.214 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.214 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.214 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.214 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.214 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.214 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.214 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-08-02T18:59:56.215 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-08-02T18:59:56.216 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-02T18:59:56.217 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.218 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-08-02T18:59:56.219 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.219 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.219 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.219 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-02T18:59:56.219 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.219 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.219 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.220 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-08-02T18:59:56.220 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-08-02T18:59:56.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.220 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.220 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.220 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.220 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-02T18:59:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-02T18:59:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.221 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.222 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.223 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.224 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.225 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.226 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.227 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.228 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.229 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.230 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-08-02T18:59:56.231 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-08-02T18:59:56.232 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.233 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-08-02T18:59:56.234 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.235 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.236 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-02T18:59:56.237 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.238 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.239 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.240 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-08-02T18:59:56.241 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-08-02T18:59:56.242 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.243 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.246 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-02T18:59:56.247 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.248 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.249 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.250 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.251 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.252 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.253 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.254 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.255 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.256 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.257 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.258 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.259 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.260 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.261 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.262 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.263 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.264 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-08-02T18:59:56.265 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.266 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.267 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-08-02T18:59:56.268 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.269 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-08-02T18:59:56.270 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.271 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.272 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.273 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.274 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.275 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.276 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.277 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-02T18:59:56.278 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-08-02T18:59:56.279 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.280 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.281 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.282 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.283 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.284 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.285 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.286 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.287 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.288 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.289 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.290 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.291 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.292 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-08-02T18:59:56.293 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.294 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.295 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.296 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.297 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.298 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.299 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.300 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.302 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.303 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.304 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.305 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.306 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.307 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.308 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.309 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.310 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.311 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-02T18:59:56.312 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-08-02T18:59:56.313 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.314 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.315 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.316 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.317 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.318 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.319 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.320 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.321 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.322 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-02T18:59:56.323 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-02T18:59:56.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-02T18:59:56.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-02T18:59:56.326 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.327 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.328 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.330 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.331 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.332 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.333 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.334 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.335 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.336 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.337 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.338 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.339 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.340 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.341 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.342 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.343 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.344 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-08-02T18:59:56.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-08-02T18:59:56.346 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.347 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.348 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.349 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.350 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.351 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.352 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.353 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.354 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.355 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.356 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.357 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.358 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-08-02T18:59:56.359 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-08-02T18:59:56.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-08-02T18:59:56.361 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.362 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.363 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.364 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.365 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.366 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.367 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.368 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.369 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.370 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.371 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.372 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.373 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.374 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.375 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-08-02T18:59:56.376 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.377 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.378 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.379 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.380 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.381 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.382 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.383 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.384 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.385 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.386 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.388 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.389 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.390 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.391 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.392 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.393 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.394 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.395 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-08-02T18:59:56.396 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-08-02T18:59:56.397 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.398 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.400 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.401 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-02T18:59:56.402 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.403 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.404 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.405 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.406 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.407 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.408 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.409 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.410 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.411 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.412 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.413 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.415 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.416 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.417 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.418 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.419 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.420 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.421 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.422 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.423 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.424 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.426 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.427 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.428 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.429 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.430 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.431 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-08-02T18:59:56.432 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-08-02T18:59:56.433 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.434 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.435 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.436 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.437 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.438 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.439 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.440 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.441 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.442 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.443 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.444 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.445 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-08-02T18:59:56.446 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.447 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.448 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.449 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.450 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.451 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.452 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.453 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.454 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.455 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.456 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.458 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-08-02T18:59:56.459 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.460 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.461 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.462 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.463 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.464 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.465 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.466 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.467 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.468 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.469 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.470 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.471 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.472 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.473 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.474 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.475 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.476 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.477 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.478 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-08-02T18:59:56.479 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.480 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.481 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.482 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.483 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.484 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.485 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.486 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.487 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.488 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:56.489 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.490 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.491 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.492 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.493 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.494 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.495 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.496 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.497 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.498 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.499 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.500 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.501 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.502 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.503 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-08-02T18:59:56.504 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.505 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-08-02T18:59:56.506 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.507 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.508 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.510 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.511 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.512 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.513 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.514 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.515 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.516 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.517 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.518 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.519 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.520 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.521 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.522 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.523 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:56.524 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:56.525 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.527 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.528 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.529 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.530 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.531 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.532 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.533 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.534 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.535 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.536 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.537 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-08-02T18:59:56.538 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.539 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.540 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.541 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.542 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.543 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.544 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.545 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.546 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.547 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.548 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.549 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.550 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.551 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.552 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-08-02T18:59:56.553 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.554 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.555 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.557 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.558 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.559 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.560 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.561 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.562 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.563 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.564 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.566 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.567 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.568 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.569 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.570 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.571 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.572 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.573 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.574 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.575 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.576 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.577 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.578 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-08-02T18:59:56.579 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.580 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.581 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.582 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.583 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.584 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.585 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.586 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.587 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.588 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-08-02T18:59:56.589 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-08-02T18:59:56.590 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-08-02T18:59:56.591 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.592 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.593 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.594 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.595 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.596 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.597 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.598 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-08-02T18:59:56.599 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.600 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.601 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.602 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.603 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.604 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.605 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.606 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.607 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.608 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.609 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.610 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.611 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.612 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.613 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.614 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.615 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.616 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.617 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.618 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.619 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.620 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.621 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.622 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-02T18:59:56.623 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.624 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.625 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.626 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.627 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.628 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.629 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.630 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.631 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.632 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.633 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.634 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-08-02T18:59:56.635 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.636 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:56.637 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "gid": 24866, 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "y", 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "mgr_features": 4540701547738038271, 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:56.638 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.639 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.640 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.641 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.642 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.643 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.644 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to", 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.645 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-08-02T18:59:56.646 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-08-02T18:59:56.647 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.648 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.649 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.650 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.651 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.652 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.653 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.654 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-02T18:59:56.655 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-02T18:59:56.656 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-02T18:59:56.657 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.658 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-08-02T18:59:56.659 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.660 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.661 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.662 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.663 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.664 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.665 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.666 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-08-02T18:59:56.667 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-08-02T18:59:56.668 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-08-02T18:59:56.669 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.670 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.671 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.672 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:56.673 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.674 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.675 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.676 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.677 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.678 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.679 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.680 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.681 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.682 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.683 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.684 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.685 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.686 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.687 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-02T18:59:56.688 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.689 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.690 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.691 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-08-02T18:59:56.692 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.693 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.694 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-08-02T18:59:56.695 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.696 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.697 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.698 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.699 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-08-02T18:59:56.700 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-08-02T18:59:56.701 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.702 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.703 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.704 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-02T18:59:56.705 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.706 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.707 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.708 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.709 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.710 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.711 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.712 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.713 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-08-02T18:59:56.714 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.715 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.716 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.717 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.718 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.719 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.720 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.721 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.722 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.723 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.724 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.725 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.726 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.727 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.728 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.729 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.730 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-02T18:59:56.731 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.732 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.733 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.734 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.735 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.736 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-08-02T18:59:56.737 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-08-02T18:59:56.738 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-08-02T18:59:56.739 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.740 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.741 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.742 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.743 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.744 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.745 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.746 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.747 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.748 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.749 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.750 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.751 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.752 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.753 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.754 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.755 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.756 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.757 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.758 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.759 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.760 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.761 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-02T18:59:56.762 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-02T18:59:56.763 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.764 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.765 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.766 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.767 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.768 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.769 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.770 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-02T18:59:56.771 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.772 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.773 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.774 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.775 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.776 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.777 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.778 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.779 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.780 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.781 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.782 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-02T18:59:56.783 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-02T18:59:56.784 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.785 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.786 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.787 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.788 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.789 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.790 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-08-02T18:59:56.791 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.792 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.793 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-02T18:59:56.794 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-02T18:59:56.795 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.796 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.797 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.798 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.799 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.800 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.801 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.802 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.803 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-08-02T18:59:56.804 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.805 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.806 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.807 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.808 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.809 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.810 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-08-02T18:59:56.811 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.812 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.813 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.814 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.815 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.816 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.817 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.818 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-08-02T18:59:56.819 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.820 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.821 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.822 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.823 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.824 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.825 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.826 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.827 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-08-02T18:59:56.828 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-08-02T18:59:56.829 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-08-02T18:59:56.830 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.831 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.832 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-08-02T18:59:56.833 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.834 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.835 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.836 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.837 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.838 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.839 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.840 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.841 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-08-02T18:59:56.842 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.843 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-08-02T18:59:56.844 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-02T18:59:56.845 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.846 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.847 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-08-02T18:59:56.848 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.849 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.850 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.851 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.852 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.853 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-08-02T18:59:56.854 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-08-02T18:59:56.855 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-08-02T18:59:56.856 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-08-02T18:59:56.857 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-08-02T18:59:56.858 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.859 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.860 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.861 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.862 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.863 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.864 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.865 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.866 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.867 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.868 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.869 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.870 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.871 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-08-02T18:59:56.872 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.873 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-02T18:59:56.874 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.875 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.876 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.877 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.878 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.879 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-08-02T18:59:56.880 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-08-02T18:59:56.881 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.882 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.883 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.884 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.885 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.886 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.887 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.888 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.889 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.890 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.891 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-02T18:59:56.892 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.893 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.894 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.895 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.896 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.897 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.898 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.899 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.900 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.901 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.902 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.903 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.904 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.905 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.906 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.907 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.908 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.909 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.910 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.911 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.912 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.913 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.914 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.917 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.918 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.919 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.920 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.921 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.922 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.923 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.924 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.925 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.926 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.927 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.928 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.929 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.930 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.931 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.932 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.933 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.934 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.935 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.936 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.937 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.938 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.939 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-08-02T18:59:56.940 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.941 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.942 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.943 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.944 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.945 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.946 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.947 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.948 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-08-02T18:59:56.949 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.950 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.951 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.952 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.953 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.954 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.955 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.956 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.957 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.958 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.959 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.960 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.961 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.962 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.963 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.964 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.965 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.966 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-08-02T18:59:56.967 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.968 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.969 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.970 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.971 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.972 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.973 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:56.974 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.975 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.976 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.977 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.978 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.979 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.980 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.981 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.982 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.983 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.984 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.985 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.986 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.987 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.988 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.989 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.990 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.991 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.992 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.993 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.994 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.995 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.996 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.997 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:56.998 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:56.999 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-02T18:59:57.000 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.001 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.002 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.003 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.004 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.005 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.006 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.007 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.008 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.009 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.010 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.011 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.012 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.013 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.014 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.015 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-08-02T18:59:57.016 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.017 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.018 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.019 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.020 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.021 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.022 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.023 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.024 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.025 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.026 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.027 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.028 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.029 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.030 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.031 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.032 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.033 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.034 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.035 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.036 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.037 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.038 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.039 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.040 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.041 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.042 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.043 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.044 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.045 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.046 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.047 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.048 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.049 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.050 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.051 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.052 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.053 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.054 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-08-02T18:59:57.055 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-08-02T18:59:57.056 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.057 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.058 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.059 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.060 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.061 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.062 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.063 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.064 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.065 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.066 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.067 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.068 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.069 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.070 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.071 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.072 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.073 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.074 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.075 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.076 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.077 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.078 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.079 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.080 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.081 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.082 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.083 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.084 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.085 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.086 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.087 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.088 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:57.089 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.090 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.091 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.092 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.093 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.094 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-08-02T18:59:57.095 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-08-02T18:59:57.096 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.097 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: "modules": [ 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: "dashboard", 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: "iostat", 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: "nfs", 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: "restful", 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: "snap_schedule" 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.099 INFO:teuthology.orchestra.run.smithi103.stdout: "available_modules": [ 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "alerts", 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.100 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How frequently to reexamine health status", 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.101 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.102 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.103 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.104 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.105 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_destination": { 2024-08-02T18:59:57.106 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_destination", 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email address to send alerts to", 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_from_name": { 2024-08-02T18:59:57.107 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_from_name", 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "Ceph", 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Email From: name", 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.108 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_host": { 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_host", 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP server", 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.109 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_password": { 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_password", 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Password to authenticate with", 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.110 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_port": { 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_port", 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "465", 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP port", 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.111 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_sender": { 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_sender", 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SMTP envelope sender", 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.112 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_ssl": { 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_ssl", 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use SSL to connect to SMTP server", 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.113 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "smtp_user": { 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "smtp_user", 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "User to authenticate as", 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.114 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "balancer", 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "active": { 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "active", 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.115 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically balance PGs across cluster", 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_time": { 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_time", 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.116 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0000", 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "beginning time of day to automatically balance", 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "begin_weekday": { 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "begin_weekday", 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:57.117 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to this day of the week or later", 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_max_iterations": { 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_max_iterations", 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:57.118 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "25", 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "250", 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum number of iterations to attempt optimization", 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_metrics": { 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_metrics", 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.119 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.120 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.121 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "pgs,objects,bytes", 2024-08-02T18:59:57.121 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.121 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.121 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.121 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "metrics with which to calculate OSD utilization", 2024-08-02T18:59:57.121 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.", 2024-08-02T18:59:57.121 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "crush_compat_step": { 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crush_compat_step", 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.5", 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0.001", 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "0.999", 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "aggressiveness of optimization", 2024-08-02T18:59:57.122 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": ".99 is very aggressive, .01 is less aggressive", 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "end_time": { 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_time", 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2359", 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.123 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ending time of day to automatically balance", 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "This is a time of day in the format HHMM.", 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "end_weekday": { 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "end_weekday", 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "0", 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "6", 2024-08-02T18:59:57.124 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Restrict automatic balancing to days of the week earlier than this", 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "0 = Sunday, 1 = Monday, etc.", 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.125 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.126 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.127 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.128 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.129 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "min_score": { 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_score", 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.130 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "minimum score, below which no optimization is attempted", 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.131 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "upmap", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "crush-compat", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "none", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "read", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap-read" 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Balancer mode", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.132 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_ids": { 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_ids", 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "pools which the automatic balancing will be limited to", 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.133 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and attempt optimization", 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.134 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_deviation": { 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_deviation", 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.135 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "deviation below which no optimization is attempted", 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "If the number of PGs are within this count then no optimization is attempted", 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "upmap_max_optimizations": { 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "upmap_max_optimizations", 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.136 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "maximum upmap optimizations to make per attempt", 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm", 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_down_multiplier": { 2024-08-02T18:59:57.137 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_down_multiplier", 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Multiplied by agent refresh rate to calculate how long agent must not report before being marked down", 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.138 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_refresh_rate": { 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_refresh_rate", 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "20", 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How often agent on each host will try to gather and send metadata", 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.139 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "agent_starting_port": { 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "agent_starting_port", 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4721", 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)", 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.140 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_ptrace": { 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_ptrace", 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow SYS_PTRACE capability on ceph containers", 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.", 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.141 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_interval": { 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_interval", 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to autotune daemon memory", 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.142 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "autotune_memory_target_ratio": { 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "autotune_memory_target_ratio", 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0.7", 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "ratio of total system memory to divide amongst autotuned daemons", 2024-08-02T18:59:57.143 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm_log_destination": { 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cephadm_log_destination", 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "file", 2024-08-02T18:59:57.144 INFO:teuthology.orchestra.run.smithi103.stdout: "file,syslog", 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "syslog" 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Destination for cephadm command's persistent logging", 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "cgroups_split": { 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cgroups_split", 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.145 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Pass --cgroups=split when cephadm creates containers (currently podman only)", 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "config_checks_enabled": { 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_checks_enabled", 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.146 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable or disable the cephadm configuration analysis", 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "config_dashboard": { 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_dashboard", 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.147 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "manage configs like API endpoints in Dashboard.", 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_alertmanager": { 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_alertmanager", 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.148 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/alertmanager:v0.25.0", 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_base": { 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_base", 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.149 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/ceph", 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Container image name, without the tag", 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_elasticsearch": { 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_elasticsearch", 2024-08-02T18:59:57.150 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/omrizeneva/elasticsearch:6.8.23", 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "elasticsearch container image", 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_grafana": { 2024-08-02T18:59:57.151 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_grafana", 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/grafana:9.4.12", 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.152 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_haproxy": { 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_haproxy", 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/haproxy:2.3", 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "HAproxy container image", 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.153 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_agent": { 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_agent", 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-agent:1.29", 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger agent container image", 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.154 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_collector": { 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_collector", 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-collector:1.29", 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger collector container image", 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.155 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_jaeger_query": { 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_jaeger_query", 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/jaegertracing/jaeger-query:1.29", 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Jaeger query container image", 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.156 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_keepalived": { 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_keepalived", 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/keepalived:2.2.4", 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Keepalived container image", 2024-08-02T18:59:57.157 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_loki": { 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_loki", 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/loki:3.0.0", 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.158 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Loki container image", 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_node_exporter": { 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_node_exporter", 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/node-exporter:v1.5.0", 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.159 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_nvmeof": { 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_nvmeof", 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/ceph/nvmeof:1.2.5", 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.160 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Nvme-of container image", 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_prometheus": { 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_prometheus", 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/prometheus/prometheus:v2.43.0", 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.161 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Prometheus container image", 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_promtail": { 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_promtail", 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/grafana/promtail:3.0.0", 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.162 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Promtail container image", 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_samba": { 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_samba", 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "quay.io/samba.org/samba-server:devbuilds-centos-amd64", 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.163 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Samba/SMB container image", 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "container_image_snmp_gateway": { 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_image_snmp_gateway", 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io/maxwo/snmp-notifier:v1.2.1", 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.164 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "SNMP Gateway container image", 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "container_init": { 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "container_init", 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.165 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Run podman/docker with `--init`", 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "daemon_cache_timeout": { 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "daemon_cache_timeout", 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.166 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache service (daemon) inventory", 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "default_cephadm_command_timeout": { 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_cephadm_command_timeout", 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.167 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "900", 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default timeout applied to cephadm commands run directly on the host (in seconds)", 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "default_registry": { 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "default_registry", 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.168 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "docker.io", 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Search-registry to which we should normalize unqualified image names. This is not the default registry", 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "device_cache_timeout": { 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_cache_timeout", 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.169 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1800", 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache device inventory", 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "device_enhanced_scan": { 2024-08-02T18:59:57.170 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_enhanced_scan", 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use libstoragemgmt during device scans", 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.171 INFO:teuthology.orchestra.run.smithi103.stdout: "facts_cache_timeout": { 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "facts_cache_timeout", 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "seconds to cache host facts data", 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.172 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "grafana_dashboards_path": { 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "grafana_dashboards_path", 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/grafana/dashboards/ceph-dashboard/", 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of dashboards to include in grafana deployments", 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.173 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "host_check_interval": { 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "host_check_interval", 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to perform a host check", 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.174 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "hw_monitoring": { 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hw_monitoring", 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Deploy hw monitoring daemon on every host.", 2024-08-02T18:59:57.175 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "inventory_list_all": { 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "inventory_list_all", 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.176 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)", 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.177 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.178 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "log_refresh_metadata": { 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_refresh_metadata", 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level", 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.179 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "log to the \"cephadm\" cluster log channel\"", 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.180 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.181 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.182 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf": { 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf", 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.183 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Manage and own /etc/ceph/ceph.conf on the hosts.", 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "manage_etc_ceph_ceph_conf_hosts": { 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "manage_etc_ceph_ceph_conf_hosts", 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.184 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "*", 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf", 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "max_count_per_host": { 2024-08-02T18:59:57.185 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_count_per_host", 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of daemons per service per host", 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.186 INFO:teuthology.orchestra.run.smithi103.stdout: "max_osd_draining_count": { 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_osd_draining_count", 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "max number of osds that will be drained simultaneously when osds are removed", 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.187 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "migration_current": { 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "migration_current", 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "internal - do not modify", 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.188 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "mode": { 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mode", 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "root", 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm-package", 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: "root" 2024-08-02T18:59:57.189 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "mode for remote execution of cephadm", 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "oob_default_addr": { 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "oob_default_addr", 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "169.254.1.1", 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.190 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Default address for RedFish API (oob management).", 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "prometheus_alerts_path": { 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus_alerts_path", 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/etc/prometheus/ceph/ceph_default_alerts.yml", 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.191 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "location of alerts to include in prometheus deployments", 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_insecure": { 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_insecure", 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.192 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry is to be considered insecure (no TLS available). Only for development purposes.", 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_password": { 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_password", 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.193 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository password. Only used for logging into a registry.", 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_url": { 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_url", 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.194 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Registry url for login purposes. This is not the default registry", 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "registry_username": { 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "registry_username", 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.195 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Custom repository username. Only used for logging into a registry.", 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "secure_monitoring_stack": { 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "secure_monitoring_stack", 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.196 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable TLS security for all the monitoring stack daemons", 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "service_discovery_port": { 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "service_discovery_port", 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.197 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8765", 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "cephadm service discovery port", 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "ssh_config_file": { 2024-08-02T18:59:57.198 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssh_config_file", 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "customized SSH config file to connect to managed hosts", 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "use_agent": { 2024-08-02T18:59:57.199 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_agent", 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use cephadm agent on each host to gather and send metadata", 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.200 INFO:teuthology.orchestra.run.smithi103.stdout: "use_repo_digest": { 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "use_repo_digest", 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Automatically convert image tags to image digest. Make sure all daemons use the same image", 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.201 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_failed_host_check": { 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_failed_host_check", 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if the host check fails", 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.202 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_daemons": { 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_daemons", 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected that are not managed by cephadm", 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.203 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_on_stray_hosts": { 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_on_stray_hosts", 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise a health warning if daemons are detected on a host that is not managed by cephadm", 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.204 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crash", 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.205 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.206 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.207 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.208 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.209 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.210 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "retain_interval": { 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retain_interval", 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "31536000", 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain crashes before pruning them", 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.211 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_recent_interval": { 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_recent_interval", 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1209600", 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "time interval in which to warn about recent crashes", 2024-08-02T18:59:57.212 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dashboard", 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "ACCOUNT_LOCKOUT_ATTEMPTS": { 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ACCOUNT_LOCKOUT_ATTEMPTS", 2024-08-02T18:59:57.213 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.214 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_HOST": { 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_HOST", 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.215 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "ALERTMANAGER_API_SSL_VERIFY": { 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ALERTMANAGER_API_SSL_VERIFY", 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.216 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_ENABLED": { 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_ENABLED", 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.217 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "AUDIT_API_LOG_PAYLOAD": { 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "AUDIT_API_LOG_PAYLOAD", 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.218 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "ENABLE_BROWSABLE_API": { 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ENABLE_BROWSABLE_API", 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.219 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_CEPHFS": { 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_CEPHFS", 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.220 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_DASHBOARD": { 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_DASHBOARD", 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.221 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_ISCSI": { 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_ISCSI", 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.222 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_MIRRORING": { 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_MIRRORING", 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.223 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_NFS": { 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_NFS", 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.224 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RBD": { 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RBD", 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.225 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "FEATURE_TOGGLE_RGW": { 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "FEATURE_TOGGLE_RGW", 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.226 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE": { 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE", 2024-08-02T18:59:57.227 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_PASSWORD": { 2024-08-02T18:59:57.228 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_PASSWORD", 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_SSL_VERIFY": { 2024-08-02T18:59:57.229 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_SSL_VERIFY", 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.230 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_URL": { 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_URL", 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.231 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_API_USERNAME": { 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_API_USERNAME", 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.232 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_FRONTEND_API_URL": { 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_FRONTEND_API_URL", 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.233 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "GRAFANA_UPDATE_DASHBOARDS": { 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.234 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "ISCSI_API_SSL_VERIFICATION": { 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISCSI_API_SSL_VERIFICATION", 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.235 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "ISSUE_TRACKER_API_KEY": { 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ISSUE_TRACKER_API_KEY", 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.236 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_HOST": { 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_HOST", 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.237 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "PROMETHEUS_API_SSL_VERIFY": { 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PROMETHEUS_API_SSL_VERIFY", 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.238 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_COMPLEXITY_ENABLED": { 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_COMPLEXITY_ENABLED", 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.239 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED": { 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED", 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.240 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_LENGTH_ENABLED": { 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_LENGTH_ENABLED", 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.241 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_OLDPWD_ENABLED": { 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_OLDPWD_ENABLED", 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.242 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED": { 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED", 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.243 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED": { 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED", 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.244 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_CHECK_USERNAME_ENABLED": { 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_CHECK_USERNAME_ENABLED", 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.245 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_ENABLED": { 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_ENABLED", 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.246 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_EXCLUSION_LIST": { 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_EXCLUSION_LIST", 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.247 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps", 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_COMPLEXITY": { 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_COMPLEXITY", 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.248 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "PWD_POLICY_MIN_LENGTH": { 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "PWD_POLICY_MIN_LENGTH", 2024-08-02T18:59:57.249 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8", 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "REST_REQUESTS_TIMEOUT": { 2024-08-02T18:59:57.250 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "REST_REQUESTS_TIMEOUT", 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "45", 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ACCESS_KEY": { 2024-08-02T18:59:57.251 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ACCESS_KEY", 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.252 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_ADMIN_RESOURCE": { 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_ADMIN_RESOURCE", 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "admin", 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.253 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SECRET_KEY": { 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SECRET_KEY", 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.254 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "RGW_API_SSL_VERIFY": { 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "RGW_API_SSL_VERIFY", 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.255 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_SPAN": { 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_SPAN", 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.256 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_1": { 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_1", 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.257 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "USER_PWD_EXPIRATION_WARNING_2": { 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "USER_PWD_EXPIRATION_WARNING_2", 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.258 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "cross_origin_url": { 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cross_origin_url", 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.259 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "crt_file": { 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "crt_file", 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.260 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "debug": { 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "debug", 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.261 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Enable/disable debug options", 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "jwt_token_ttl": { 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "jwt_token_ttl", 2024-08-02T18:59:57.262 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "28800", 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-08-02T18:59:57.263 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.264 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.265 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.266 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.267 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.268 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.269 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "motd": { 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "motd", 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.270 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "The message of the day", 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect_resolve_ip_addr": { 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "redirect_resolve_ip_addr", 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.271 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.272 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.273 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8080", 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-08-02T18:59:57.274 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl_server_port": { 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl_server_port", 2024-08-02T18:59:57.275 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8443", 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-08-02T18:59:57.276 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "redirect", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "redirect" 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.277 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.278 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "url_prefix": { 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url_prefix", 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.279 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.280 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_monitoring": { 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_monitoring", 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "monitor device health metrics", 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.281 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.282 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.283 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.284 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.285 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.286 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "mark_out_threshold": { 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mark_out_threshold", 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "2419200", 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.287 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "automatically mark OSD if it may fail before this long", 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "pool_name": { 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pool_name", 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "device_health_metrics", 2024-08-02T18:59:57.288 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name of pool in which to store device health metrics", 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "retention_period": { 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "retention_period", 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.289 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15552000", 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long to retain device health metrics", 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_frequency": { 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_frequency", 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.290 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to scrape device health metrics", 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "self_heal": { 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "self_heal", 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.291 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "preemptively heal cluster around devices that may fail", 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:57.292 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how frequently to wake up and check device health", 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "warn_threshold": { 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "warn_threshold", 2024-08-02T18:59:57.293 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7257600", 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "raise health warning if OSD may fail before this long", 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.294 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "diskprediction_local", 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.295 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.296 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.297 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.298 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.299 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "predict_interval": { 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predict_interval", 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.300 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "86400", 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.301 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "predictor_model": { 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "predictor_model", 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "prophetstor", 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.302 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "600", 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.303 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "influx", 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": false, 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "influxdb python module not found", 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "batch_size": { 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "batch_size", 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.304 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5000", 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How big batches of data points should be when sending to InfluxDB.", 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "database": { 2024-08-02T18:59:57.305 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "database", 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "ceph", 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.", 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "hostname": { 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "hostname", 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server hostname", 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.307 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "30", 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "5", 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Time between reports to InfluxDB. Default 30 seconds.", 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.308 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.309 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.310 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.311 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.312 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.313 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "password": { 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "password", 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.314 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "password of InfluxDB server user", 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "port": { 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "port", 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.315 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "8086", 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "InfluxDB server port", 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "ssl": { 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ssl", 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.316 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "false", 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Use https connection for InfluxDB server. Use \"true\" or \"false\".", 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "threads": { 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threads", 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.317 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "32", 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "How many worker threads should be spawned for sending data to InfluxDB.", 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "username": { 2024-08-02T18:59:57.318 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "username", 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "username of InfluxDB server user", 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "verify_ssl": { 2024-08-02T18:59:57.319 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "verify_ssl", 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "true", 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Verify https cert for InfluxDB server. Use \"true\" or \"false\".", 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.320 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "insights", 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.321 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.322 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.323 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.324 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.325 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.326 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.329 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "iostat", 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.330 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.331 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.332 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.333 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.334 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "k8sevents", 2024-08-02T18:59:57.335 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "ceph_event_retention_days": { 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "ceph_event_retention_days", 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "7", 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Days to hold ceph event information within local cache", 2024-08-02T18:59:57.336 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "config_check_secs": { 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "config_check_secs", 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "10", 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.337 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "interval (secs) to check for cluster configuration changes", 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.338 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.339 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.340 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.341 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.342 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.343 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "localpool", 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "failure_domain": { 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "failure_domain", 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "host", 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.344 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "failure domain for any created local pool", 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "what failure domain we should separate data replicas across.", 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.345 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.346 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.347 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.348 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.349 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "min_size": { 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "min_size", 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.350 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default min_size for any created local pool", 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "value to set min_size to (unchanged from Ceph's default if this option is not set)", 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "num_rep": { 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "num_rep", 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.351 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3", 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default replica count for any created local pool", 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_num": { 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_num", 2024-08-02T18:59:57.352 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "128", 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "default pg_num for any created local pool", 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "prefix": { 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prefix", 2024-08-02T18:59:57.353 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "name prefix for any created local pool", 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "subtree": { 2024-08-02T18:59:57.354 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "subtree", 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "rack", 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "CRUSH level for which to create a local pool", 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "which CRUSH subtree type the module should create a pool for.", 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.355 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mds_autoscaler", 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.356 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.357 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.358 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.359 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.360 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.361 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirroring", 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.362 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.363 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.364 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.365 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.366 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "nfs", 2024-08-02T18:59:57.367 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.368 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.369 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.370 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.371 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.372 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "fail_fs": { 2024-08-02T18:59:57.373 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "fail_fs", 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Fail filesystem for rapid multi-rank mds upgrade", 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.374 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.375 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.376 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.377 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.378 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.379 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator": { 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "orchestrator", 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.380 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "cephadm", 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "rook", 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "test_orchestrator" 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Orchestrator backend", 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.381 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_perf_query", 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.382 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.383 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.384 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.385 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.386 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "osd_support", 2024-08-02T18:59:57.387 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.388 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.389 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.390 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.391 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.392 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "pg_autoscaler", 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.393 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.394 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.395 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.396 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.397 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.398 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.399 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "threshold": { 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "threshold", 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "3.0", 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1.0", 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.400 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "scaling threshold", 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0", 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "progress", 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.401 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_pg_recovery_event": { 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_pg_recovery_event", 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow the module to show pg recovery progress", 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.402 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.403 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.404 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.405 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.406 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.407 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.408 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "max_completed_events": { 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_completed_events", 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "50", 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.409 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "number of past completed events to remember", 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "sleep_interval": { 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "sleep_interval", 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "5", 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.410 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "how long the module is going to sleep", 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "prometheus", 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.411 INFO:teuthology.orchestra.run.smithi103.stdout: "cache": { 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "cache", 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.412 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "exclude_perf_counters": { 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "exclude_perf_counters", 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Do not include perf-counters in the metrics output", 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.", 2024-08-02T18:59:57.413 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.414 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.415 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.416 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.417 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.418 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools": { 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools", 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.419 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_stats_pools_refresh_interval": { 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_stats_pools_refresh_interval", 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "300", 2024-08-02T18:59:57.420 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "scrape_interval": { 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "scrape_interval", 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15.0", 2024-08-02T18:59:57.421 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.422 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "::", 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the IPv4 or IPv6 address on which the module listens for HTTP requests", 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.423 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "9283", 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "the port on which the module listens for HTTP requests", 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "stale_cache_strategy": { 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stale_cache_strategy", 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.424 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "log", 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_behaviour": { 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_behaviour", 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.425 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "default", 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "default", 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "error" 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.426 INFO:teuthology.orchestra.run.smithi103.stdout: "standby_error_status_code": { 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "standby_error_status_code", 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "500", 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "400", 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "599", 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.427 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.428 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.429 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.430 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.431 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.432 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_snap_create": { 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_snap_create", 2024-08-02T18:59:57.433 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10", 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "mirror_snapshot_schedule": { 2024-08-02T18:59:57.434 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "mirror_snapshot_schedule", 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.435 INFO:teuthology.orchestra.run.smithi103.stdout: "trash_purge_schedule": { 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "trash_purge_schedule", 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.436 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "restful", 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "enable_auth": { 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enable_auth", 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.437 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "key_file": { 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "key_file", 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.438 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.439 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.440 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.441 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.442 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.443 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "server_addr": { 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_addr", 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.444 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "server_port": { 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "server_port", 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.445 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.446 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rgw", 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.447 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.448 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.449 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.450 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.451 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rook", 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.452 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.453 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.454 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.455 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.456 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.457 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "storage_class": { 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "storage_class", 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "local", 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.458 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "storage class name for LSO-discovered PVs", 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "selftest", 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.459 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.460 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.461 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.462 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.463 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.464 INFO:teuthology.orchestra.run.smithi103.stdout: "roption1": { 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption1", 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.465 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "roption2": { 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "roption2", 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "xyz", 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.466 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption1": { 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption1", 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.467 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption2": { 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption2", 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.468 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption3": { 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption3", 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "float", 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.469 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption4": { 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption4", 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.470 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption5": { 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption5", 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.471 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption6": { 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption6", 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.472 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "rwoption7": { 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rwoption7", 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "1", 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "42", 2024-08-02T18:59:57.473 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "testkey": { 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testkey", 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.474 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "testlkey": { 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testlkey", 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.475 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "testnewline": { 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "testnewline", 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.476 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.477 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "allow_m_granularity": { 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "allow_m_granularity", 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "allow minute scheduled snapshots", 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.478 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "dump_on_update": { 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "dump_on_update", 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "dump database to debug log on update", 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.479 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.480 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.481 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.482 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.483 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.484 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "stats", 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.485 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.486 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.487 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.488 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.489 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.490 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "status", 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.491 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.492 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.493 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.494 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.495 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.496 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telegraf", 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "address": { 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "address", 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "unixgram:///tmp/telegraf.sock", 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.497 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "15", 2024-08-02T18:59:57.498 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.499 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.500 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.501 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.502 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.503 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.504 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "telemetry", 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_basic": { 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_basic", 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.505 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share basic cluster information (size, version)", 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_crash": { 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_crash", 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.506 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share metadata about Ceph daemon crashes (version, stack straces, etc)", 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_device": { 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_device", 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.507 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)", 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_ident": { 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_ident", 2024-08-02T18:59:57.508 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share a user-provided description and/or contact email for the cluster", 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "channel_perf": { 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "channel_perf", 2024-08-02T18:59:57.509 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Share various performance metrics of a cluster", 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "contact": { 2024-08-02T18:59:57.510 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "contact", 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "description": { 2024-08-02T18:59:57.511 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "description", 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.512 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "device_url": { 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "device_url", 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/device", 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.513 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "enabled": { 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "enabled", 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.514 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "24", 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "8", 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.515 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "last_opt_revision": { 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "last_opt_revision", 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "1", 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.516 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard": { 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard", 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.517 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "leaderboard_description": { 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "leaderboard_description", 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.518 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.519 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.520 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.521 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.522 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.523 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "organization": { 2024-08-02T18:59:57.524 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "organization", 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.525 INFO:teuthology.orchestra.run.smithi103.stdout: "proxy": { 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "proxy", 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.526 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "url": { 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "url", 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "https://telemetry.ceph.com/report", 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.527 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "test_orchestrator", 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.528 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.529 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.530 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.531 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.532 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.533 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.533 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.533 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.533 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.533 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.533 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.534 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.535 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.536 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.537 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.538 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.539 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.540 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "max_concurrent_clones": { 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "max_concurrent_clones", 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "4", 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Number of asynchronous cloner threads", 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.541 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "periodic_async_work": { 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "periodic_async_work", 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.542 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Periodically check for async work", 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_delay": { 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_delay", 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "0", 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.543 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Delay clone begin operation by snapshot_clone_delay seconds", 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "snapshot_clone_no_wait": { 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snapshot_clone_no_wait", 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "True", 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.544 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "Reject subvolume clone request when cloner threads are busy", 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix", 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "can_run": true, 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "error_string": "", 2024-08-02T18:59:57.545 INFO:teuthology.orchestra.run.smithi103.stdout: "module_options": { 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "discovery_interval": { 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "discovery_interval", 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "uint", 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "100", 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.546 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "identifier": { 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "identifier", 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.547 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "interval": { 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "interval", 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "secs", 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "60", 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.548 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "log_level": { 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_level", 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.549 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster": { 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster", 2024-08-02T18:59:57.550 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_cluster_level": { 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_cluster_level", 2024-08-02T18:59:57.551 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "info", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [ 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "critical", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "debug", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "error", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "info", 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "warning" 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.552 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "log_to_file": { 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "log_to_file", 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "bool", 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 1, 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "False", 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.553 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_host": { 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_host", 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "", 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.554 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_port": { 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_port", 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "int", 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "10051", 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.555 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "zabbix_sender": { 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "zabbix_sender", 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "str", 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "level": "advanced", 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "flags": 0, 2024-08-02T18:59:57.556 INFO:teuthology.orchestra.run.smithi103.stdout: "default_value": "/usr/bin/zabbix_sender", 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "min": "", 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "max": "", 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "enum_allowed": [], 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "desc": "", 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "long_desc": "", 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "tags": [], 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "see_also": [] 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "services": { 2024-08-02T18:59:57.557 INFO:teuthology.orchestra.run.smithi103.stdout: "dashboard": "https://172.21.15.103:8443/" 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "always_on_modules": { 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "octopus": [ 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-08-02T18:59:57.558 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "pacific": [ 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-08-02T18:59:57.559 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "quincy": [ 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.560 INFO:teuthology.orchestra.run.smithi103.stdout: "reef": [ 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: ], 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "squid": [ 2024-08-02T18:59:57.561 INFO:teuthology.orchestra.run.smithi103.stdout: "balancer", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "crash", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "devicehealth", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "orchestrator", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "pg_autoscaler", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "progress", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "rbd_support", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "status", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "telemetry", 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "volumes" 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "last_failure_osd_epoch": 90, 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: "active_clients": [ 2024-08-02T18:59:57.562 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "devicehealth", 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2648260310 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "libcephsqlite", 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.563 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 42928053 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "rbd_support", 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2472246758 2024-08-02T18:59:57.564 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 2620325567 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.565 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "snap_schedule", 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 1673034732 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: "name": "volumes", 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: "addrvec": [ 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: { 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: "type": "v2", 2024-08-02T18:59:57.566 INFO:teuthology.orchestra.run.smithi103.stdout: "addr": "172.21.15.103:0", 2024-08-02T18:59:57.567 INFO:teuthology.orchestra.run.smithi103.stdout: "nonce": 3823861357 2024-08-02T18:59:57.567 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.567 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.567 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:57.567 INFO:teuthology.orchestra.run.smithi103.stdout: ] 2024-08-02T18:59:57.567 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:59:57.568 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:55 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2748151734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:55 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3261380751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:55 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4192762189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:55 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1743468530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:56 smithi151 ceph-mon[37155]: pgmap v317: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:56 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3280447125' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:55 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2748151734' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:55 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3261380751' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:55 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4192762189' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:55 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1743468530' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]: dispatch 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:56 smithi121 ceph-mon[37236]: pgmap v317: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-02T18:59:57.569 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:56 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3280447125' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-02T18:59:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f05040a2d80 msgr2=0x7f05040a5240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f05040a2d80 0x7f05040a5240 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f0508000c00 tx=0x7f0508032c80 comp rx=0 tx=0).stop 2024-08-02T18:59:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0518101050 msgr2=0x7f05181976b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T18:59:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0518101050 0x7f05181976b0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f050000c890 tx=0x7f050000cd50 comp rx=0 tx=0).stop 2024-08-02T18:59:57.570 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 shutdown_connections 2024-08-02T18:59:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f05040a2d80 0x7f05040a5240 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f05181066c0 0x7f051819ba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0518101050 0x7f05181976b0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 --2- 172.21.15.103:0/3280447125 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f05181006b0 0x7f0518197170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T18:59:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 >> 172.21.15.103:0/3280447125 conn(0x7f0518077740 msgr2=0x7f05181035a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T18:59:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 shutdown_connections 2024-08-02T18:59:57.571 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T18:59:56.159+0000 7f051ea7f640 1 -- 172.21.15.103:0/3280447125 wait complete. 2024-08-02T18:59:57.624 DEBUG:tasks.check_counter:Getting stats from a 2024-08-02T18:59:57.624 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.a perf dump 2024-08-02T18:59:57.625 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:56 smithi103 ceph-mon[32753]: pgmap v317: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 12 op/s 2024-08-02T18:59:57.625 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:56 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3280447125' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json-pretty"}]: dispatch 2024-08-02T18:59:57.999 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:57 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:59:58.139 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:57 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:59:58.264 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:57 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-08-02T18:59:58.535 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T18:59:58.954 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:58 smithi103 ceph-mon[32753]: pgmap v318: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-02T18:59:58.954 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:58 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:59:58.954 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 18:59:58 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:59:59.086 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 4, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 4, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 2992, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 448, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.003244849, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000037163, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.002308589, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T18:59:59.087 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3, 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.004043341, 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001347780 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 448 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T18:59:59.088 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 158, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 320, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 184304, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.013737460, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.009682041, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001715899, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T18:59:59.089 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 155, 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.012755071, 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000082290 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 184304 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.090 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 218, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 207, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1579664, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 127264, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.040507055, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.015071030, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.037325311, 2024-08-02T18:59:59.091 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 206, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.011665318, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000056627 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1579664, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 127264 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.092 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T18:59:59.093 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T18:59:59.094 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-08-02T18:59:59.095 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 149017, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 31, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-08-02T18:59:59.096 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-08-02T18:59:59.097 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 220, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1548945, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 220, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 220, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1548945, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T18:59:59.098 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T18:59:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:58 smithi121 ceph-mon[37236]: pgmap v318: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-02T18:59:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:58 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:59:59.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 18:59:58 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:59:59.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:58 smithi151 ceph-mon[37155]: pgmap v318: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-02T18:59:59.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:58 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:59:59.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 18:59:58 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T18:59:59.938 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.a 2024-08-02T18:59:59.938 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.a 2024-08-02T18:59:59.938 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.a 2024-08-02T18:59:59.938 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.a 2024-08-02T18:59:59.939 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.a 2024-08-02T18:59:59.939 DEBUG:tasks.check_counter:Getting stats from d 2024-08-02T18:59:59.939 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.d perf dump 2024-08-02T19:00:00.238 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:00.320 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi121 to 176.1M 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: Unable to set osd_memory_target on smithi121 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-08-02T19:00:00.321 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-08-02T19:00:00.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-08-02T19:00:00.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-08-02T19:00:00.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: mds.c(mds.2): Metadata damage detected 2024-08-02T19:00:00.322 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:00 smithi151 ceph-mon[37155]: mds.i(mds.1): Metadata damage detected 2024-08-02T19:00:00.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T18:59:59.999+0000 7f4e9562d640 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-08-02T19:00:00.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T18:59:59.999+0000 7f4e9562d640 -1 log_channel(cluster) log [ERR] : [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-08-02T19:00:00.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T18:59:59.999+0000 7f4e9562d640 -1 log_channel(cluster) log [ERR] : mds.c(mds.2): Metadata damage detected 2024-08-02T19:00:00.325 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T18:59:59.999+0000 7f4e9562d640 -1 log_channel(cluster) log [ERR] : mds.i(mds.1): Metadata damage detected 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi121 to 176.1M 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: Unable to set osd_memory_target on smithi121 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.326 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-08-02T19:00:00.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-08-02T19:00:00.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-08-02T19:00:00.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-08-02T19:00:00.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: mds.c(mds.2): Metadata damage detected 2024-08-02T19:00:00.327 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:00 smithi103 ceph-mon[32753]: mds.i(mds.1): Metadata damage detected 2024-08-02T19:00:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:00.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.10", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi121 to 176.1M 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: Unable to set osd_memory_target on smithi121 to 184727244: error parsing value: Value '184727244' is below minimum 939524096 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.8", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.11", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi151 to 176.2M 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: Unable to set osd_memory_target on smithi151 to 184787456: error parsing value: Value '184787456' is below minimum 939524096 2024-08-02T19:00:00.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: Health detail: HEALTH_ERR 2 MDSs report damaged metadata 2024-08-02T19:00:00.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: [ERR] MDS_DAMAGE: 2 MDSs report damaged metadata 2024-08-02T19:00:00.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: mds.c(mds.2): Metadata damage detected 2024-08-02T19:00:00.503 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:00 smithi121 ceph-mon[37236]: mds.i(mds.1): Metadata damage detected 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.001145501, 2024-08-02T19:00:00.824 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000206340, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.825 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-02T19:00:00.826 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-08-02T19:00:00.826 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.826 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:00.826 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 164, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 320, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 185360, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.013838295, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.009717499, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001916864, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:00.827 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 161, 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.011049810, 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000068632 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 185360 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:00.828 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 228, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 215, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1584288, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 131552, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.042079309, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.015503786, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.037670989, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 215, 2024-08-02T19:00:00.829 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.017780856, 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000082701 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1584288, 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 131552 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-08-02T19:00:00.830 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:00.831 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:00.832 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:00.833 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 149034, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 32, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-08-02T19:00:00.834 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:00.835 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 226, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1549725, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 226, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-08-02T19:00:00.836 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 226, 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1549725, 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T19:00:00.837 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T19:00:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: pgmap v319: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-02T19:00:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T19:00:01.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T19:00:01.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:01 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: pgmap v319: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T19:00:01.538 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:01 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.565 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.d 2024-08-02T19:00:01.565 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.d 2024-08-02T19:00:01.565 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.d 2024-08-02T19:00:01.566 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.d 2024-08-02T19:00:01.566 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.d 2024-08-02T19:00:01.566 DEBUG:tasks.check_counter:Getting stats from g 2024-08-02T19:00:01.566 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.g perf dump 2024-08-02T19:00:01.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: pgmap v319: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 5.4 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-02T19:00:01.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd.9", "name": "osd_memory_target"}]: dispatch 2024-08-02T19:00:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-08-02T19:00:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-08-02T19:00:01.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:01 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' 2024-08-02T19:00:01.821 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:02.303 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T19:00:02.303 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 0, 2024-08-02T19:00:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 2, 2024-08-02T19:00:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 0, 2024-08-02T19:00:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 0, 2024-08-02T19:00:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-08-02T19:00:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-08-02T19:00:02.304 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.001124678, 2024-08-02T19:00:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000000000, 2024-08-02T19:00:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.000194762, 2024-08-02T19:00:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:02.305 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:02.306 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-02T19:00:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 0 2024-08-02T19:00:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:02.307 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 224, 2024-08-02T19:00:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 211, 2024-08-02T19:00:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1583200, 2024-08-02T19:00:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 128992, 2024-08-02T19:00:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-08-02T19:00:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-08-02T19:00:02.308 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.042493969, 2024-08-02T19:00:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.016025485, 2024-08-02T19:00:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.039071799, 2024-08-02T19:00:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 211, 2024-08-02T19:00:02.309 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.015648871, 2024-08-02T19:00:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000074165 2024-08-02T19:00:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:02.310 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1583200, 2024-08-02T19:00:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 128992 2024-08-02T19:00:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.311 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2, 2024-08-02T19:00:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 160, 2024-08-02T19:00:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 320, 2024-08-02T19:00:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 184656, 2024-08-02T19:00:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-08-02T19:00:02.312 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-08-02T19:00:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.013352294, 2024-08-02T19:00:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.009315578, 2024-08-02T19:00:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001724159, 2024-08-02T19:00:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:02.313 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 157, 2024-08-02T19:00:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.015658448, 2024-08-02T19:00:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000099735 2024-08-02T19:00:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.314 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T19:00:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 184656 2024-08-02T19:00:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.315 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-08-02T19:00:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-08-02T19:00:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-08-02T19:00:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-08-02T19:00:02.316 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:02.317 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:02.318 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:02.319 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:02.320 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 148977, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 30, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:02.321 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-08-02T19:00:02.322 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 222, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1549205, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 222, 2024-08-02T19:00:02.323 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 222, 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1549205, 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T19:00:02.324 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T19:00:02.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:02 smithi121 ceph-mon[37236]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-08-02T19:00:02.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:02 smithi121 ceph-mon[37236]: Unable to set osd_memory_target on smithi103 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-02T19:00:02.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:02 smithi151 ceph-mon[37155]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-08-02T19:00:02.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:02 smithi151 ceph-mon[37155]: Unable to set osd_memory_target on smithi103 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-02T19:00:02.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:02 smithi103 ceph-mon[32753]: Adjusting osd_memory_target on smithi103 to 176.0M 2024-08-02T19:00:02.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:02 smithi103 ceph-mon[32753]: Unable to set osd_memory_target on smithi103 to 184596787: error parsing value: Value '184596787' is below minimum 939524096 2024-08-02T19:00:02.991 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.g 2024-08-02T19:00:02.991 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.g 2024-08-02T19:00:02.991 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.g 2024-08-02T19:00:02.991 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.g 2024-08-02T19:00:02.991 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.g 2024-08-02T19:00:02.991 DEBUG:tasks.check_counter:Getting stats from j 2024-08-02T19:00:02.992 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.j perf dump 2024-08-02T19:00:03.244 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:03.501 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:03 smithi121 ceph-mon[37236]: pgmap v320: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-02T19:00:03.526 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:03 smithi103 ceph-mon[32753]: pgmap v320: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-02T19:00:03.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:03 smithi151 ceph-mon[37155]: pgmap v320: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 10 op/s 2024-08-02T19:00:03.786 INFO:teuthology.orchestra.run.smithi103.stdout:{ 2024-08-02T19:00:03.786 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:03.786 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 225, 2024-08-02T19:00:03.786 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 214, 2024-08-02T19:00:03.786 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 1581568, 2024-08-02T19:00:03.786 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 131744, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 4, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 0, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.039882086, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.015068828, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.035625222, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 213, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.012986426, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000060969 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.787 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 1581568, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 131744 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 2, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 164, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 320, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 185360, 2024-08-02T19:00:03.788 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 5, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 3, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.013513029, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.009485188, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.001808361, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 161, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.016684223, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000103628 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:03.789 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 185360 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_messages": 4, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages": 4, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_bytes": 2992, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_bytes": 448, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_created_connections": 2, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_active_connections": 1, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_total_time": 0.002329790, 2024-08-02T19:00:03.790 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_send_time": 0.000038496, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_recv_time": 0.002281259, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 3, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.004075111, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.001358370 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-02T19:00:03.791 INFO:teuthology.orchestra.run.smithi103.stdout: "msgr_send_encrypted_bytes": 448 2024-08-02T19:00:03.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.792 INFO:teuthology.orchestra.run.smithi103.stdout: "cct": { 2024-08-02T19:00:03.792 INFO:teuthology.orchestra.run.smithi103.stdout: "total_workers": 0, 2024-08-02T19:00:03.792 INFO:teuthology.orchestra.run.smithi103.stdout: "unhealthy_workers": 0 2024-08-02T19:00:03.792 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.792 INFO:teuthology.orchestra.run.smithi103.stdout: "mempool": { 2024-08-02T19:00:03.792 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:03.793 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:03.794 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:03.795 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:03.795 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:03.795 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:03.795 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:03.795 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:03.795 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:03.795 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_items": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:03.796 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_bytes": 148994, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_anon_items": 31, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_bytes": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "buffer_meta_items": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_bytes": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_items": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_bytes": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_items": 0, 2024-08-02T19:00:03.797 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "pgmap_items": 0, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_bytes": 928, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "mds_co_items": 2, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_1_items": 0, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "unittest_2_items": 0 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: }, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "val": 0, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "max": 104857600, 2024-08-02T19:00:03.798 INFO:teuthology.orchestra.run.smithi103.stdout: "get_started": 0, 2024-08-02T19:00:03.799 INFO:teuthology.orchestra.run.smithi103.stdout: "get": 227, 2024-08-02T19:00:03.799 INFO:teuthology.orchestra.run.smithi103.stdout: "get_sum": 1549855, 2024-08-02T19:00:03.799 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:03.799 INFO:teuthology.orchestra.run.smithi103.stdout: "get_or_fail_success": 227, 2024-08-02T19:00:03.799 INFO:teuthology.orchestra.run.smithi103.stdout: "take": 0, 2024-08-02T19:00:03.799 INFO:teuthology.orchestra.run.smithi103.stdout: "take_sum": 0, 2024-08-02T19:00:03.799 INFO:teuthology.orchestra.run.smithi103.stdout: "put": 227, 2024-08-02T19:00:03.799 INFO:teuthology.orchestra.run.smithi103.stdout: "put_sum": 1549855, 2024-08-02T19:00:03.800 INFO:teuthology.orchestra.run.smithi103.stdout: "wait": { 2024-08-02T19:00:03.800 INFO:teuthology.orchestra.run.smithi103.stdout: "avgcount": 0, 2024-08-02T19:00:03.800 INFO:teuthology.orchestra.run.smithi103.stdout: "sum": 0.000000000, 2024-08-02T19:00:03.800 INFO:teuthology.orchestra.run.smithi103.stdout: "avgtime": 0.000000000 2024-08-02T19:00:03.800 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T19:00:03.800 INFO:teuthology.orchestra.run.smithi103.stdout: } 2024-08-02T19:00:03.800 INFO:teuthology.orchestra.run.smithi103.stdout:} 2024-08-02T19:00:04.517 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.j 2024-08-02T19:00:04.517 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.j 2024-08-02T19:00:04.517 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.j 2024-08-02T19:00:04.518 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.j 2024-08-02T19:00:04.518 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.j 2024-08-02T19:00:04.518 DEBUG:tasks.check_counter:Getting stats from b 2024-08-02T19:00:04.518 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.b perf dump 2024-08-02T19:00:04.784 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T19:00:05.320 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 7836, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 7486, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 2570774, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 31185787, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 70, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.559745459, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.219973481, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.188276178, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.148052027, 2024-08-02T19:00:05.321 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 7485, 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 4.329257465, 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000578391 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2888, 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000482490, 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000167 2024-08-02T19:00:05.322 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 45360, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 1664 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 6851, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 6786, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 3899763, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 11458253, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 12, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.410990772, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.133223286, 2024-08-02T19:00:05.323 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.127402426, 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.142194008, 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 6784, 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 6.827813705, 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001006458 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 295, 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000061465, 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000208 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.324 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1796512, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 489728 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 32196, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 59781, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 12355727, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 46154372, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 19, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 7, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 2.255817168, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 1.032124027, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 1.593079009, 2024-08-02T19:00:05.325 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.248428150, 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 59779, 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 11.614572966, 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000194291 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 70410, 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.009472056, 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000134 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 8865200, 2024-08-02T19:00:05.326 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 27698496 2024-08-02T19:00:05.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.327 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-08-02T19:00:05.327 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-08-02T19:00:05.327 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-08-02T19:00:05.327 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.327 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-08-02T19:00:05.327 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-02T19:00:05.327 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3666, 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 11.455626211, 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.003124829 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 4892, 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.812225894, 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000166031 2024-08-02T19:00:05.328 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 13077, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 13068, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 13068, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 44.966752978, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.003440982 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 9, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-08-02T19:00:05.329 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 548, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 12, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 2, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 347, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 182, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 150, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 15, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 61, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 6099, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 3, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 4, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 4, 2024-08-02T19:00:05.330 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 13411, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 13367, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 1, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 2, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 0, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 14, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 5930, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 8, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 265, 2024-08-02T19:00:05.331 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 3700, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 4, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 234, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 6, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 3700, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 338, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 4, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 334, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 3362, 2024-08-02T19:00:05.332 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 9, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 1250, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 12224, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 7758, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 6218, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 28, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 4720 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-08-02T19:00:05.333 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 2, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 12, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 7, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 3021, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 3014, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-08-02T19:00:05.334 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 2, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 24, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 4, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 14, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 14, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.335 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 23352, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 22009, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 22009, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 1343, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 8938, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 36, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 34, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 34, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 2, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 1, 2024-08-02T19:00:05.336 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 10, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 51380266, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 54081085, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 0, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 908, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 24.029569123, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.026464283 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 0 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 32, 2024-08-02T19:00:05.337 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 8963, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 8931, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 37, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 752, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 715, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 347, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 11454, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 11107, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 4, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 8897, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 8893, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 95128, 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 231712 2024-08-02T19:00:05.338 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.339 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-08-02T19:00:05.339 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 14398, 2024-08-02T19:00:05.339 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 379, 2024-08-02T19:00:05.339 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 13077, 2024-08-02T19:00:05.339 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 49, 2024-08-02T19:00:05.339 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 765, 2024-08-02T19:00:05.339 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-08-02T19:00:05.339 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 8266, 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 13.501354298, 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001633360 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 129, 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.029789904, 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000230929 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.340 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 237, 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.634650850, 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002677851 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.341 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2, 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000164988, 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000082494 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-08-02T19:00:05.342 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.343 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 11, 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.001415660, 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000128696 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 623, 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 22.835994876, 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.036654887 2024-08-02T19:00:05.344 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 11, 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.610095217, 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.055463201 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.345 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1, 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000224105, 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000224105 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 749, 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.973548238, 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001299797 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2, 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.002114177, 2024-08-02T19:00:05.346 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001057088 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.347 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 190, 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 2.473251213, 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.013017111 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 5, 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.021531265, 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.004306253 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.348 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3, 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.193983541, 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.064661180 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.349 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-08-02T19:00:05.350 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 8, 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.020488000, 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.002561000 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.351 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2831, 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 3.668146646, 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001295707 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.352 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 2, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 6, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 4, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 2, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 74, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 37, 2024-08-02T19:00:05.353 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 610, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 360, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 360, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:05.354 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:05.355 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:05.356 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:05.356 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:05.356 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:05.356 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:05.356 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:05.356 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:05.356 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:05.357 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 343700, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 127, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 88, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 1, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:05.358 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 9416, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 190, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 407720, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 5210, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:05.359 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 20045, 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 59477207, 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 37, 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 20045, 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 20045, 2024-08-02T19:00:05.360 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1830.186713140, 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.091303901 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 20045, 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 33275 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 20045, 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 3739, 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 16306, 2024-08-02T19:00:05.361 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 155, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 8203, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 35, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 939, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 77, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 12, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 6445, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-08-02T19:00:05.362 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 3704, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 12455, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-08-02T19:00:05.363 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-08-02T19:00:05.364 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 98, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 17, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 12, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 12, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 1196, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 0, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 54 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-08-02T19:00:05.365 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 1, 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "osd-slow-ops": { 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 27 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 41, 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-08-02T19:00:05.366 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 10, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 5903, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 3014, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 46879, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 13415068, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 46879, 2024-08-02T19:00:05.367 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 46879, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 13415068, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:05.368 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 20045, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 59804293, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 20045, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 59804293, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.369 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 20045, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 20045, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 20045, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 20045, 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:05.370 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 3014, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 327086, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 3014, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:05.371 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 31, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 327086, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x55a6da37c960": { 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 60, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 23352, 2024-08-02T19:00:05.372 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 49886781, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 23352, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 908, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 49886721, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:05.373 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-02T19:00:05.472 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:05 smithi121 ceph-mon[37236]: pgmap v321: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-02T19:00:05.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:05 smithi151 ceph-mon[37155]: pgmap v321: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-02T19:00:05.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:05 smithi103 ceph-mon[32753]: pgmap v321: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 4.2 KiB/s rd, 0 B/s wr, 9 op/s 2024-08-02T19:00:06.175 INFO:tasks.check_counter:Daemon mds.b mds.exported=14 2024-08-02T19:00:06.175 INFO:tasks.check_counter:Daemon mds.b mds.imported=8 2024-08-02T19:00:06.175 INFO:tasks.check_counter:Daemon mds.b mds.root_rsnaps=6 2024-08-02T19:00:06.175 INFO:tasks.check_counter:Daemon mds.b mds_server.req_mksnap_latency.avgcount=11 2024-08-02T19:00:06.175 INFO:tasks.check_counter:Daemon mds.b mds_server.req_rmsnap_latency.avgcount=5 2024-08-02T19:00:06.175 DEBUG:tasks.check_counter:Getting stats from e 2024-08-02T19:00:06.176 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.e perf dump 2024-08-02T19:00:06.431 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T19:00:06.933 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-02T19:00:06.933 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:06.933 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 283, 2024-08-02T19:00:06.933 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 257, 2024-08-02T19:00:06.933 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 5871854, 2024-08-02T19:00:06.933 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 143104, 2024-08-02T19:00:06.933 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 6, 2024-08-02T19:00:06.933 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.048740349, 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.016274615, 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.044827824, 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000587565, 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 256, 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.016011053, 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000062543 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:06.934 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1669984, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 134512 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 658, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 820, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 12754647, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 645237, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 8, 2024-08-02T19:00:06.935 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.075678089, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.026537187, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.023693001, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.017443081, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 817, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.044078663, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000053951 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.936 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 436624 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1451, 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1451, 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 10492883, 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 460652, 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-08-02T19:00:06.937 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 4, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.151451249, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.050697092, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.042992178, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.044534525, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1450, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.066491413, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000045856 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.938 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 448 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-08-02T19:00:06.939 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3591, 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.101777461, 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000028342 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.940 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 0, 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 0, 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 0, 2024-08-02T19:00:06.941 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 4534, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 4534, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 4534, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 0, 2024-08-02T19:00:06.942 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 1, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 0, 2024-08-02T19:00:06.943 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-08-02T19:00:06.946 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-02T19:00:06.947 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 0 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-08-02T19:00:06.948 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-08-02T19:00:06.949 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-08-02T19:00:06.950 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 10763, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 0, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 15, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 2, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 4194304, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 31027844, 2024-08-02T19:00:06.951 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 31025756, 2024-08-02T19:00:06.952 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-08-02T19:00:06.952 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 10763 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 759, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 3862, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 3103, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 73, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 199, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 126, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 4534, 2024-08-02T19:00:06.953 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 5925, 2024-08-02T19:00:06.954 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 1391, 2024-08-02T19:00:06.954 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 0, 2024-08-02T19:00:06.954 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 0, 2024-08-02T19:00:06.954 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 0, 2024-08-02T19:00:06.954 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 61388, 2024-08-02T19:00:06.954 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 215328 2024-08-02T19:00:06.954 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 0, 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 0, 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 0, 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 0, 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 0, 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.955 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.956 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-08-02T19:00:06.956 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.956 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.956 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.956 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.956 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-08-02T19:00:06.956 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.957 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.957 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.957 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-08-02T19:00:06.957 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.957 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.957 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.957 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-08-02T19:00:06.958 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.959 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.960 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.962 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-08-02T19:00:06.962 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.962 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.962 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.962 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.962 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-08-02T19:00:06.962 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.963 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-08-02T19:00:06.964 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.965 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.966 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-08-02T19:00:06.967 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.968 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.969 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 2, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 4, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 2, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 4, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 0, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 0, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 3351, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-08-02T19:00:06.970 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:06.971 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:06.972 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 243943, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 863, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-08-02T19:00:06.973 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 9416, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 190, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-08-02T19:00:06.974 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 5157677, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 55988, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 2130, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 21, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 3, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 2130, 2024-08-02T19:00:06.975 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2130, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 1.874975124, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000880270 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2130, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 2131 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 2130, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 2130, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 0, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-08-02T19:00:06.976 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 1361, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 767, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-08-02T19:00:06.977 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 1, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-08-02T19:00:06.978 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-08-02T19:00:06.979 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 98, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 11, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 8, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 8, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 0, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 2, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 0 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-08-02T19:00:06.980 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 0, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "osd-slow-ops": { 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 0, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 0, 2024-08-02T19:00:06.981 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 0, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 0, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 2388, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 28888397, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 2388, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:06.982 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2388, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 28888397, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:06.983 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 2130, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 26836802, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2130, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 26836802, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.984 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 2130, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 2130, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2130, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 2130, 2024-08-02T19:00:06.985 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:06.986 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x558b00c44b40": { 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:06.987 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:06.988 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.989 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:06.989 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-02T19:00:07.500 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:07 smithi121 ceph-mon[37236]: pgmap v322: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-08-02T19:00:07.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:07 smithi151 ceph-mon[37155]: pgmap v322: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-08-02T19:00:07.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:07 smithi103 ceph-mon[32753]: pgmap v322: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 44 KiB/s wr, 29 op/s 2024-08-02T19:00:07.774 INFO:tasks.check_counter:Daemon mds.e mds.exported=0 2024-08-02T19:00:07.774 INFO:tasks.check_counter:Daemon mds.e mds.imported=0 2024-08-02T19:00:07.774 INFO:tasks.check_counter:Daemon mds.e mds.root_rsnaps=0 2024-08-02T19:00:07.775 INFO:tasks.check_counter:Daemon mds.e mds_server.req_mksnap_latency.avgcount=0 2024-08-02T19:00:07.775 INFO:tasks.check_counter:Daemon mds.e mds_server.req_rmsnap_latency.avgcount=0 2024-08-02T19:00:07.775 DEBUG:tasks.check_counter:Getting stats from h 2024-08-02T19:00:07.776 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.h perf dump 2024-08-02T19:00:08.030 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T19:00:08.416 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:08 smithi121 ceph-mon[37236]: osdmap e99: 12 total, 12 up, 12 in 2024-08-02T19:00:08.525 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-02T19:00:08.525 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:08.525 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 1761, 2024-08-02T19:00:08.525 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 1733, 2024-08-02T19:00:08.525 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 23086131, 2024-08-02T19:00:08.525 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 611338, 2024-08-02T19:00:08.525 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 6, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 2, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.188962824, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.065323230, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.085506317, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.040551456, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 1733, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.070156388, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000040482 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:08.526 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1673904, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 134016 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 581, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 741, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 20683521, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 620460, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 8, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:08.527 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.065199373, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.022980211, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.022934382, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.013615619, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 738, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.035175100, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000047662 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.528 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 436272 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 249, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 251, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 8453194, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 79189, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 4, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.026201529, 2024-08-02T19:00:08.529 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.005933130, 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.010708705, 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.007529855, 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 249, 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.009646201, 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000038739 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.530 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 1, 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-MDSRank": { 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 3856, 2024-08-02T19:00:08.531 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.122703779, 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000031821 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: "finisher-PurgeQueue": { 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: "queue_len": 0, 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: "complete_latency": { 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.532 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "mds": { 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "request": 0, 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "reply": 0, 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "reply_latency": { 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_reply": 0, 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "forward": 0, 2024-08-02T19:00:08.533 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_complete": 0, 2024-08-02T19:00:08.534 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_fetch_keys": 0, 2024-08-02T19:00:08.534 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_commit": 0, 2024-08-02T19:00:08.534 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_split": 0, 2024-08-02T19:00:08.534 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_merge": 0, 2024-08-02T19:00:08.534 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes": 3553, 2024-08-02T19:00:08.534 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_top": 1902, 2024-08-02T19:00:08.534 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_bottom": 1651, 2024-08-02T19:00:08.534 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pin_tail": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_pinned": 835, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_expired": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "inodes_with_caps": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "caps": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "subtrees": 2, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_hit": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_forward": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_discover": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_dir_fetch": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_remote_ino": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "traverse_lock": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "load_cent": 0, 2024-08-02T19:00:08.535 INFO:teuthology.orchestra.run.smithi121.stdout: "q": 0, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "exported": 0, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "exported_inodes": 0, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "imported": 0, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "imported_inodes": 0, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_dir_fetch": 0, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_backtrace_fetch": 0, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "openino_peer_discover": 0, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rfiles": 4, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rbytes": 234, 2024-08-02T19:00:08.536 INFO:teuthology.orchestra.run.smithi121.stdout: "root_rsnaps": 6, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_fetch": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_set_tag": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_backtrace_repaired": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_inotable_repaired": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_inodes": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dir_base_inodes": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_dirfrag_rstats": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "scrub_file_inodes": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_inode_file_caps": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_revoke": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_grant": 0, 2024-08-02T19:00:08.537 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_trunc": 0, 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps": 0, 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_caps_dirty": 0, 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_cap_release": 0, 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "process_request_cap_release": 0 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_cache": { 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update": 0, 2024-08-02T19:00:08.538 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_update_receipt": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_try_discover": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_send_discover": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "dir_handle_discover": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_delayed": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "num_strays_enqueuing": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_created": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_enqueued": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_reintegrated": 0, 2024-08-02T19:00:08.539 INFO:teuthology.orchestra.run.smithi121.stdout: "strays_migrated": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_processing": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_enqueued": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "num_recovering_prioritized": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_started": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "recovery_completed": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_path": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_quiesce_inode": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_enqueue_scrub": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_exportdir": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_flush": 0, 2024-08-02T19:00:08.540 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragmentdir": 0, 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_fragstats": 0, 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "ireq_inodestats": 0 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_log": { 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "evlrg": 0, 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "evadd": 0, 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "evex": 0, 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "evtrm": 0, 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "ev": 23352, 2024-08-02T19:00:08.541 INFO:teuthology.orchestra.run.smithi121.stdout: "evexg": 0, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "evexd": 0, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "segadd": 0, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "segex": 0, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "segtrm": 0, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "seg": 2, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "segmjr": 13, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "segexg": 0, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "segexd": 0, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "expos": 51380266, 2024-08-02T19:00:08.542 INFO:teuthology.orchestra.run.smithi121.stdout: "wrpos": 54081085, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "rdpos": 54081025, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "jlat": { 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "replayed": 23352 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_mem": { 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "ino": 67, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "ino+": 8939, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "ino-": 8872, 2024-08-02T19:00:08.543 INFO:teuthology.orchestra.run.smithi121.stdout: "dir": 31, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "dir+": 731, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "dir-": 700, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "dn": 3553, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "dn+": 11359, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "dn-": 7806, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "cap": 0, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "cap+": 0, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "cap-": 0, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "rss": 62804, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "heap": 215328 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_server": { 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_client_request": 0, 2024-08-02T19:00:08.544 INFO:teuthology.orchestra.run.smithi121.stdout: "dispatch_server_request": 0, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_request": 0, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_client_session": 0, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "handle_peer_request": 0, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "req_create_latency": { 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getattr_latency": { 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.545 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getfilelock_latency": { 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "req_link_latency": { 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookup_latency": { 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.546 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookuphash_latency": { 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupino_latency": { 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupname_latency": { 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.547 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupparent_latency": { 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lookupsnap_latency": { 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "req_lssnap_latency": { 2024-08-02T19:00:08.548 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mkdir_latency": { 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mknod_latency": { 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.549 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "req_mksnap_latency": { 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "req_open_latency": { 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "req_readdir_latency": { 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.550 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rename_latency": { 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "req_renamesnap_latency": { 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.551 INFO:teuthology.orchestra.run.smithi121.stdout: "req_snapdiff_latency": { 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmdir_latency": { 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmsnap_latency": { 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.552 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "req_rmxattr_latency": { 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setattr_latency": { 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setdirlayout_latency": { 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.553 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setfilelock_latency": { 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setlayout_latency": { 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.554 INFO:teuthology.orchestra.run.smithi121.stdout: "req_setxattr_latency": { 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "req_symlink_latency": { 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "req_unlink_latency": { 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.555 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_revoke_eviction": 0, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "cap_acquisition_throttle": 0, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "req_getvxattr_latency": { 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_sessions": { 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "session_count": 2, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "session_add": 6, 2024-08-02T19:00:08.556 INFO:teuthology.orchestra.run.smithi121.stdout: "session_remove": 4, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_open": 4, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "sessions_stale": 0, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "total_load": 0, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "average_load": 0, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "avg_session_uptime": 3349, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "mdthresh_evicted": 0 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:08.557 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:08.558 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:08.559 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 216381, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 118, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:08.560 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:08.561 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 9416, 2024-08-02T19:00:08.561 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 190, 2024-08-02T19:00:08.561 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:08.561 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:08.561 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:08.561 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 2717631, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 18106, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "objecter": { 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "op_active": 0, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "op_laggy": 0, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send": 2329, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "op_send_bytes": 26, 2024-08-02T19:00:08.562 INFO:teuthology.orchestra.run.smithi121.stdout: "op_resend": 4, 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: "op_reply": 2329, 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: "op_latency": { 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2329, 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 2.808962755, 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.001206081 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: "op_inflight": 0, 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: "oplen_avg": { 2024-08-02T19:00:08.563 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 2329, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 2330 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "op": 2329, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "op_r": 2329, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "op_w": 0, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "op_rmw": 0, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "op_pg": 0, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_stat": 1485, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_create": 0, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_read": 841, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_write": 0, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writefull": 0, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_writesame": 0, 2024-08-02T19:00:08.564 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_append": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_zero": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_truncate": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_delete": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_mapext": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_sparse_read": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_clonerange": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_getxattr": 2, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_setxattr": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_cmpxattr": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_rmxattr": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_resetxattrs": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_call": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_watch": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_notify": 0, 2024-08-02T19:00:08.565 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_src_cmpxattr": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_pgls_filter": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "osdop_other": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_active": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_send": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_resend": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "linger_ping": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_active": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_send": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "poolop_resend": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_active": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_send": 0, 2024-08-02T19:00:08.566 INFO:teuthology.orchestra.run.smithi121.stdout: "poolstat_resend": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_active": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_send": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "statfs_resend": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "command_active": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "command_send": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "command_resend": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "map_epoch": 99, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "map_full": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "map_inc": 12, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_sessions": 8, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_open": 8, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_session_close": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_laggy": 0, 2024-08-02T19:00:08.567 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_wr": 0, 2024-08-02T19:00:08.568 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_rd": 2, 2024-08-02T19:00:08.568 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_del": 0 2024-08-02T19:00:08.568 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.568 INFO:teuthology.orchestra.run.smithi121.stdout: "oft": { 2024-08-02T19:00:08.568 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_objs": 0, 2024-08-02T19:00:08.568 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_kv_pairs": 0, 2024-08-02T19:00:08.568 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_updates": 0, 2024-08-02T19:00:08.568 INFO:teuthology.orchestra.run.smithi121.stdout: "omap_total_removes": 0 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "osd-slow-ops": { 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "slow_ops_count": 0 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "purge_queue": { 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops": 0, 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_ops_high_water": 0, 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing": 0, 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executing_high_water": 0, 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed_ops": 0, 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_executed": 0, 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: "pq_item_in_journal": 0 2024-08-02T19:00:08.569 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 2587, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 51973957, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 2587, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:08.570 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2587, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 51973957, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_bytes": { 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:08.571 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 2329, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 49896878, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2329, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 49896878, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.572 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-objecter_ops": { 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 1024, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:08.573 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 2329, 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 2329, 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 2329, 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 2329, 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle": { 2024-08-02T19:00:08.574 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-08-02T19:00:08.575 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-write_buf_throttle-0x55a7f071eb40": { 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:08.576 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 3758096384, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 0, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 0, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 0, 2024-08-02T19:00:08.577 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 0, 2024-08-02T19:00:08.578 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:08.578 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:08.578 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:08.578 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:08.578 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.578 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:08.578 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-02T19:00:08.582 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:08 smithi103 ceph-mon[32753]: osdmap e99: 12 total, 12 up, 12 in 2024-08-02T19:00:08.582 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:08 smithi151 ceph-mon[37155]: osdmap e99: 12 total, 12 up, 12 in 2024-08-02T19:00:09.260 INFO:tasks.check_counter:Daemon mds.h mds.exported=0 2024-08-02T19:00:09.260 INFO:tasks.check_counter:Daemon mds.h mds.imported=0 2024-08-02T19:00:09.260 INFO:tasks.check_counter:Daemon mds.h mds.root_rsnaps=6 2024-08-02T19:00:09.260 INFO:tasks.check_counter:Daemon mds.h mds_server.req_mksnap_latency.avgcount=0 2024-08-02T19:00:09.260 INFO:tasks.check_counter:Daemon mds.h mds_server.req_rmsnap_latency.avgcount=0 2024-08-02T19:00:09.260 DEBUG:tasks.check_counter:Getting stats from k 2024-08-02T19:00:09.261 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.k perf dump 2024-08-02T19:00:09.502 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:09 smithi121 ceph-mon[37236]: pgmap v324: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:09.518 INFO:teuthology.orchestra.run.smithi121.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.b/config 2024-08-02T19:00:09.571 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:09 smithi151 ceph-mon[37155]: pgmap v324: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:09.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:09 smithi103 ceph-mon[32753]: pgmap v324: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout:{ 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 0, 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 2, 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 0, 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 0, 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 4, 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 0, 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.001013668, 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.000000000, 2024-08-02T19:00:10.077 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.000217997, 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.078 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 0 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 231, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 218, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 1585104, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 133472, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 2, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 1, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.043642499, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.015413818, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.041224850, 2024-08-02T19:00:10.079 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 218, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.017109983, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000078486 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 1585104, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 133472 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.080 INFO:teuthology.orchestra.run.smithi121.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_messages": 2, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages": 167, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_bytes": 320, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_bytes": 185888, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_created_connections": 5, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_active_connections": 3, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_total_time": 0.011073153, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_send_time": 0.007468386, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_recv_time": 0.001301423, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 164, 2024-08-02T19:00:10.081 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.014849638, 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000090546 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "msgr_send_encrypted_bytes": 185888 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "cct": { 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "total_workers": 0, 2024-08-02T19:00:10.082 INFO:teuthology.orchestra.run.smithi121.stdout: "unhealthy_workers": 0 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "mempool": { 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:10.083 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:10.084 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_items": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:10.085 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_bytes": 148731, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_anon_items": 31, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_bytes": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "buffer_meta_items": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_bytes": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_items": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_bytes": 0, 2024-08-02T19:00:10.086 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_items": 0, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "pgmap_items": 0, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_bytes": 928, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "mds_co_items": 2, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_1_items": 0, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "unittest_2_items": 0 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: }, 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:10.087 INFO:teuthology.orchestra.run.smithi121.stdout: "val": 0, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "max": 104857600, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "get_started": 0, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "get": 229, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "get_sum": 1550115, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "get_or_fail_success": 229, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "take": 0, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "take_sum": 0, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "put": 229, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "put_sum": 1550115, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "wait": { 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "avgcount": 0, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "sum": 0.000000000, 2024-08-02T19:00:10.088 INFO:teuthology.orchestra.run.smithi121.stdout: "avgtime": 0.000000000 2024-08-02T19:00:10.089 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:10.089 INFO:teuthology.orchestra.run.smithi121.stdout: } 2024-08-02T19:00:10.089 INFO:teuthology.orchestra.run.smithi121.stdout:} 2024-08-02T19:00:10.776 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.k 2024-08-02T19:00:10.776 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.k 2024-08-02T19:00:10.776 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.k 2024-08-02T19:00:10.777 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.k 2024-08-02T19:00:10.777 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.k 2024-08-02T19:00:10.777 DEBUG:tasks.check_counter:Getting stats from c 2024-08-02T19:00:10.777 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.c perf dump 2024-08-02T19:00:11.047 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T19:00:11.459 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:11 smithi151 ceph-mon[37155]: pgmap v325: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:11.562 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-08-02T19:00:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 10245, 2024-08-02T19:00:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 19941, 2024-08-02T19:00:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 5358735, 2024-08-02T19:00:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 16278935, 2024-08-02T19:00:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 14, 2024-08-02T19:00:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:11.563 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.790279000, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.354119328, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.502616347, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.067710393, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 19938, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.602266071, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000080362 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 20505, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.003730435, 2024-08-02T19:00:11.564 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000181 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 4812704, 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 8882416 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 2960, 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 2920, 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 855298, 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 14137405, 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 16, 2024-08-02T19:00:11.565 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 5, 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.273475515, 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.118166397, 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.064767074, 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.072637686, 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2920, 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.246761357, 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000084507 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.566 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 609, 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000097111, 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000159 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 6720, 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 130128 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 3251, 2024-08-02T19:00:11.567 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 3645, 2024-08-02T19:00:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 3363716, 2024-08-02T19:00:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 3317480, 2024-08-02T19:00:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 14, 2024-08-02T19:00:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.273503333, 2024-08-02T19:00:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.103954231, 2024-08-02T19:00:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.104393700, 2024-08-02T19:00:11.568 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.056679814, 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3643, 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.328633187, 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000090209 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2770, 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000505430, 2024-08-02T19:00:11.569 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000182 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 160, 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 313824 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-08-02T19:00:11.570 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 536, 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4.561944308, 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.008511090 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-08-02T19:00:11.571 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4984, 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.882079895, 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000176982 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 4487, 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 4485, 2024-08-02T19:00:11.572 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-08-02T19:00:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4485, 2024-08-02T19:00:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 8.349772018, 2024-08-02T19:00:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001861710 2024-08-02T19:00:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-08-02T19:00:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 2, 2024-08-02T19:00:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-08-02T19:00:11.573 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 19, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 1, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 1831, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 2, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 1829, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 1829, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 226, 2024-08-02T19:00:11.574 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 1, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 1, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 3, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 4959, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 4662, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 1, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 5, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 5, 2024-08-02T19:00:11.575 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 209, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 11, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 2052, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 141, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 3140, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 19146797, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 3, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 141, 2024-08-02T19:00:11.576 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 141, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 2, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 255, 2024-08-02T19:00:11.577 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 4431, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 3289, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 2111, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 25, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 3420 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-08-02T19:00:11.578 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 7, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 2, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 50, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 3094, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 3044, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-08-02T19:00:11.579 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 2, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 10, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 5, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 1, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-08-02T19:00:11.580 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 10763, 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 10763, 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-08-02T19:00:11.581 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 15, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 15, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 2, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 31027844, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-08-02T19:00:11.582 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 206, 2024-08-02T19:00:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.153825277, 2024-08-02T19:00:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.005601093 2024-08-02T19:00:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-08-02T19:00:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-08-02T19:00:11.583 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 768, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 3860, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 3092, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 83, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 198, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 115, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 1831, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 5928, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 4097, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 1, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 3099, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 3098, 2024-08-02T19:00:11.584 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 83380, 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223520 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 5173, 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 112, 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 4487, 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 26, 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 513, 2024-08-02T19:00:11.585 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1116, 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.049338319, 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000940267 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2, 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001137586, 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000568793 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.586 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 170, 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.048467129, 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000285100 2024-08-02T19:00:11.587 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.588 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.589 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-08-02T19:00:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.590 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-08-02T19:00:11.591 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:11 smithi103 ceph-mon[32753]: pgmap v325: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-08-02T19:00:11.592 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.593 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.594 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 102, 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.066168116, 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000648707 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.595 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-08-02T19:00:11.596 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 113, 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 2.168096812, 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.019186697 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-08-02T19:00:11.597 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1, 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.438220908, 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.438220908 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.598 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-08-02T19:00:11.599 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.600 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2981, 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4.578343148, 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001535841 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.601 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-08-02T19:00:11.602 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 2, 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 4, 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 2, 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 2, 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 3332, 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 1666, 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 620, 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-08-02T19:00:11.603 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:11.604 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:11.605 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:11.606 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 718131, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 958, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 352, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 4, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-08-02T19:00:11.607 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 9656, 2024-08-02T19:00:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 196, 2024-08-02T19:00:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:11.608 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-08-02T19:00:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 3351322, 2024-08-02T19:00:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 52891, 2024-08-02T19:00:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-08-02T19:00:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:11.609 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-08-02T19:00:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-08-02T19:00:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-08-02T19:00:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-08-02T19:00:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 6605, 2024-08-02T19:00:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 27874785, 2024-08-02T19:00:11.610 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 33, 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 6605, 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 6605, 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 46.536453371, 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.007045640 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-08-02T19:00:11.611 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 6605, 2024-08-02T19:00:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 6672 2024-08-02T19:00:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 6605, 2024-08-02T19:00:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 184, 2024-08-02T19:00:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 6421, 2024-08-02T19:00:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-08-02T19:00:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-08-02T19:00:11.612 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 0, 2024-08-02T19:00:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 10, 2024-08-02T19:00:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 43, 2024-08-02T19:00:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 249, 2024-08-02T19:00:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 29, 2024-08-02T19:00:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-08-02T19:00:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-08-02T19:00:11.613 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-08-02T19:00:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 1, 2024-08-02T19:00:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 6083, 2024-08-02T19:00:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-08-02T19:00:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-08-02T19:00:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-08-02T19:00:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 141, 2024-08-02T19:00:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 20, 2024-08-02T19:00:11.614 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-08-02T19:00:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-08-02T19:00:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-08-02T19:00:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-08-02T19:00:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-08-02T19:00:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-08-02T19:00:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-08-02T19:00:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-08-02T19:00:11.615 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-08-02T19:00:11.616 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-08-02T19:00:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-08-02T19:00:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-08-02T19:00:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-08-02T19:00:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-08-02T19:00:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-08-02T19:00:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-08-02T19:00:11.617 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 99, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 12, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 12, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 12, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 80, 2024-08-02T19:00:11.618 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 0, 2024-08-02T19:00:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 16 2024-08-02T19:00:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-08-02T19:00:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-08-02T19:00:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-08-02T19:00:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-08-02T19:00:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-08-02T19:00:11.619 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 12 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 23, 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 10, 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 6065, 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 3044, 2024-08-02T19:00:11.620 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-08-02T19:00:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-08-02T19:00:11.621 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 16452, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 7690352, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 16452, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 16452, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 7690352, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.622 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:11.623 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 6605, 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 28211709, 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 6605, 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 28211709, 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.624 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-08-02T19:00:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-08-02T19:00:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-08-02T19:00:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-08-02T19:00:11.625 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 6605, 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 6605, 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 6605, 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 6605, 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.626 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 3044, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 336924, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 3044, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:11.627 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 43, 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 336924, 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:11.628 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x564b1675c960": { 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 10763, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 26833540, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 10763, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 206, 2024-08-02T19:00:11.629 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 26833540, 2024-08-02T19:00:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.630 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:11.630 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-08-02T19:00:11.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:11 smithi121 ceph-mon[37236]: pgmap v325: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 15 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:12.428 INFO:tasks.check_counter:Daemon mds.c mds.exported=5 2024-08-02T19:00:12.428 INFO:tasks.check_counter:Daemon mds.c mds.imported=11 2024-08-02T19:00:12.428 INFO:tasks.check_counter:Daemon mds.c mds.root_rsnaps=3 2024-08-02T19:00:12.428 INFO:tasks.check_counter:Daemon mds.c mds_server.req_mksnap_latency.avgcount=0 2024-08-02T19:00:12.428 INFO:tasks.check_counter:Daemon mds.c mds_server.req_rmsnap_latency.avgcount=0 2024-08-02T19:00:12.428 DEBUG:tasks.check_counter:Getting stats from f 2024-08-02T19:00:12.429 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.f perf dump 2024-08-02T19:00:12.685 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T19:00:13.239 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-08-02T19:00:13.239 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:13.239 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 1156, 2024-08-02T19:00:13.239 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 1156, 2024-08-02T19:00:13.239 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 25524932, 2024-08-02T19:00:13.239 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 366791, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 7, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.130293884, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.037879970, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.042165835, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.039323566, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1155, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.057682338, 2024-08-02T19:00:13.240 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000049941 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 2992, 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 448 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:13.241 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 553, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 715, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 16925322, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 613520, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 8, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.075021508, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.023885995, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.026550710, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.017205224, 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:13.242 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 712, 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.042378058, 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000059519 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 438240 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.243 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 750, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 724, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 8790423, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 291462, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.095147095, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.029660169, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.060370022, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.015003298, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 723, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.033193190, 2024-08-02T19:00:13.244 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000045910 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1671296, 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 134688 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-08-02T19:00:13.245 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 3454, 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.108844078, 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000031512 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.246 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 0, 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 0, 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.247 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 0, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 0, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 0, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 0, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 6382, 2024-08-02T19:00:13.248 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 6382, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 6382, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 1, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-08-02T19:00:13.249 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 0, 2024-08-02T19:00:13.250 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-02T19:00:13.251 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 0 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-08-02T19:00:13.252 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 0, 2024-08-02T19:00:13.253 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 20694, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-08-02T19:00:13.254 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 0, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 29, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 3, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 53126360, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 53124272, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.255 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 20694 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 221, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 5911, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 5690, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 33, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 382, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 349, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 6382, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 9863, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 3481, 2024-08-02T19:00:13.256 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 0, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 0, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 66096, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 215328 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 0, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 0, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 0, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 0, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 0, 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-08-02T19:00:13.257 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.258 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.259 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.260 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.261 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.262 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-08-02T19:00:13.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.262 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.262 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.262 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.263 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.264 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.265 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.266 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.267 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.268 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-08-02T19:00:13.269 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-08-02T19:00:13.270 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 2, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 4, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 2, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 3, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 0, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 0, 2024-08-02T19:00:13.271 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 2573, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:13.272 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:13.273 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:13.274 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 222231, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 276, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 9656, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 196, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:13.275 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 5081431, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 38804, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 2196, 2024-08-02T19:00:13.276 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 21, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 3, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 2196, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2196, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 3.185962594, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001450802 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 2196, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 2197 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 2196, 2024-08-02T19:00:13.277 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 2196, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 1417, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 777, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 0, 2024-08-02T19:00:13.278 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 0, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 1, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 0, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-08-02T19:00:13.279 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-08-02T19:00:13.280 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-08-02T19:00:13.282 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-08-02T19:00:13.282 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-08-02T19:00:13.282 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-08-02T19:00:13.282 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-08-02T19:00:13.282 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-08-02T19:00:13.282 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-08-02T19:00:13.282 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 99, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 12, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 8, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 8, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 0, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 2, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 0 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.283 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 0, 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 0 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 0, 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-08-02T19:00:13.284 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 0, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 0, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 0, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 2455, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 51003610, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 2455, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:13.285 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 2455, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 51003610, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:13.286 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 2196, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 48939377, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 2196, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 48939377, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.287 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 2196, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 2196, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 2196, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 2196, 2024-08-02T19:00:13.288 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:13.289 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.289 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.289 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.289 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.289 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.289 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-08-02T19:00:13.289 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:13.289 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-08-02T19:00:13.290 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x563384556b40": { 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:13.291 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 0, 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 0, 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:13.292 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-08-02T19:00:13.552 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:13 smithi151 ceph-mon[37155]: pgmap v326: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:13.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:13 smithi103 ceph-mon[32753]: pgmap v326: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:13.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:13 smithi121 ceph-mon[37236]: pgmap v326: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:14.066 INFO:tasks.check_counter:Daemon mds.f mds.exported=0 2024-08-02T19:00:14.066 INFO:tasks.check_counter:Daemon mds.f mds.imported=0 2024-08-02T19:00:14.066 INFO:tasks.check_counter:Daemon mds.f mds.root_rsnaps=0 2024-08-02T19:00:14.067 INFO:tasks.check_counter:Daemon mds.f mds_server.req_mksnap_latency.avgcount=0 2024-08-02T19:00:14.067 INFO:tasks.check_counter:Daemon mds.f mds_server.req_rmsnap_latency.avgcount=0 2024-08-02T19:00:14.067 DEBUG:tasks.check_counter:Getting stats from i 2024-08-02T19:00:14.067 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.i perf dump 2024-08-02T19:00:14.321 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T19:00:14.845 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-08-02T19:00:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:14.845 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 5312, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 6270, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 5514288, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 25399223, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 11, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 4, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.461881142, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.177362001, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.154199498, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.112226923, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 6268, 2024-08-02T19:00:14.846 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.657248527, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000104857 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 4173, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000816901, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000195 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1728, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 5872 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 16834, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 34404, 2024-08-02T19:00:14.847 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 7920695, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 24021510, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 10, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 1.284188493, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.627416467, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 1.045948202, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.081401203, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 34403, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.867473234, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000054282 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.848 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 37467, 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.005603768, 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000149 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 7335456, 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 16086080 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 6296, 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 6410, 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 2324755, 2024-08-02T19:00:14.849 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 12718751, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 23, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 6, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.513118555, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.187757649, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.124007328, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.161003549, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 6408, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.625268605, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000097576 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:14.850 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 610, 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000098280, 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000161 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 5808, 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 130528 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 1, 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.851 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-MDSRank": { 2024-08-02T19:00:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-08-02T19:00:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-08-02T19:00:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 999, 2024-08-02T19:00:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 8.172991312, 2024-08-02T19:00:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.008181172 2024-08-02T19:00:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.852 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "finisher-PurgeQueue": { 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "queue_len": 0, 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "complete_latency": { 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 8885, 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.660861330, 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000186928 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "mds": { 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "request": 7750, 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "reply": 7749, 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "reply_latency": { 2024-08-02T19:00:14.853 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 7749, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 14.555656838, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001878391 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_reply": 0, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "forward": 1, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_complete": 0, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_fetch_keys": 0, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_commit": 20, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_split": 1, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_merge": 1, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes": 671, 2024-08-02T19:00:14.854 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_top": 174, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_bottom": 482, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pin_tail": 15, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_pinned": 418, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_expired": 239, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "inodes_with_caps": 0, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "caps": 0, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "subtrees": 4, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse": 8206, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_hit": 7885, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_forward": 0, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_discover": 5, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_dir_fetch": 0, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_remote_ino": 0, 2024-08-02T19:00:14.855 INFO:teuthology.orchestra.run.smithi151.stdout: "traverse_lock": 0, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "load_cent": 0, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "q": 0, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "exported": 4, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "exported_inodes": 130, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "imported": 4, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "imported_inodes": 3952, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_dir_fetch": 0, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_backtrace_fetch": 232, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "openino_peer_discover": 1, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rfiles": 3140, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rbytes": 19146797, 2024-08-02T19:00:14.856 INFO:teuthology.orchestra.run.smithi151.stdout: "root_rsnaps": 3, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_fetch": 232, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_set_tag": 0, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_backtrace_repaired": 0, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_inotable_repaired": 0, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_inodes": 3, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dir_base_inodes": 0, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_dirfrag_rstats": 3, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "scrub_file_inodes": 229, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_inode_file_caps": 2, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_revoke": 703, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_grant": 7957, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_trunc": 0, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flushsnap_ack": 0, 2024-08-02T19:00:14.857 INFO:teuthology.orchestra.run.smithi151.stdout: "ceph_cap_op_flush_ack": 0, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps": 6405, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_caps_dirty": 3962, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_cap_release": 56, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "process_request_cap_release": 6018 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_cache": { 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update": 0, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_update_receipt": 0, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_try_discover": 0, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_send_discover": 6, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "dir_handle_discover": 1, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays": 15, 2024-08-02T19:00:14.858 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_delayed": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "num_strays_enqueuing": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_created": 5646, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_enqueued": 5631, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_reintegrated": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "strays_migrated": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_processing": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_enqueued": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "num_recovering_prioritized": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_started": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "recovery_completed": 0, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_path": 2, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_quiesce_inode": 4, 2024-08-02T19:00:14.859 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_enqueue_scrub": 0, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_exportdir": 4, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_flush": 0, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragmentdir": 2, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_fragstats": 0, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "ireq_inodestats": 0 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_log": { 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "evlrg": 2, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "evadd": 20694, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "evex": 0, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "evtrm": 0, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "ev": 20694, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "evexg": 0, 2024-08-02T19:00:14.860 INFO:teuthology.orchestra.run.smithi151.stdout: "evexd": 0, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "segadd": 29, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "segex": 0, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "segtrm": 0, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "seg": 29, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "segmjr": 3, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "segexg": 0, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "segexd": 0, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "expos": 4194304, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "wrpos": 53126360, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "rdpos": 0, 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "jlat": { 2024-08-02T19:00:14.861 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 421, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4.613474444, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.010958371 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "replayed": 0 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_mem": { 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "ino": 230, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "ino+": 5905, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "ino-": 5675, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "dir": 43, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "dir+": 378, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "dir-": 335, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "dn": 671, 2024-08-02T19:00:14.862 INFO:teuthology.orchestra.run.smithi151.stdout: "dn+": 9863, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "dn-": 9192, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "cap": 0, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "cap+": 5657, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "cap-": 5657, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "rss": 89936, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "heap": 223520 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_server": { 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_client_request": 9370, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "dispatch_server_request": 3, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_request": 7750, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_client_session": 26, 2024-08-02T19:00:14.863 INFO:teuthology.orchestra.run.smithi151.stdout: "handle_peer_request": 209, 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "req_create_latency": { 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1766, 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 1.712564683, 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000969742 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getattr_latency": { 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 1, 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.001081675, 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001081675 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getfilelock_latency": { 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.864 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "req_link_latency": { 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookup_latency": { 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 130, 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.041855093, 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000321962 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.865 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookuphash_latency": { 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupino_latency": { 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupname_latency": { 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.866 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupparent_latency": { 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lookupsnap_latency": { 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.867 INFO:teuthology.orchestra.run.smithi151.stdout: "req_lssnap_latency": { 2024-08-02T19:00:14.868 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.868 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.868 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.868 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mkdir_latency": { 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mknod_latency": { 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "req_mksnap_latency": { 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.869 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "req_open_latency": { 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "req_readdir_latency": { 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 206, 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.263558291, 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001279409 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.870 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rename_latency": { 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "req_renamesnap_latency": { 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "req_snapdiff_latency": { 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.871 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmdir_latency": { 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 314, 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 4.655406314, 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.014826134 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmsnap_latency": { 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "req_rmxattr_latency": { 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.872 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setattr_latency": { 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setdirlayout_latency": { 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.873 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setfilelock_latency": { 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setlayout_latency": { 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "req_setxattr_latency": { 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.874 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "req_symlink_latency": { 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "req_unlink_latency": { 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 5332, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 7.881190782, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.001478092 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_revoke_eviction": 0, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "cap_acquisition_throttle": 0, 2024-08-02T19:00:14.875 INFO:teuthology.orchestra.run.smithi151.stdout: "req_getvxattr_latency": { 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_sessions": { 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "session_count": 2, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "session_add": 4, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "session_remove": 2, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_open": 2, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "sessions_stale": 0, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "total_load": 5499, 2024-08-02T19:00:14.876 INFO:teuthology.orchestra.run.smithi151.stdout: "average_load": 2749, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "avg_session_uptime": 608, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "mdthresh_evicted": 0 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:14.877 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:14.878 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:14.879 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 330263, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 333, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 528, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 6, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 9656, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 196, 2024-08-02T19:00:14.880 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 1131406, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 18508, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "objecter": { 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "op_active": 0, 2024-08-02T19:00:14.881 INFO:teuthology.orchestra.run.smithi151.stdout: "op_laggy": 0, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send": 11912, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "op_send_bytes": 50554874, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "op_resend": 32, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "op_reply": 11912, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "op_latency": { 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 11912, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 57.497324758, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.004826840 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "op_inflight": 0, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "oplen_avg": { 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 11912, 2024-08-02T19:00:14.882 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 11999 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "op": 11912, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "op_r": 300, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "op_w": 11612, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "op_rmw": 0, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "op_pg": 0, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_stat": 0, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_create": 10, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_read": 68, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_write": 489, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writefull": 42, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_writesame": 0, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_append": 0, 2024-08-02T19:00:14.883 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_zero": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_truncate": 1, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_delete": 11010, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_mapext": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_sparse_read": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_clonerange": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_getxattr": 232, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_setxattr": 20, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_cmpxattr": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_rmxattr": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_resetxattrs": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_call": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_watch": 0, 2024-08-02T19:00:14.884 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_notify": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_src_cmpxattr": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_pgls_filter": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "osdop_other": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_active": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_send": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_resend": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "linger_ping": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_active": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_send": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "poolop_resend": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_active": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_send": 0, 2024-08-02T19:00:14.885 INFO:teuthology.orchestra.run.smithi151.stdout: "poolstat_resend": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_active": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_send": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "statfs_resend": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "command_active": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "command_send": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "command_resend": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "map_epoch": 99, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "map_full": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "map_inc": 12, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_sessions": 12, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_open": 12, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_session_close": 0, 2024-08-02T19:00:14.886 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_laggy": 0, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_wr": 100, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_rd": 0, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_del": 27 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "oft": { 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_objs": 1, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_kv_pairs": 0, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_updates": 0, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "omap_total_removes": 0 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "osd-slow-ops": { 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "slow_ops_count": 6 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.887 INFO:teuthology.orchestra.run.smithi151.stdout: "purge_queue": { 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops": 0, 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_ops_high_water": 23, 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing": 0, 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executing_high_water": 16, 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed_ops": 10979, 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_executed": 5631, 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: "pq_item_in_journal": 0 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.888 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 28438, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 12480448, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 28438, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 28438, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 12480448, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.889 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_bytes": { 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 11912, 2024-08-02T19:00:14.890 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 51168109, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 11912, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 51168109, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-objecter_ops": { 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 1024, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:14.891 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 0, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 0, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 0, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 11912, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 11912, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 11912, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 11912, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.892 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle": { 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 5631, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 613235, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 5631, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 68, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 613235, 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:14.893 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-write_buf_throttle-0x562aff536960": { 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 3758096384, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 20694, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 48932056, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 20694, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:14.894 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 421, 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 48932056, 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:14.895 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-08-02T19:00:15.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:15 smithi151 ceph-mon[37155]: pgmap v327: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:15.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:15 smithi103 ceph-mon[32753]: pgmap v327: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:15.647 INFO:tasks.check_counter:Daemon mds.i mds.exported=4 2024-08-02T19:00:15.647 INFO:tasks.check_counter:Daemon mds.i mds.imported=4 2024-08-02T19:00:15.647 INFO:tasks.check_counter:Daemon mds.i mds.root_rsnaps=3 2024-08-02T19:00:15.647 INFO:tasks.check_counter:Daemon mds.i mds_server.req_mksnap_latency.avgcount=0 2024-08-02T19:00:15.647 INFO:tasks.check_counter:Daemon mds.i mds_server.req_rmsnap_latency.avgcount=0 2024-08-02T19:00:15.647 DEBUG:tasks.check_counter:Getting stats from l 2024-08-02T19:00:15.648 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph daemon mds.l perf dump 2024-08-02T19:00:15.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:15 smithi121 ceph-mon[37236]: pgmap v327: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 16 KiB/s rd, 53 KiB/s wr, 28 op/s 2024-08-02T19:00:15.900 INFO:teuthology.orchestra.run.smithi151.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.c/config 2024-08-02T19:00:16.443 INFO:teuthology.orchestra.run.smithi151.stdout:{ 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-0": { 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 0, 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 2, 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 0, 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 0, 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 4, 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 0, 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.001157815, 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.000000000, 2024-08-02T19:00:16.444 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.000266439, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 0, 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 0 2024-08-02T19:00:16.445 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-1": { 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 234, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 221, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 1585920, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 135376, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 2, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 1, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.047487578, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.015945484, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.045314979, 2024-08-02T19:00:16.446 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 221, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.017319801, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000078370 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 1585920, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 135376 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.447 INFO:teuthology.orchestra.run.smithi151.stdout: "AsyncMessenger::Worker-2": { 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_messages": 2, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages": 168, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_bytes": 320, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_bytes": 186064, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_created_connections": 5, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_active_connections": 3, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_total_time": 0.011758068, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_send_time": 0.007989312, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_recv_time": 0.001290811, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_running_fast_dispatch_time": 0.000000000, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_messages_queue_lat": { 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 165, 2024-08-02T19:00:16.448 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.020218908, 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000122538 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_handle_ack_lat": { 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_recv_encrypted_bytes": 320, 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: "msgr_send_encrypted_bytes": 186064 2024-08-02T19:00:16.449 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "cct": { 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "total_workers": 0, 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "unhealthy_workers": 0 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "mempool": { 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_bytes": 0, 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "bloom_filter_items": 0, 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_bytes": 0, 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_alloc_items": 0, 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_bytes": 0, 2024-08-02T19:00:16.450 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_data_items": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_bytes": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_onode_items": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_bytes": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_meta_items": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_bytes": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_other_items": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_bytes": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_cache_buffer_items": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_bytes": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_extent_items": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_bytes": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_blob_items": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_bytes": 0, 2024-08-02T19:00:16.451 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_shared_blob_items": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_bytes": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_inline_bl_items": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_bytes": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_fsck_items": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_bytes": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_txc_items": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_bytes": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_deferred_items": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_bytes": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluestore_writing_items": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_bytes": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_items": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_bytes": 0, 2024-08-02T19:00:16.452 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_reader_items": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_bytes": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "bluefs_file_writer_items": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_bytes": 148761, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_anon_items": 31, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_bytes": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "buffer_meta_items": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_bytes": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_items": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_bytes": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_mapbl_items": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_bytes": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "osd_pglog_items": 0, 2024-08-02T19:00:16.453 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_bytes": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_items": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_bytes": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "osdmap_mapping_items": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_bytes": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "pgmap_items": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_bytes": 928, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "mds_co_items": 2, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_bytes": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_1_items": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_bytes": 0, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "unittest_2_items": 0 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: }, 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "throttle-msgr_dispatch_throttler-mds": { 2024-08-02T19:00:16.454 INFO:teuthology.orchestra.run.smithi151.stdout: "val": 0, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "max": 104857600, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "get_started": 0, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "get": 232, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "get_sum": 1550505, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_fail": 0, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "get_or_fail_success": 232, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "take": 0, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "take_sum": 0, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "put": 232, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "put_sum": 1550505, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "wait": { 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "avgcount": 0, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "sum": 0.000000000, 2024-08-02T19:00:16.455 INFO:teuthology.orchestra.run.smithi151.stdout: "avgtime": 0.000000000 2024-08-02T19:00:16.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:16.456 INFO:teuthology.orchestra.run.smithi151.stdout: } 2024-08-02T19:00:16.456 INFO:teuthology.orchestra.run.smithi151.stdout:} 2024-08-02T19:00:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:16 smithi151 ceph-mon[37155]: pgmap v328: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T19:00:17.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:16 smithi151 ceph-mon[37155]: osdmap e100: 12 total, 12 up, 12 in 2024-08-02T19:00:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:16 smithi103 ceph-mon[32753]: pgmap v328: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T19:00:17.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:16 smithi103 ceph-mon[32753]: osdmap e100: 12 total, 12 up, 12 in 2024-08-02T19:00:17.142 WARNING:tasks.check_counter:Counter 'mds.exported' not found on daemon mds.l 2024-08-02T19:00:17.142 WARNING:tasks.check_counter:Counter 'mds.imported' not found on daemon mds.l 2024-08-02T19:00:17.142 WARNING:tasks.check_counter:Counter 'mds.root_rsnaps' not found on daemon mds.l 2024-08-02T19:00:17.143 WARNING:tasks.check_counter:Counter 'mds_server.req_mksnap_latency.avgcount' not found on daemon mds.l 2024-08-02T19:00:17.143 WARNING:tasks.check_counter:Counter 'mds_server.req_rmsnap_latency.avgcount' not found on daemon mds.l 2024-08-02T19:00:17.143 DEBUG:teuthology.run_tasks:Unwinding manager kclient 2024-08-02T19:00:17.158 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-02T19:00:17.158 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T19:00:17.159 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-02T19:00:17.180 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T19:00:17.181 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-02T19:00:17.240 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd blocklist ls 2024-08-02T19:00:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:16 smithi121 ceph-mon[37236]: pgmap v328: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T19:00:17.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:16 smithi121 ceph-mon[37236]: osdmap e100: 12 total, 12 up, 12 in 2024-08-02T19:00:17.547 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:18.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 -- 172.21.15.103:0/3008275028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db410bed0 msgr2=0x7f6db410e340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:18.055 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 --2- 172.21.15.103:0/3008275028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db410bed0 0x7f6db410e340 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f6dac009ca0 tx=0x7f6dac02a950 comp rx=0 tx=0).stop 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 -- 172.21.15.103:0/3008275028 shutdown_connections 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 --2- 172.21.15.103:0/3008275028 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db410bed0 0x7f6db410e340 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 --2- 172.21.15.103:0/3008275028 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db4103410 0x7f6db410b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 --2- 172.21.15.103:0/3008275028 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6db4102af0 0x7f6db4102ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 -- 172.21.15.103:0/3008275028 >> 172.21.15.103:0/3008275028 conn(0x7f6db40fc4d0 msgr2=0x7f6db40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 -- 172.21.15.103:0/3008275028 shutdown_connections 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.041+0000 7f6dba817640 1 -- 172.21.15.103:0/3008275028 wait complete. 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6dba817640 1 Processor -- start 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6dba817640 1 -- start start 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6dba817640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db4102af0 0x7f6db4198190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:18.056 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6dba817640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db4103410 0x7f6db41986d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6dba817640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6db410bed0 0x7f6db419ca60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6dba817640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4111dd0 con 0x7f6db4103410 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6dba817640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4111c50 con 0x7f6db410bed0 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6dba817640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f6db4111f50 con 0x7f6db4102af0 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6db37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db4103410 0x7f6db41986d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6db37fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db4103410 0x7f6db41986d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:47890/0 (socket says 172.21.15.103:47890) 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.042+0000 7f6db37fe640 1 -- 172.21.15.103:0/584119759 learned_addr learned my addr 172.21.15.103:0/584119759 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db8db4640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6db410bed0 0x7f6db419ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db3fff640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db4102af0 0x7f6db4198190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:18.057 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db37fe640 1 -- 172.21.15.103:0/584119759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db4102af0 msgr2=0x7f6db4198190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db37fe640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db4102af0 0x7f6db4198190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db37fe640 1 -- 172.21.15.103:0/584119759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6db410bed0 msgr2=0x7f6db419ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db37fe640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6db410bed0 0x7f6db419ca60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db37fe640 1 -- 172.21.15.103:0/584119759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6db419d140 con 0x7f6db4103410 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db8db4640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6db410bed0 0x7f6db419ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db37fe640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db4103410 0x7f6db41986d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c970 tx=0x7f6da800ce30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db17fa640 1 -- 172.21.15.103:0/584119759 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da8007bb0 con 0x7f6db4103410 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db17fa640 1 -- 172.21.15.103:0/584119759 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f6da8007d50 con 0x7f6db4103410 2024-08-02T19:00:18.058 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6db419d430 con 0x7f6db4103410 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6db17fa640 1 -- 172.21.15.103:0/584119759 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6da800f4b0 con 0x7f6db4103410 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.043+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6db41a4d10 con 0x7f6db4103410 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.044+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6db4102ed0 con 0x7f6db4103410 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.045+0000 7f6db17fa640 1 -- 172.21.15.103:0/584119759 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f6da80046c0 con 0x7f6db4103410 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.046+0000 7f6db17fa640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6d9c0a2cf0 0x7f6d9c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.046+0000 7f6db3fff640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6d9c0a2cf0 0x7f6d9c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.046+0000 7f6db17fa640 1 -- 172.21.15.103:0/584119759 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9438+0+0 (secure 0 0 0) 0x7f6da80cf610 con 0x7f6db4103410 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.046+0000 7f6db3fff640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6d9c0a2cf0 0x7f6d9c0a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6da400ba40 tx=0x7f6da4005cc0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:18.059 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.050+0000 7f6db17fa640 1 -- 172.21.15.103:0/584119759 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f6da8014030 con 0x7f6db4103410 2024-08-02T19:00:18.228 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.227+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f6db41994f0 con 0x7f6db4103410 2024-08-02T19:00:18.229 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.227+0000 7f6db17fa640 1 -- 172.21.15.103:0/584119759 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 16 entries v100) ==== 81+0+955 (secure 0 0 0) 0x7f6da809bea0 con 0x7f6db4103410 2024-08-02T19:00:18.229 INFO:teuthology.orchestra.run.smithi103.stderr:listed 16 entries 2024-08-02T19:00:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/3303960029 2024-08-03T18:49:43.556859+0000 2024-08-02T19:00:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2382390785 2024-08-03T18:40:42.170602+0000 2024-08-02T19:00:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2382390785 2024-08-03T18:40:42.170602+0000 2024-08-02T19:00:18.229 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/433411047 2024-08-03T18:49:43.556859+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2020700081 2024-08-03T18:41:05.260353+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/2738010911 2024-08-03T18:49:43.556859+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/15319849 2024-08-03T18:49:43.556859+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1840770374 2024-08-03T18:40:42.170602+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/639519332 2024-08-03T18:40:42.170602+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/2532430315 2024-08-03T18:41:05.260353+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/3927889797 2024-08-03T18:40:42.170602+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/1976977182 2024-08-03T18:41:05.260353+0000 2024-08-02T19:00:18.230 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/34686070 2024-08-03T18:41:05.260353+0000 2024-08-02T19:00:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6801/3303960029 2024-08-03T18:49:43.556859+0000 2024-08-02T19:00:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:6800/2532430315 2024-08-03T18:41:05.260353+0000 2024-08-02T19:00:18.231 INFO:teuthology.orchestra.run.smithi103.stdout:172.21.15.103:0/592081832 2024-08-03T18:49:43.556859+0000 2024-08-02T19:00:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6d9c0a2cf0 msgr2=0x7f6d9c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6d9c0a2cf0 0x7f6d9c0a51b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f6da400ba40 tx=0x7f6da4005cc0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db4103410 msgr2=0x7f6db41986d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db4103410 0x7f6db41986d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f6da800c970 tx=0x7f6da800ce30 comp rx=0 tx=0).stop 2024-08-02T19:00:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 shutdown_connections 2024-08-02T19:00:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f6d9c0a2cf0 0x7f6d9c0a51b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.232 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f6db410bed0 0x7f6db419ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f6db4103410 0x7f6db41986d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 --2- 172.21.15.103:0/584119759 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f6db4102af0 0x7f6db4198190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:18.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 >> 172.21.15.103:0/584119759 conn(0x7f6db40fc4d0 msgr2=0x7f6db40fd0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:18.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 shutdown_connections 2024-08-02T19:00:18.233 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:18.230+0000 7f6dba817640 1 -- 172.21.15.103:0/584119759 wait complete. 2024-08-02T19:00:18.962 DEBUG:tasks.cephfs.kernel_mount:Unmounting client client.0... 2024-08-02T19:00:18.962 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T19:00:18.962 DEBUG:teuthology.orchestra.run.smithi103:> sudo umount /home/ubuntu/cephtest/mnt.0 2024-08-02T19:00:19.008 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T19:00:19.008 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T19:00:19.008 DEBUG:teuthology.orchestra.run.smithi103:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-08-02T19:00:19.039 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T19:00:19.039 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-02T19:00:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:18 smithi151 ceph-mon[37155]: pgmap v330: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T19:00:19.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:18 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/584119759' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T19:00:19.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:18 smithi103 ceph-mon[32753]: pgmap v330: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T19:00:19.076 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:18 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/584119759' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T19:00:19.111 INFO:teuthology.orchestra.run.smithi103.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-08-02T19:00:19.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T19:00:19.112 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-08-02T19:00:19.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T19:00:19.178 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-08-02T19:00:19.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:18 smithi121 ceph-mon[37236]: pgmap v330: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 204 B/s wr, 8 op/s 2024-08-02T19:00:19.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:18 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/584119759' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-08-02T19:00:19.270 INFO:tasks.kclient:Unmounting kernel clients... 2024-08-02T19:00:19.271 DEBUG:teuthology.orchestra.run.smithi103:> set -ex 2024-08-02T19:00:19.271 DEBUG:teuthology.orchestra.run.smithi103:> dd if=/proc/self/mounts of=/dev/stdout 2024-08-02T19:00:19.288 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056072,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=1211 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248736k,nr_inodes=812184,mode=700,uid=1000,gid=1316,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/sda1 /var/lib/containers/storage/overlay ext4 rw,seclabel,relatime 0 0 overlay /var/lib/containers/storage/overlay/ed09b2522d69f682128099f150cdc760c32189a8679f8765a148cfddbbf3bc84/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/ed09b2522d69f682128099f150cdc760c32189a8679f8765a148cfddbbf3bc84/diff,workdir=/var/lib/containers/storage/overlay/ed09b2522d69f682128099f150cdc760c32189a8679f8765a148cfddbbf3bc84/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/a15630e4ddeb5bbb7916f153e9e5d505b3f332f9c1ea9a48bf6b6ae459c56727/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/a15630e4ddeb5bbb7916f153e9e5d505b3f332f9c1ea9a48bf6b6ae459c56727/diff,workdir=/var/lib/containers/storage/overlay/a15630e4ddeb5bbb7916f153e9e5d505b3f332f9c1ea9a48bf6b6ae459c56727/work,metacopy=on,volatile 0 0 tmpfs /run/user/0 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248736k,nr_inodes=812184,mode=700,inode64 0 0 binfmt_misc /proc/sys/fs/binfmt_misc binfmt_misc rw,nosuid,nodev,noexec,relatime 0 0 overlay /var/lib/containers/storage/overlay/3118c8eb561b0b1d13e4f5066540fc305aaff97b4769f510924fe8191432892c/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/3118c8eb561b0b1d13e4f5066540fc305aaff97b4769f510924fe8191432892c/diff,workdir=/var/lib/containers/storage/overlay/3118c8eb561b0b1d13e4f5066540fc305aaff97b4769f510924fe8191432892c/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/c4012e2155d1401851a4fdfe6afd5693285177a0003c65c95bf1d4eaf9ada626/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/c4012e2155d1401851a4fdfe6afd5693285177a0003c65c95bf1d4eaf9ada626/diff,workdir=/var/lib/containers/storage/overlay/c4012e2155d1401851a4fdfe6afd5693285177a0003c65c95bf1d4eaf9ada626/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/cb19b6cef98f950f86fce9d924545e718cfafab1f9c94a9549f23218579de1b4/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/cb19b6cef98f950f86fce9d924545e718cfafab1f9c94a9549f23218579de1b4/diff,workdir=/var/lib/containers/storage/overlay/cb19b6cef98f950f86fce9d924545e718cfafab1f9c94a9549f23218579de1b4/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/af99fe687f18f3630603662dba96a562ff4d15382cd33a2f39cae6657fc06526/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/af99fe687f18f3630603662dba96a562ff4d15382cd33a2f39cae6657fc06526/diff,workdir=/var/lib/containers/storage/overlay/af99fe687f18f3630603662dba96a562ff4d15382cd33a2f39cae6657fc06526/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/190980413da39d389effe85cbebc95daf61e9b6c0b8db49930d1d74a4d39eded/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/190980413da39d389effe85cbebc95daf61e9b6c0b8db49930d1d74a4d39eded/diff,workdir=/var/lib/containers/storage/overlay/190980413da39d389effe85cbebc95daf61e9b6c0b8db49930d1d74a4d39eded/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/094ada1a4cb6d028b0bcdbc3854bdba1dbefda5073409cad74c98d4a79e8644f/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/094ada1a4cb6d028b0bcdbc3854bdba1dbefda5073409cad74c98d4a79e8644f/diff,workdir=/var/lib/containers/storage/overlay/094ada1a4cb6d028b0bcdbc3854bdba1dbefda5073409cad74c98d4a79e8644f/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/53c4e172a8adbd4f3665b632af44942cbd0983afc9750c07ca9b3ac72d0d4f7d/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/53c4e172a8adbd4f3665b632af44942cbd0983afc9750c07ca9b3ac72d0d4f7d/diff,workdir=/var/lib/containers/storage/overlay/53c4e172a8adbd4f3665b632af44942cbd0983afc9750c07ca9b3ac72d0d4f7d/work,metacopy=on,volatile 0 0 overlay /var/lib/containers/storage/overlay/80c7dffb7a220cdcf2a7dd599086ada20e3d40a51009beeaed8de3fae28c18f7/merged overlay rw,context="system_u:object_r:container_file_t:s0:c1022,c1023",nodev,relatime,lowerdir=/var/lib/containers/storage/overlay/l/KQMGNK4VCBTPEGQH6UNM6ZAJ53:/var/lib/containers/storage/overlay/l/72K7RTNNGFNIOMGAUDJUVDCHQO,upperdir=/var/lib/containers/storage/overlay/80c7dffb7a220cdcf2a7dd599086ada20e3d40a51009beeaed8de3fae28c18f7/diff,workdir=/var/lib/containers/storage/overlay/80c7dffb7a220cdcf2a7dd599086ada20e3d40a51009beeaed8de3fae28c18f7/work,metacopy=on,volatile 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497480k,nr_inodes=819200,mode=755,inode64 0 0 2024-08-02T19:00:19.288 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T19:00:19.288 DEBUG:teuthology.orchestra.run.smithi103:> ip netns list 2024-08-02T19:00:19.345 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-08-02T19:00:19.345 DEBUG:teuthology.orchestra.run.smithi103:> sudo ip link delete ceph-brx 2024-08-02T19:00:19.413 INFO:teuthology.orchestra.run.smithi103.stderr:Cannot find device "ceph-brx" 2024-08-02T19:00:19.414 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T19:00:19.415 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-08-02T19:00:19.427 INFO:tasks.cephadm:Teardown begin 2024-08-02T19:00:19.427 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-08-02T19:00:19.428 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T19:00:19.709 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 -- 172.21.15.103:0/3587250607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98801006b0 msgr2=0x7f9880100a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 --2- 172.21.15.103:0/3587250607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98801006b0 0x7f9880100a90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f987c009900 tx=0x7f987c02a470 comp rx=0 tx=0).stop 2024-08-02T19:00:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 -- 172.21.15.103:0/3587250607 shutdown_connections 2024-08-02T19:00:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 --2- 172.21.15.103:0/3587250607 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880105ac0 0x7f9880105f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.208 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 --2- 172.21.15.103:0/3587250607 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9880100fd0 0x7f98801054a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 --2- 172.21.15.103:0/3587250607 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f98801006b0 0x7f9880100a90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 -- 172.21.15.103:0/3587250607 >> 172.21.15.103:0/3587250607 conn(0x7f98800fc360 msgr2=0x7f98800fe780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 -- 172.21.15.103:0/3587250607 shutdown_connections 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 -- 172.21.15.103:0/3587250607 wait complete. 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.186+0000 7f9886ba1640 1 Processor -- start 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9886ba1640 1 -- start start 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9886ba1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98801006b0 0x7f988019e680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9886ba1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880100fd0 0x7f988019ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:20.209 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9886ba1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9880105ac0 0x7f98801a2f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9886ba1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9880118220 con 0x7f9880105ac0 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9886ba1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f98801180a0 con 0x7f98801006b0 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9886ba1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f98801183a0 con 0x7f9880100fd0 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9880105ac0 0x7f98801a2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9880105ac0 0x7f98801a2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53372/0 (socket says 172.21.15.103:53372) 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 -- 172.21.15.103:0/1447709421 learned_addr learned my addr 172.21.15.103:0/1447709421 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9885b9f640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98801006b0 0x7f988019e680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f988539e640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880100fd0 0x7f988019ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:20.210 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 -- 172.21.15.103:0/1447709421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880100fd0 msgr2=0x7f988019ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880100fd0 0x7f988019ebc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 -- 172.21.15.103:0/1447709421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98801006b0 msgr2=0x7f988019e680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98801006b0 0x7f988019e680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 -- 172.21.15.103:0/1447709421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98801a3630 con 0x7f9880105ac0 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f9885b9f640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98801006b0 0x7f988019e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.187+0000 7f98863a0640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9880105ac0 0x7f98801a2f50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f987800eaa0 tx=0x7f987800ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.188+0000 7f9876ffd640 1 -- 172.21.15.103:0/1447709421 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f987800cdb0 con 0x7f9880105ac0 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.188+0000 7f9876ffd640 1 -- 172.21.15.103:0/1447709421 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9878004b20 con 0x7f9880105ac0 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.188+0000 7f9876ffd640 1 -- 172.21.15.103:0/1447709421 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9878011760 con 0x7f9880105ac0 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.188+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98801a3920 con 0x7f9880105ac0 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.188+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98801ab200 con 0x7f9880105ac0 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.189+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98801054a0 con 0x7f9880105ac0 2024-08-02T19:00:20.211 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.190+0000 7f9876ffd640 1 -- 172.21.15.103:0/1447709421 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f9878011900 con 0x7f9880105ac0 2024-08-02T19:00:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.190+0000 7f9876ffd640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f986c0a2cf0 0x7f986c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.191+0000 7f9885b9f640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f986c0a2cf0 0x7f986c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.191+0000 7f9876ffd640 1 -- 172.21.15.103:0/1447709421 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9438+0+0 (secure 0 0 0) 0x7f98780cfd00 con 0x7f9880105ac0 2024-08-02T19:00:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.191+0000 7f9885b9f640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f986c0a2cf0 0x7f986c0a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f987c009230 tx=0x7f987c0058d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:20.212 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.193+0000 7f9876ffd640 1 -- 172.21.15.103:0/1447709421 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9878016030 con 0x7f9880105ac0 2024-08-02T19:00:20.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.393+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f988019f9e0 con 0x7f9880105ac0 2024-08-02T19:00:20.395 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.394+0000 7f9876ffd640 1 -- 172.21.15.103:0/1447709421 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11933 (secure 0 0 0) 0x7f988019f9e0 con 0x7f9880105ac0 2024-08-02T19:00:20.396 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T19:00:20.396 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":39,"btime":"2024-08-02T18:55:17:112658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:55:16.637460+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":72,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":70,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T19:00:20.396 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 39 2024-08-02T19:00:20.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f986c0a2cf0 msgr2=0x7f986c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:20.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f986c0a2cf0 0x7f986c0a51b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f987c009230 tx=0x7f987c0058d0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9880105ac0 msgr2=0x7f98801a2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:20.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9880105ac0 0x7f98801a2f50 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f987800eaa0 tx=0x7f987800ef60 comp rx=0 tx=0).stop 2024-08-02T19:00:20.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 shutdown_connections 2024-08-02T19:00:20.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f986c0a2cf0 0x7f986c0a51b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.398 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9880105ac0 0x7f98801a2f50 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9880100fd0 0x7f988019ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 --2- 172.21.15.103:0/1447709421 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f98801006b0 0x7f988019e680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 >> 172.21.15.103:0/1447709421 conn(0x7f98800fc360 msgr2=0x7f9880103470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 shutdown_connections 2024-08-02T19:00:20.399 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:20.397+0000 7f9886ba1640 1 -- 172.21.15.103:0/1447709421 wait complete. 2024-08-02T19:00:21.046 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:20 smithi103 ceph-mon[32753]: pgmap v331: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-02T19:00:21.046 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:20 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1447709421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T19:00:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:20 smithi151 ceph-mon[37155]: pgmap v331: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-02T19:00:21.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:20 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1447709421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T19:00:21.080 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs dump --format=json 2024-08-02T19:00:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:20 smithi121 ceph-mon[37236]: pgmap v331: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.2 KiB/s rd, 511 B/s wr, 8 op/s 2024-08-02T19:00:21.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:20 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1447709421' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T19:00:21.337 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:21.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 -- 172.21.15.103:0/258134879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01007b0 msgr2=0x7f0fd0100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:21.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/258134879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01007b0 0x7f0fd0100c10 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f0fbc009930 tx=0x7f0fbc02a420 comp rx=0 tx=0).stop 2024-08-02T19:00:21.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 -- 172.21.15.103:0/258134879 shutdown_connections 2024-08-02T19:00:21.892 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/258134879 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd0101150 0x7f0fd010d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/258134879 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01007b0 0x7f0fd0100c10 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/258134879 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fd01067b0 0x7f0fd0106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 -- 172.21.15.103:0/258134879 >> 172.21.15.103:0/258134879 conn(0x7f0fd00fc4d0 msgr2=0x7f0fd00fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 -- 172.21.15.103:0/258134879 shutdown_connections 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.863+0000 7f0fd70d8640 1 -- 172.21.15.103:0/258134879 wait complete. 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd70d8640 1 Processor -- start 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd70d8640 1 -- start start 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd70d8640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd01007b0 0x7f0fd01982a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd70d8640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fd0101150 0x7f0fd01987e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd70d8640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01067b0 0x7f0fd019cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd70d8640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd0110d10 con 0x7f0fd01067b0 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd70d8640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd0110b90 con 0x7f0fd0101150 2024-08-02T19:00:21.893 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd70d8640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f0fd0110e90 con 0x7f0fd01007b0 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd5675640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01067b0 0x7f0fd019cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd5675640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01067b0 0x7f0fd019cb70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53394/0 (socket says 172.21.15.103:53394) 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd5675640 1 -- 172.21.15.103:0/1419412806 learned_addr learned my addr 172.21.15.103:0/1419412806 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fcffff640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fd0101150 0x7f0fd01987e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.864+0000 7f0fd4e74640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd01007b0 0x7f0fd01982a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fd5675640 1 -- 172.21.15.103:0/1419412806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd01007b0 msgr2=0x7f0fd01982a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fd5675640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd01007b0 0x7f0fd01982a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fd5675640 1 -- 172.21.15.103:0/1419412806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fd0101150 msgr2=0x7f0fd01987e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fd5675640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fd0101150 0x7f0fd01987e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fd5675640 1 -- 172.21.15.103:0/1419412806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0fd019d250 con 0x7f0fd01067b0 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fd5675640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01067b0 0x7f0fd019cb70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800eaa0 tx=0x7f0fc800eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fcdffb640 1 -- 172.21.15.103:0/1419412806 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc8004d20 con 0x7f0fd01067b0 2024-08-02T19:00:21.894 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fcdffb640 1 -- 172.21.15.103:0/1419412806 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f0fc8005020 con 0x7f0fd01067b0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0fd019d540 con 0x7f0fd01067b0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fcdffb640 1 -- 172.21.15.103:0/1419412806 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0fc80116b0 con 0x7f0fd01067b0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.865+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0fd01a4e20 con 0x7f0fd01067b0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.866+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0fd0100c10 con 0x7f0fd01067b0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.867+0000 7f0fcdffb640 1 -- 172.21.15.103:0/1419412806 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f0fc80051d0 con 0x7f0fd01067b0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.868+0000 7f0fcdffb640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0fc00a2cf0 0x7f0fc00a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.868+0000 7f0fd4e74640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0fc00a2cf0 0x7f0fc00a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.868+0000 7f0fcdffb640 1 -- 172.21.15.103:0/1419412806 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9438+0+0 (secure 0 0 0) 0x7f0fc80cf9e0 con 0x7f0fd01067b0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.868+0000 7f0fd4e74640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0fc00a2cf0 0x7f0fc00a51b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009990 tx=0x7f0fc4009110 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:21.895 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:21.872+0000 7f0fcdffb640 1 -- 172.21.15.103:0/1419412806 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f0fc8016030 con 0x7f0fd01067b0 2024-08-02T19:00:22.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.074+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f0fd01a5080 con 0x7f0fd01067b0 2024-08-02T19:00:22.076 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.075+0000 7f0fcdffb640 1 -- 172.21.15.103:0/1419412806 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 39 v39) ==== 94+0+11933 (secure 0 0 0) 0x7f0fc809c270 con 0x7f0fd01067b0 2024-08-02T19:00:22.077 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T19:00:22.077 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":39,"btime":"2024-08-02T18:55:17:112658+0000","default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14547,"name":"j","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6835/1945803931","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6834","nonce":1945803931},{"type":"v1","addr":"172.21.15.103:6835","nonce":1945803931}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":4},{"gid":14559,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6837/3186466318","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6836","nonce":3186466318},{"type":"v1","addr":"172.21.15.103:6837","nonce":3186466318}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":5},{"gid":14607,"name":"g","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6839/4168002022","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6838","nonce":4168002022},{"type":"v1","addr":"172.21.15.103:6839","nonce":4168002022}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":11},{"gid":14619,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.103:6841/1212214786","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6840","nonce":1212214786},{"type":"v1","addr":"172.21.15.103:6841","nonce":1212214786}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":12},{"gid":24403,"name":"l","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.151:6833/13799064","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6832","nonce":13799064},{"type":"v1","addr":"172.21.15.151:6833","nonce":13799064}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":24404,"name":"k","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.121:6833/4001571667","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6832","nonce":4001571667},{"type":"v1","addr":"172.21.15.121:6833","nonce":4001571667}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":39,"flags":306,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":true,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":true},"ever_allowed_features":32,"explicitly_allowed_features":32,"created":"2024-08-02T18:47:22.067716+0000","modified":"2024-08-02T18:55:16.637460+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":3,"in":[0,1,2],"up":{"mds_0":24473,"mds_1":24469,"mds_2":24454},"failed":[],"damaged":[],"stopped":[],"info":{"gid_24425":{"gid":24425,"name":"e","rank":2,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6835/1461531566","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6834","nonce":1461531566},{"type":"v1","addr":"172.21.15.121:6835","nonce":1461531566}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24442":{"gid":24442,"name":"f","rank":1,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.151:6835/126654937","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6834","nonce":126654937},{"type":"v1","addr":"172.21.15.151:6835","nonce":126654937}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24449":{"gid":24449,"name":"h","rank":0,"incarnation":0,"state":"up:standby-replay","state_seq":1,"addr":"172.21.15.121:6837/1633433490","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6836","nonce":1633433490},{"type":"v1","addr":"172.21.15.121:6837","nonce":1633433490}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24454":{"gid":24454,"name":"c","rank":2,"incarnation":22,"state":"up:active","state_seq":72,"addr":"172.21.15.151:6837/1434322363","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6836","nonce":1434322363},{"type":"v1","addr":"172.21.15.151:6837","nonce":1434322363}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24469":{"gid":24469,"name":"i","rank":1,"incarnation":20,"state":"up:active","state_seq":70,"addr":"172.21.15.151:6839/3705298051","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6838","nonce":3705298051},{"type":"v1","addr":"172.21.15.151:6839","nonce":3705298051}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_24473":{"gid":24473,"name":"b","rank":0,"incarnation":14,"state":"up:active","state_seq":4,"addr":"172.21.15.121:6839/3512573309","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6838","nonce":3512573309},{"type":"v1","addr":"172.21.15.121:6839","nonce":3512573309}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":24473,"qdb_cluster":[24454,24469,24473]},"id":1}]} 2024-08-02T19:00:22.078 INFO:teuthology.orchestra.run.smithi103.stderr:dumped fsmap epoch 39 2024-08-02T19:00:22.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0fc00a2cf0 msgr2=0x7f0fc00a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:22.079 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0fc00a2cf0 0x7f0fc00a51b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4009990 tx=0x7f0fc4009110 comp rx=0 tx=0).stop 2024-08-02T19:00:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01067b0 msgr2=0x7f0fd019cb70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01067b0 0x7f0fd019cb70 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7f0fc800eaa0 tx=0x7f0fc800eea0 comp rx=0 tx=0).stop 2024-08-02T19:00:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 shutdown_connections 2024-08-02T19:00:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f0fc00a2cf0 0x7f0fc00a51b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:22.080 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f0fd01067b0 0x7f0fd019cb70 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f0fd0101150 0x7f0fd01987e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 --2- 172.21.15.103:0/1419412806 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f0fd01007b0 0x7f0fd01982a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 >> 172.21.15.103:0/1419412806 conn(0x7f0fd00fc4d0 msgr2=0x7f0fd0104520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 shutdown_connections 2024-08-02T19:00:22.081 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:22.077+0000 7f0fd70d8640 1 -- 172.21.15.103:0/1419412806 wait complete. 2024-08-02T19:00:22.770 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd dump --format=json 2024-08-02T19:00:23.027 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:22 smithi151 ceph-mon[37155]: pgmap v332: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-02T19:00:23.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:22 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1419412806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T19:00:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:22 smithi103 ceph-mon[32753]: pgmap v332: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-02T19:00:23.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:22 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1419412806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T19:00:23.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:22 smithi121 ceph-mon[37236]: pgmap v332: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-02T19:00:23.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:22 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1419412806' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 -- 172.21.15.103:0/1982516578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec1078b0 msgr2=0x7f70ec107c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 --2- 172.21.15.103:0/1982516578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec1078b0 0x7f70ec107c90 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f70e8009930 tx=0x7f70e802a420 comp rx=0 tx=0).stop 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 -- 172.21.15.103:0/1982516578 shutdown_connections 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 --2- 172.21.15.103:0/1982516578 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70ec102250 0x7f70ec10e780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 --2- 172.21.15.103:0/1982516578 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70ec1018b0 0x7f70ec101d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 --2- 172.21.15.103:0/1982516578 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec1078b0 0x7f70ec107c90 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 -- 172.21.15.103:0/1982516578 >> 172.21.15.103:0/1982516578 conn(0x7f70ec0fd5f0 msgr2=0x7f70ec0ffa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 -- 172.21.15.103:0/1982516578 shutdown_connections 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.523+0000 7f70f42e2640 1 -- 172.21.15.103:0/1982516578 wait complete. 2024-08-02T19:00:23.544 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f42e2640 1 Processor -- start 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f42e2640 1 -- start start 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f42e2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70ec1018b0 0x7f70ec1982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f42e2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec102250 0x7f70ec1987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f42e2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70ec1078b0 0x7f70ec19cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f42e2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec111dd0 con 0x7f70ec102250 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f42e2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec111c50 con 0x7f70ec1018b0 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f42e2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f70ec111f50 con 0x7f70ec1078b0 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f187d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec102250 0x7f70ec1987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f187d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec102250 0x7f70ec1987f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53410/0 (socket says 172.21.15.103:53410) 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f187d640 1 -- 172.21.15.103:0/880186456 learned_addr learned my addr 172.21.15.103:0/880186456 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f207e640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70ec1018b0 0x7f70ec1982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f287f640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70ec1078b0 0x7f70ec19cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:23.545 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f187d640 1 -- 172.21.15.103:0/880186456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70ec1078b0 msgr2=0x7f70ec19cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f187d640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70ec1078b0 0x7f70ec19cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f187d640 1 -- 172.21.15.103:0/880186456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70ec1018b0 msgr2=0x7f70ec1982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f187d640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70ec1018b0 0x7f70ec1982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f187d640 1 -- 172.21.15.103:0/880186456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70ec19d260 con 0x7f70ec102250 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.524+0000 7f70f207e640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70ec1018b0 0x7f70ec1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.525+0000 7f70f187d640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec102250 0x7f70ec1987f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c890 tx=0x7f70e000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.525+0000 7f70df7fe640 1 -- 172.21.15.103:0/880186456 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0004220 con 0x7f70ec102250 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.525+0000 7f70df7fe640 1 -- 172.21.15.103:0/880186456 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f70e00043c0 con 0x7f70ec102250 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.525+0000 7f70df7fe640 1 -- 172.21.15.103:0/880186456 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e0004b10 con 0x7f70ec102250 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.525+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70ec19d550 con 0x7f70ec102250 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.525+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70ec1a4e30 con 0x7f70ec102250 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.526+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70ec101d10 con 0x7f70ec102250 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.527+0000 7f70df7fe640 1 -- 172.21.15.103:0/880186456 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f70e00051b0 con 0x7f70ec102250 2024-08-02T19:00:23.546 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.528+0000 7f70df7fe640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70d80a2d70 0x7f70d80a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:23.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.528+0000 7f70f207e640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70d80a2d70 0x7f70d80a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:23.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.528+0000 7f70df7fe640 1 -- 172.21.15.103:0/880186456 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9438+0+0 (secure 0 0 0) 0x7f70e00cf8e0 con 0x7f70ec102250 2024-08-02T19:00:23.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.528+0000 7f70f207e640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70d80a2d70 0x7f70d80a5230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000c00 tx=0x7f70e8032d60 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:23.547 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.532+0000 7f70df7fe640 1 -- 172.21.15.103:0/880186456 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f70e0014030 con 0x7f70ec102250 2024-08-02T19:00:23.703 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.702+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70ec02d5e0 con 0x7f70ec102250 2024-08-02T19:00:23.704 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.703+0000 7f70df7fe640 1 -- 172.21.15.103:0/880186456 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) ==== 74+0+25265 (secure 0 0 0) 0x7f70e009c170 con 0x7f70ec102250 2024-08-02T19:00:23.705 INFO:teuthology.orchestra.run.smithi103.stdout: 2024-08-02T19:00:23.705 INFO:teuthology.orchestra.run.smithi103.stdout:{"epoch":100,"fsid":"7ef68402-50fe-11ef-bcca-c7b262605968","created":"2024-08-02T18:40:20.516286+0000","modified":"2024-08-02T19:00:15.795055+0000","last_up_change":"2024-08-02T18:46:30.435856+0000","last_in_change":"2024-08-02T18:46:10.758496+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":27,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":12,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-08-02T18:43:05.562258+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"21","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":12,"score_stable":12,"optimal_score":0.25,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-08-02T18:47:18.244339+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-08-02T18:47:20.250497+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":0.99999988079071045,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-08-02T18:47:26.589938+0000","flags":8197,"flags_names":"hashpspool,ec_overwrites,selfmanaged_snaps","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"99","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":17,"snap_epoch":99,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"9478879a-fb16-4c8a-922d-e555bf3f7ff0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6802","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6803","nonce":683162835}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6804","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6805","nonce":683162835}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6808","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6809","nonce":683162835}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6806","nonce":683162835},{"type":"v1","addr":"172.21.15.103:6807","nonce":683162835}]},"public_addr":"172.21.15.103:6803/683162835","cluster_addr":"172.21.15.103:6805/683162835","heartbeat_back_addr":"172.21.15.103:6809/683162835","heartbeat_front_addr":"172.21.15.103:6807/683162835","state":["exists","up"]},{"osd":1,"uuid":"9ba10d16-f7e6-47ca-80f3-cccbfce499fe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6800","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6801","nonce":427937936}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6802","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6803","nonce":427937936}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6806","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6807","nonce":427937936}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6804","nonce":427937936},{"type":"v1","addr":"172.21.15.121:6805","nonce":427937936}]},"public_addr":"172.21.15.121:6801/427937936","cluster_addr":"172.21.15.121:6803/427937936","heartbeat_back_addr":"172.21.15.121:6807/427937936","heartbeat_front_addr":"172.21.15.121:6805/427937936","state":["exists","up"]},{"osd":2,"uuid":"4eb4b4fc-bd57-4ecf-891c-cf965b0bd1ec","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6800","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6801","nonce":352420773}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6802","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6803","nonce":352420773}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6806","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6807","nonce":352420773}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6804","nonce":352420773},{"type":"v1","addr":"172.21.15.151:6805","nonce":352420773}]},"public_addr":"172.21.15.151:6801/352420773","cluster_addr":"172.21.15.151:6803/352420773","heartbeat_back_addr":"172.21.15.151:6807/352420773","heartbeat_front_addr":"172.21.15.151:6805/352420773","state":["exists","up"]},{"osd":3,"uuid":"63933dee-170e-4e8e-b9e3-e120c55cac8b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":24,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6810","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6811","nonce":3894858705}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6812","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6813","nonce":3894858705}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6816","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6817","nonce":3894858705}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6814","nonce":3894858705},{"type":"v1","addr":"172.21.15.103:6815","nonce":3894858705}]},"public_addr":"172.21.15.103:6811/3894858705","cluster_addr":"172.21.15.103:6813/3894858705","heartbeat_back_addr":"172.21.15.103:6817/3894858705","heartbeat_front_addr":"172.21.15.103:6815/3894858705","state":["exists","up"]},{"osd":4,"uuid":"ef0e458a-1e86-42a3-afe4-7d80a10e12ea","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6808","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6809","nonce":3147928372}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6810","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6811","nonce":3147928372}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6814","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6815","nonce":3147928372}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6812","nonce":3147928372},{"type":"v1","addr":"172.21.15.121:6813","nonce":3147928372}]},"public_addr":"172.21.15.121:6809/3147928372","cluster_addr":"172.21.15.121:6811/3147928372","heartbeat_back_addr":"172.21.15.121:6815/3147928372","heartbeat_front_addr":"172.21.15.121:6813/3147928372","state":["exists","up"]},{"osd":5,"uuid":"a9e2a3d3-7b17-489c-9229-04141660dc5b","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":36,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6808","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6809","nonce":2549009973}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6810","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6811","nonce":2549009973}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6814","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6815","nonce":2549009973}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6812","nonce":2549009973},{"type":"v1","addr":"172.21.15.151:6813","nonce":2549009973}]},"public_addr":"172.21.15.151:6809/2549009973","cluster_addr":"172.21.15.151:6811/2549009973","heartbeat_back_addr":"172.21.15.151:6815/2549009973","heartbeat_front_addr":"172.21.15.151:6813/2549009973","state":["exists","up"]},{"osd":6,"uuid":"3c779781-bb3d-4067-8c1d-86c5c5ef5dfe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":44,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6818","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6819","nonce":3191321050}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6820","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6821","nonce":3191321050}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6824","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6825","nonce":3191321050}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6822","nonce":3191321050},{"type":"v1","addr":"172.21.15.103:6823","nonce":3191321050}]},"public_addr":"172.21.15.103:6819/3191321050","cluster_addr":"172.21.15.103:6821/3191321050","heartbeat_back_addr":"172.21.15.103:6825/3191321050","heartbeat_front_addr":"172.21.15.103:6823/3191321050","state":["exists","up"]},{"osd":7,"uuid":"35728743-216c-4e32-be58-71f4feafabbc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":49,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6816","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6817","nonce":2205509035}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6818","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6819","nonce":2205509035}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6822","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6823","nonce":2205509035}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6820","nonce":2205509035},{"type":"v1","addr":"172.21.15.121:6821","nonce":2205509035}]},"public_addr":"172.21.15.121:6817/2205509035","cluster_addr":"172.21.15.121:6819/2205509035","heartbeat_back_addr":"172.21.15.121:6823/2205509035","heartbeat_front_addr":"172.21.15.121:6821/2205509035","state":["exists","up"]},{"osd":8,"uuid":"277019f3-1818-4768-9a9e-dceaf7763848","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":56,"up_thru":84,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6816","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6817","nonce":931243122}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6818","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6819","nonce":931243122}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6822","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6823","nonce":931243122}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6820","nonce":931243122},{"type":"v1","addr":"172.21.15.151:6821","nonce":931243122}]},"public_addr":"172.21.15.151:6817/931243122","cluster_addr":"172.21.15.151:6819/931243122","heartbeat_back_addr":"172.21.15.151:6823/931243122","heartbeat_front_addr":"172.21.15.151:6821/931243122","state":["exists","up"]},{"osd":9,"uuid":"dd6a19ec-851e-4957-8968-53d1a614eaaa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":63,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6826","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6827","nonce":2790635350}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6828","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6829","nonce":2790635350}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6832","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6833","nonce":2790635350}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.103:6830","nonce":2790635350},{"type":"v1","addr":"172.21.15.103:6831","nonce":2790635350}]},"public_addr":"172.21.15.103:6827/2790635350","cluster_addr":"172.21.15.103:6829/2790635350","heartbeat_back_addr":"172.21.15.103:6833/2790635350","heartbeat_front_addr":"172.21.15.103:6831/2790635350","state":["exists","up"]},{"osd":10,"uuid":"29c7b69d-2db4-4ff1-b5d0-544096db8cf7","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":68,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6824","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6825","nonce":1207550526}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6826","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6827","nonce":1207550526}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6830","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6831","nonce":1207550526}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.121:6828","nonce":1207550526},{"type":"v1","addr":"172.21.15.121:6829","nonce":1207550526}]},"public_addr":"172.21.15.121:6825/1207550526","cluster_addr":"172.21.15.121:6827/1207550526","heartbeat_back_addr":"172.21.15.121:6831/1207550526","heartbeat_front_addr":"172.21.15.121:6829/1207550526","state":["exists","up"]},{"osd":11,"uuid":"63dc42b7-851c-44a9-896d-cd9112f9ba35","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":75,"up_thru":88,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6824","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6825","nonce":3221128949}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6826","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6827","nonce":3221128949}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6830","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6831","nonce":3221128949}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.151:6828","nonce":3221128949},{"type":"v1","addr":"172.21.15.151:6829","nonce":3221128949}]},"public_addr":"172.21.15.151:6825/3221128949","cluster_addr":"172.21.15.151:6827/3221128949","heartbeat_back_addr":"172.21.15.151:6831/3221128949","heartbeat_front_addr":"172.21.15.151:6829/3221128949","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:20.582641+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:42:41.484780+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:02.591670+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:25.017188+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:43:47.467648+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:09.786758+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:32.323238+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:44:54.956453+0000","dead_epoch":0},{"osd":8,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:18.186697+0000","dead_epoch":0},{"osd":9,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:45:41.859707+0000","dead_epoch":0},{"osd":10,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:05.094755+0000","dead_epoch":0},{"osd":11,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-08-02T18:46:28.045258+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"2.13","mappings":[{"from":2,"to":11}]},{"pgid":"2.1d","mappings":[{"from":8,"to":11}]},{"pgid":"3.6","mappings":[{"from":4,"to":6}]},{"pgid":"3.1b","mappings":[{"from":5,"to":9}]},{"pgid":"3.1e","mappings":[{"from":3,"to":9}]},{"pgid":"3.3c","mappings":[{"from":4,"to":9}]},{"pgid":"4.e","mappings":[{"from":9,"to":11}]},{"pgid":"4.15","mappings":[{"from":5,"to":10}]},{"pgid":"4.1c","mappings":[{"from":9,"to":8}]},{"pgid":"4.1f","mappings":[{"from":9,"to":8}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.103:6800/3303960029":"2024-08-03T18:49:43.556859+0000","172.21.15.103:6800/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2382390785":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/433411047":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/2020700081":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/2738010911":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/15319849":"2024-08-03T18:49:43.556859+0000","172.21.15.103:0/1840770374":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/639519332":"2024-08-03T18:40:42.170602+0000","172.21.15.103:6801/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/3927889797":"2024-08-03T18:40:42.170602+0000","172.21.15.103:0/1976977182":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/34686070":"2024-08-03T18:41:05.260353+0000","172.21.15.103:6801/3303960029":"2024-08-03T18:49:43.556859+0000","172.21.15.103:6800/2532430315":"2024-08-03T18:41:05.260353+0000","172.21.15.103:0/592081832":"2024-08-03T18:49:43.556859+0000"},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[{"pool":3,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]},{"pool":4,"snaps":[{"begin":6,"length":1},{"begin":17,"length":1}]}],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-08-02T19:00:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70d80a2d70 msgr2=0x7f70d80a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70d80a2d70 0x7f70d80a5230 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f70e8000c00 tx=0x7f70e8032d60 comp rx=0 tx=0).stop 2024-08-02T19:00:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec102250 msgr2=0x7f70ec1987f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec102250 0x7f70ec1987f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f70e000c890 tx=0x7f70e000cd50 comp rx=0 tx=0).stop 2024-08-02T19:00:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 shutdown_connections 2024-08-02T19:00:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f70d80a2d70 0x7f70d80a5230 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f70ec1078b0 0x7f70ec19cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.707 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f70ec102250 0x7f70ec1987f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 --2- 172.21.15.103:0/880186456 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f70ec1018b0 0x7f70ec1982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 >> 172.21.15.103:0/880186456 conn(0x7f70ec0fd5f0 msgr2=0x7f70ec0fde10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 shutdown_connections 2024-08-02T19:00:23.708 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:23.705+0000 7f70f42e2640 1 -- 172.21.15.103:0/880186456 wait complete. 2024-08-02T19:00:24.064 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:23 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/880186456' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T19:00:24.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:23 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/880186456' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T19:00:24.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:23 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/880186456' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-08-02T19:00:24.437 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs fail cephfs 2024-08-02T19:00:24.692 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:25.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:24 smithi151 ceph-mon[37155]: pgmap v333: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-02T19:00:25.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:24 smithi103 ceph-mon[32753]: pgmap v333: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-02T19:00:25.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2756180066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 msgr2=0x7f7a6c10d770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:25.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2756180066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 0x7f7a6c10d770 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f7a64009900 tx=0x7f7a6402a480 comp rx=0 tx=0).stop 2024-08-02T19:00:25.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2756180066 shutdown_connections 2024-08-02T19:00:25.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2756180066 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 0x7f7a6c10d770 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2756180066 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a6c1022a0 0x7f7a6c1026e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2756180066 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a6c100b50 0x7f7a6c100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2756180066 >> 172.21.15.103:0/2756180066 conn(0x7f7a6c0fc500 msgr2=0x7f7a6c0fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:25.213 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2756180066 shutdown_connections 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2756180066 wait complete. 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.190+0000 7f7a70a2e640 1 Processor -- start 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a70a2e640 1 -- start start 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a70a2e640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a6c100b50 0x7f7a6c1982e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a70a2e640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a6c1022a0 0x7f7a6c198820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a70a2e640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 0x7f7a6c19cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a70a2e640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c110e30 con 0x7f7a6c102c20 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a70a2e640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c110cb0 con 0x7f7a6c1022a0 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a70a2e640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f7a6c110fb0 con 0x7f7a6c100b50 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 0x7f7a6c19cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:25.214 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 0x7f7a6c19cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53426/0 (socket says 172.21.15.103:53426) 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 -- 172.21.15.103:0/2762195047 learned_addr learned my addr 172.21.15.103:0/2762195047 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a69d9b640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a6c1022a0 0x7f7a6c198820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6a59c640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a6c100b50 0x7f7a6c1982e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 -- 172.21.15.103:0/2762195047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a6c100b50 msgr2=0x7f7a6c1982e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a6c100b50 0x7f7a6c1982e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 -- 172.21.15.103:0/2762195047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a6c1022a0 msgr2=0x7f7a6c198820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a6c1022a0 0x7f7a6c198820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 -- 172.21.15.103:0/2762195047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a6c19d290 con 0x7f7a6c102c20 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a69d9b640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a6c1022a0 0x7f7a6c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.191+0000 7f7a6ad9d640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 0x7f7a6c19cbb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7a64004770 tx=0x7f7a64004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.192+0000 7f7a637fe640 1 -- 172.21.15.103:0/2762195047 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a6403f030 con 0x7f7a6c102c20 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.192+0000 7f7a637fe640 1 -- 172.21.15.103:0/2762195047 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f7a64005500 con 0x7f7a6c102c20 2024-08-02T19:00:25.215 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.192+0000 7f7a637fe640 1 -- 172.21.15.103:0/2762195047 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a64035070 con 0x7f7a6c102c20 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.192+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a6c19d520 con 0x7f7a6c102c20 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.192+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a6c19d9b0 con 0x7f7a6c102c20 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.193+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a6c100f30 con 0x7f7a6c102c20 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.194+0000 7f7a637fe640 1 -- 172.21.15.103:0/2762195047 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f7a64042030 con 0x7f7a6c102c20 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.194+0000 7f7a637fe640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a580a2cf0 0x7f7a580a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.195+0000 7f7a637fe640 1 -- 172.21.15.103:0/2762195047 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(100..100 src has 1..100) ==== 9438+0+0 (secure 0 0 0) 0x7f7a640f0440 con 0x7f7a6c102c20 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.195+0000 7f7a6a59c640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a580a2cf0 0x7f7a580a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.195+0000 7f7a6a59c640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a580a2cf0 0x7f7a580a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c005fd0 tx=0x7f7a5c009870 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:25.216 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.198+0000 7f7a637fe640 1 -- 172.21.15.103:0/2762195047 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f7a640bccd0 con 0x7f7a6c102c20 2024-08-02T19:00:25.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:24 smithi121 ceph-mon[37236]: pgmap v333: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.4 KiB/s rd, 1023 B/s wr, 9 op/s 2024-08-02T19:00:25.402 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.401+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f7a6c109e00 con 0x7f7a6c102c20 2024-08-02T19:00:25.405 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.403+0000 7f7a637fe640 1 -- 172.21.15.103:0/2762195047 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v40) ==== 161+0+0 (secure 0 0 0) 0x7f7a640bc5d0 con 0x7f7a6c102c20 2024-08-02T19:00:25.405 INFO:teuthology.orchestra.run.smithi103.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-08-02T19:00:25.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a580a2cf0 msgr2=0x7f7a580a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:25.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a580a2cf0 0x7f7a580a51b0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f7a5c005fd0 tx=0x7f7a5c009870 comp rx=0 tx=0).stop 2024-08-02T19:00:25.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 msgr2=0x7f7a6c19cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:25.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 0x7f7a6c19cbb0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f7a64004770 tx=0x7f7a64004c00 comp rx=0 tx=0).stop 2024-08-02T19:00:25.408 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 shutdown_connections 2024-08-02T19:00:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f7a580a2cf0 0x7f7a580a51b0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f7a6c102c20 0x7f7a6c19cbb0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f7a6c1022a0 0x7f7a6c198820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 --2- 172.21.15.103:0/2762195047 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f7a6c100b50 0x7f7a6c1982e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 >> 172.21.15.103:0/2762195047 conn(0x7f7a6c0fc500 msgr2=0x7f7a6c069e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 shutdown_connections 2024-08-02T19:00:25.409 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:25.407+0000 7f7a70a2e640 1 -- 172.21.15.103:0/2762195047 wait complete. 2024-08-02T19:00:25.751 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h[66850]: ignoring --setuser ceph since I am not root 2024-08-02T19:00:25.751 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h[66850]: ignoring --setgroup ceph since I am not root 2024-08-02T19:00:25.751 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mds[66854]: -- 172.21.15.121:0/334945209 <== mon.2 v2:172.21.15.121:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55ffe3ff7c20 con 0x55ffe3fd4800 2024-08-02T19:00:25.751 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h[66850]: starting mds.h at 2024-08-02T19:00:25.751 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e[66546]: ignoring --setuser ceph since I am not root 2024-08-02T19:00:25.751 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e[66546]: ignoring --setgroup ceph since I am not root 2024-08-02T19:00:25.751 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mds[66550]: -- 172.21.15.121:0/3624641403 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x556a3656f860 con 0x556a3654d400 2024-08-02T19:00:25.751 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e[66546]: starting mds.e at 2024-08-02T19:00:25.752 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b[67166]: ignoring --setuser ceph since I am not root 2024-08-02T19:00:25.752 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b[67166]: ignoring --setgroup ceph since I am not root 2024-08-02T19:00:25.752 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mds[67170]: -- 172.21.15.121:0/1900749695 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x561e5d74ed00 con 0x561e5d723000 2024-08-02T19:00:25.752 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mds[67170]: -- 172.21.15.121:0/1900749695 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x561e5d745860 con 0x561e5d723000 2024-08-02T19:00:25.752 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b[67166]: starting mds.b at 2024-08-02T19:00:25.752 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b[67166]: 2024-08-02T19:00:25.450+0000 7f4b8e9b9640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6838/0: (98) Address already in use 2024-08-02T19:00:25.774 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T19:00:25.402+0000 7f4e92e28640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-02T19:00:25.817 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: ignoring --setuser ceph since I am not root 2024-08-02T19:00:25.817 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: ignoring --setgroup ceph since I am not root 2024-08-02T19:00:25.817 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mds[67431]: -- 172.21.15.151:0/4084486952 <== mon.1 v2:172.21.15.151:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x563604879860 con 0x563604857000 2024-08-02T19:00:25.817 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: starting mds.i at 2024-08-02T19:00:25.817 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: ignoring --setuser ceph since I am not root 2024-08-02T19:00:25.817 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: ignoring --setgroup ceph since I am not root 2024-08-02T19:00:25.818 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: starting mds.c at 2024-08-02T19:00:25.818 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f[66811]: ignoring --setuser ceph since I am not root 2024-08-02T19:00:25.818 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f[66811]: ignoring --setgroup ceph since I am not root 2024-08-02T19:00:25.818 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mds[66815]: -- 172.21.15.151:0/268818118 <== mon.0 v2:172.21.15.103:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5580545dd860 con 0x5580545bb000 2024-08-02T19:00:25.818 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f[66811]: starting mds.f at 2024-08-02T19:00:26.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2762195047' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-02T19:00:26.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mon[37155]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-02T19:00:26.070 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mon[37155]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-02T19:00:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mon[37155]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-08-02T19:00:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/2762195047' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-02T19:00:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mon[37155]: osdmap e101: 12 total, 12 up, 12 in 2024-08-02T19:00:26.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:25 smithi151 ceph-mon[37155]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-02T19:00:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:25 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2762195047' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-02T19:00:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:25 smithi103 ceph-mon[32753]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-02T19:00:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:25 smithi103 ceph-mon[32753]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-02T19:00:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:25 smithi103 ceph-mon[32753]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-08-02T19:00:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:25 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/2762195047' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-02T19:00:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:25 smithi103 ceph-mon[32753]: osdmap e101: 12 total, 12 up, 12 in 2024-08-02T19:00:26.075 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:25 smithi103 ceph-mon[32753]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-02T19:00:26.138 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph fs rm cephfs --yes-i-really-mean-it 2024-08-02T19:00:26.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2762195047' entity='client.admin' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-08-02T19:00:26.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mon[37236]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-08-02T19:00:26.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mon[37236]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-08-02T19:00:26.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mon[37236]: Health check cleared: MDS_DAMAGE (was: 2 MDSs report damaged metadata) 2024-08-02T19:00:26.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/2762195047' entity='client.admin' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-08-02T19:00:26.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mon[37236]: osdmap e101: 12 total, 12 up, 12 in 2024-08-02T19:00:26.251 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:25 smithi121 ceph-mon[37236]: fsmap cephfs:0/3 6 up:standby, 3 failed 2024-08-02T19:00:26.393 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 -- 172.21.15.103:0/1214022317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 msgr2=0x7f68c810e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1214022317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 0x7f68c810e970 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009cd0 tx=0x7f68c002a8e0 comp rx=0 tx=0).stop 2024-08-02T19:00:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 -- 172.21.15.103:0/1214022317 shutdown_connections 2024-08-02T19:00:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1214022317 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 0x7f68c810e970 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1214022317 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c8103410 0x7f68c81078c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1214022317 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c8102a60 0x7f68c8102e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:26.897 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 -- 172.21.15.103:0/1214022317 >> 172.21.15.103:0/1214022317 conn(0x7f68c80fc500 msgr2=0x7f68c80fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 -- 172.21.15.103:0/1214022317 shutdown_connections 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 -- 172.21.15.103:0/1214022317 wait complete. 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 Processor -- start 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.877+0000 7f68cd80a640 1 -- start start 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cd80a640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c8102a60 0x7f68c8198320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cd80a640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c8103410 0x7f68c8198860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cd80a640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 0x7f68c819cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cd80a640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f68c8111ef0 con 0x7f68c8107fd0 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cd80a640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f68c8111d70 con 0x7f68c8102a60 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cd80a640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f68c8112070 con 0x7f68c8103410 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 0x7f68c819cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 0x7f68c819cbf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53438/0 (socket says 172.21.15.103:53438) 2024-08-02T19:00:26.898 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 -- 172.21.15.103:0/1025498868 learned_addr learned my addr 172.21.15.103:0/1025498868 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c67fc640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c8103410 0x7f68c8198860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c6ffd640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c8102a60 0x7f68c8198320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 -- 172.21.15.103:0/1025498868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c8103410 msgr2=0x7f68c8198860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c8103410 0x7f68c8198860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 -- 172.21.15.103:0/1025498868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c8102a60 msgr2=0x7f68c8198320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c8102a60 0x7f68c8198320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 -- 172.21.15.103:0/1025498868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f68c819d2d0 con 0x7f68c8107fd0 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c6ffd640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c8102a60 0x7f68c8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68c77fe640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 0x7f68c819cbf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009df0 tx=0x7f68c0032c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cc808640 1 -- 172.21.15.103:0/1025498868 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c0004240 con 0x7f68c8107fd0 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cc808640 1 -- 172.21.15.103:0/1025498868 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f68c0003e20 con 0x7f68c8107fd0 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f68c819d560 con 0x7f68c8107fd0 2024-08-02T19:00:26.899 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.878+0000 7f68cc808640 1 -- 172.21.15.103:0/1025498868 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f68c00466e0 con 0x7f68c8107fd0 2024-08-02T19:00:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.879+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f68c81a4ea0 con 0x7f68c8107fd0 2024-08-02T19:00:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.879+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f68c8102e40 con 0x7f68c8107fd0 2024-08-02T19:00:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.881+0000 7f68cc808640 1 -- 172.21.15.103:0/1025498868 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f68c00307c0 con 0x7f68c8107fd0 2024-08-02T19:00:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.882+0000 7f68cc808640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f68b40a2d70 0x7f68b40a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.882+0000 7f68c6ffd640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f68b40a2d70 0x7f68b40a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.882+0000 7f68cc808640 1 -- 172.21.15.103:0/1025498868 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9608+0+0 (secure 0 0 0) 0x7f68c002e030 con 0x7f68c8107fd0 2024-08-02T19:00:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.882+0000 7f68c6ffd640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f68b40a2d70 0x7f68b40a5230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68b80058c0 tx=0x7f68b8005ec0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:26.900 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:26.884+0000 7f68cc808640 1 -- 172.21.15.103:0/1025498868 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f68c004b060 con 0x7f68c8107fd0 2024-08-02T19:00:27.090 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.089+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7f68c81a5070 con 0x7f68c8107fd0 2024-08-02T19:00:27.411 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.409+0000 7f68cc808640 1 -- 172.21.15.103:0/1025498868 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v42) ==== 104+0+0 (secure 0 0 0) 0x7f68c00098b0 con 0x7f68c8107fd0 2024-08-02T19:00:27.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.411+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f68b40a2d70 msgr2=0x7f68b40a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:27.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.411+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f68b40a2d70 0x7f68b40a5230 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f68b80058c0 tx=0x7f68b8005ec0 comp rx=0 tx=0).stop 2024-08-02T19:00:27.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.411+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 msgr2=0x7f68c819cbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:27.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.411+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 0x7f68c819cbf0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f68c0009df0 tx=0x7f68c0032c00 comp rx=0 tx=0).stop 2024-08-02T19:00:27.414 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.412+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 shutdown_connections 2024-08-02T19:00:27.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.412+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f68b40a2d70 0x7f68b40a5230 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:27.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.412+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f68c8107fd0 0x7f68c819cbf0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:27.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.412+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f68c8103410 0x7f68c8198860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:27.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.412+0000 7f68cd80a640 1 --2- 172.21.15.103:0/1025498868 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f68c8102a60 0x7f68c8198320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:27.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.412+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 >> 172.21.15.103:0/1025498868 conn(0x7f68c80fc500 msgr2=0x7f68c80fe080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:27.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.412+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 shutdown_connections 2024-08-02T19:00:27.415 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:27.412+0000 7f68cd80a640 1 -- 172.21.15.103:0/1025498868 wait complete. 2024-08-02T19:00:27.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: pgmap v335: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 924 B/s wr, 8 op/s 2024-08-02T19:00:27.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6834/3111233090,v1:172.21.15.151:6837/3111233090] up:boot 2024-08-02T19:00:27.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6836/2267121413,v1:172.21.15.151:6839/2267121413] up:boot 2024-08-02T19:00:27.743 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.121:6834/3835622989,v1:172.21.15.121:6837/3835622989] up:boot 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.121:6836/3035143627,v1:172.21.15.121:6839/3035143627] up:boot 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.121:6835/3434296778,v1:172.21.15.121:6838/3434296778] up:boot 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: mds.? [v2:172.21.15.151:6835/3952192997,v1:172.21.15.151:6838/3952192997] up:boot 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T19:00:27.744 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:27 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1025498868' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: pgmap v335: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 924 B/s wr, 8 op/s 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6834/3111233090,v1:172.21.15.151:6837/3111233090] up:boot 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6836/2267121413,v1:172.21.15.151:6839/2267121413] up:boot 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.121:6834/3835622989,v1:172.21.15.121:6837/3835622989] up:boot 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.121:6836/3035143627,v1:172.21.15.121:6839/3035143627] up:boot 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.121:6835/3434296778,v1:172.21.15.121:6838/3434296778] up:boot 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: mds.? [v2:172.21.15.151:6835/3952192997,v1:172.21.15.151:6838/3952192997] up:boot 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T19:00:27.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T19:00:27.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T19:00:27.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T19:00:27.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T19:00:27.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T19:00:27.752 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:27 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1025498868' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-02T19:00:27.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: pgmap v335: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 924 B/s wr, 8 op/s 2024-08-02T19:00:27.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6834/3111233090,v1:172.21.15.151:6837/3111233090] up:boot 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6836/2267121413,v1:172.21.15.151:6839/2267121413] up:boot 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.121:6834/3835622989,v1:172.21.15.121:6837/3835622989] up:boot 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.121:6836/3035143627,v1:172.21.15.121:6839/3035143627] up:boot 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.121:6835/3434296778,v1:172.21.15.121:6838/3434296778] up:boot 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: mds.? [v2:172.21.15.151:6835/3952192997,v1:172.21.15.151:6838/3952192997] up:boot 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: fsmap cephfs:0/3 12 up:standby, 3 failed 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "h"}]: dispatch 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "b"}]: dispatch 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "c"}]: dispatch 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "i"}]: dispatch 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "f"}]: dispatch 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: from='mgr.15252 172.21.15.103:0/3238020314' entity='mgr.x' cmd=[{"prefix": "mds metadata", "who": "e"}]: dispatch 2024-08-02T19:00:27.821 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:27 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1025498868' entity='client.admin' cmd=[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]: dispatch 2024-08-02T19:00:28.054 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-08-02T19:00:28.313 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:28.706 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:28 smithi103 ceph-mon[32753]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-02T19:00:28.707 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:28 smithi103 ceph-mon[32753]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-02T19:00:28.707 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:28 smithi103 ceph-mon[32753]: Cluster is now healthy 2024-08-02T19:00:28.707 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:28 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1025498868' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-02T19:00:28.707 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:28 smithi103 ceph-mon[32753]: fsmap 12 up:standby 2024-08-02T19:00:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:28 smithi121 ceph-mon[37236]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-02T19:00:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:28 smithi121 ceph-mon[37236]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-02T19:00:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:28 smithi121 ceph-mon[37236]: Cluster is now healthy 2024-08-02T19:00:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:28 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1025498868' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-02T19:00:28.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:28 smithi121 ceph-mon[37236]: fsmap 12 up:standby 2024-08-02T19:00:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/3740646801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 msgr2=0x7fcc281026e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/3740646801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 0x7fcc281026e0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c009900 tx=0x7fcc1c02a480 comp rx=0 tx=0).stop 2024-08-02T19:00:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/3740646801 shutdown_connections 2024-08-02T19:00:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/3740646801 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc28102c20 0x7fcc2810d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/3740646801 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 0x7fcc281026e0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/3740646801 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc28100b50 0x7fcc28100f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/3740646801 >> 172.21.15.103:0/3740646801 conn(0x7fcc280fc500 msgr2=0x7fcc280fe920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:28.815 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/3740646801 shutdown_connections 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/3740646801 wait complete. 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.790+0000 7fcc2d8b1640 1 Processor -- start 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc2d8b1640 1 -- start start 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc2d8b1640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc28100b50 0x7fcc280fc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc2d8b1640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 0x7fcc280fcef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc2d8b1640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc28102c20 0x7fcc280fd430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc2d8b1640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28110dd0 con 0x7fcc281022a0 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc2d8b1640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28110c50 con 0x7fcc28100b50 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc2d8b1640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7fcc28110f50 con 0x7fcc28102c20 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 0x7fcc280fcef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc267fc640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 0x7fcc280fcef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:53452/0 (socket says 172.21.15.103:53452) 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc267fc640 1 -- 172.21.15.103:0/1570609668 learned_addr learned my addr 172.21.15.103:0/1570609668 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:28.816 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc277fe640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc28102c20 0x7fcc280fd430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc26ffd640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc28100b50 0x7fcc280fc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc267fc640 1 -- 172.21.15.103:0/1570609668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc28102c20 msgr2=0x7fcc280fd430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc267fc640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc28102c20 0x7fcc280fd430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc267fc640 1 -- 172.21.15.103:0/1570609668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc28100b50 msgr2=0x7fcc280fc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc267fc640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc28100b50 0x7fcc280fc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc267fc640 1 -- 172.21.15.103:0/1570609668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc281a6810 con 0x7fcc281022a0 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.791+0000 7fcc277fe640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc28102c20 0x7fcc280fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.792+0000 7fcc267fc640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 0x7fcc280fcef0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c006010 tx=0x7fcc1c004c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.792+0000 7fcc2c8af640 1 -- 172.21.15.103:0/1570609668 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c03f030 con 0x7fcc281022a0 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.792+0000 7fcc2c8af640 1 -- 172.21.15.103:0/1570609668 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7fcc1c005500 con 0x7fcc281022a0 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.792+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc281a6aa0 con 0x7fcc281022a0 2024-08-02T19:00:28.817 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.792+0000 7fcc2c8af640 1 -- 172.21.15.103:0/1570609668 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc1c035070 con 0x7fcc281022a0 2024-08-02T19:00:28.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.792+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc281a6fd0 con 0x7fcc281022a0 2024-08-02T19:00:28.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.793+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc28100f30 con 0x7fcc281022a0 2024-08-02T19:00:28.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.794+0000 7fcc2c8af640 1 -- 172.21.15.103:0/1570609668 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7fcc1c042030 con 0x7fcc281022a0 2024-08-02T19:00:28.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.795+0000 7fcc2c8af640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcc100a2d70 0x7fcc100a5230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:28.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.795+0000 7fcc26ffd640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcc100a2d70 0x7fcc100a5230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:28.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.795+0000 7fcc2c8af640 1 -- 172.21.15.103:0/1570609668 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(101..101 src has 1..101) ==== 9608+0+0 (secure 0 0 0) 0x7fcc1c0efde0 con 0x7fcc281022a0 2024-08-02T19:00:28.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.795+0000 7fcc26ffd640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcc100a2d70 0x7fcc100a5230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcc180058c0 tx=0x7fcc18005c60 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:28.818 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.799+0000 7fcc2c8af640 1 -- 172.21.15.103:0/1570609668 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7fcc1c0bc5c0 con 0x7fcc281022a0 2024-08-02T19:00:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:28 smithi151 ceph-mon[37155]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-08-02T19:00:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:28 smithi151 ceph-mon[37155]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-08-02T19:00:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:28 smithi151 ceph-mon[37155]: Cluster is now healthy 2024-08-02T19:00:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:28 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1025498868' entity='client.admin' cmd='[{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]': finished 2024-08-02T19:00:28.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:28 smithi151 ceph-mon[37155]: fsmap 12 up:standby 2024-08-02T19:00:28.967 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:28.964+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fcc28109dd0 con 0x7fcc281022a0 2024-08-02T19:00:29.430 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.427+0000 7fcc2c8af640 1 -- 172.21.15.103:0/1570609668 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v102) ==== 181+0+0 (secure 0 0 0) 0x7fcc1c0bbec0 con 0x7fcc281022a0 2024-08-02T19:00:29.430 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_metadata' removed 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.429+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcc100a2d70 msgr2=0x7fcc100a5230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.429+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcc100a2d70 0x7fcc100a5230 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fcc180058c0 tx=0x7fcc18005c60 comp rx=0 tx=0).stop 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.429+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 msgr2=0x7fcc280fcef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.429+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 0x7fcc280fcef0 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fcc1c006010 tx=0x7fcc1c004c00 comp rx=0 tx=0).stop 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.429+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 shutdown_connections 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.429+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7fcc100a2d70 0x7fcc100a5230 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.430+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7fcc28102c20 0x7fcc280fd430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.430+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7fcc281022a0 0x7fcc280fcef0 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.430+0000 7fcc2d8b1640 1 --2- 172.21.15.103:0/1570609668 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7fcc28100b50 0x7fcc280fc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.430+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 >> 172.21.15.103:0/1570609668 conn(0x7fcc280fc500 msgr2=0x7fcc28069f80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:29.432 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.430+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 shutdown_connections 2024-08-02T19:00:29.433 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:29.430+0000 7fcc2d8b1640 1 -- 172.21.15.103:0/1570609668 wait complete. 2024-08-02T19:00:29.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:29 smithi103 ceph-mon[32753]: pgmap v336: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 8 op/s 2024-08-02T19:00:29.575 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:29 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1570609668' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:29.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:29 smithi121 ceph-mon[37236]: pgmap v336: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 8 op/s 2024-08-02T19:00:29.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:29 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1570609668' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:29.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:29 smithi151 ceph-mon[37155]: pgmap v336: 129 pgs: 129 active+clean; 78 MiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail; 3.3 KiB/s rd, 921 B/s wr, 8 op/s 2024-08-02T19:00:29.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:29 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1570609668' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:30.169 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-08-02T19:00:30.431 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:30.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:30 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/1570609668' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:30.711 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:30 smithi103 ceph-mon[32753]: osdmap e102: 12 total, 12 up, 12 in 2024-08-02T19:00:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:30 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/1570609668' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:30.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:30 smithi121 ceph-mon[37236]: osdmap e102: 12 total, 12 up, 12 in 2024-08-02T19:00:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:30 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/1570609668' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:30.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:30 smithi151 ceph-mon[37155]: osdmap e102: 12 total, 12 up, 12 in 2024-08-02T19:00:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 -- 172.21.15.103:0/1205089445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641007b0 msgr2=0x7f9d64100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:30.950 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 --2- 172.21.15.103:0/1205089445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641007b0 0x7f9d64100c10 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f9d54009930 tx=0x7f9d5402a420 comp rx=0 tx=0).stop 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 -- 172.21.15.103:0/1205089445 shutdown_connections 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 --2- 172.21.15.103:0/1205089445 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64101150 0x7f9d6410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 --2- 172.21.15.103:0/1205089445 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641007b0 0x7f9d64100c10 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 --2- 172.21.15.103:0/1205089445 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d641067b0 0x7f9d64106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 -- 172.21.15.103:0/1205089445 >> 172.21.15.103:0/1205089445 conn(0x7f9d640fc4d0 msgr2=0x7f9d640fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 -- 172.21.15.103:0/1205089445 shutdown_connections 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.941+0000 7f9d6c405640 1 -- 172.21.15.103:0/1205089445 wait complete. 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6c405640 1 Processor -- start 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6c405640 1 -- start start 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6c405640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d641007b0 0x7f9d641982b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6c405640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64101150 0x7f9d641987f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6c405640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641067b0 0x7f9d6419cb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:30.951 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6c405640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64110cd0 con 0x7f9d641067b0 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6c405640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64110b50 con 0x7f9d64101150 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6c405640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f9d64110e50 con 0x7f9d641007b0 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6a9a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641067b0 0x7f9d6419cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6a9a2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641067b0 0x7f9d6419cb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50590/0 (socket says 172.21.15.103:50590) 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6a9a2640 1 -- 172.21.15.103:0/3880514874 learned_addr learned my addr 172.21.15.103:0/3880514874 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d6a1a1640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d641007b0 0x7f9d641982b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.942+0000 7f9d699a0640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64101150 0x7f9d641987f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d6a9a2640 1 -- 172.21.15.103:0/3880514874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d641007b0 msgr2=0x7f9d641982b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d6a9a2640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d641007b0 0x7f9d641982b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d6a9a2640 1 -- 172.21.15.103:0/3880514874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64101150 msgr2=0x7f9d641987f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d6a9a2640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64101150 0x7f9d641987f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:30.952 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d6a9a2640 1 -- 172.21.15.103:0/3880514874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d6419d260 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d6a9a2640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641067b0 0x7f9d6419cb80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009fd0 tx=0x7f9d5c00b260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d5b7fe640 1 -- 172.21.15.103:0/3880514874 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c017070 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d5b7fe640 1 -- 172.21.15.103:0/3880514874 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f9d5c004020 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d6419d550 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d5b7fe640 1 -- 172.21.15.103:0/3880514874 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d5c0106c0 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.943+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d641a4e30 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.944+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d64100c10 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.945+0000 7f9d5b7fe640 1 -- 172.21.15.103:0/3880514874 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f9d5c0041d0 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.946+0000 7f9d5b7fe640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9d500a2cf0 0x7f9d500a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.946+0000 7f9d6a1a1640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9d500a2cf0 0x7f9d500a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.946+0000 7f9d5b7fe640 1 -- 172.21.15.103:0/3880514874 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(102..102 src has 1..102) ==== 9112+0+0 (secure 0 0 0) 0x7f9d5c0cf340 con 0x7f9d641067b0 2024-08-02T19:00:30.953 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.946+0000 7f9d6a1a1640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9d500a2cf0 0x7f9d500a51b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000bb60 tx=0x7f9d6000b390 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:30.954 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:30.950+0000 7f9d5b7fe640 1 -- 172.21.15.103:0/3880514874 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f9d5c09b6c0 con 0x7f9d641067b0 2024-08-02T19:00:31.123 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.120+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7f9d64109d30 con 0x7f9d641067b0 2024-08-02T19:00:31.437 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.435+0000 7f9d5b7fe640 1 -- 172.21.15.103:0/3880514874 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v103) ==== 169+0+0 (secure 0 0 0) 0x7f9d5c09f9c0 con 0x7f9d641067b0 2024-08-02T19:00:31.437 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data' removed 2024-08-02T19:00:31.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.437+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9d500a2cf0 msgr2=0x7f9d500a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:31.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.437+0000 7f9d6c405640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9d500a2cf0 0x7f9d500a51b0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f9d6000bb60 tx=0x7f9d6000b390 comp rx=0 tx=0).stop 2024-08-02T19:00:31.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.437+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641067b0 msgr2=0x7f9d6419cb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:31.440 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.437+0000 7f9d6c405640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641067b0 0x7f9d6419cb80 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c009fd0 tx=0x7f9d5c00b260 comp rx=0 tx=0).stop 2024-08-02T19:00:31.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.439+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 shutdown_connections 2024-08-02T19:00:31.442 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.439+0000 7f9d6c405640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f9d500a2cf0 0x7f9d500a51b0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:31.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.439+0000 7f9d6c405640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f9d641067b0 0x7f9d6419cb80 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:31.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.439+0000 7f9d6c405640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f9d64101150 0x7f9d641987f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:31.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.439+0000 7f9d6c405640 1 --2- 172.21.15.103:0/3880514874 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f9d641007b0 0x7f9d641982b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:31.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.439+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 >> 172.21.15.103:0/3880514874 conn(0x7f9d640fc4d0 msgr2=0x7f9d6406a7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:31.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.440+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 shutdown_connections 2024-08-02T19:00:31.443 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:31.440+0000 7f9d6c405640 1 -- 172.21.15.103:0/3880514874 wait complete. 2024-08-02T19:00:31.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:31 smithi121 ceph-mon[37236]: pgmap v338: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T19:00:31.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:31 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3880514874' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:31.763 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:31 smithi103 ceph-mon[32753]: pgmap v338: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T19:00:31.763 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:31 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3880514874' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:31.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:31 smithi151 ceph-mon[37155]: pgmap v338: 97 pgs: 97 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T19:00:31.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:31 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3880514874' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:32.155 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm --image quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea shell --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 -- ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-08-02T19:00:32.422 INFO:teuthology.orchestra.run.smithi103.stderr:Inferring config /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/mon.a/config 2024-08-02T19:00:32.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:32 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/3880514874' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:32.700 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:32 smithi103 ceph-mon[32753]: osdmap e103: 12 total, 12 up, 12 in 2024-08-02T19:00:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:32 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/3880514874' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:32.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:32 smithi121 ceph-mon[37236]: osdmap e103: 12 total, 12 up, 12 in 2024-08-02T19:00:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:32 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/3880514874' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:32.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:32 smithi151 ceph-mon[37155]: osdmap e103: 12 total, 12 up, 12 in 2024-08-02T19:00:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 -- 172.21.15.103:0/823696724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 msgr2=0x7f32a4100c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 --2- 172.21.15.103:0/823696724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 0x7f32a4100c10 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f3298009930 tx=0x7f329802a420 comp rx=0 tx=0).stop 2024-08-02T19:00:32.935 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 -- 172.21.15.103:0/823696724 shutdown_connections 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 --2- 172.21.15.103:0/823696724 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32a4101150 0x7f32a410d680 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 --2- 172.21.15.103:0/823696724 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 0x7f32a4100c10 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 --2- 172.21.15.103:0/823696724 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32a41067b0 0x7f32a4106b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 -- 172.21.15.103:0/823696724 >> 172.21.15.103:0/823696724 conn(0x7f32a40fc4d0 msgr2=0x7f32a40fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 -- 172.21.15.103:0/823696724 shutdown_connections 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.917+0000 7f32a8db2640 1 -- 172.21.15.103:0/823696724 wait complete. 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a8db2640 1 Processor -- start 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a8db2640 1 -- start start 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a8db2640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 0x7f32a4199160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a8db2640 1 --2- >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32a4101150 0x7f32a41996a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a8db2640 1 --2- >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32a41067b0 0x7f32a41a41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:32.936 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a8db2640 1 -- --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4110d10 con 0x7f32a41007b0 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a8db2640 1 -- --> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4110b90 con 0x7f32a4101150 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a8db2640 1 -- --> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] -- mon_getmap magic: 0 -- 0x7f32a4110e90 con 0x7f32a41067b0 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 0x7f32a4199160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a259c640 1 --2- >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 0x7f32a4199160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.103:3300/0 says I am v2:172.21.15.103:50616/0 (socket says 172.21.15.103:50616) 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a259c640 1 -- 172.21.15.103:0/4285048988 learned_addr learned my addr 172.21.15.103:0/4285048988 (peer_addr_for_me v2:172.21.15.103:0/0) 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.918+0000 7f32a1d9b640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32a4101150 0x7f32a41996a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a2d9d640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32a41067b0 0x7f32a41a41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a259c640 1 -- 172.21.15.103:0/4285048988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32a41067b0 msgr2=0x7f32a41a41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a259c640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32a41067b0 0x7f32a41a41e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a259c640 1 -- 172.21.15.103:0/4285048988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32a4101150 msgr2=0x7f32a41996a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a259c640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32a4101150 0x7f32a41996a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a259c640 1 -- 172.21.15.103:0/4285048988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32a41a4720 con 0x7f32a41007b0 2024-08-02T19:00:32.937 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a2d9d640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32a41067b0 0x7f32a41a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a259c640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 0x7f32a4199160 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f329400b4a0 tx=0x7f329400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32937fe640 1 -- 172.21.15.103:0/4285048988 <== mon.0 v2:172.21.15.103:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294014070 con 0x7f32a41007b0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32a41a48f0 con 0x7f32a41007b0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32937fe640 1 -- 172.21.15.103:0/4285048988 <== mon.0 v2:172.21.15.103:3300/0 2 ==== config(28 keys) ==== 1174+0+0 (secure 0 0 0) 0x7f3294010b10 con 0x7f32a41007b0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32937fe640 1 -- 172.21.15.103:0/4285048988 <== mon.0 v2:172.21.15.103:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3294017d60 con 0x7f32a41007b0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.919+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32a41a4e00 con 0x7f32a41007b0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.920+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32a4100c10 con 0x7f32a41007b0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.921+0000 7f32937fe640 1 -- 172.21.15.103:0/4285048988 <== mon.0 v2:172.21.15.103:3300/0 4 ==== mgrmap(e 26) ==== 137965+0+0 (secure 0 0 0) 0x7f3294017070 con 0x7f32a41007b0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.922+0000 7f32937fe640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f328c0a2cf0 0x7f328c0a51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.922+0000 7f32a1d9b640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f328c0a2cf0 0x7f328c0a51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.922+0000 7f32937fe640 1 -- 172.21.15.103:0/4285048988 <== mon.0 v2:172.21.15.103:3300/0 5 ==== osd_map(103..103 src has 1..103) ==== 8582+0+0 (secure 0 0 0) 0x7f32940ce700 con 0x7f32a41007b0 2024-08-02T19:00:32.938 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.922+0000 7f32a1d9b640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f328c0a2cf0 0x7f328c0a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3298009900 tx=0x7f32980058d0 comp rx=0 tx=0).ready entity=mgr.15252 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-08-02T19:00:32.939 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:32.926+0000 7f32937fe640 1 -- 172.21.15.103:0/4285048988 <== mon.0 v2:172.21.15.103:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+187871 (secure 0 0 0) 0x7f329409b3f0 con 0x7f32a41007b0 2024-08-02T19:00:33.097 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.095+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 --> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f32a4108d40 con 0x7f32a41007b0 2024-08-02T19:00:33.450 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.447+0000 7f32937fe640 1 -- 172.21.15.103:0/4285048988 <== mon.0 v2:172.21.15.103:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v104) ==== 178+0+0 (secure 0 0 0) 0x7f329409acf0 con 0x7f32a41007b0 2024-08-02T19:00:33.450 INFO:teuthology.orchestra.run.smithi103.stderr:pool 'cephfs_data_ec' removed 2024-08-02T19:00:33.452 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f328c0a2cf0 msgr2=0x7f328c0a51b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f328c0a2cf0 0x7f328c0a51b0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f3298009900 tx=0x7f32980058d0 comp rx=0 tx=0).stop 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 msgr2=0x7f32a4199160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 0x7f32a4199160 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f329400b4a0 tx=0x7f329400b960 comp rx=0 tx=0).stop 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 shutdown_connections 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:6800/1161044409,v1:172.21.15.103:6801/1161044409] conn(0x7f328c0a2cf0 0x7f328c0a51b0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.151:3300/0,v1:172.21.15.151:6789/0] conn(0x7f32a41067b0 0x7f32a41a41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.121:3300/0,v1:172.21.15.121:6789/0] conn(0x7f32a4101150 0x7f32a41996a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 --2- 172.21.15.103:0/4285048988 >> [v2:172.21.15.103:3300/0,v1:172.21.15.103:6789/0] conn(0x7f32a41007b0 0x7f32a4199160 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 >> 172.21.15.103:0/4285048988 conn(0x7f32a40fc4d0 msgr2=0x7f32a40fcbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-08-02T19:00:33.453 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 shutdown_connections 2024-08-02T19:00:33.454 INFO:teuthology.orchestra.run.smithi103.stderr:2024-08-02T19:00:33.450+0000 7f32a8db2640 1 -- 172.21.15.103:0/4285048988 wait complete. 2024-08-02T19:00:33.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:33 smithi121 ceph-mon[37236]: pgmap v340: 33 pgs: 33 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T19:00:33.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:33 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4285048988' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:33.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:33 smithi151 ceph-mon[37155]: pgmap v340: 33 pgs: 33 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T19:00:33.820 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:33 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4285048988' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:33.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:33 smithi103 ceph-mon[32753]: pgmap v340: 33 pgs: 33 active+clean; 577 KiB data, 1.1 GiB used, 1.0 TiB / 1.0 TiB avail 2024-08-02T19:00:33.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:33 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4285048988' entity='client.admin' cmd=[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]: dispatch 2024-08-02T19:00:34.235 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-02T19:00:34.263 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-02T19:00:34.294 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-02T19:00:34.324 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-08-02T19:00:34.324 DEBUG:teuthology.orchestra.run.smithi103:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-02T19:00:34.340 DEBUG:teuthology.orchestra.run.smithi121:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-02T19:00:34.358 DEBUG:teuthology.orchestra.run.smithi151:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-08-02T19:00:34.380 INFO:tasks.cephadm:Stopping all daemons... 2024-08-02T19:00:34.381 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-08-02T19:00:34.381 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.a 2024-08-02T19:00:34.467 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:34 smithi103 systemd[1]: Stopping Ceph mon.a for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:34.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:34 smithi151 ceph-mon[37155]: from='client.? 172.21.15.103:0/4285048988' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:34.570 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:34 smithi151 ceph-mon[37155]: osdmap e104: 12 total, 12 up, 12 in 2024-08-02T19:00:34.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:34 smithi121 ceph-mon[37236]: from='client.? 172.21.15.103:0/4285048988' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:34.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:34 smithi121 ceph-mon[37236]: osdmap e104: 12 total, 12 up, 12 in 2024-08-02T19:00:34.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:34 smithi103 ceph-mon[32753]: from='client.? 172.21.15.103:0/4285048988' entity='client.admin' cmd='[{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]': finished 2024-08-02T19:00:34.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:34 smithi103 ceph-mon[32753]: osdmap e104: 12 total, 12 up, 12 in 2024-08-02T19:00:34.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:34 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T19:00:34.684+0000 7f4e98633640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:00:34.825 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:34 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a[32749]: 2024-08-02T19:00:34.684+0000 7f4e98633640 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-08-02T19:00:35.196 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:34 smithi103 podman[100780]: 2024-08-02 19:00:34.890278815 +0000 UTC m=+0.320532536 container died 966880a17b7ef183c4591605a15ce81cae8ca90c6c21aee8618511f388d83b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T19:00:35.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:35 smithi103 podman[100780]: 2024-08-02 19:00:35.294756024 +0000 UTC m=+0.725009779 container cleanup 966880a17b7ef183c4591605a15ce81cae8ca90c6c21aee8618511f388d83b38 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a, ceph=True, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-08-02T19:00:35.539 INFO:journalctl@ceph.mon.a.smithi103.stdout:Aug 02 19:00:35 smithi103 bash[100780]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-a 2024-08-02T19:00:35.696 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.a.service' 2024-08-02T19:00:35.745 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:00:35.745 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-08-02T19:00:35.746 INFO:tasks.cephadm.mon.c:Stopping mon.b... 2024-08-02T19:00:35.746 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.b 2024-08-02T19:00:36.058 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:35 smithi121 systemd[1]: Stopping Ceph mon.b for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:36.436 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-b[37232]: 2024-08-02T19:00:36.056+0000 7eff95004640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:00:36.437 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-b[37232]: 2024-08-02T19:00:36.056+0000 7eff95004640 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-08-02T19:00:36.437 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 podman[73025]: 2024-08-02 19:00:36.180009169 +0000 UTC m=+0.239910507 container died 6e33e9aa008247fe94a1d6f8abdfb85120a4a9f42fd9a3076042467b3412b3b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-b, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.36.0) 2024-08-02T19:00:36.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 podman[73025]: 2024-08-02 19:00:36.557962843 +0000 UTC m=+0.617864169 container cleanup 6e33e9aa008247fe94a1d6f8abdfb85120a4a9f42fd9a3076042467b3412b3b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-b, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-08-02T19:00:36.751 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 bash[73025]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-b 2024-08-02T19:00:36.998 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.b.service' 2024-08-02T19:00:37.018 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 podman[73040]: 2024-08-02 19:00:36.760309072 +0000 UTC m=+0.577958701 container remove 6e33e9aa008247fe94a1d6f8abdfb85120a4a9f42fd9a3076042467b3412b3b8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-b, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True) 2024-08-02T19:00:37.019 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 systemd[1]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.b.service: Deactivated successfully. 2024-08-02T19:00:37.019 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 systemd[1]: Stopped Ceph mon.b for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T19:00:37.019 INFO:journalctl@ceph.mon.b.smithi121.stdout:Aug 02 19:00:36 smithi121 systemd[1]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.b.service: Consumed 12.068s CPU time. 2024-08-02T19:00:37.051 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:00:37.051 INFO:tasks.cephadm.mon.c:Stopped mon.b 2024-08-02T19:00:37.051 INFO:tasks.cephadm.mon.c:Stopping mon.c... 2024-08-02T19:00:37.051 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.c 2024-08-02T19:00:37.361 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:37 smithi151 systemd[1]: Stopping Ceph mon.c for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:37.796 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:37 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c[37151]: 2024-08-02T19:00:37.359+0000 7f74b8dea640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:00:37.796 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:37 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c[37151]: 2024-08-02T19:00:37.359+0000 7f74b8dea640 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-08-02T19:00:37.796 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:37 smithi151 podman[73189]: 2024-08-02 19:00:37.49262785 +0000 UTC m=+0.246397566 container died 6d6b6bf8a41ad89ba8856257801fc05d078172b6dda59f7f168e0205190877e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, ceph=True) 2024-08-02T19:00:38.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:37 smithi151 podman[73189]: 2024-08-02 19:00:37.903483127 +0000 UTC m=+0.657252842 container cleanup 6d6b6bf8a41ad89ba8856257801fc05d078172b6dda59f7f168e0205190877e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T19:00:38.071 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:37 smithi151 bash[73189]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c 2024-08-02T19:00:38.388 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.c.service' 2024-08-02T19:00:38.495 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:38 smithi151 podman[73202]: 2024-08-02 19:00:38.164059486 +0000 UTC m=+0.667278603 container remove 6d6b6bf8a41ad89ba8856257801fc05d078172b6dda59f7f168e0205190877e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mon-c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731) 2024-08-02T19:00:38.496 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:38 smithi151 systemd[1]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.c.service: Deactivated successfully. 2024-08-02T19:00:38.496 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:38 smithi151 systemd[1]: Stopped Ceph mon.c for 7ef68402-50fe-11ef-bcca-c7b262605968. 2024-08-02T19:00:38.496 INFO:journalctl@ceph.mon.c.smithi151.stdout:Aug 02 19:00:38 smithi151 systemd[1]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mon.c.service: Consumed 12.518s CPU time. 2024-08-02T19:00:38.521 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:00:38.521 INFO:tasks.cephadm.mon.c:Stopped mon.c 2024-08-02T19:00:38.522 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-08-02T19:00:38.522 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.x 2024-08-02T19:00:38.825 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 19:00:38 smithi103 systemd[1]: Stopping Ceph mgr.x for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:39.243 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 19:00:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x[32981]: 2024-08-02T19:00:38.908+0000 7f78eb4a4640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.x -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:00:39.244 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 19:00:38 smithi103 podman[100900]: 2024-08-02 19:00:38.939479433 +0000 UTC m=+0.218371796 container died ffcd03abcab0639a8afdbe9a965a65a3dc937254d027456f8615aff1b071961f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD) 2024-08-02T19:00:39.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 19:00:39 smithi103 podman[100900]: 2024-08-02 19:00:39.35135348 +0000 UTC m=+0.630245833 container cleanup ffcd03abcab0639a8afdbe9a965a65a3dc937254d027456f8615aff1b071961f (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph:26c3fb8e197dcf7a49a54d1f4c8a7362ee35a8ea, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-02T19:00:39.575 INFO:journalctl@ceph.mgr.x.smithi103.stdout:Aug 02 19:00:39 smithi103 bash[100900]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-x 2024-08-02T19:00:39.724 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.x.service' 2024-08-02T19:00:39.760 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:00:39.760 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-08-02T19:00:39.760 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-08-02T19:00:39.760 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.y 2024-08-02T19:00:40.102 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 19:00:39 smithi121 systemd[1]: Stopping Ceph mgr.y for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:40.375 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 19:00:40 smithi121 podman[73162]: 2024-08-02 19:00:40.100750326 +0000 UTC m=+0.156598422 container died f14d365e8546b69a5dea2bc086c8e763dd180b0156321707d496177d5f1eaea6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8) 2024-08-02T19:00:40.743 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 19:00:40 smithi121 podman[73162]: 2024-08-02 19:00:40.465110566 +0000 UTC m=+0.520958654 container cleanup f14d365e8546b69a5dea2bc086c8e763dd180b0156321707d496177d5f1eaea6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-02T19:00:40.743 INFO:journalctl@ceph.mgr.y.smithi121.stdout:Aug 02 19:00:40 smithi121 bash[73162]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-y 2024-08-02T19:00:40.889 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.y.service' 2024-08-02T19:00:40.933 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:00:40.933 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-08-02T19:00:40.933 INFO:tasks.cephadm.mgr.z:Stopping mgr.z... 2024-08-02T19:00:40.933 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.z 2024-08-02T19:00:41.272 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 19:00:40 smithi151 systemd[1]: Stopping Ceph mgr.z for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:41.561 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 19:00:41 smithi151 podman[73311]: 2024-08-02 19:00:41.271175824 +0000 UTC m=+0.142624220 container died 694d5fc294c9fd904e489d49a42b9b9d1cf43f54f405f95db9962675144d2ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux ) 2024-08-02T19:00:41.820 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 19:00:41 smithi151 podman[73311]: 2024-08-02 19:00:41.685413514 +0000 UTC m=+0.556861898 container cleanup 694d5fc294c9fd904e489d49a42b9b9d1cf43f54f405f95db9962675144d2ac8 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z, ceph=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, io.buildah.version=1.36.0) 2024-08-02T19:00:41.821 INFO:journalctl@ceph.mgr.z.smithi151.stdout:Aug 02 19:00:41 smithi151 bash[73311]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mgr-z 2024-08-02T19:00:42.107 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mgr.z.service' 2024-08-02T19:00:42.143 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:00:42.143 INFO:tasks.cephadm.mgr.z:Stopped mgr.z 2024-08-02T19:00:42.144 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-08-02T19:00:42.144 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.0 2024-08-02T19:00:42.449 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:42 smithi103 systemd[1]: Stopping Ceph osd.0 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:42.825 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0[46741]: 2024-08-02T19:00:42.447+0000 7f5334f07640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:00:42.825 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0[46741]: 2024-08-02T19:00:42.447+0000 7f5334f07640 -1 osd.0 104 *** Got signal Terminated *** 2024-08-02T19:00:42.825 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0[46741]: 2024-08-02T19:00:42.447+0000 7f5334f07640 -1 osd.0 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:00:48.134 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:47 smithi103 podman[101020]: 2024-08-02 19:00:47.840230123 +0000 UTC m=+5.504556830 container died 7135c35acaa3adf3ab58870123123c228a32b722395a6c0458a33cbc6aa3fe9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True) 2024-08-02T19:00:48.501 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:48 smithi103 podman[101020]: 2024-08-02 19:00:48.232673728 +0000 UTC m=+5.897000436 container cleanup 7135c35acaa3adf3ab58870123123c228a32b722395a6c0458a33cbc6aa3fe9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T19:00:48.501 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:48 smithi103 bash[101020]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0 2024-08-02T19:00:48.825 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:48 smithi103 podman[101038]: 2024-08-02 19:00:48.50103565 +0000 UTC m=+0.650384619 container remove 7135c35acaa3adf3ab58870123123c228a32b722395a6c0458a33cbc6aa3fe9a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8) 2024-08-02T19:00:49.138 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:48 smithi103 podman[101127]: 2024-08-02 19:00:48.764740909 +0000 UTC m=+0.017388510 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:00:49.139 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:48 smithi103 podman[101127]: 2024-08-02 19:00:48.885500262 +0000 UTC m=+0.138147853 container create 4318f82ced65393e08d4e94d8d660ffe9808488826c505bda0a45dd6ece4fd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-02T19:00:49.576 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:49 smithi103 podman[101127]: 2024-08-02 19:00:49.138371066 +0000 UTC m=+0.391018668 container init 4318f82ced65393e08d4e94d8d660ffe9808488826c505bda0a45dd6ece4fd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, ceph=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS) 2024-08-02T19:00:49.576 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:49 smithi103 podman[101127]: 2024-08-02 19:00:49.142186358 +0000 UTC m=+0.394833950 container start 4318f82ced65393e08d4e94d8d660ffe9808488826c505bda0a45dd6ece4fd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0-deactivate, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-08-02T19:00:49.576 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:49 smithi103 podman[101127]: 2024-08-02 19:00:49.238531509 +0000 UTC m=+0.491179113 container attach 4318f82ced65393e08d4e94d8d660ffe9808488826c505bda0a45dd6ece4fd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-02T19:00:49.576 INFO:journalctl@ceph.osd.0.smithi103.stdout:Aug 02 19:00:49 smithi103 podman[101127]: 2024-08-02 19:00:49.331532373 +0000 UTC m=+0.584179970 container died 4318f82ced65393e08d4e94d8d660ffe9808488826c505bda0a45dd6ece4fd84 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=) 2024-08-02T19:00:50.026 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.0.service' 2024-08-02T19:00:50.064 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:00:50.065 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-08-02T19:00:50.065 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-08-02T19:00:50.065 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.1 2024-08-02T19:00:50.378 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:50 smithi121 systemd[1]: Stopping Ceph osd.1 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:50.751 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1[41717]: 2024-08-02T19:00:50.377+0000 7f8823439640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:00:50.751 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1[41717]: 2024-08-02T19:00:50.377+0000 7f8823439640 -1 osd.1 104 *** Got signal Terminated *** 2024-08-02T19:00:50.751 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1[41717]: 2024-08-02T19:00:50.377+0000 7f8823439640 -1 osd.1 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:00:55.996 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:55 smithi121 podman[73288]: 2024-08-02 19:00:55.702144718 +0000 UTC m=+5.446295884 container died 0c603d08da45929607a17145072c9dcd50fee02b4a086132a29788acb49fc6d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1, org.label-schema.license=GPLv2, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0) 2024-08-02T19:00:56.251 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:56 smithi121 podman[73288]: 2024-08-02 19:00:56.095042889 +0000 UTC m=+5.839194056 container cleanup 0c603d08da45929607a17145072c9dcd50fee02b4a086132a29788acb49fc6d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-02T19:00:56.251 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:56 smithi121 bash[73288]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1 2024-08-02T19:00:56.717 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:56 smithi121 podman[73304]: 2024-08-02 19:00:56.305638863 +0000 UTC m=+0.603886077 container remove 0c603d08da45929607a17145072c9dcd50fee02b4a086132a29788acb49fc6d6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T19:00:56.993 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:56 smithi121 podman[73392]: 2024-08-02 19:00:56.619562046 +0000 UTC m=+0.017240526 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:00:56.993 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:56 smithi121 podman[73392]: 2024-08-02 19:00:56.756473322 +0000 UTC m=+0.154151805 container create d21e88a252f96ca3d7fcc252f3a1e13bfaf108c78ff31f3838ce48982effdb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1-deactivate, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-02T19:00:57.251 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:56 smithi121 podman[73392]: 2024-08-02 19:00:56.992990616 +0000 UTC m=+0.390669105 container init d21e88a252f96ca3d7fcc252f3a1e13bfaf108c78ff31f3838ce48982effdb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-02T19:00:57.251 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:56 smithi121 podman[73392]: 2024-08-02 19:00:56.996449533 +0000 UTC m=+0.394128013 container start d21e88a252f96ca3d7fcc252f3a1e13bfaf108c78ff31f3838ce48982effdb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1-deactivate, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0) 2024-08-02T19:00:57.251 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:57 smithi121 podman[73392]: 2024-08-02 19:00:57.09285238 +0000 UTC m=+0.490530866 container attach d21e88a252f96ca3d7fcc252f3a1e13bfaf108c78ff31f3838ce48982effdb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1-deactivate, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-02T19:00:57.251 INFO:journalctl@ceph.osd.1.smithi121.stdout:Aug 02 19:00:57 smithi121 podman[73392]: 2024-08-02 19:00:57.180820078 +0000 UTC m=+0.578498559 container died d21e88a252f96ca3d7fcc252f3a1e13bfaf108c78ff31f3838ce48982effdb60 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-1-deactivate, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T19:00:57.866 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.1.service' 2024-08-02T19:00:57.902 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:00:57.903 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-08-02T19:00:57.903 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-08-02T19:00:57.903 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.2 2024-08-02T19:00:58.320 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:00:57 smithi151 systemd[1]: Stopping Ceph osd.2 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:00:58.820 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:00:58 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2[42100]: 2024-08-02T19:00:58.399+0000 7f73e30be640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:00:58.820 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:00:58 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2[42100]: 2024-08-02T19:00:58.399+0000 7f73e30be640 -1 osd.2 104 *** Got signal Terminated *** 2024-08-02T19:00:58.820 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:00:58 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2[42100]: 2024-08-02T19:00:58.399+0000 7f73e30be640 -1 osd.2 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:01:04.169 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:03 smithi151 podman[73448]: 2024-08-02 19:01:03.86197059 +0000 UTC m=+5.761863999 container died b0ef97efbf95064acbf6c9a882947252dabe1f797bc2dbe2cc43e11f9b2c458e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T19:01:04.546 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:04 smithi151 podman[73448]: 2024-08-02 19:01:04.259903625 +0000 UTC m=+6.159797036 container cleanup b0ef97efbf95064acbf6c9a882947252dabe1f797bc2dbe2cc43e11f9b2c458e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, ceph=True) 2024-08-02T19:01:04.546 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:04 smithi151 bash[73448]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2 2024-08-02T19:01:04.820 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:04 smithi151 podman[73481]: 2024-08-02 19:01:04.545376288 +0000 UTC m=+0.675391799 container remove b0ef97efbf95064acbf6c9a882947252dabe1f797bc2dbe2cc43e11f9b2c458e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-02T19:01:05.218 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:04 smithi151 podman[73570]: 2024-08-02 19:01:04.762910608 +0000 UTC m=+0.017037041 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:01:05.218 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:04 smithi151 podman[73570]: 2024-08-02 19:01:04.946657782 +0000 UTC m=+0.200784261 container create 2b525f0debc1b539131a36d640f9975977b71c74709ca949a0b789de9c8b2f86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2-deactivate, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, io.buildah.version=1.36.0) 2024-08-02T19:01:05.570 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:05 smithi151 podman[73570]: 2024-08-02 19:01:05.217319644 +0000 UTC m=+0.471446081 container init 2b525f0debc1b539131a36d640f9975977b71c74709ca949a0b789de9c8b2f86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T19:01:05.570 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:05 smithi151 podman[73570]: 2024-08-02 19:01:05.220921699 +0000 UTC m=+0.475048133 container start 2b525f0debc1b539131a36d640f9975977b71c74709ca949a0b789de9c8b2f86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True) 2024-08-02T19:01:05.570 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:05 smithi151 podman[73570]: 2024-08-02 19:01:05.317184893 +0000 UTC m=+0.571311341 container attach 2b525f0debc1b539131a36d640f9975977b71c74709ca949a0b789de9c8b2f86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T19:01:05.571 INFO:journalctl@ceph.osd.2.smithi151.stdout:Aug 02 19:01:05 smithi151 podman[73570]: 2024-08-02 19:01:05.406884292 +0000 UTC m=+0.661010736 container died 2b525f0debc1b539131a36d640f9975977b71c74709ca949a0b789de9c8b2f86 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-2-deactivate, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-08-02T19:01:06.112 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.2.service' 2024-08-02T19:01:06.159 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:01:06.160 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-08-02T19:01:06.160 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-08-02T19:01:06.160 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.3 2024-08-02T19:01:06.563 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:06 smithi103 systemd[1]: Stopping Ceph osd.3 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:01:06.826 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3[53497]: 2024-08-02T19:01:06.562+0000 7f8802193640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:01:06.826 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3[53497]: 2024-08-02T19:01:06.562+0000 7f8802193640 -1 osd.3 104 *** Got signal Terminated *** 2024-08-02T19:01:06.826 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:06 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3[53497]: 2024-08-02T19:01:06.562+0000 7f8802193640 -1 osd.3 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:01:09.071 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:08 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:08.695+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:09.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:09.159+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:10.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:09.677+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:10.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:10.151+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:10.825 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:10 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3[53497]: 2024-08-02T19:01:10.552+0000 7f87fe7a9640 -1 osd.3 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.898207+0000 front 2024-08-02T19:00:46.898147+0000 (oldest deadline 2024-08-02T19:01:09.798319+0000) 2024-08-02T19:01:11.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:10.725+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:11.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:11.161+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:11.825 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:11 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3[53497]: 2024-08-02T19:01:11.523+0000 7f87fe7a9640 -1 osd.3 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.898207+0000 front 2024-08-02T19:00:46.898147+0000 (oldest deadline 2024-08-02T19:01:09.798319+0000) 2024-08-02T19:01:12.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:11.770+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:12.251 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:11 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:11.754+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:12.325 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:12 smithi103 podman[101246]: 2024-08-02 19:01:12.096458543 +0000 UTC m=+5.736619323 container died 6942644b5e9c5311930a2fb8f16ba881c9b534793bf78cd14141fef7b6ce993c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=) 2024-08-02T19:01:12.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:11 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:11.949+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:12.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:12.198+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:12.643 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:12 smithi103 podman[101246]: 2024-08-02 19:01:12.431607238 +0000 UTC m=+6.071768018 container cleanup 6942644b5e9c5311930a2fb8f16ba881c9b534793bf78cd14141fef7b6ce993c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731) 2024-08-02T19:01:12.644 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:12 smithi103 bash[101246]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3 2024-08-02T19:01:12.991 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:12 smithi103 podman[101272]: 2024-08-02 19:01:12.641655647 +0000 UTC m=+0.542876124 container remove 6942644b5e9c5311930a2fb8f16ba881c9b534793bf78cd14141fef7b6ce993c (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T19:01:13.071 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:12.803+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:13.251 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:12 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:12.753+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:13.326 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:13 smithi103 podman[101359]: 2024-08-02 19:01:12.957292458 +0000 UTC m=+0.017056034 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:01:13.326 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:13 smithi103 podman[101359]: 2024-08-02 19:01:13.08434854 +0000 UTC m=+0.144112107 container create 16057396b1623c7d6a36cd051deff0d5f2626252b5a1b51f5e36f1db52599c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3-deactivate, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True) 2024-08-02T19:01:13.327 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:12 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:12.989+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:13.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:13.148+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:13.825 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:13 smithi103 podman[101359]: 2024-08-02 19:01:13.328598885 +0000 UTC m=+0.388362449 container init 16057396b1623c7d6a36cd051deff0d5f2626252b5a1b51f5e36f1db52599c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3-deactivate, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-02T19:01:13.825 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:13 smithi103 podman[101359]: 2024-08-02 19:01:13.331959345 +0000 UTC m=+0.391722910 container start 16057396b1623c7d6a36cd051deff0d5f2626252b5a1b51f5e36f1db52599c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3-deactivate, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-02T19:01:13.825 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:13 smithi103 podman[101359]: 2024-08-02 19:01:13.420544857 +0000 UTC m=+0.480308435 container attach 16057396b1623c7d6a36cd051deff0d5f2626252b5a1b51f5e36f1db52599c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD) 2024-08-02T19:01:13.826 INFO:journalctl@ceph.osd.3.smithi103.stdout:Aug 02 19:01:13 smithi103 podman[101359]: 2024-08-02 19:01:13.517682627 +0000 UTC m=+0.577446203 container died 16057396b1623c7d6a36cd051deff0d5f2626252b5a1b51f5e36f1db52599c33 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-3-deactivate, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD) 2024-08-02T19:01:14.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:13 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:13.707+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:14.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:13.794+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:14.225 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:13 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:13.976+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:14.255 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.3.service' 2024-08-02T19:01:14.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:01:14.302 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-08-02T19:01:14.302 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-08-02T19:01:14.302 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.4 2024-08-02T19:01:14.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:14.106+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:14.624 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:14 smithi121 systemd[1]: Stopping Ceph osd.4 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:01:15.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:14 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:14.741+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:15.002 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:14 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T19:01:14.622+0000 7faaca60b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:01:15.002 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:14 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T19:01:14.622+0000 7faaca60b640 -1 osd.4 104 *** Got signal Terminated *** 2024-08-02T19:01:15.002 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:14 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T19:01:14.622+0000 7faaca60b640 -1 osd.4 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:01:15.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:14.767+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:15.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:14 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:14.992+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:15.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:15.123+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:16.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:15 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:15.728+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:16.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:15.743+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:16.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:16 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:16.005+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:16.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:16 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:16.005+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:16.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:16 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:16.167+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:17.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:16 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:16.728+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:17.101 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:16 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:16.769+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:17.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:17 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:17.016+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:17.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:17 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:17.016+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:17.501 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:17 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T19:01:17.099+0000 7faac6c21640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.213831+0000 front 2024-08-02T19:00:51.213883+0000 (oldest deadline 2024-08-02T19:01:16.514006+0000) 2024-08-02T19:01:17.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:17 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:17.200+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:18.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:17 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:17.736+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:18.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:17 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:17.736+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:18.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:17 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:17.731+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:18.325 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:18 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:18.215+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:18.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:17 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:17.996+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:18.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:17 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:17.996+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:18.501 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:18 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T19:01:18.145+0000 7faac6c21640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.213831+0000 front 2024-08-02T19:00:51.213883+0000 (oldest deadline 2024-08-02T19:01:16.514006+0000) 2024-08-02T19:01:18.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:18 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:18.116+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:18.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:18 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:18.175+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:19.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:18 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:18.724+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:19.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:18 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:18.724+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:19.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:18 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:18.766+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:19.071 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:18 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:18.927+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:19.325 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:19 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:19.197+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:19.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:18 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:18.984+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:19.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:18 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:18.984+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:19.342 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:19 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:19.185+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:19.501 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:19 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4[48437]: 2024-08-02T19:01:19.141+0000 7faac6c21640 -1 osd.4 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.213831+0000 front 2024-08-02T19:00:51.213883+0000 (oldest deadline 2024-08-02T19:01:16.514006+0000) 2024-08-02T19:01:19.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:19 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:19.141+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:20.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:19 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:19.675+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:20.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:19 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:19.675+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:20.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:19 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:19.727+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:20.070 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:19 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:19.920+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:20.325 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:20 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:20.199+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:20.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:20 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:20.020+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:20.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:20 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:20.020+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:20.433 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:20 smithi121 podman[73527]: 2024-08-02 19:01:20.172166949 +0000 UTC m=+5.673506606 container died 567e8ba80bf8c2cc3af4cdc39c32df7def99c503922a2a924793dde22a1f167d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, ceph=True) 2024-08-02T19:01:20.433 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:20 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:20.162+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:20.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:20 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:20.186+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:20.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:20 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:20.186+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:54.725669+0000 front 2024-08-02T19:00:54.725529+0000 (oldest deadline 2024-08-02T19:01:20.025493+0000) 2024-08-02T19:01:20.725 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:20 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:20.635+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:20.725 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:20 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:20.635+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:20.725 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:20 smithi121 podman[73527]: 2024-08-02 19:01:20.514781272 +0000 UTC m=+6.016120929 container cleanup 567e8ba80bf8c2cc3af4cdc39c32df7def99c503922a2a924793dde22a1f167d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-02T19:01:20.725 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:20 smithi121 bash[73527]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4 2024-08-02T19:01:21.001 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:20 smithi121 podman[73544]: 2024-08-02 19:01:20.724352346 +0000 UTC m=+0.546182360 container remove 567e8ba80bf8c2cc3af4cdc39c32df7def99c503922a2a924793dde22a1f167d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-02T19:01:21.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:20 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:20.770+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:21.071 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:20 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:20.959+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:21.228 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:20 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:20.973+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:21.228 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:20 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:20.973+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:21.420 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:21 smithi121 podman[73630]: 2024-08-02 19:01:21.049530874 +0000 UTC m=+0.017451016 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:01:21.420 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:21 smithi121 podman[73630]: 2024-08-02 19:01:21.166950945 +0000 UTC m=+0.134871116 container create d11c84c78e4ff9327faf37c03d0f7e356f8ea76a329f3fe4c9acb105e495d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_CLEAN=True, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T19:01:21.420 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:21 smithi121 podman[73630]: 2024-08-02 19:01:21.419528998 +0000 UTC m=+0.387449131 container init d11c84c78e4ff9327faf37c03d0f7e356f8ea76a329f3fe4c9acb105e495d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4-deactivate, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240731) 2024-08-02T19:01:21.421 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:21 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:21.210+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:21.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:21 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:21.219+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:21.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:21 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:21.219+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:54.725669+0000 front 2024-08-02T19:00:54.725529+0000 (oldest deadline 2024-08-02T19:01:20.025493+0000) 2024-08-02T19:01:21.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:21 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:21.226+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:21.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:21 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:21.632+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:21.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:21 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:21.632+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:21.752 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:21 smithi121 podman[73630]: 2024-08-02 19:01:21.422623319 +0000 UTC m=+0.390543449 container start d11c84c78e4ff9327faf37c03d0f7e356f8ea76a329f3fe4c9acb105e495d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0) 2024-08-02T19:01:21.752 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:21 smithi121 podman[73630]: 2024-08-02 19:01:21.519483169 +0000 UTC m=+0.487403307 container attach d11c84c78e4ff9327faf37c03d0f7e356f8ea76a329f3fe4c9acb105e495d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2) 2024-08-02T19:01:21.752 INFO:journalctl@ceph.osd.4.smithi121.stdout:Aug 02 19:01:21 smithi121 podman[73630]: 2024-08-02 19:01:21.607995433 +0000 UTC m=+0.575915572 container died d11c84c78e4ff9327faf37c03d0f7e356f8ea76a329f3fe4c9acb105e495d90e (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-4-deactivate, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T19:01:22.070 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:22 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:22.006+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:22.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:21 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:21.761+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:22.268 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:21 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:21.967+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:22.268 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:21 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:21.967+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:22.270 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.4.service' 2024-08-02T19:01:22.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:01:22.309 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-08-02T19:01:22.309 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-08-02T19:01:22.309 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.5 2024-08-02T19:01:22.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:22 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:22.257+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:22.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:22 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:22.179+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:22.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:22 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:22.179+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:54.725669+0000 front 2024-08-02T19:00:54.725529+0000 (oldest deadline 2024-08-02T19:01:20.025493+0000) 2024-08-02T19:01:22.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:22 smithi151 systemd[1]: Stopping Ceph osd.5 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:01:22.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:22 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:22.267+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:22.968 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:22 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:22.799+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:22.968 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:22 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:22.651+0000 7fe22fb8c640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:01:22.969 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:22 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:22.651+0000 7fe22fb8c640 -1 osd.5 104 *** Got signal Terminated *** 2024-08-02T19:01:22.969 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:22 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:22.651+0000 7fe22fb8c640 -1 osd.5 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:01:23.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:22 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:22.636+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:23.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:22 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:22.636+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:23.299 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:22 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:22.923+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:23.299 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:22 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:22.923+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:23.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:22 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:22.967+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:23.321 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:23 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:23.204+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:23.321 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:23 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:23.204+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:54.725669+0000 front 2024-08-02T19:00:54.725529+0000 (oldest deadline 2024-08-02T19:01:20.025493+0000) 2024-08-02T19:01:23.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:23 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:23.298+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:23.611 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:23 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:23.258+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:24.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:23 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:23.610+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:24.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:23 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:23.610+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:24.070 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:23 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:23.920+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:24.071 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:23 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:23.806+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:24.303 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:23 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:23.926+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:24.304 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:23 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:23.926+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:24.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:24 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:24.221+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:24.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:24 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:24.221+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:54.725669+0000 front 2024-08-02T19:00:54.725529+0000 (oldest deadline 2024-08-02T19:01:20.025493+0000) 2024-08-02T19:01:24.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:24 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:24.324+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:24.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:24 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:24.324+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:24.588 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:24 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:24.257+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:25.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:24 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:24.586+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:25.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:24 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:24.586+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:25.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:24 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:24.804+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:25.071 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:24 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:24.956+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:25.071 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:24 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:24.956+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:25.318 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:24 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:24.940+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:25.318 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:24 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:24.940+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:25.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:25.233+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:25.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:25.258+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:25.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:25.258+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:54.725669+0000 front 2024-08-02T19:00:54.725529+0000 (oldest deadline 2024-08-02T19:01:20.025493+0000) 2024-08-02T19:01:25.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:25.316+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:25.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:25.316+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:26.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:25.584+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:26.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:25.584+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:26.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:25 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:25.584+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:26.070 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:25.800+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:26.070 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:25.947+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:26.071 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:25 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:25.947+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:26.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:25.953+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:26.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:25.953+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:26.551 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:26 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:26.267+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:26.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:26 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:26.255+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:26.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:26 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:26.255+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:54.725669+0000 front 2024-08-02T19:00:54.725529+0000 (oldest deadline 2024-08-02T19:01:20.025493+0000) 2024-08-02T19:01:26.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:26 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:26.255+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:00.025964+0000 front 2024-08-02T19:01:00.025927+0000 (oldest deadline 2024-08-02T19:01:25.926084+0000) 2024-08-02T19:01:26.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:26 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:26.324+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:26.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:26 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:26.324+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:27.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:26 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:26.550+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:27.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:26 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:26.550+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:27.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:26 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:26.550+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:27.245 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:26 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:26.839+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:27.245 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:26 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:26.946+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:27.246 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:26 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:26.946+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:27.283 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:26 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:26.972+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:27.283 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:26 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:26.972+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:27.542 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:27 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:27.269+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:27.543 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:27 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:27.269+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:27.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:27 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:27.244+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.423102+0000 front 2024-08-02T19:00:47.423178+0000 (oldest deadline 2024-08-02T19:01:09.123126+0000) 2024-08-02T19:01:27.570 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:27 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:27.244+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:54.725669+0000 front 2024-08-02T19:00:54.725529+0000 (oldest deadline 2024-08-02T19:01:20.025493+0000) 2024-08-02T19:01:27.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:27 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5[48841]: 2024-08-02T19:01:27.244+0000 7fe22c1a2640 -1 osd.5 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:00.025964+0000 front 2024-08-02T19:01:00.025927+0000 (oldest deadline 2024-08-02T19:01:25.926084+0000) 2024-08-02T19:01:27.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:27 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:27.281+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:27.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:27 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:27.281+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:28.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:27 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:27.540+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:28.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:27 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:27.540+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:28.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:27 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:27.540+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:28.318 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:27 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:27.993+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:28.318 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:27 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:27.993+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:28.318 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:27 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:27.993+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:28.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:27 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:27.855+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:28.320 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:28 smithi151 podman[73697]: 2024-08-02 19:01:28.033145129 +0000 UTC m=+5.524851616 container died 12a77a18ba978bdb257b6a05b80f2890efac0f5f7d8c19a491f5454b05d4f24a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-02T19:01:28.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:27 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:27.978+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:28.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:27 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:27.978+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:28.527 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:28 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:28.261+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:28.527 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:28 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:28.261+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:28.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:28 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:28.316+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:28.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:28 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:28.316+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:28.680 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:28 smithi151 podman[73697]: 2024-08-02 19:01:28.386082143 +0000 UTC m=+5.877788640 container cleanup 12a77a18ba978bdb257b6a05b80f2890efac0f5f7d8c19a491f5454b05d4f24a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-08-02T19:01:28.680 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:28 smithi151 bash[73697]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5 2024-08-02T19:01:29.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:28 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:28.526+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:29.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:28 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:28.526+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:29.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:28 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:28.526+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:29.014 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:28 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:28.888+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:29.014 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:28 smithi151 podman[73713]: 2024-08-02 19:01:28.679569717 +0000 UTC m=+0.644962134 container remove 12a77a18ba978bdb257b6a05b80f2890efac0f5f7d8c19a491f5454b05d4f24a (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, RELEASE=squid-release-26c3fb8) 2024-08-02T19:01:29.295 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:29 smithi151 podman[73803]: 2024-08-02 19:01:28.917061956 +0000 UTC m=+0.017410655 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:01:29.295 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:29 smithi151 podman[73803]: 2024-08-02 19:01:29.057908723 +0000 UTC m=+0.158257412 container create 8f232b6be64bab8f60dcfc2164663177cdc18b86b9112a8d5402c1e07ea887bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5-deactivate, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, GIT_CLEAN=True) 2024-08-02T19:01:29.296 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:29 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:29.013+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:29.296 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:29 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:29.013+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:29.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:29.035+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:29.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:29.035+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:29.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:29.035+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:29.500 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:29 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:29.232+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:29.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:29 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:29.232+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:29.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:29 smithi151 podman[73803]: 2024-08-02 19:01:29.294873762 +0000 UTC m=+0.395222456 container init 8f232b6be64bab8f60dcfc2164663177cdc18b86b9112a8d5402c1e07ea887bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD) 2024-08-02T19:01:29.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:29 smithi151 podman[73803]: 2024-08-02 19:01:29.298310896 +0000 UTC m=+0.398659591 container start 8f232b6be64bab8f60dcfc2164663177cdc18b86b9112a8d5402c1e07ea887bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, RELEASE=squid-release-26c3fb8, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-02T19:01:29.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:29 smithi151 podman[73803]: 2024-08-02 19:01:29.403164762 +0000 UTC m=+0.503513453 container attach 8f232b6be64bab8f60dcfc2164663177cdc18b86b9112a8d5402c1e07ea887bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0) 2024-08-02T19:01:29.571 INFO:journalctl@ceph.osd.5.smithi151.stdout:Aug 02 19:01:29 smithi151 podman[73803]: 2024-08-02 19:01:29.482750368 +0000 UTC m=+0.583099066 container died 8f232b6be64bab8f60dcfc2164663177cdc18b86b9112a8d5402c1e07ea887bf (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-5-deactivate, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T19:01:29.826 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:29.331+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:29.826 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:29 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:29.331+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:30.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:29 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:29.538+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:30.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:29 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:29.538+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:30.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:29 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:29.538+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:30.038 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:29 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:29.937+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:30.038 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:29 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:29.937+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:30.195 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.5.service' 2024-08-02T19:01:30.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:01:30.233 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-08-02T19:01:30.233 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-08-02T19:01:30.234 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.6 2024-08-02T19:01:30.278 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:30.011+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:30.278 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:30.011+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:30.278 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:30.011+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:30.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:30 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:30.037+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:30.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:30 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:30.037+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:30.500 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:30 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:30.236+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:30.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:30 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:30.236+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:30.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:30 smithi103 systemd[1]: Stopping Ceph osd.6 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:01:30.576 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:30.379+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:30.576 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:30.379+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:31.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:30 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:30.527+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:31.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:30 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:30.527+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:31.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:30 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:30.527+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:31.001 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:30.576+0000 7f9452cf8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:01:31.001 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:30.576+0000 7f9452cf8640 -1 osd.6 104 *** Got signal Terminated *** 2024-08-02T19:01:31.001 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:30.576+0000 7f9452cf8640 -1 osd.6 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:01:31.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:31 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:31.000+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:31.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:31 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:31.000+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:31.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:30 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:30.935+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:31.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:30 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:30.935+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:31.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:30.999+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:31.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:30.999+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:31.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:30.999+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:31.482 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:31 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:31.203+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:31.482 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:31 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:31.203+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:31.750 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:31 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:31.481+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:31.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:31 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:31.481+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:31.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:31 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:31.481+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:31.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:31.342+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:31.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:31 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:31.342+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:32.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:32.002+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:32.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:32.002+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:32.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:31 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:31.957+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:32.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:31 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:31.957+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:32.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:32 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:32.015+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:32.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:32 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:32.015+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:32.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:32 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:32.015+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:32.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:32 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:32.156+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:32.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:32 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:32.156+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:32.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:32 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:32.375+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:32.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:32 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:32.375+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:32.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:32 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:32.375+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.533767+0000 front 2024-08-02T19:01:10.533687+0000 (oldest deadline 2024-08-02T19:01:32.134161+0000) 2024-08-02T19:01:33.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:32 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:32.515+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:33.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:32 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:32.515+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:33.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:32 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:32.515+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:33.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:33 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:33.006+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:33.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:33 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:33.006+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:33.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:32.915+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:33.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:32 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:32.915+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:33.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:33 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:33.029+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:33.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:33 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:33.029+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:33.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:33 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:33.029+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:33.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:33 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:33.149+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:33.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:33 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:33.149+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:33.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:33 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:33.412+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:33.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:33 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:33.412+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:33.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:33 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:33.412+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.533767+0000 front 2024-08-02T19:01:10.533687+0000 (oldest deadline 2024-08-02T19:01:32.134161+0000) 2024-08-02T19:01:34.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:33 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:33.499+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:34.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:33 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:33.499+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:34.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:33 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:33.499+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:34.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:33 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:33.976+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:34.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:33 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:33.976+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:34.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:33 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:33.929+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:34.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:33 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:33.929+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:34.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:34 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:34.049+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:34.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:34 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:34.049+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:34.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:34 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:34.049+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:34.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:34 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:34.137+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:34.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:34 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:34.137+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:34.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:34 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:34.443+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:34.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:34 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:34.443+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:34.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:34 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:34.443+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.533767+0000 front 2024-08-02T19:01:10.533687+0000 (oldest deadline 2024-08-02T19:01:32.134161+0000) 2024-08-02T19:01:35.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:34 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:34.542+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:35.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:34 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:34.542+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:35.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:34 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:34.542+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:35.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:34 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:34.542+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:35.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:34 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:34.985+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:35.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:34 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:34.985+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:35.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:34 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:34.923+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:35.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:34 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:34.923+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:35.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:34 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:34.923+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:35.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:35.008+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:35.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:35.008+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:35.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:35.008+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:35.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:35 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:35.165+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:35.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:35 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:35.165+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:35.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:35.406+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:51.930768+0000 front 2024-08-02T19:00:51.930757+0000 (oldest deadline 2024-08-02T19:01:17.830531+0000) 2024-08-02T19:01:35.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:35.406+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.331706+0000 front 2024-08-02T19:01:01.331876+0000 (oldest deadline 2024-08-02T19:01:24.132207+0000) 2024-08-02T19:01:35.825 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6[60383]: 2024-08-02T19:01:35.406+0000 7f944b306640 -1 osd.6 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.533767+0000 front 2024-08-02T19:01:10.533687+0000 (oldest deadline 2024-08-02T19:01:32.134161+0000) 2024-08-02T19:01:36.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:35 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:35.533+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:36.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:35 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:35.533+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:36.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:35 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:35.533+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:36.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:35 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:35.533+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:36.237 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:35 smithi103 podman[101462]: 2024-08-02 19:01:35.943679784 +0000 UTC m=+5.513877397 container died f29b7e787888dd1e925f4143e99230c18ab009473991758ad826be5b8b6f3fc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux ) 2024-08-02T19:01:36.238 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:35.968+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:36.238 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:35.968+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:36.238 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:35 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:35.968+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:36.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:36 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:36.005+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:36.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:36 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:36.005+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:36.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:35 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:35.951+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:36.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:35 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:35.951+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:36.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:35 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:35.951+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:36.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:36.157+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:36.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:36.157+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:36.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:36.157+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.445534+0000 front 2024-08-02T19:01:11.445609+0000 (oldest deadline 2024-08-02T19:01:36.145674+0000) 2024-08-02T19:01:36.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:36 smithi103 podman[101462]: 2024-08-02 19:01:36.353324182 +0000 UTC m=+5.923521796 container cleanup f29b7e787888dd1e925f4143e99230c18ab009473991758ad826be5b8b6f3fc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-02T19:01:36.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:36 smithi103 bash[101462]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6 2024-08-02T19:01:36.921 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:36 smithi103 podman[101479]: 2024-08-02 19:01:36.59651318 +0000 UTC m=+0.656094058 container remove f29b7e787888dd1e925f4143e99230c18ab009473991758ad826be5b8b6f3fc1 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD) 2024-08-02T19:01:37.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:36.531+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:37.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:36.531+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:37.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:36.531+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:37.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:36 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:36.531+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:37.275 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:36 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:36.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:37.276 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:36 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:36.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:37.276 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:36 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:36.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:37.276 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:36 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:36.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:37.276 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:36 smithi103 podman[101567]: 2024-08-02 19:01:36.824017825 +0000 UTC m=+0.017522875 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:01:37.276 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:36 smithi103 podman[101567]: 2024-08-02 19:01:36.930732719 +0000 UTC m=+0.124237810 container create e3b4418b7bb56c1eb957fccad7859a67048262d41c668b1c3aec1b9d01c0bd4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6-deactivate, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-02T19:01:37.276 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:37 smithi103 podman[101567]: 2024-08-02 19:01:37.166509051 +0000 UTC m=+0.360014117 container init e3b4418b7bb56c1eb957fccad7859a67048262d41c668b1c3aec1b9d01c0bd4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, ceph=True) 2024-08-02T19:01:37.277 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:37 smithi103 podman[101567]: 2024-08-02 19:01:37.169693629 +0000 UTC m=+0.363198679 container start e3b4418b7bb56c1eb957fccad7859a67048262d41c668b1c3aec1b9d01c0bd4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6-deactivate, ceph=True, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0) 2024-08-02T19:01:37.277 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:37 smithi103 podman[101567]: 2024-08-02 19:01:37.274889006 +0000 UTC m=+0.468394067 container attach e3b4418b7bb56c1eb957fccad7859a67048262d41c668b1c3aec1b9d01c0bd4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6-deactivate, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-02T19:01:37.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:37 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:37.006+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:37.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:37 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:37.006+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:37.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:37 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:37.006+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:37.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:36 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:36.984+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:37.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:36 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:36.984+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:37.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:36 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:36.984+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:37.497 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:37 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:37.196+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:37.497 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:37 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:37.196+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:37.497 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:37 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:37.196+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.445534+0000 front 2024-08-02T19:01:11.445609+0000 (oldest deadline 2024-08-02T19:01:36.145674+0000) 2024-08-02T19:01:37.575 INFO:journalctl@ceph.osd.6.smithi103.stdout:Aug 02 19:01:37 smithi103 podman[101567]: 2024-08-02 19:01:37.362020824 +0000 UTC m=+0.555525879 container died e3b4418b7bb56c1eb957fccad7859a67048262d41c668b1c3aec1b9d01c0bd4b (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-6-deactivate, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-02T19:01:37.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:37 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:37.496+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:37.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:37 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:37.496+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:37.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:37 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:37.496+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:37.752 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:37 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:37.496+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:37.985 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.6.service' 2024-08-02T19:01:38.067 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:01:38.067 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-08-02T19:01:38.067 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-08-02T19:01:38.067 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.7 2024-08-02T19:01:38.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:37 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:37.996+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:38.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:37 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:37.996+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:38.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:37 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:37.996+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:38.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:38.032+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:38.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:38.032+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:38.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:38.032+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:38.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:37.912+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:38.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:37.912+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:38.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:37.912+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:38.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:37 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:37.912+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:38.359 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:38 smithi121 systemd[1]: Stopping Ceph osd.7 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:01:38.359 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:38.188+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:38.359 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:38.188+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:38.359 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:38.188+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.445534+0000 front 2024-08-02T19:01:11.445609+0000 (oldest deadline 2024-08-02T19:01:36.145674+0000) 2024-08-02T19:01:38.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:38.497+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:38.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:38.497+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:38.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:38.497+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:38.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:38.497+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:38.751 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:38.357+0000 7fe89058a640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:01:38.751 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:38.357+0000 7fe89058a640 -1 osd.7 104 *** Got signal Terminated *** 2024-08-02T19:01:38.751 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:38.357+0000 7fe89058a640 -1 osd.7 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:01:39.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:38.961+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:39.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:38.961+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:39.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:38 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:38.961+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:39.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:39.037+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:39.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:39.037+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:39.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:39.037+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:39.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:38.941+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:39.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:38.941+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:39.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:38.941+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:39.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:38 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:38.941+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:39.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:39.167+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:39.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:39.167+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:39.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:39.167+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.445534+0000 front 2024-08-02T19:01:11.445609+0000 (oldest deadline 2024-08-02T19:01:36.145674+0000) 2024-08-02T19:01:39.796 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:39.534+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:39.797 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:39.534+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:39.797 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:39.534+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:39.797 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:39 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:39.534+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:40.226 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:39.918+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:40.227 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:39.918+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:40.227 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:39.918+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:40.227 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:39 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:39.918+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:40.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:39.943+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:40.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:39.943+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:40.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:39 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:39.943+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:40.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:40.073+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:40.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:40.073+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:40.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:40.073+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:40.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:40.132+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:40.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:40.132+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:40.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:40.132+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.445534+0000 front 2024-08-02T19:01:11.445609+0000 (oldest deadline 2024-08-02T19:01:36.145674+0000) 2024-08-02T19:01:41.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:40.523+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:41.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:40.523+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:41.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:40.523+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:41.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:40 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:40.523+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:41.242 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:40.891+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:41.243 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:40.891+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:41.243 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:40.891+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:41.243 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:40.891+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:41.243 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:40 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:40.891+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:41.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:40.990+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:41.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:40.990+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:41.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:40 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:40.990+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:41.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:41.117+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:41.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:41.117+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:41.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:41.117+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:41.484 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:41.121+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:41.485 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:41.121+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:41.485 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:41.121+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.445534+0000 front 2024-08-02T19:01:11.445609+0000 (oldest deadline 2024-08-02T19:01:36.145674+0000) 2024-08-02T19:01:41.485 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:41.121+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.146111+0000 front 2024-08-02T19:01:16.146145+0000 (oldest deadline 2024-08-02T19:01:40.746707+0000) 2024-08-02T19:01:41.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:41.483+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:41.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:41.483+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:41.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:41.483+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:41.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:41 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:41.483+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:42.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:41.968+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:42.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:41.968+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:42.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:41.968+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:42.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:41 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:41.968+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:42.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:42.115+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:42.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:42.115+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:42.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:42.115+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:42.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:42.115+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:42.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:41.909+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:42.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:41.909+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:42.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:41.909+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:42.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:41.909+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:42.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:41 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:41.909+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:42.491 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:42.146+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:42.491 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:42.146+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:42.491 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:42.146+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.445534+0000 front 2024-08-02T19:01:11.445609+0000 (oldest deadline 2024-08-02T19:01:36.145674+0000) 2024-08-02T19:01:42.491 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:42.146+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.146111+0000 front 2024-08-02T19:01:16.146145+0000 (oldest deadline 2024-08-02T19:01:40.746707+0000) 2024-08-02T19:01:42.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:42.489+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:42.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:42.489+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:42.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:42.489+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:42.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:42.489+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:42.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:42.489+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:43.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:42.938+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:43.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:42.938+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:43.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:42.938+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:43.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:42 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:42.938+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:43.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:43.089+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:43.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:43.089+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:43.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:43.089+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:43.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:43.089+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:43.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:42.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:43.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:42.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:43.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:42.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:43.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:42.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:43.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:42 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:42.930+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:43.449 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:43.163+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:53.942426+0000 front 2024-08-02T19:00:53.942374+0000 (oldest deadline 2024-08-02T19:01:18.042557+0000) 2024-08-02T19:01:43.449 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:43.163+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.543762+0000 front 2024-08-02T19:01:01.543808+0000 (oldest deadline 2024-08-02T19:01:26.744372+0000) 2024-08-02T19:01:43.449 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:43.163+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.445534+0000 front 2024-08-02T19:01:11.445609+0000 (oldest deadline 2024-08-02T19:01:36.145674+0000) 2024-08-02T19:01:43.449 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7[55059]: 2024-08-02T19:01:43.163+0000 7fe888b98640 -1 osd.7 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.146111+0000 front 2024-08-02T19:01:16.146145+0000 (oldest deadline 2024-08-02T19:01:40.746707+0000) 2024-08-02T19:01:43.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:43.448+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:43.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:43.448+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:43.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:43.448+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:43.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:43.448+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:43.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:43 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:43.448+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:44.134 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:43 smithi121 podman[73734]: 2024-08-02 19:01:43.818871632 +0000 UTC m=+5.561977839 container died 8fb284d421ef7ffe78f7f22c19cee4658719f61752d4554f2e5ae19410530c88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux ) 2024-08-02T19:01:44.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:43.919+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:44.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:43.919+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:44.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:43.919+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:44.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:43 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:43.919+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:44.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:44 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:44.083+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:44.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:44 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:44.083+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:44.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:44 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:44.083+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:44.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:44 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:44.083+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:44.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:43.903+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:44.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:43.903+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:44.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:43.903+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:44.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:43.903+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:44.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:43 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:43.903+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:44.426 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:44 smithi121 podman[73734]: 2024-08-02 19:01:44.232779296 +0000 UTC m=+5.975885502 container cleanup 8fb284d421ef7ffe78f7f22c19cee4658719f61752d4554f2e5ae19410530c88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.build-date=20240731) 2024-08-02T19:01:44.427 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:44 smithi121 bash[73734]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7 2024-08-02T19:01:44.750 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:44 smithi121 podman[73761]: 2024-08-02 19:01:44.484427149 +0000 UTC m=+0.663151671 container remove 8fb284d421ef7ffe78f7f22c19cee4658719f61752d4554f2e5ae19410530c88 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, RELEASE=squid-release-26c3fb8, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.build-date=20240731) 2024-08-02T19:01:44.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:44 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:44.425+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:44.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:44 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:44.425+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:44.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:44 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:44.425+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:44.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:44 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:44.425+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:44.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:44 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:44.425+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:45.230 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:44 smithi121 podman[73853]: 2024-08-02 19:01:44.809342113 +0000 UTC m=+0.016808577 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:01:45.230 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:44 smithi121 podman[73853]: 2024-08-02 19:01:44.918501943 +0000 UTC m=+0.125968454 container create df953c2f0d55de359c3066cd25c9ec5f435e27efcfcc7735e53bdb684950a234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD) 2024-08-02T19:01:45.230 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:45 smithi121 podman[73853]: 2024-08-02 19:01:45.1458439 +0000 UTC m=+0.353310365 container init df953c2f0d55de359c3066cd25c9ec5f435e27efcfcc7735e53bdb684950a234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7-deactivate, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-02T19:01:45.230 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:45 smithi121 podman[73853]: 2024-08-02 19:01:45.149194055 +0000 UTC m=+0.356660510 container start df953c2f0d55de359c3066cd25c9ec5f435e27efcfcc7735e53bdb684950a234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7-deactivate, org.label-schema.schema-version=1.0, ceph=True, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8) 2024-08-02T19:01:45.231 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:45 smithi121 podman[73853]: 2024-08-02 19:01:45.22916217 +0000 UTC m=+0.436628637 container attach df953c2f0d55de359c3066cd25c9ec5f435e27efcfcc7735e53bdb684950a234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7-deactivate, ceph=True, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-02T19:01:45.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:44 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:44.960+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:45.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:44 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:44.960+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:45.322 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:44 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:44.960+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:45.322 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:44 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:44.960+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:45.323 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:45 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:45.079+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:45.323 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:45 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:45.079+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:45.324 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:45 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:45.079+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:45.324 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:45 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:45.079+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:45.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:44.928+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:45.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:44.928+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:45.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:44.928+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:45.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:44.928+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:45.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:44 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:44.928+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:45.501 INFO:journalctl@ceph.osd.7.smithi121.stdout:Aug 02 19:01:45 smithi121 podman[73853]: 2024-08-02 19:01:45.336114358 +0000 UTC m=+0.543580811 container died df953c2f0d55de359c3066cd25c9ec5f435e27efcfcc7735e53bdb684950a234 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-7-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD) 2024-08-02T19:01:45.501 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:45 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:45.467+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:45.501 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:45 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:45.467+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:45.501 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:45 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:45.467+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:45.501 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:45 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:45.467+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:45.501 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:45 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:45.467+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:46.147 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.7.service' 2024-08-02T19:01:46.189 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:01:46.189 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-08-02T19:01:46.189 INFO:tasks.cephadm.osd.8:Stopping osd.8... 2024-08-02T19:01:46.189 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.8 2024-08-02T19:01:46.216 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:46.069+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:46.216 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:46.069+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:46.216 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:46.069+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:46.217 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:46.069+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:46.217 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:45 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:45.957+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:46.217 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:45 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:45.957+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:46.217 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:45 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:45.957+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:46.217 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:45 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:45.957+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:46.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:45 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:45.940+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:46.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:45 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:45.940+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:46.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:45 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:45.940+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:46.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:45 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:45.940+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:46.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:45 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:45.940+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:46.452 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:46 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:46.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:46.452 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:46 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:46.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:46.504 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:46 smithi151 systemd[1]: Stopping Ceph osd.8 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:01:46.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:46 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:46.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:46.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:46 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:46.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:46.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:46 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:46.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:46.820 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:46.503+0000 7f7c15743640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.8 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:01:46.820 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:46.503+0000 7f7c15743640 -1 osd.8 104 *** Got signal Terminated *** 2024-08-02T19:01:46.820 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:46.503+0000 7f7c15743640 -1 osd.8 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:01:47.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:46.932+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:47.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:46.932+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:47.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:46.932+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:47.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:46 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:46.932+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:47.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:47 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:47.091+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:47.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:47 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:47.091+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:47.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:47 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:47.091+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:47.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:47 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:47.091+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:47.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:46.897+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:47.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:46.897+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:47.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:46.897+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:47.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:46.897+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:47.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:46 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:46.897+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:47.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:47 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:47.434+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:47.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:47 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:47.434+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:47.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:47 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:47.434+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:47.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:47 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:47.434+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:47.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:47 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:47.434+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:48.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:47 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:47.929+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:48.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:47 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:47.929+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:48.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:47 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:47.929+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:48.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:47 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:47.929+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:48.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:48 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:48.047+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:48.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:48 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:48.047+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:48.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:48 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:48.047+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:48.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:48 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:48.047+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:48.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:47 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:47.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:48.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:47 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:47.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:48.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:47 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:47.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:48.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:47 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:47.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:48.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:47 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:47.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:48.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:48 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:48.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:48.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:48 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:48.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:48.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:48 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:48.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:48.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:48 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:48.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:48.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:48 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:48.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:49.222 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:49.044+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:49.222 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:49.044+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:49.222 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:49.044+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:49.222 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:49.044+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:49.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:48 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:48.949+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:49.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:48 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:48.949+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:49.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:48 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:48.949+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:49.223 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:48 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:48.949+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:49.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:48 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:48.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:49.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:48 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:48.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:49.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:48 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:48.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:49.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:48 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:48.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:49.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:48 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:48.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:49.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:48 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:48.929+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:49.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:49 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:49.411+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:49.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:49 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:49.411+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:49.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:49 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:49.411+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:49.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:49 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:49.411+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:49.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:49 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:49.411+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:50.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:50.046+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:50.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:50.046+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:50.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:50.046+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:50.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:50.046+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:50.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:49.950+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:50.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:49.950+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:50.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:49.950+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:50.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:49.950+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:50.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:49 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:49.950+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:27.395851+0000 front 2024-08-02T19:01:27.395769+0000 (oldest deadline 2024-08-02T19:01:49.095865+0000) 2024-08-02T19:01:50.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:49 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:49.967+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:50.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:49 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:49.967+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:50.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:49 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:49.967+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:50.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:49 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:49.967+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:50.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:49 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:49.967+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:50.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:49 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:49.967+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:50.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:50.376+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:50.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:50.376+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:50.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:50.376+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:50.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:50.376+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:50.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:50 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:50.376+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:51.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:51 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:51.053+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:51.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:51 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:51.053+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:51.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:51 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:51.053+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:51.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:51 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:51.053+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:51.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:50.934+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.991213+0000 front 2024-08-02T19:00:52.991200+0000 (oldest deadline 2024-08-02T19:01:18.291032+0000) 2024-08-02T19:01:51.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:50.934+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:01.791877+0000 front 2024-08-02T19:01:01.791950+0000 (oldest deadline 2024-08-02T19:01:24.691726+0000) 2024-08-02T19:01:51.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:50.934+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:10.592821+0000 front 2024-08-02T19:01:10.592711+0000 (oldest deadline 2024-08-02T19:01:36.492802+0000) 2024-08-02T19:01:51.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:50.934+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.194053+0000 front 2024-08-02T19:01:18.193924+0000 (oldest deadline 2024-08-02T19:01:41.093861+0000) 2024-08-02T19:01:51.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:50 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8[55281]: 2024-08-02T19:01:50.934+0000 7f7c11d59640 -1 osd.8 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:27.395851+0000 front 2024-08-02T19:01:27.395769+0000 (oldest deadline 2024-08-02T19:01:49.095865+0000) 2024-08-02T19:01:51.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:50 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:50.965+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:51.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:50 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:50.965+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:51.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:50 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:50.965+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:51.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:50 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:50.965+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:51.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:50 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:50.965+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:51.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:50 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:50.965+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:51.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:51 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:51.346+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:51.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:51 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:51.346+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:51.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:51 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:51.346+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:51.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:51 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:51.346+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:51.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:51 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:51.346+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:51.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:51 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:51.346+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:52.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:52 smithi151 podman[73905]: 2024-08-02 19:01:52.02401843 +0000 UTC m=+5.642441513 container died 28ca70e1c4f42e56dd7faf9f5a3f0735072d0028341817ffeb75919d41ba935d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, ceph=True, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T19:01:52.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:52 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:52.081+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:52.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:52 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:52.081+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:52.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:52 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:52.081+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:52.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:52 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:52.081+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:52.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:52 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:52.013+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:52.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:52 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:52.013+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:52.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:52 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:52.013+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:52.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:52 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:52.013+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:52.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:52 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:52.013+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:52.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:52 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:52.013+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:52.640 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:52 smithi151 podman[73905]: 2024-08-02 19:01:52.420983356 +0000 UTC m=+6.039406442 container cleanup 28ca70e1c4f42e56dd7faf9f5a3f0735072d0028341817ffeb75919d41ba935d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731) 2024-08-02T19:01:52.640 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:52 smithi151 bash[73905]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8 2024-08-02T19:01:52.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:52 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:52.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:52.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:52 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:52.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:52.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:52 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:52.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:52.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:52 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:52.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:52.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:52 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:52.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:52.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:52 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:52.387+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:53.047 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:52 smithi151 podman[73936]: 2024-08-02 19:01:52.639341751 +0000 UTC m=+0.603618015 container remove 28ca70e1c4f42e56dd7faf9f5a3f0735072d0028341817ffeb75919d41ba935d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8, ceph=True, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731) 2024-08-02T19:01:53.320 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:53 smithi151 podman[74025]: 2024-08-02 19:01:52.949463288 +0000 UTC m=+0.017187875 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:01:53.321 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:53 smithi151 podman[74025]: 2024-08-02 19:01:53.065239471 +0000 UTC m=+0.132964050 container create 4a4bc7ee59b03e383c39ec63e4cc3db5eb21d11dcd068533e4c7d8091143f1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8-deactivate, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731) 2024-08-02T19:01:53.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:53 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:53.072+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:53.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:53 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:53.072+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:53.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:53 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:53.072+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:53.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:53 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:53.072+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:53.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:53 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:53.046+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:53.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:53 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:53.046+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:53.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:53 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:53.046+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:53.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:53 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:53.046+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:53.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:53 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:53.046+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:53.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:53 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:53.046+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:53.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:53 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:53.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:53.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:53 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:53.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:53.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:53 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:53.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:53.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:53 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:53.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:53.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:53 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:53.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:53.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:53 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:53.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:53.820 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:53 smithi151 podman[74025]: 2024-08-02 19:01:53.370888185 +0000 UTC m=+0.438612779 container init 4a4bc7ee59b03e383c39ec63e4cc3db5eb21d11dcd068533e4c7d8091143f1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8-deactivate, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux ) 2024-08-02T19:01:53.821 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:53 smithi151 podman[74025]: 2024-08-02 19:01:53.374347941 +0000 UTC m=+0.442072529 container start 4a4bc7ee59b03e383c39ec63e4cc3db5eb21d11dcd068533e4c7d8091143f1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8-deactivate, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240731, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T19:01:53.821 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:53 smithi151 podman[74025]: 2024-08-02 19:01:53.476814619 +0000 UTC m=+0.544539227 container attach 4a4bc7ee59b03e383c39ec63e4cc3db5eb21d11dcd068533e4c7d8091143f1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8-deactivate, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-02T19:01:53.821 INFO:journalctl@ceph.osd.8.smithi151.stdout:Aug 02 19:01:53 smithi151 podman[74025]: 2024-08-02 19:01:53.563570913 +0000 UTC m=+0.631295493 container died 4a4bc7ee59b03e383c39ec63e4cc3db5eb21d11dcd068533e4c7d8091143f1e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-8-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, ceph=True) 2024-08-02T19:01:54.199 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:54 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:54.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:54.199 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:54 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:54.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:54.199 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:54 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:54.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:54.199 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:54 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:54.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:54.199 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:54 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:54.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:01:54.224 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.8.service' 2024-08-02T19:01:54.302 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:01:54.302 INFO:tasks.cephadm.osd.8:Stopped osd.8 2024-08-02T19:01:54.303 INFO:tasks.cephadm.osd.9:Stopping osd.9... 2024-08-02T19:01:54.303 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.9 2024-08-02T19:01:54.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.063+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:54.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.063+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:54.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.063+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:54.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.063+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:54.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.063+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:54.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.063+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:54.591 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 systemd[1]: Stopping Ceph osd.9 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:01:54.591 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.590+0000 7f33a789b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.9 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:01:54.591 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.590+0000 7f33a789b640 -1 osd.9 104 *** Got signal Terminated *** 2024-08-02T19:01:54.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:54 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:54.470+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:54.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:54 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:54.470+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:54.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:54 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:54.470+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:54.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:54 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:54.470+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:54.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:54 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:54.470+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:54.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:54 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:54.470+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:55.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:54 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:54.590+0000 7f33a789b640 -1 osd.9 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:01:55.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:55 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:55.060+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:55.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:55 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:55.060+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:55.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:55 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:55.060+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:55.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:55 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:55.060+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:55.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:55 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:55.060+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:55.326 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:55 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:55.060+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:55.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:55 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:55.080+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:55.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:55 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:55.080+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:55.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:55 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:55.080+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:55.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:55 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:55.080+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:55.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:55 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:55.080+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:01:55.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:55 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:55.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:55.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:55 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:55.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:55.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:55 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:55.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:55.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:55 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:55.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:55.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:55 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:55.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:55.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:55 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:55.451+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:56.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:56 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:56.043+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:56.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:56 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:56.043+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:56.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:56 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:56.043+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:56.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:56 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:56.043+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:56.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:56 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:56.043+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:01:56.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:56 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:56.062+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:56.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:56 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:56.062+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:56.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:56 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:56.062+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:56.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:56 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:56.062+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:56.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:56 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:56.062+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:56.325 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:56 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:56.062+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:56.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:56 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:56.459+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:56.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:56 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:56.459+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:56.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:56 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:56.459+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:56.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:56 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:56.459+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:56.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:56 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:56.459+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:56.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:56 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:56.459+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:57.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.029+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:57.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.029+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:57.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.029+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:57.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.029+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:57.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.029+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:01:57.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:57 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:57.081+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:57.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:57 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:57.081+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:57.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:57 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:57.081+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:57.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:57 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:57.081+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:57.576 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:57 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:57.081+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:57.576 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:57 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:57.081+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:57.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:57 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:57.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:57.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:57 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:57.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:57.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:57 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:57.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:57.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:57 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:57.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:57.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:57 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:57.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:57.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:57 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:57.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:57.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:57 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:57.429+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:01:58.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.992+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:58.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.992+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:58.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.992+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:58.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.992+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:58.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:57 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:57.992+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:01:58.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:58 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:58.110+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:58.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:58 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:58.110+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:58.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:58 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:58.110+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:58.576 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:58 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:58.110+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:58.576 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:58 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:58.110+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:58.576 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:58 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:58.110+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:58.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:58 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:58.436+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:58.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:58 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:58.436+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:58.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:58 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:58.436+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:58.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:58 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:58.436+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:58.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:58 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:58.436+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:58.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:58 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:58.436+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:58.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:58 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:58.436+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:01:59.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:59.034+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:01:59.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:59.034+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:01:59.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:59.034+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:01:59.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:59.034+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:01:59.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:01:59 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:01:59.034+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:01:59.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:59 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:59.142+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:47.218451+0000 front 2024-08-02T19:00:47.218485+0000 (oldest deadline 2024-08-02T19:01:11.318648+0000) 2024-08-02T19:01:59.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:59 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:59.142+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:55.320312+0000 front 2024-08-02T19:00:55.320262+0000 (oldest deadline 2024-08-02T19:01:15.820409+0000) 2024-08-02T19:01:59.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:59 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:59.142+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.723083+0000 front 2024-08-02T19:01:02.722837+0000 (oldest deadline 2024-08-02T19:01:27.422910+0000) 2024-08-02T19:01:59.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:59 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:59.142+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:11.324672+0000 front 2024-08-02T19:01:11.324732+0000 (oldest deadline 2024-08-02T19:01:36.624884+0000) 2024-08-02T19:01:59.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:59 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:59.142+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:16.625793+0000 front 2024-08-02T19:01:16.625590+0000 (oldest deadline 2024-08-02T19:01:40.725456+0000) 2024-08-02T19:01:59.576 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:01:59 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9[67311]: 2024-08-02T19:01:59.142+0000 7f33a3eb1640 -1 osd.9 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:21.826454+0000 front 2024-08-02T19:01:21.826552+0000 (oldest deadline 2024-08-02T19:01:48.226719+0000) 2024-08-02T19:01:59.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:59 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:59.484+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:01:59.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:59 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:59.484+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:01:59.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:59 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:59.484+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:01:59.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:59 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:59.484+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:01:59.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:59 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:59.484+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:01:59.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:59 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:59.484+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:01:59.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:01:59 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:01:59.484+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:02:00.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:00 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:00.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:00.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:00 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:00.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:00.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:00 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:00.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:00.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:00 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:00.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:00.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:00 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:00.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:00.449 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:00 smithi103 podman[101680]: 2024-08-02 19:02:00.144636885 +0000 UTC m=+5.641737495 container died 38ae0bce78d49f1834cbe5df102af14c4798bbed7e714e6f25a3dcff4884dfb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9, GIT_CLEAN=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-02T19:02:00.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:00 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:00.461+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:02:00.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:00 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:00.461+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:02:00.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:00 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:00.461+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:02:00.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:00 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:00.461+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:02:00.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:00 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:00.461+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:02:00.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:00 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:00.461+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:02:00.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:00 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:00.461+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:02:00.825 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:00 smithi103 podman[101680]: 2024-08-02 19:02:00.448473424 +0000 UTC m=+5.945574025 container cleanup 38ae0bce78d49f1834cbe5df102af14c4798bbed7e714e6f25a3dcff4884dfb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T19:02:00.825 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:00 smithi103 bash[101680]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9 2024-08-02T19:02:00.825 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:00 smithi103 podman[101694]: 2024-08-02 19:02:00.616261401 +0000 UTC m=+0.469575954 container remove 38ae0bce78d49f1834cbe5df102af14c4798bbed7e714e6f25a3dcff4884dfb5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=) 2024-08-02T19:02:01.286 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:01 smithi103 podman[101782]: 2024-08-02 19:02:00.928938545 +0000 UTC m=+0.017357801 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:02:01.287 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:01 smithi103 podman[101782]: 2024-08-02 19:02:01.050742657 +0000 UTC m=+0.139161900 container create 57dccf5718aaef82d8dc58881b56f134e3d287085ea7c57d91c9342220b99104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9-deactivate, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T19:02:01.287 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:01 smithi103 podman[101782]: 2024-08-02 19:02:01.286383421 +0000 UTC m=+0.374802664 container init 57dccf5718aaef82d8dc58881b56f134e3d287085ea7c57d91c9342220b99104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9-deactivate, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2) 2024-08-02T19:02:01.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:01.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:01.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:01.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:01.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:01.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:01.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:01.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:01.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:01.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:01.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:01 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:01.015+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:01.575 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:01 smithi103 podman[101782]: 2024-08-02 19:02:01.289853928 +0000 UTC m=+0.378273172 container start 57dccf5718aaef82d8dc58881b56f134e3d287085ea7c57d91c9342220b99104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8) 2024-08-02T19:02:01.576 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:01 smithi103 podman[101782]: 2024-08-02 19:02:01.361480415 +0000 UTC m=+0.449899675 container attach 57dccf5718aaef82d8dc58881b56f134e3d287085ea7c57d91c9342220b99104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9-deactivate, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, maintainer=Guillaume Abrioux , RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0) 2024-08-02T19:02:01.576 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:01 smithi103 podman[101782]: 2024-08-02 19:02:01.479489452 +0000 UTC m=+0.567908706 container died 57dccf5718aaef82d8dc58881b56f134e3d287085ea7c57d91c9342220b99104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9-deactivate, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, ceph=True, GIT_CLEAN=True, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T19:02:01.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:01 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:01.430+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:02:01.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:01 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:01.430+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:02:01.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:01 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:01.430+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:02:01.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:01 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:01.430+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:02:01.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:01 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:01.430+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:02:01.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:01 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:01.430+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:02:01.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:01 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:01.430+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:02:02.041 INFO:journalctl@ceph.osd.9.smithi103.stdout:Aug 02 19:02:02 smithi103 podman[101805]: 2024-08-02 19:02:02.023400799 +0000 UTC m=+0.538091619 container remove 57dccf5718aaef82d8dc58881b56f134e3d287085ea7c57d91c9342220b99104 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-9-deactivate, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-08-02T19:02:02.047 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.9.service' 2024-08-02T19:02:02.126 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:02.126 INFO:tasks.cephadm.osd.9:Stopped osd.9 2024-08-02T19:02:02.126 INFO:tasks.cephadm.osd.10:Stopping osd.10... 2024-08-02T19:02:02.126 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.10 2024-08-02T19:02:02.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:02.003+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:02.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:02.003+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:02.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:02.003+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:02.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:02.003+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:02.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:02.003+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:02.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:02.003+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:02.435 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 systemd[1]: Stopping Ceph osd.10 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:02.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.433+0000 7fb618514640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.10 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:02.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.433+0000 7fb618514640 -1 osd.10 104 *** Got signal Terminated *** 2024-08-02T19:02:02.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.433+0000 7fb618514640 -1 osd.10 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:02:02.752 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.478+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:02:02.752 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.478+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:02:02.752 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.478+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:02:02.752 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.478+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:02:02.752 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.478+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:02:02.752 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.478+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:02:02.753 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:02 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:02.478+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:02:03.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:03.048+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:03.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:03.048+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:03.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:03.048+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:03.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:03.048+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:03.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:03.048+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:03.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:03 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:03.048+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:04.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:03.511+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:02:04.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:03.511+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:02:04.002 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:03.511+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:02:04.002 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:03.511+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:02:04.002 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:03.511+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:02:04.002 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:03.511+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:02:04.002 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:03 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:03.511+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:02:04.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:04.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:04.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:04.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:04.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:04.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:04.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:04.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:04.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:04.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:04.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:04 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:04.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:04.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:04.476+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:02:04.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:04.476+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:02:04.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:04.476+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:02:04.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:04.476+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:02:04.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:04.476+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:02:04.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:04.476+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:02:04.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:04 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:04.476+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:02:05.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:05 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:05.086+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:05.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:05 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:05.086+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:05.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:05 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:05.086+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:05.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:05 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:05.086+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:05.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:05 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:05.086+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:05.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:05 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:05.086+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:05.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:05.479+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:02:05.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:05.479+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:02:05.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:05.479+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:02:05.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:05.479+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:02:05.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:05.479+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:02:05.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:05.479+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:02:05.751 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:05 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:05.479+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:02:06.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:06 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:06.103+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:06.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:06 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:06.103+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:06.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:06 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:06.103+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:06.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:06 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:06.103+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:06.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:06 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:06.103+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:06.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:06 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:06.103+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:07.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:06.525+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:46.673313+0000 front 2024-08-02T19:00:46.673327+0000 (oldest deadline 2024-08-02T19:01:10.773278+0000) 2024-08-02T19:02:07.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:06.525+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6804 osd.1 since back 2024-08-02T19:00:52.474180+0000 front 2024-08-02T19:00:52.474201+0000 (oldest deadline 2024-08-02T19:01:17.174204+0000) 2024-08-02T19:02:07.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:06.525+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:00:58.875218+0000 front 2024-08-02T19:00:58.875278+0000 (oldest deadline 2024-08-02T19:01:24.775151+0000) 2024-08-02T19:02:07.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:06.525+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:08.876245+0000 front 2024-08-02T19:01:08.876093+0000 (oldest deadline 2024-08-02T19:01:34.175993+0000) 2024-08-02T19:02:07.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:06.525+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:19.476936+0000 front 2024-08-02T19:01:19.476777+0000 (oldest deadline 2024-08-02T19:01:41.677354+0000) 2024-08-02T19:02:07.001 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:06.525+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:24.578196+0000 front 2024-08-02T19:01:24.578255+0000 (oldest deadline 2024-08-02T19:01:50.478247+0000) 2024-08-02T19:02:07.002 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:06 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10[61611]: 2024-08-02T19:02:06.525+0000 7fb614b2a640 -1 osd.10 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:34.579241+0000 front 2024-08-02T19:01:34.579259+0000 (oldest deadline 2024-08-02T19:01:56.879003+0000) 2024-08-02T19:02:07.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:07 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:07.137+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:07.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:07 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:07.137+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:07.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:07 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:07.137+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:07.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:07 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:07.137+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:07.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:07 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:07.137+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:07.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:07 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:07.137+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:07.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:07 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:07.137+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:08.226 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:07 smithi121 podman[73954]: 2024-08-02 19:02:07.935619841 +0000 UTC m=+5.620674082 container died f9a740ba0b47dca3a49ccf1229aa3c7fd49c76c93e9dd3e6c91e1bd8770b90aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, ceph=True, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0) 2024-08-02T19:02:08.501 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:08 smithi121 podman[73954]: 2024-08-02 19:02:08.333412107 +0000 UTC m=+6.018466349 container cleanup f9a740ba0b47dca3a49ccf1229aa3c7fd49c76c93e9dd3e6c91e1bd8770b90aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , RELEASE=squid-release-26c3fb8) 2024-08-02T19:02:08.501 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:08 smithi121 bash[73954]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10 2024-08-02T19:02:08.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:08 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:08.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:08.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:08 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:08.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:08.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:08 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:08.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:08.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:08 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:08.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:08.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:08 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:08.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:08.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:08 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:08.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:08.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:08 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:08.104+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:08.924 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:08 smithi121 podman[73969]: 2024-08-02 19:02:08.609721259 +0000 UTC m=+0.663903162 container remove f9a740ba0b47dca3a49ccf1229aa3c7fd49c76c93e9dd3e6c91e1bd8770b90aa (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T19:02:09.205 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:08 smithi121 podman[74058]: 2024-08-02 19:02:08.826729603 +0000 UTC m=+0.016954317 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:02:09.205 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:08 smithi121 podman[74058]: 2024-08-02 19:02:08.927432279 +0000 UTC m=+0.117657029 container create 9405c62ede75606b05b12992e9103a1a24af7dfe0f4623eb7078a764bc9073d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10-deactivate, io.buildah.version=1.36.0, ceph=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T19:02:09.205 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:09 smithi121 podman[74058]: 2024-08-02 19:02:09.146663735 +0000 UTC m=+0.336888438 container init 9405c62ede75606b05b12992e9103a1a24af7dfe0f4623eb7078a764bc9073d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, ceph=True, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731) 2024-08-02T19:02:09.206 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:09 smithi121 podman[74058]: 2024-08-02 19:02:09.149643174 +0000 UTC m=+0.339867885 container start 9405c62ede75606b05b12992e9103a1a24af7dfe0f4623eb7078a764bc9073d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10-deactivate, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, RELEASE=squid-release-26c3fb8, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, CEPH_POINT_RELEASE=) 2024-08-02T19:02:09.206 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:09 smithi121 podman[74058]: 2024-08-02 19:02:09.204837129 +0000 UTC m=+0.395061850 container attach 9405c62ede75606b05b12992e9103a1a24af7dfe0f4623eb7078a764bc9073d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10-deactivate, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0) 2024-08-02T19:02:09.500 INFO:journalctl@ceph.osd.10.smithi121.stdout:Aug 02 19:02:09 smithi121 podman[74058]: 2024-08-02 19:02:09.349975911 +0000 UTC m=+0.540200615 container died 9405c62ede75606b05b12992e9103a1a24af7dfe0f4623eb7078a764bc9073d5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-10-deactivate, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0) 2024-08-02T19:02:09.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:09.149+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:09.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:09.149+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:09.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:09.149+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:09.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:09.149+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:09.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:09.149+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:09.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:09.149+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:09.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:09 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:09.149+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:09.876 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.10.service' 2024-08-02T19:02:09.912 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:09.913 INFO:tasks.cephadm.osd.10:Stopped osd.10 2024-08-02T19:02:09.913 INFO:tasks.cephadm.osd.11:Stopping osd.11... 2024-08-02T19:02:09.913 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.11 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:09 smithi151 systemd[1]: Stopping Ceph osd.11 for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.127+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.127+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.127+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.127+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.127+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.127+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.127+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.234+0000 7f8664ecf640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.11 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:10.236 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.234+0000 7f8664ecf640 -1 osd.11 104 *** Got signal Terminated *** 2024-08-02T19:02:10.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:10 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:10.234+0000 7f8664ecf640 -1 osd.11 104 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-08-02T19:02:11.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:11.111+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:11.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:11.111+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:11.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:11.111+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:11.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:11.111+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:11.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:11.111+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:11.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:11.111+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:11.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:11 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:11.111+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:12.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:12.140+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:12.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:12.140+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:12.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:12.140+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:12.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:12.140+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:12.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:12.140+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:12.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:12.140+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:12.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:12 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:12.140+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:13.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:13.138+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:13.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:13.138+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:13.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:13.138+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:13.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:13.138+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:13.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:13.138+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:13.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:13.138+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:13.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:13 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:13.138+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:14.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:14.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:14.581 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:14.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:14.581 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:14.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:14.581 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:14.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:14.581 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:14.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:14.581 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:14.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:14.582 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:14 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:14.094+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:15.570 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:15.135+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6806 osd.0 since back 2024-08-02T19:00:45.829917+0000 front 2024-08-02T19:00:45.829723+0000 (oldest deadline 2024-08-02T19:01:08.129774+0000) 2024-08-02T19:02:15.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:15.135+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6804 osd.2 since back 2024-08-02T19:01:02.533350+0000 front 2024-08-02T19:01:02.533434+0000 (oldest deadline 2024-08-02T19:01:29.533984+0000) 2024-08-02T19:02:15.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:15.135+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6814 osd.3 since back 2024-08-02T19:01:09.534540+0000 front 2024-08-02T19:01:09.534558+0000 (oldest deadline 2024-08-02T19:01:34.734992+0000) 2024-08-02T19:02:15.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:15.135+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6812 osd.4 since back 2024-08-02T19:01:18.736501+0000 front 2024-08-02T19:01:18.736623+0000 (oldest deadline 2024-08-02T19:01:41.536934+0000) 2024-08-02T19:02:15.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:15.136+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.151:6812 osd.5 since back 2024-08-02T19:01:26.837857+0000 front 2024-08-02T19:01:26.837893+0000 (oldest deadline 2024-08-02T19:01:53.238374+0000) 2024-08-02T19:02:15.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:15.136+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.103:6822 osd.6 since back 2024-08-02T19:01:35.539478+0000 front 2024-08-02T19:01:35.539545+0000 (oldest deadline 2024-08-02T19:02:00.839374+0000) 2024-08-02T19:02:15.571 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:15 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11[61847]: 2024-08-02T19:02:15.136+0000 7f865d4dd640 -1 osd.11 104 heartbeat_check: no reply from 172.21.15.121:6820 osd.7 since back 2024-08-02T19:01:40.839790+0000 front 2024-08-02T19:01:40.839863+0000 (oldest deadline 2024-08-02T19:02:06.139781+0000) 2024-08-02T19:02:15.996 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:15 smithi151 podman[74129]: 2024-08-02 19:02:15.738645207 +0000 UTC m=+5.622901005 container died ab41d6ad1cf7c32480056120aa55e7970b17b948e7a312a74e7033e8999b2f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, ceph=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7) 2024-08-02T19:02:16.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:16 smithi151 podman[74129]: 2024-08-02 19:02:16.101961379 +0000 UTC m=+5.986217167 container cleanup ab41d6ad1cf7c32480056120aa55e7970b17b948e7a312a74e7033e8999b2f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8) 2024-08-02T19:02:16.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:16 smithi151 bash[74129]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11 2024-08-02T19:02:16.681 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:16 smithi151 podman[74146]: 2024-08-02 19:02:16.361916477 +0000 UTC m=+0.615828821 container remove ab41d6ad1cf7c32480056120aa55e7970b17b948e7a312a74e7033e8999b2f65 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, GIT_CLEAN=True) 2024-08-02T19:02:16.932 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:16 smithi151 podman[74237]: 2024-08-02 19:02:16.582936241 +0000 UTC m=+0.017501171 image pull 564b849e9656f1ee75485c9661bf7ced18201970c51e80ee530a7cf1e40b1208 quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6 2024-08-02T19:02:16.933 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:16 smithi151 podman[74237]: 2024-08-02 19:02:16.696267779 +0000 UTC m=+0.130832774 container create b37629dfc7102da6914fbf3fb71c3d954eeb97ac2688b1f576398918a0a7619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11-deactivate, org.label-schema.license=GPLv2, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD) 2024-08-02T19:02:16.933 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:16 smithi151 podman[74237]: 2024-08-02 19:02:16.932203675 +0000 UTC m=+0.366768613 container init b37629dfc7102da6914fbf3fb71c3d954eeb97ac2688b1f576398918a0a7619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11-deactivate, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.schema-version=1.0) 2024-08-02T19:02:17.320 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:16 smithi151 podman[74237]: 2024-08-02 19:02:16.935328043 +0000 UTC m=+0.369892978 container start b37629dfc7102da6914fbf3fb71c3d954eeb97ac2688b1f576398918a0a7619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11-deactivate, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, ceph=True) 2024-08-02T19:02:17.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:17 smithi151 podman[74237]: 2024-08-02 19:02:17.015657032 +0000 UTC m=+0.450221994 container attach b37629dfc7102da6914fbf3fb71c3d954eeb97ac2688b1f576398918a0a7619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11-deactivate, org.label-schema.build-date=20240731, RELEASE=squid-release-26c3fb8, org.label-schema.name=CentOS Stream 9 Base Image, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2) 2024-08-02T19:02:17.321 INFO:journalctl@ceph.osd.11.smithi151.stdout:Aug 02 19:02:17 smithi151 podman[74237]: 2024-08-02 19:02:17.125901049 +0000 UTC m=+0.560465982 container died b37629dfc7102da6914fbf3fb71c3d954eeb97ac2688b1f576398918a0a7619d (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-osd-11-deactivate, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-02T19:02:17.713 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@osd.11.service' 2024-08-02T19:02:17.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:17.750 INFO:tasks.cephadm.osd.11:Stopped osd.11 2024-08-02T19:02:17.750 INFO:tasks.cephadm.mds.a:Stopping mds.a... 2024-08-02T19:02:17.750 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.a 2024-08-02T19:02:18.051 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 19:02:17 smithi103 systemd[1]: Stopping Ceph mds.a for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:18.312 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 19:02:18 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a[74347]: 2024-08-02T19:02:18.048+0000 7f653fb45640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:18.312 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 19:02:18 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a[74347]: 2024-08-02T19:02:18.048+0000 7f653fb45640 -1 mds.a *** got signal Terminated *** 2024-08-02T19:02:20.985 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 19:02:20 smithi103 podman[101883]: 2024-08-02 19:02:20.702846578 +0000 UTC m=+2.752615842 container died d11753086e073f7347569fb28df426f9287bfef6701e3062ad586a8b666792e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-02T19:02:21.318 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 19:02:21 smithi103 podman[101883]: 2024-08-02 19:02:21.075316274 +0000 UTC m=+3.125085540 container cleanup d11753086e073f7347569fb28df426f9287bfef6701e3062ad586a8b666792e4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0) 2024-08-02T19:02:21.319 INFO:journalctl@ceph.mds.a.smithi103.stdout:Aug 02 19:02:21 smithi103 bash[101883]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-a 2024-08-02T19:02:21.459 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.a.service' 2024-08-02T19:02:21.496 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:21.496 INFO:tasks.cephadm.mds.a:Stopped mds.a 2024-08-02T19:02:21.496 INFO:tasks.cephadm.mds.d:Stopping mds.d... 2024-08-02T19:02:21.496 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.d 2024-08-02T19:02:22.075 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 19:02:21 smithi103 systemd[1]: Stopping Ceph mds.d for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:22.075 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 19:02:21 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d[73160]: 2024-08-02T19:02:21.811+0000 7fa98cfee640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.d -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:22.075 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 19:02:21 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d[73160]: 2024-08-02T19:02:21.811+0000 7fa98cfee640 -1 mds.d *** got signal Terminated *** 2024-08-02T19:02:24.406 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 19:02:24 smithi103 podman[102018]: 2024-08-02 19:02:24.129130826 +0000 UTC m=+2.412109024 container died 8973ba515c3ca700f97562ef695711e8725ca6df5f8a40b7b5ce6a76f41ad3a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d, org.label-schema.license=GPLv2, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, ceph=True, GIT_CLEAN=True) 2024-08-02T19:02:24.764 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 19:02:24 smithi103 podman[102018]: 2024-08-02 19:02:24.504286631 +0000 UTC m=+2.787264829 container cleanup 8973ba515c3ca700f97562ef695711e8725ca6df5f8a40b7b5ce6a76f41ad3a6 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d, ceph=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, org.label-schema.schema-version=1.0) 2024-08-02T19:02:24.764 INFO:journalctl@ceph.mds.d.smithi103.stdout:Aug 02 19:02:24 smithi103 bash[102018]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-d 2024-08-02T19:02:24.942 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.d.service' 2024-08-02T19:02:24.975 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:24.975 INFO:tasks.cephadm.mds.d:Stopped mds.d 2024-08-02T19:02:24.976 INFO:tasks.cephadm.mds.g:Stopping mds.g... 2024-08-02T19:02:24.976 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.g 2024-08-02T19:02:25.325 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 19:02:25 smithi103 systemd[1]: Stopping Ceph mds.g for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:25.825 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 19:02:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g[73949]: 2024-08-02T19:02:25.333+0000 7fcc9f50e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.g -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:25.825 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 19:02:25 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g[73949]: 2024-08-02T19:02:25.333+0000 7fcc9f50e640 -1 mds.g *** got signal Terminated *** 2024-08-02T19:02:29.319 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 19:02:29 smithi103 podman[102138]: 2024-08-02 19:02:29.051622961 +0000 UTC m=+3.862243579 container died 3a0c4ca74da89165ab3beed6f4787a9f89f41c0b1a3fb7d2a6fda88344f68047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-02T19:02:29.575 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 19:02:29 smithi103 podman[102138]: 2024-08-02 19:02:29.516948068 +0000 UTC m=+4.327568685 container cleanup 3a0c4ca74da89165ab3beed6f4787a9f89f41c0b1a3fb7d2a6fda88344f68047 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g, org.label-schema.license=GPLv2, org.label-schema.build-date=20240731, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-08-02T19:02:29.575 INFO:journalctl@ceph.mds.g.smithi103.stdout:Aug 02 19:02:29 smithi103 bash[102138]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-g 2024-08-02T19:02:29.891 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.g.service' 2024-08-02T19:02:29.924 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:29.924 INFO:tasks.cephadm.mds.g:Stopped mds.g 2024-08-02T19:02:29.924 INFO:tasks.cephadm.mds.j:Stopping mds.j... 2024-08-02T19:02:29.924 DEBUG:teuthology.orchestra.run.smithi103:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.j 2024-08-02T19:02:30.075 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 19:02:30 smithi103 systemd[1]: Stopping Ceph mds.j for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:30.575 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 19:02:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j[72747]: 2024-08-02T19:02:30.237+0000 7fea73fa2640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.j -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:30.575 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 19:02:30 smithi103 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j[72747]: 2024-08-02T19:02:30.237+0000 7fea73fa2640 -1 mds.j *** got signal Terminated *** 2024-08-02T19:02:33.075 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 19:02:32 smithi103 podman[102260]: 2024-08-02 19:02:32.803152994 +0000 UTC m=+2.663297212 container died d84c0df1ea2f5ed74819319b1f93fac468ba2c70e5ecd6b94d536168d6007bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j, GIT_CLEAN=True, org.label-schema.build-date=20240731, ceph=True, GIT_BRANCH=HEAD, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0) 2024-08-02T19:02:33.456 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 19:02:33 smithi103 podman[102260]: 2024-08-02 19:02:33.195897452 +0000 UTC m=+3.056041670 container cleanup d84c0df1ea2f5ed74819319b1f93fac468ba2c70e5ecd6b94d536168d6007bb4 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T19:02:33.456 INFO:journalctl@ceph.mds.j.smithi103.stdout:Aug 02 19:02:33 smithi103 bash[102260]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-j 2024-08-02T19:02:33.585 DEBUG:teuthology.orchestra.run.smithi103:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.j.service' 2024-08-02T19:02:33.617 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:33.617 INFO:tasks.cephadm.mds.j:Stopped mds.j 2024-08-02T19:02:33.618 INFO:tasks.cephadm.mds.b:Stopping mds.b... 2024-08-02T19:02:33.618 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.b 2024-08-02T19:02:33.908 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:02:33 smithi121 systemd[1]: Stopping Ceph mds.b for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:34.251 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:02:33 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b[67166]: 2024-08-02T19:02:33.906+0000 7f4b8c9b5640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:34.251 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:02:33 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b[67166]: 2024-08-02T19:02:33.906+0000 7f4b8c9b5640 -1 mds.b *** got signal Terminated *** 2024-08-02T19:02:37.741 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:02:37 smithi121 podman[74171]: 2024-08-02 19:02:37.470635919 +0000 UTC m=+3.658105859 container died d49ebf03fa4dd202524296fc24f33862067a9b33353ced364fd43412e60c9048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.build-date=20240731, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-08-02T19:02:38.000 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:02:37 smithi121 podman[74171]: 2024-08-02 19:02:37.839584772 +0000 UTC m=+4.027054718 container cleanup d49ebf03fa4dd202524296fc24f33862067a9b33353ced364fd43412e60c9048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b, RELEASE=squid-release-26c3fb8, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 9 Base Image, GIT_BRANCH=HEAD, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-08-02T19:02:38.001 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:02:37 smithi121 bash[74171]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b 2024-08-02T19:02:38.253 INFO:journalctl@ceph.mds.b.smithi121.stdout:Aug 02 19:02:38 smithi121 podman[74184]: 2024-08-02 19:02:38.099069979 +0000 UTC m=+0.627705319 container remove d49ebf03fa4dd202524296fc24f33862067a9b33353ced364fd43412e60c9048 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.36.0, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, org.label-schema.vendor=CentOS, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-08-02T19:02:38.275 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.b.service' 2024-08-02T19:02:38.308 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:38.308 INFO:tasks.cephadm.mds.b:Stopped mds.b 2024-08-02T19:02:38.308 INFO:tasks.cephadm.mds.e:Stopping mds.e... 2024-08-02T19:02:38.309 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.e 2024-08-02T19:02:38.619 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:02:38 smithi121 systemd[1]: Stopping Ceph mds.e for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:39.001 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:02:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e[66546]: 2024-08-02T19:02:38.618+0000 7f8342897640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.e -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:39.001 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:02:38 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e[66546]: 2024-08-02T19:02:38.618+0000 7f8342897640 -1 mds.e *** got signal Terminated *** 2024-08-02T19:02:41.751 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:02:41 smithi121 podman[74291]: 2024-08-02 19:02:41.465163701 +0000 UTC m=+2.943180405 container died 1aa3f21ff7e7917211ae640494304c7db6d5bbd6a1fec2e6e31919b577e7a303 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-release-26c3fb8) 2024-08-02T19:02:42.087 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:02:41 smithi121 podman[74291]: 2024-08-02 19:02:41.835154672 +0000 UTC m=+3.313171374 container cleanup 1aa3f21ff7e7917211ae640494304c7db6d5bbd6a1fec2e6e31919b577e7a303 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, ceph=True, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD) 2024-08-02T19:02:42.087 INFO:journalctl@ceph.mds.e.smithi121.stdout:Aug 02 19:02:41 smithi121 bash[74291]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-e 2024-08-02T19:02:42.215 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.e.service' 2024-08-02T19:02:42.248 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:42.248 INFO:tasks.cephadm.mds.e:Stopped mds.e 2024-08-02T19:02:42.249 INFO:tasks.cephadm.mds.h:Stopping mds.h... 2024-08-02T19:02:42.249 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.h 2024-08-02T19:02:42.500 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:02:42 smithi121 systemd[1]: Stopping Ceph mds.h for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:43.000 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:02:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h[66850]: 2024-08-02T19:02:42.605+0000 7fd28fc3e640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.h -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:43.001 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:02:42 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h[66850]: 2024-08-02T19:02:42.605+0000 7fd28fc3e640 -1 mds.h *** got signal Terminated *** 2024-08-02T19:02:45.751 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:02:45 smithi121 podman[74424]: 2024-08-02 19:02:45.463621785 +0000 UTC m=+3.001727265 container died 948319a123191de59fbf14ea42e428274abec56977f5709fcccddce746194f85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.36.0, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0) 2024-08-02T19:02:46.107 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:02:45 smithi121 podman[74424]: 2024-08-02 19:02:45.830593839 +0000 UTC m=+3.368699328 container cleanup 948319a123191de59fbf14ea42e428274abec56977f5709fcccddce746194f85 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.build-date=20240731, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.36.0) 2024-08-02T19:02:46.107 INFO:journalctl@ceph.mds.h.smithi121.stdout:Aug 02 19:02:45 smithi121 bash[74424]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-h 2024-08-02T19:02:46.235 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.h.service' 2024-08-02T19:02:46.266 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:46.266 INFO:tasks.cephadm.mds.h:Stopped mds.h 2024-08-02T19:02:46.266 INFO:tasks.cephadm.mds.k:Stopping mds.k... 2024-08-02T19:02:46.267 DEBUG:teuthology.orchestra.run.smithi121:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.k 2024-08-02T19:02:46.501 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 19:02:46 smithi121 systemd[1]: Stopping Ceph mds.k for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:47.000 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 19:02:46 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k[66241]: 2024-08-02T19:02:46.600+0000 7ff8aa9b8640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.k -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:47.001 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 19:02:46 smithi121 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k[66241]: 2024-08-02T19:02:46.600+0000 7ff8aa9b8640 -1 mds.k *** got signal Terminated *** 2024-08-02T19:02:50.377 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 19:02:50 smithi121 podman[74544]: 2024-08-02 19:02:50.115986191 +0000 UTC m=+3.635802628 container died 2d5eeeccfd548c46b72cdb10bb82bf8976f3c6b61321ff73a2bbe88e195f16e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, ceph=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T19:02:50.751 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 19:02:50 smithi121 podman[74544]: 2024-08-02 19:02:50.475656807 +0000 UTC m=+3.995473236 container cleanup 2d5eeeccfd548c46b72cdb10bb82bf8976f3c6b61321ff73a2bbe88e195f16e9 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k, io.buildah.version=1.36.0, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, ceph=True, org.label-schema.build-date=20240731, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True) 2024-08-02T19:02:50.751 INFO:journalctl@ceph.mds.k.smithi121.stdout:Aug 02 19:02:50 smithi121 bash[74544]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-k 2024-08-02T19:02:50.899 DEBUG:teuthology.orchestra.run.smithi121:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.k.service' 2024-08-02T19:02:50.930 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:50.930 INFO:tasks.cephadm.mds.k:Stopped mds.k 2024-08-02T19:02:50.930 INFO:tasks.cephadm.mds.c:Stopping mds.c... 2024-08-02T19:02:50.931 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.c 2024-08-02T19:02:51.238 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:02:50 smithi151 systemd[1]: Stopping Ceph mds.c for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:51.497 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:02:51 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T19:02:51.236+0000 7ff11812d640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:51.497 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:02:51 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c[67122]: 2024-08-02T19:02:51.236+0000 7ff11812d640 -1 mds.c *** got signal Terminated *** 2024-08-02T19:02:53.747 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:02:53 smithi151 podman[74339]: 2024-08-02 19:02:53.470976375 +0000 UTC m=+2.340491227 container died 108c8193648698b6ef48e7c108edb2e8e9c7488052d6c1aa1ea9b81f9535b757 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240731, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 9 Base Image) 2024-08-02T19:02:54.070 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:02:53 smithi151 podman[74339]: 2024-08-02 19:02:53.829447771 +0000 UTC m=+2.698962633 container cleanup 108c8193648698b6ef48e7c108edb2e8e9c7488052d6c1aa1ea9b81f9535b757 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.schema-version=1.0) 2024-08-02T19:02:54.070 INFO:journalctl@ceph.mds.c.smithi151.stdout:Aug 02 19:02:53 smithi151 bash[74339]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-c 2024-08-02T19:02:54.263 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.c.service' 2024-08-02T19:02:54.298 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:54.298 INFO:tasks.cephadm.mds.c:Stopped mds.c 2024-08-02T19:02:54.298 INFO:tasks.cephadm.mds.f:Stopping mds.f... 2024-08-02T19:02:54.298 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.f 2024-08-02T19:02:54.626 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:02:54 smithi151 systemd[1]: Stopping Ceph mds.f for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:55.070 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:02:54 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f[66811]: 2024-08-02T19:02:54.624+0000 7f984db3f640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.f -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:55.070 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:02:54 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f[66811]: 2024-08-02T19:02:54.624+0000 7f984db3f640 -1 mds.f *** got signal Terminated *** 2024-08-02T19:02:57.735 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:02:57 smithi151 podman[74473]: 2024-08-02 19:02:57.473718876 +0000 UTC m=+2.953195989 container died 18f73e5f41af4d4cf54537467fc049f9cf1ebb0502e5533e9ea8bc84aa4f52d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.vendor=CentOS, GIT_CLEAN=True, io.buildah.version=1.36.0, org.label-schema.license=GPLv2) 2024-08-02T19:02:58.070 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:02:57 smithi151 podman[74473]: 2024-08-02 19:02:57.842546829 +0000 UTC m=+3.322023939 container cleanup 18f73e5f41af4d4cf54537467fc049f9cf1ebb0502e5533e9ea8bc84aa4f52d2 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240731, org.label-schema.schema-version=1.0, ceph=True) 2024-08-02T19:02:58.070 INFO:journalctl@ceph.mds.f.smithi151.stdout:Aug 02 19:02:57 smithi151 bash[74473]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-f 2024-08-02T19:02:58.277 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.f.service' 2024-08-02T19:02:58.309 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:02:58.309 INFO:tasks.cephadm.mds.f:Stopped mds.f 2024-08-02T19:02:58.309 INFO:tasks.cephadm.mds.i:Stopping mds.i... 2024-08-02T19:02:58.310 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.i 2024-08-02T19:02:58.639 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:02:58 smithi151 systemd[1]: Stopping Ceph mds.i for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:02:59.070 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:02:58 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T19:02:58.638+0000 7ff11d36b640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.i -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:02:59.070 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:02:58 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i[67427]: 2024-08-02T19:02:58.638+0000 7ff11d36b640 -1 mds.i *** got signal Terminated *** 2024-08-02T19:03:01.739 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:03:01 smithi151 podman[74593]: 2024-08-02 19:03:01.469307842 +0000 UTC m=+2.937412575 container died edf35a6810a6f105dd6b029166d4480644b6ebb5e8a747fac0c41c1a720f59e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=, io.buildah.version=1.36.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, RELEASE=squid-release-26c3fb8, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240731) 2024-08-02T19:03:02.070 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:03:01 smithi151 podman[74593]: 2024-08-02 19:03:01.822047084 +0000 UTC m=+3.290151828 container cleanup edf35a6810a6f105dd6b029166d4480644b6ebb5e8a747fac0c41c1a720f59e5 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i, org.label-schema.build-date=20240731, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, maintainer=Guillaume Abrioux , ceph=True, io.buildah.version=1.36.0, RELEASE=squid-release-26c3fb8, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 9 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=) 2024-08-02T19:03:02.070 INFO:journalctl@ceph.mds.i.smithi151.stdout:Aug 02 19:03:01 smithi151 bash[74593]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-i 2024-08-02T19:03:02.256 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.i.service' 2024-08-02T19:03:02.290 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:03:02.291 INFO:tasks.cephadm.mds.i:Stopped mds.i 2024-08-02T19:03:02.291 INFO:tasks.cephadm.mds.l:Stopping mds.l... 2024-08-02T19:03:02.291 DEBUG:teuthology.orchestra.run.smithi151:> sudo systemctl stop ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.l 2024-08-02T19:03:02.820 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 19:03:02 smithi151 systemd[1]: Stopping Ceph mds.l for 7ef68402-50fe-11ef-bcca-c7b262605968... 2024-08-02T19:03:02.820 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 19:03:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l[66495]: 2024-08-02T19:03:02.601+0000 7f10f99e3640 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mds -n mds.l -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-08-02T19:03:02.820 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 19:03:02 smithi151 ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l[66495]: 2024-08-02T19:03:02.601+0000 7f10f99e3640 -1 mds.l *** got signal Terminated *** 2024-08-02T19:03:06.928 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 19:03:06 smithi151 podman[74713]: 2024-08-02 19:03:06.615307361 +0000 UTC m=+4.106377978 container died 6f3d26102afc3e73946e6bebffb9014f15f822f61f7bbd3d779c3c642d6dea70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l, org.label-schema.name=CentOS Stream 9 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, RELEASE=squid-release-26c3fb8, org.label-schema.build-date=20240731, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, ceph=True) 2024-08-02T19:03:07.229 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 19:03:07 smithi151 podman[74713]: 2024-08-02 19:03:07.027454246 +0000 UTC m=+4.518524850 container cleanup 6f3d26102afc3e73946e6bebffb9014f15f822f61f7bbd3d779c3c642d6dea70 (image=quay-quay-quay.apps.os.sepia.ceph.com/ceph-ci/ceph@sha256:6365e5c9c60465c6a86a1efc2ae80339db907d187de8bd717e7c6952210feca6, name=ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 9 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , RELEASE=squid-release-26c3fb8, io.buildah.version=1.36.0, GIT_COMMIT=c5aaba5e3282b30e4782f2b5d6e4e362e22dfcb7, GIT_CLEAN=True, GIT_BRANCH=HEAD, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240731) 2024-08-02T19:03:07.229 INFO:journalctl@ceph.mds.l.smithi151.stdout:Aug 02 19:03:07 smithi151 bash[74713]: ceph-7ef68402-50fe-11ef-bcca-c7b262605968-mds-l 2024-08-02T19:03:07.453 DEBUG:teuthology.orchestra.run.smithi151:> sudo pkill -f 'journalctl -f -n 0 -u ceph-7ef68402-50fe-11ef-bcca-c7b262605968@mds.l.service' 2024-08-02T19:03:07.485 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-08-02T19:03:07.485 INFO:tasks.cephadm.mds.l:Stopped mds.l 2024-08-02T19:03:07.485 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 --force --keep-logs 2024-08-02T19:03:07.690 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T19:03:10.229 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 --force --keep-logs 2024-08-02T19:03:10.431 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T19:03:12.835 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 --force --keep-logs 2024-08-02T19:03:13.038 INFO:teuthology.orchestra.run.smithi151.stdout:Deleting cluster with fsid: 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T19:03:15.405 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-02T19:03:15.440 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-02T19:03:15.472 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-08-02T19:03:15.497 INFO:tasks.cephadm:Archiving crash dumps... 2024-08-02T19:03:15.499 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi103/crash 2024-08-02T19:03:15.500 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash -- . 2024-08-02T19:03:15.529 INFO:teuthology.orchestra.run.smithi103.stderr:tar: /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash: Cannot open: No such file or directory 2024-08-02T19:03:15.529 INFO:teuthology.orchestra.run.smithi103.stderr:tar: Error is not recoverable: exiting now 2024-08-02T19:03:15.531 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi121/crash 2024-08-02T19:03:15.532 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash -- . 2024-08-02T19:03:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:tar: /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash: Cannot open: No such file or directory 2024-08-02T19:03:15.575 INFO:teuthology.orchestra.run.smithi121.stderr:tar: Error is not recoverable: exiting now 2024-08-02T19:03:15.577 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi151/crash 2024-08-02T19:03:15.578 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash -- . 2024-08-02T19:03:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:tar: /var/lib/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/crash: Cannot open: No such file or directory 2024-08-02T19:03:15.632 INFO:teuthology.orchestra.run.smithi151.stderr:tar: Error is not recoverable: exiting now 2024-08-02T19:03:15.633 INFO:tasks.cephadm:Checking cluster log for badness... 2024-08-02T19:03:15.634 DEBUG:teuthology.orchestra.run.smithi103:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v MON_DOWN | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'Degraded data redundancy' | egrep -v 'slow metadata IO' | egrep -v SLOW_OPS | egrep -v 'slow request' | head -n 1 2024-08-02T19:03:15.671 INFO:teuthology.orchestra.run.smithi103.stdout:2024-08-02T18:51:32.770407+0000 mds.i (mds.1) 2 : cluster [WRN] Scrub error on inode 0x10000000321 (/volumes/qa/sv_1/3a5a7039-98a1-4bb8-8b38-dec5dfc09d75/client.0/tmp/untar_tar/linux-4.0.5/Documentation/DocBook/libata.tmpl) see mds.i log and `damage ls` output for details 2024-08-02T19:03:15.672 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-08-02T19:03:15.673 INFO:tasks.cephadm:Compressing logs... 2024-08-02T19:03:15.673 DEBUG:teuthology.orchestra.run.smithi103:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-02T19:03:15.716 DEBUG:teuthology.orchestra.run.smithi121:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-02T19:03:15.718 DEBUG:teuthology.orchestra.run.smithi151:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-08-02T19:03:15.741 INFO:teuthology.orchestra.run.smithi151.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log 2024-08-02T19:03:15.741 INFO:teuthology.orchestra.run.smithi151.stderr:: No such file or directory 2024-08-02T19:03:15.741 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.2.log 2024-08-02T19:03:15.741 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.f.log 2024-08-02T19:03:15.750 INFO:teuthology.orchestra.run.smithi121.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:: No such file or directory 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.7.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log: /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.b.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.4.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.1.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.b.log: /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.4.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.y.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.h.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.y.log: /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.h.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.10.log 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr: 90.5% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log.gz 2024-08-02T19:03:15.751 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.10.log: 89.5% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log.gz 2024-08-02T19:03:15.755 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log 2024-08-02T19:03:15.755 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.5.log 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.c.log 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log: /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.c.log 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.c.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.z.log 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.i.log 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.z.log: 89.5% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log.gz 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr: 90.5% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log.gz 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.i.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.11.log 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log: 82.2% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log.gz 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.8.log 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.11.log: 91.9% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.z.log.gz 2024-08-02T19:03:15.756 INFO:teuthology.orchestra.run.smithi151.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log 2024-08-02T19:03:15.757 INFO:teuthology.orchestra.run.smithi103.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:: No such file or directory 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.g.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log: /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.j.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.g.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.3.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.j.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.0.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.x.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.a.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.6.log 2024-08-02T19:03:15.758 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.a.log: 90.4% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.audit.log.gz 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr: 89.4% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.log.gz 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.a.log 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log: 94.6% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.g.log.gz 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr: 84.7% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log.gz 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr: 94.7% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.j.log.gz 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.a.log: 94.7% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.a.log.gz 2024-08-02T19:03:15.759 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.d.log 2024-08-02T19:03:15.760 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.9.log 2024-08-02T19:03:15.760 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-02T19:03:15.761 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.9.log: 94.6% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.d.log.gz 2024-08-02T19:03:15.763 INFO:teuthology.orchestra.run.smithi121.stderr: 91.8% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.y.log.gz 2024-08-02T19:03:15.763 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log 2024-08-02T19:03:15.763 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.e.log 2024-08-02T19:03:15.763 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log 2024-08-02T19:03:15.763 INFO:teuthology.orchestra.run.smithi121.stderr: 82.2% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph.cephadm.log.gz 2024-08-02T19:03:15.763 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.e.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.b.log 2024-08-02T19:03:15.767 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.8.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.l.log 2024-08-02T19:03:15.768 INFO:teuthology.orchestra.run.smithi103.stderr: 91.0% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log.gz 2024-08-02T19:03:15.769 INFO:teuthology.orchestra.run.smithi103.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.log 2024-08-02T19:03:15.769 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.k.log 2024-08-02T19:03:15.771 INFO:teuthology.orchestra.run.smithi103.stderr:/var/log/ceph/cephadm.log: /var/log/ceph/ceph-client.admin.log: 92.7% -- replaced with /var/log/ceph/ceph-client.admin.log.gz 2024-08-02T19:03:15.774 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.b.log: 91.0% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log.gz 2024-08-02T19:03:15.778 INFO:teuthology.orchestra.run.smithi103.stderr: 93.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-02T19:03:15.786 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-02T19:03:15.788 INFO:teuthology.orchestra.run.smithi121.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-08-02T19:03:15.794 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.k.log: 94.5% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.k.log.gz 2024-08-02T19:03:15.801 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.l.log: 94.5% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.l.log.gz 91.0% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-volume.log.gz 2024-08-02T19:03:15.801 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-08-02T19:03:15.805 INFO:teuthology.orchestra.run.smithi151.stderr:/var/log/ceph/cephadm.log: 92.2% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-02T19:03:15.811 INFO:teuthology.orchestra.run.smithi121.stderr:/var/log/ceph/cephadm.log: 91.9% -- replaced with /var/log/ceph/cephadm.log.gz 2024-08-02T19:03:16.105 INFO:teuthology.orchestra.run.smithi103.stderr: 90.4% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mgr.x.log.gz 2024-08-02T19:03:16.180 INFO:teuthology.orchestra.run.smithi151.stderr: 91.8% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.c.log.gz 2024-08-02T19:03:16.211 INFO:teuthology.orchestra.run.smithi121.stderr: 91.9% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.b.log.gz 2024-08-02T19:03:16.545 INFO:teuthology.orchestra.run.smithi103.stderr: 90.5% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mon.a.log.gz 2024-08-02T19:03:16.670 INFO:teuthology.orchestra.run.smithi121.stderr: 95.4% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.e.log.gz 2024-08-02T19:03:17.321 INFO:teuthology.orchestra.run.smithi151.stderr: 95.4% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.f.log.gz 2024-08-02T19:03:17.672 INFO:teuthology.orchestra.run.smithi121.stderr: 95.4% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.h.log.gz 2024-08-02T19:03:20.319 INFO:teuthology.orchestra.run.smithi151.stderr: 91.9% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.8.log.gz 2024-08-02T19:03:20.512 INFO:teuthology.orchestra.run.smithi121.stderr: 92.0% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.10.log.gz 2024-08-02T19:03:21.653 INFO:teuthology.orchestra.run.smithi103.stderr: 92.0% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.0.log.gz 2024-08-02T19:03:21.934 INFO:teuthology.orchestra.run.smithi121.stderr: 91.9% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.1.log.gz 2024-08-02T19:03:21.962 INFO:teuthology.orchestra.run.smithi103.stderr: 91.7% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.3.log.gz 2024-08-02T19:03:22.479 INFO:teuthology.orchestra.run.smithi103.stderr: 91.9% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.6.log.gz 2024-08-02T19:03:22.974 INFO:teuthology.orchestra.run.smithi151.stderr: 92.1% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.11.log.gz 2024-08-02T19:03:22.977 INFO:teuthology.orchestra.run.smithi103.stderr: 91.7% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.9.log.gz 2024-08-02T19:03:22.979 INFO:teuthology.orchestra.run.smithi103.stderr: 2024-08-02T19:03:22.979 INFO:teuthology.orchestra.run.smithi103.stderr:real 0m7.249s 2024-08-02T19:03:22.979 INFO:teuthology.orchestra.run.smithi103.stderr:user 0m26.379s 2024-08-02T19:03:22.979 INFO:teuthology.orchestra.run.smithi103.stderr:sys 0m0.903s 2024-08-02T19:03:23.469 INFO:teuthology.orchestra.run.smithi121.stderr: 92.0% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.7.log.gz 2024-08-02T19:03:23.627 INFO:teuthology.orchestra.run.smithi151.stderr: 92.1% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.2.log.gz 2024-08-02T19:03:23.716 INFO:teuthology.orchestra.run.smithi121.stderr: 91.7% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.4.log.gz 2024-08-02T19:03:25.216 INFO:teuthology.orchestra.run.smithi151.stderr: 91.6% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-osd.5.log.gz 2024-08-02T19:03:25.319 INFO:teuthology.orchestra.run.smithi151.stderr: 93.3% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.c.log.gz 2024-08-02T19:03:28.935 INFO:teuthology.orchestra.run.smithi151.stderr: 93.3% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.i.log.gz 2024-08-02T19:03:28.937 INFO:teuthology.orchestra.run.smithi151.stderr: 2024-08-02T19:03:28.937 INFO:teuthology.orchestra.run.smithi151.stderr:real 0m13.204s 2024-08-02T19:03:28.937 INFO:teuthology.orchestra.run.smithi151.stderr:user 0m52.395s 2024-08-02T19:03:28.937 INFO:teuthology.orchestra.run.smithi151.stderr:sys 0m1.468s 2024-08-02T19:03:32.808 INFO:teuthology.orchestra.run.smithi121.stderr: 93.2% -- replaced with /var/log/ceph/7ef68402-50fe-11ef-bcca-c7b262605968/ceph-mds.b.log.gz 2024-08-02T19:03:32.810 INFO:teuthology.orchestra.run.smithi121.stderr: 2024-08-02T19:03:32.810 INFO:teuthology.orchestra.run.smithi121.stderr:real 0m17.078s 2024-08-02T19:03:32.810 INFO:teuthology.orchestra.run.smithi121.stderr:user 0m45.585s 2024-08-02T19:03:32.810 INFO:teuthology.orchestra.run.smithi121.stderr:sys 0m1.361s 2024-08-02T19:03:32.810 INFO:tasks.cephadm:Archiving logs... 2024-08-02T19:03:32.811 DEBUG:teuthology.misc:Transferring archived files from smithi103:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi103/log 2024-08-02T19:03:32.812 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-02T19:03:37.259 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi121/log 2024-08-02T19:03:37.260 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-02T19:03:43.934 DEBUG:teuthology.misc:Transferring archived files from smithi151:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi151/log 2024-08-02T19:03:43.935 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /var/log/ceph -- . 2024-08-02T19:03:50.736 INFO:tasks.cephadm:Removing cluster... 2024-08-02T19:03:50.736 DEBUG:teuthology.orchestra.run.smithi103:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 --force 2024-08-02T19:03:50.944 INFO:teuthology.orchestra.run.smithi103.stdout:Deleting cluster with fsid: 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T19:03:51.239 DEBUG:teuthology.orchestra.run.smithi121:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 --force 2024-08-02T19:03:51.443 INFO:teuthology.orchestra.run.smithi121.stdout:Deleting cluster with fsid: 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T19:03:51.750 DEBUG:teuthology.orchestra.run.smithi151:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 7ef68402-50fe-11ef-bcca-c7b262605968 --force 2024-08-02T19:03:51.958 INFO:teuthology.orchestra.run.smithi151.stdout:Deleting cluster with fsid: 7ef68402-50fe-11ef-bcca-c7b262605968 2024-08-02T19:03:52.503 INFO:tasks.cephadm:Removing cephadm ... 2024-08-02T19:03:52.504 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-02T19:03:52.523 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-02T19:03:52.540 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf /home/ubuntu/cephtest/cephadm 2024-08-02T19:03:52.555 INFO:tasks.cephadm:Teardown complete 2024-08-02T19:03:52.555 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-08-02T19:03:52.568 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-08-02T19:03:52.568 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-02T19:03:52.571 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-02T19:03:52.582 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-08-02T19:03:52.695 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-08-02T19:03:52.706 INFO:teuthology.task.clock:Checking final clock skew... 2024-08-02T19:03:52.706 DEBUG:teuthology.orchestra.run.smithi103:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-02T19:03:52.709 DEBUG:teuthology.orchestra.run.smithi121:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-02T19:03:52.712 DEBUG:teuthology.orchestra.run.smithi151:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-08-02T19:03:52.724 INFO:teuthology.orchestra.run.smithi103.stderr:bash: line 1: ntpq: command not found 2024-08-02T19:03:52.725 INFO:teuthology.orchestra.run.smithi151.stderr:bash: line 1: ntpq: command not found 2024-08-02T19:03:52.725 INFO:teuthology.orchestra.run.smithi121.stderr:bash: line 1: ntpq: command not found 2024-08-02T19:03:52.728 INFO:teuthology.orchestra.run.smithi103.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-02T19:03:52.728 INFO:teuthology.orchestra.run.smithi103.stdout:=============================================================================== 2024-08-02T19:03:52.729 INFO:teuthology.orchestra.run.smithi103.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +714us[ +729us] +/- 60ms 2024-08-02T19:03:52.729 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -1021us[-1021us] +/- 54ms 2024-08-02T19:03:52.729 INFO:teuthology.orchestra.run.smithi103.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 25 +605us[ +605us] +/- 87ms 2024-08-02T19:03:52.729 INFO:teuthology.orchestra.run.smithi103.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T19:03:52.731 INFO:teuthology.orchestra.run.smithi121.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-02T19:03:52.731 INFO:teuthology.orchestra.run.smithi121.stdout:=============================================================================== 2024-08-02T19:03:52.731 INFO:teuthology.orchestra.run.smithi121.stdout:^* hv01.front.sepia.ceph.com 3 6 377 27 +741us[ +698us] +/- 60ms 2024-08-02T19:03:52.731 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 25 -1041us[-1041us] +/- 54ms 2024-08-02T19:03:52.731 INFO:teuthology.orchestra.run.smithi121.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 29 +585us[ +542us] +/- 87ms 2024-08-02T19:03:52.731 INFO:teuthology.orchestra.run.smithi121.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T19:03:52.731 INFO:teuthology.orchestra.run.smithi151.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-08-02T19:03:52.731 INFO:teuthology.orchestra.run.smithi151.stdout:=============================================================================== 2024-08-02T19:03:52.732 INFO:teuthology.orchestra.run.smithi151.stdout:^* hv01.front.sepia.ceph.com 3 6 377 26 +714us[ +716us] +/- 60ms 2024-08-02T19:03:52.732 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 26 -1042us[-1042us] +/- 54ms 2024-08-02T19:03:52.732 INFO:teuthology.orchestra.run.smithi151.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 28 +603us[ +605us] +/- 87ms 2024-08-02T19:03:52.732 INFO:teuthology.orchestra.run.smithi151.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-08-02T19:03:52.732 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-08-02T19:03:52.743 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-08-02T19:03:52.743 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-08-02T19:03:52.753 DEBUG:teuthology.orchestra.run.smithi103:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-02T19:03:52.853 DEBUG:teuthology.orchestra.run.smithi121:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-02T19:03:52.925 DEBUG:teuthology.orchestra.run.smithi151:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-08-02T19:03:52.991 DEBUG:teuthology.orchestra.run.smithi103:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-02T19:03:53.021 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T19:03:53.021 DEBUG:teuthology.orchestra.run.smithi121:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-02T19:03:53.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T19:03:53.049 DEBUG:teuthology.orchestra.run.smithi151:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:logrotate_t:s0 -e scontext=system_u:system_r:getty_t:s0 -e scontext=system_u:system_r:getty_t:s0 2024-08-02T19:03:53.076 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T19:03:53.076 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-08-02T19:03:53.088 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-08-02T19:03:53.098 INFO:teuthology.task.internal:Duration was 1882.854623 seconds 2024-08-02T19:03:53.099 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-08-02T19:03:53.109 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-08-02T19:03:53.110 DEBUG:teuthology.orchestra.run.smithi103:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-02T19:03:53.112 DEBUG:teuthology.orchestra.run.smithi121:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-02T19:03:53.115 DEBUG:teuthology.orchestra.run.smithi151:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-08-02T19:03:53.150 INFO:teuthology.orchestra.run.smithi103.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-02T19:03:53.152 INFO:teuthology.orchestra.run.smithi121.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-02T19:03:53.153 INFO:teuthology.orchestra.run.smithi151.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-08-02T19:03:53.546 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-08-02T19:03:53.546 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi103.front.sepia.ceph.com 2024-08-02T19:03:53.546 DEBUG:teuthology.orchestra.run.smithi103:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-02T19:03:53.568 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi121.front.sepia.ceph.com 2024-08-02T19:03:53.568 DEBUG:teuthology.orchestra.run.smithi121:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-02T19:03:53.615 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi151.front.sepia.ceph.com 2024-08-02T19:03:53.616 DEBUG:teuthology.orchestra.run.smithi151:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-08-02T19:03:53.642 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-08-02T19:03:53.642 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-02T19:03:53.645 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-02T19:03:53.658 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-08-02T19:03:53.707 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-08-02T19:03:53.707 DEBUG:teuthology.orchestra.run.smithi103:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-02T19:03:53.712 DEBUG:teuthology.orchestra.run.smithi121:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-02T19:03:53.728 DEBUG:teuthology.orchestra.run.smithi151:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-08-02T19:03:54.444 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-08-02T19:03:54.457 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-08-02T19:03:54.457 DEBUG:teuthology.orchestra.run.smithi103:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-02T19:03:54.482 DEBUG:teuthology.orchestra.run.smithi121:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-02T19:03:54.506 DEBUG:teuthology.orchestra.run.smithi151:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-08-02T19:03:54.531 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-08-02T19:03:54.543 DEBUG:teuthology.orchestra.run.smithi103:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-02T19:03:54.546 DEBUG:teuthology.orchestra.run.smithi121:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-02T19:03:54.549 DEBUG:teuthology.orchestra.run.smithi151:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-08-02T19:03:54.567 INFO:teuthology.orchestra.run.smithi103.stdout:kernel.core_pattern = core 2024-08-02T19:03:54.569 INFO:teuthology.orchestra.run.smithi121.stdout:kernel.core_pattern = core 2024-08-02T19:03:54.595 INFO:teuthology.orchestra.run.smithi151.stdout:kernel.core_pattern = core 2024-08-02T19:03:54.625 DEBUG:teuthology.orchestra.run.smithi103:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-02T19:03:54.639 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T19:03:54.640 DEBUG:teuthology.orchestra.run.smithi121:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-02T19:03:54.653 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T19:03:54.654 DEBUG:teuthology.orchestra.run.smithi151:> test -e /home/ubuntu/cephtest/archive/coredump 2024-08-02T19:03:54.679 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-08-02T19:03:54.680 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-08-02T19:03:54.691 INFO:teuthology.task.internal:Transferring archived files... 2024-08-02T19:03:54.692 DEBUG:teuthology.misc:Transferring archived files from smithi103:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi103 2024-08-02T19:03:54.692 DEBUG:teuthology.orchestra.run.smithi103:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-02T19:03:54.747 DEBUG:teuthology.misc:Transferring archived files from smithi121:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi121 2024-08-02T19:03:54.747 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-02T19:03:54.781 DEBUG:teuthology.misc:Transferring archived files from smithi151:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-08-02_15:32:26-fs-squid-release-distro-default-smithi/7832803/remote/smithi151 2024-08-02T19:03:54.781 DEBUG:teuthology.orchestra.run.smithi151:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-08-02T19:03:54.818 INFO:teuthology.task.internal:Removing archive directory... 2024-08-02T19:03:54.818 DEBUG:teuthology.orchestra.run.smithi103:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-02T19:03:54.821 DEBUG:teuthology.orchestra.run.smithi121:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-02T19:03:54.823 DEBUG:teuthology.orchestra.run.smithi151:> rm -rf -- /home/ubuntu/cephtest/archive 2024-08-02T19:03:54.867 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-08-02T19:03:54.880 INFO:teuthology.task.internal:Not uploading archives. 2024-08-02T19:03:54.880 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-08-02T19:03:54.891 INFO:teuthology.task.internal:Tidying up after the test... 2024-08-02T19:03:54.892 DEBUG:teuthology.orchestra.run.smithi103:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-02T19:03:54.894 DEBUG:teuthology.orchestra.run.smithi121:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-02T19:03:54.896 DEBUG:teuthology.orchestra.run.smithi151:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-08-02T19:03:54.907 INFO:teuthology.orchestra.run.smithi103.stdout: 265824 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 2 19:03 /home/ubuntu/cephtest 2024-08-02T19:03:54.908 INFO:teuthology.orchestra.run.smithi121.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 2 19:03 /home/ubuntu/cephtest 2024-08-02T19:03:54.921 INFO:teuthology.orchestra.run.smithi151.stdout: 262161 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Aug 2 19:03 /home/ubuntu/cephtest 2024-08-02T19:03:54.922 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-08-02T19:03:54.934 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-08-02T19:03:54.961 INFO:teuthology.run:Summary data: description: fs/workload/{0-centos_9.stream begin/{0-install 1-cephadm 2-logrotate 3-modules} clusters/1a11s-mds-1c-client-3node conf/{client mds mgr mon osd} mount/kclient/{base/{mount-syntax/{v1} mount overrides/{distro/stock/{centos_9.stream k-stock} ms-die-on-skipped}} ms_mode/secure wsync/no} objectstore-ec/bluestore-ec-root omap_limit/10000 overrides/{cephsqlite-timeout frag ignorelist_health ignorelist_wrongly_marked_down osd-asserts pg_health session_timeout} ranks/multi/{balancer/automatic export-check n/3 replication/default} standby-replay tasks/{0-subvolume/{with-no-extra-options} 1-check-counter 2-scrub/yes 3-snaps/yes 4-flush/yes 5-quiesce/with-quiesce 6-workunit/fs/norstats}} duration: 1882.8546230793 failure_reason: 'error during scrub thrashing: rank damage found: {''backtrace''}' flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-08-02T19:03:54.961 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-08-02T19:03:55.049 INFO:teuthology.run:FAIL